2024-04-26T19:56:57.429 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T19:56:57.430 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} --owner scheduled_rishabh@teuthology --verbose -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/orig.config.yaml 2024-04-26T19:56:57.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T19:56:57.608 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149 branch: wip-rishabh-testing-20240426.111959 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} email: null first_in_suite: false job_id: '7675149' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTGjejqpbQDAD++nbA9+Ym/T8BUDwtYqcEoG0njRBily8ego5Nmk3hszPyBVSIiiktsyjzS2wZY5iYKzYOHvtg= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVs/7j9ob/Q/IcH0U+XvENvvdM8lmGH5+eYGLR9+ceZI/Jmf0C7/7P00h6e8mxFqN1gzUvP0ZJfaxOetYvV0nI= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcqEWnmnALbLH9IW3Cl+mf2kqGl6sokW9hQmXnjwsJfVz+O4L/OD0EqdgT8rZUzsY/spq7PsdHlfXIUptpm/IU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T19:56:57.608 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T19:56:57.609 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T19:56:57.609 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T19:56:57.611 INFO:teuthology.task.internal:Checking packages... 2024-04-26T19:56:57.632 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T19:56:57.633 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T19:56:57.633 INFO:teuthology.packaging:ref: None 2024-04-26T19:56:57.633 INFO:teuthology.packaging:tag: None 2024-04-26T19:56:57.633 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T19:56:57.633 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T19:56:57.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T19:56:57.860 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T19:56:57.862 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T19:56:57.869 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T19:56:57.869 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T19:56:57.876 INFO:teuthology.task.internal:Saving configuration 2024-04-26T19:56:57.902 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T19:56:57.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T19:56:57.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:56.859744', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTGjejqpbQDAD++nbA9+Ym/T8BUDwtYqcEoG0njRBily8ego5Nmk3hszPyBVSIiiktsyjzS2wZY5iYKzYOHvtg='} 2024-04-26T19:56:57.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:56.861062', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVs/7j9ob/Q/IcH0U+XvENvvdM8lmGH5+eYGLR9+ceZI/Jmf0C7/7P00h6e8mxFqN1gzUvP0ZJfaxOetYvV0nI='} 2024-04-26T19:56:57.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:56.862142', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcqEWnmnALbLH9IW3Cl+mf2kqGl6sokW9hQmXnjwsJfVz+O4L/OD0EqdgT8rZUzsY/spq7PsdHlfXIUptpm/IU='} 2024-04-26T19:56:57.984 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T19:56:57.990 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-26T19:56:57.990 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-26T19:56:57.990 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-26T19:56:57.990 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T19:56:58.090 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9091205160>, signals=[15]) 2024-04-26T19:56:58.090 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T19:56:58.096 INFO:teuthology.task.internal:Opening connections... 2024-04-26T19:56:58.096 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T19:56:58.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T19:56:58.176 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-04-26T19:56:58.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T19:56:58.251 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T19:56:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T19:56:58.325 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T19:56:58.332 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-26T19:56:58.350 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-26T19:56:58.350 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-04-26T19:56:58.407 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-04-26T19:56:58.408 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T19:56:58.408 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-04-26T19:56:58.408 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T19:56:58.408 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T19:56:58.408 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T19:56:58.408 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-26T19:56:58.431 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-04-26T19:56:58.449 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-04-26T19:56:58.449 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-04-26T19:56:58.507 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-04-26T19:56:58.507 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-04-26T19:56:58.507 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-04-26T19:56:58.507 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-04-26T19:56:58.507 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-04-26T19:56:58.507 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-04-26T19:56:58.508 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T19:56:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T19:56:58.510 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-04-26T19:56:58.531 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-04-26T19:56:58.549 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-04-26T19:56:58.549 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T19:56:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-04-26T19:56:58.607 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T19:56:58.607 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T19:56:58.607 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T19:56:58.607 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-26T19:56:58.631 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T19:56:58.642 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T19:56:58.648 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T19:56:58.648 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-26T19:56:58.651 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-04-26T19:56:58.653 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-04-26T19:56:58.670 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T19:56:58.676 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T19:56:58.676 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-26T19:56:58.708 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-04-26T19:56:58.710 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-04-26T19:56:58.737 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T19:56:58.804 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T19:56:58.818 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T19:56:58.818 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-26T19:56:58.818 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-26T19:56:58.819 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T19:56:58.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T19:56:58.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-26T19:56:58.995 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T19:56:58.996 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T19:56:58.996 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-26T19:56:59.013 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-04-26T19:56:59.013 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T19:56:59.013 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T19:56:59.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2024-04-26T19:57:01.511 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-26T19:57:03.529 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T19:57:07.962 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T19:57:09.529 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-04-26T19:57:28.630 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-04-26T19:57:33.760 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-26T19:57:35.755 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-26T19:57:35.756 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-26T19:57:35.756 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-26T19:57:35.852 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T19:57:35.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T19:57:36.000 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T19:57:36.000 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T19:57:36.003 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2024-04-26T19:58:26.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26 19:58:26 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T19:58:26.727 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2024-04-26 19:58:26-- 2024-04-26T19:58:26.727 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 51s 2024-04-26T19:58:26.727 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 341M in 50s (6.79 MB/s) 2024-04-26T19:58:26.730 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T19:58:26.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T19:58:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2024-04-26T19:58:28.978 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2024-04-26T19:58:29.065 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2024-04-26T19:58:37.097 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T19:59:14.971 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T19:59:14.971 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T19:59:15.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T19:59:15.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T19:59:15.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T19:59:15.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T19:59:15.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T19:59:15.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T19:59:15.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T19:59:15.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T19:59:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T19:59:15.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T19:59:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T19:59:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T19:59:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T19:59:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T19:59:15.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T19:59:15.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T19:59:15.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T19:59:15.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T19:59:15.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T19:59:15.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T19:59:15.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T19:59:15.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T19:59:15.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T19:59:15.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T19:59:15.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T19:59:15.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T19:59:15.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T19:59:15.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T19:59:15.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T19:59:15.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T19:59:15.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T19:59:15.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T19:59:15.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T19:59:15.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T19:59:15.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T19:59:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T19:59:15.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T19:59:15.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T19:59:15.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T19:59:15.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T19:59:15.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T19:59:15.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T19:59:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T19:59:15.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T19:59:15.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T19:59:15.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T19:59:15.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T19:59:15.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T19:59:15.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T19:59:15.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T19:59:15.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T19:59:15.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T19:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T19:59:15.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T19:59:15.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T19:59:15.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T19:59:15.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T19:59:15.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T19:59:15.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T19:59:15.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T19:59:15.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T19:59:15.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T19:59:15.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T19:59:15.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T19:59:15.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T19:59:15.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T19:59:15.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T19:59:15.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T19:59:15.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T19:59:15.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T19:59:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T19:59:15.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T19:59:15.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T19:59:15.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T19:59:15.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T19:59:15.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T19:59:15.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T19:59:15.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T19:59:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T19:59:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T19:59:15.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T19:59:15.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T19:59:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T19:59:15.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T19:59:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T19:59:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T19:59:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T19:59:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T19:59:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T19:59:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T19:59:15.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T19:59:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T19:59:15.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T19:59:15.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T19:59:15.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T19:59:15.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T19:59:15.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T19:59:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T19:59:15.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T19:59:15.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T19:59:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T19:59:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T19:59:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T19:59:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T19:59:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T19:59:15.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T19:59:15.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T19:59:15.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T19:59:15.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T19:59:15.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T19:59:15.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T19:59:15.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T19:59:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T19:59:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T19:59:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T19:59:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T19:59:15.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T19:59:15.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T19:59:15.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T19:59:15.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T19:59:15.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T19:59:15.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T19:59:15.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T19:59:15.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T19:59:15.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T19:59:15.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T19:59:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T19:59:15.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T19:59:15.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T19:59:15.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T19:59:15.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T19:59:15.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T19:59:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T19:59:15.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T19:59:15.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T19:59:15.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T19:59:15.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T19:59:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T19:59:15.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T19:59:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T19:59:15.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T19:59:15.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T19:59:15.207 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.207 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout:for file in vmlinuz System.map config; do 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: fi 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T19:59:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.231 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-26T19:59:15.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T19:59:15.306 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-04-26T19:59:15.307 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T19:59:15.308 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T19:59:15.308 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T19:59:15.308 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T19:59:15.308 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-04-26T19:59:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T19:59:15.308 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T19:59:15.309 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T19:59:15.309 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:15.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T19:59:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-04-26T19:59:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T19:59:17.217 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-04-26T19:59:17.219 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-04-26T19:59:17.258 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.bwlE0ynfKz 2024-04-26T19:59:17.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bwlE0ynfKz 2024-04-26T19:59:17.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.bwlE0ynfKz 2024-04-26T19:59:17.473 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.bwlE0ynfKz is 6KB 2024-04-26T19:59:17.522 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.bwlE0ynfKz 2024-04-26T19:59:17.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T19:59:17.597 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T19:59:17.597 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T19:59:17.597 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T19:59:17.597 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T19:59:17.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:17.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-04-26T19:59:47.799 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T19:59:47.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T19:59:47.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:00:06.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-26T20:00:15.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T20:00:15.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:00:18.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-26T20:00:30.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T20:00:30.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:01:30.243 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T20:01:45.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T20:01:45.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:01:45.686 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T20:01:46.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T20:01:46.339 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T20:01:46.340 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-26T20:01:46.391 INFO:teuthology.orchestra.run.smithi082.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T20:01:46.391 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T20:01:46.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T20:01:46.391 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T20:01:47.392 DEBUG:teuthology.parallel:result is None 2024-04-26T20:01:47.393 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T20:01:47.400 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T20:01:47.400 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:01:47.408 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:01:47.411 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:01:47.457 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T20:01:47.464 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T20:01:47.470 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T20:01:47.470 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:01:47.475 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:01:47.477 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:01:47.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T20:01:47.602 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T20:01:47.603 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:01:47.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:01:47.619 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:01:47.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:01:47.636 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:01:47.643 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:01:47.662 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:01:47.710 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.717 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.724 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.734 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.761 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.821 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.827 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T20:01:47.834 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T20:01:47.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:01:47.841 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:01:47.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:01:47.911 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T20:01:47.924 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T20:01:47.925 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:01:47.932 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:01:47.934 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:01:47.976 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.142 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.305 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:01:48.306 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:01:48.388 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.485 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.572 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.613 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:01:48.613 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:01:48.679 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.777 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.856 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.903 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:01:48.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:01:48.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-26T20:01:48.978 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-04-26T20:01:48.981 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-04-26T20:01:49.027 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:01:49.045 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:01:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:01:49.528 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T20:01:49.538 INFO:teuthology.task.internal:Starting timer... 2024-04-26T20:01:49.538 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T20:01:49.548 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T20:01:49.558 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T20:01:49.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-04-26T20:01:49.677 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-04-26T20:01:49.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-04-26T20:01:49.745 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-04-26T20:01:49.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-04-26T20:01:49.816 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-04-26T20:01:49.818 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T20:01:49.819 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-04-26T20:01:49.876 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-04-26T20:01:49.876 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-04-26T20:01:49.897 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-04-26T20:01:49.898 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-04-26T20:01:49.921 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-04-26T20:01:49.921 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2024-04-26T20:01:49.922 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:01:49.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:01:49.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:01:50.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:01:50.024 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:01:50.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:01:50.050 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T20:01:50.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:01:50.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:01:50.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:01:50.184 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T20:01:50.194 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T20:01:50.211 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T20:01:50.212 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi135.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T20:06:51.887 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-04-26T20:06:51.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T20:06:51.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:06:51.988 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T20:06:52.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T20:06:52.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-04-26T20:06:52.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:06:52.209 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-04-26T20:06:52.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-04-26T20:06:52.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-26T20:06:52.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:06:52.358 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-26T20:06:52.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-26T20:06:52.434 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T20:06:52.447 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T20:06:52.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:06:52.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:06:52.455 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:06:52.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:06:52.458 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:06:52.458 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:06:52.487 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:06:52.502 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:06:52.502 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:06:52.516 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:06:52.526 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-04-26T20:06:52.537 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-04-26T20:06:52.539 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-04-26T20:06:52.544 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:06:52.550 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-04-26T20:06:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:06:52.563 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:06:52.565 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:06:52.576 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:06:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:06:52.619 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:06:52.623 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:06:52.623 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-04-26T20:06:52.623 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.623 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.623 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.623 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:06:52.632 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:06:52.632 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-26T20:06:52.632 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.632 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.632 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.632 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.659 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-04-26T20:06:52.692 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-04-26T20:06:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:06:52.775 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:06:52.916 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:06:52.924 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:06:52.924 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-26T20:06:52.924 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.924 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.925 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.925 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:06:52.926 INFO:teuthology.run_tasks:Running task install... 2024-04-26T20:06:52.934 DEBUG:teuthology.task.install:project ceph 2024-04-26T20:06:52.934 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T20:06:52.934 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T20:06:52.934 INFO:teuthology.task.install:Using flavor: default 2024-04-26T20:06:52.939 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T20:06:52.940 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T20:06:52.940 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:06:52.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:06:52.942 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:06:52.942 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:06:52.943 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:06:52.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:06:53.162 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T20:06:53.162 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T20:06:53.170 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T20:06:53.171 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T20:06:53.183 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T20:06:53.183 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T20:06:53.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:06:53.277 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:06:53.277 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:06:53.279 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:06:53.280 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:06:53.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:06:53.287 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:06:53.288 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:06:53.288 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:06:53.305 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T20:06:53.306 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:06:53.317 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T20:06:53.317 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:06:53.368 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T20:06:53.369 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:06:53.370 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:06:53.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:06:53.444 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:06:53.465 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:06:53.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:06:53.507 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-04-26T20:06:53.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-04-26T20:06:53.530 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-04-26T20:06:53.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-04-26T20:06:53.608 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:06:53.688 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-04-26T20:06:53.692 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-04-26T20:06:53.730 INFO:teuthology.orchestra.run.smithi139.stdout:48 files removed 2024-04-26T20:06:53.758 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T20:06:53.762 INFO:teuthology.orchestra.run.smithi135.stdout:48 files removed 2024-04-26T20:06:53.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T20:06:54.010 INFO:teuthology.orchestra.run.smithi082.stdout:48 files removed 2024-04-26T20:06:54.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T20:06:54.494 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-04-26T20:06:54.542 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 170 kB/s | 84 kB 00:00 2024-04-26T20:06:54.853 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-04-26T20:06:54.957 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 178 kB/s | 84 kB 00:00 2024-04-26T20:06:54.993 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-04-26T20:06:55.312 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-04-26T20:06:55.352 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-04-26T20:06:55.483 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-04-26T20:06:56.003 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T20:06:56.084 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-04-26T20:06:56.765 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-26T20:06:56.844 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-26T20:06:57.871 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-26T20:07:00.570 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 19 MB 00:02 2024-04-26T20:07:02.113 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-26T20:07:03.539 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-04-26T20:07:04.897 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-04-26T20:07:04.926 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T20:07:06.281 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-04-26T20:07:07.844 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-26T20:07:10.057 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T20:07:12.208 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:07:12.208 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:07:12.219 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T20:07:12.219 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T20:07:12.220 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T20:07:12.221 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T20:07:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T20:07:12.225 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T20:07:12.225 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T20:07:12.285 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-26T20:07:12.302 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T20:07:12.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T20:07:12.304 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T20:07:12.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T20:07:12.306 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:07:12.307 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:07:12.308 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:07:12.309 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:07:12.310 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:07:12.311 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T20:07:12.312 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:07:12.313 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:07:12.314 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout:Install 148 Packages 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 4 Packages 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:07:12.315 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 222 M 2024-04-26T20:07:12.316 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-26T20:07:12.899 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T20:07:13.192 INFO:teuthology.orchestra.run.smithi139.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-04-26T20:07:13.400 INFO:teuthology.orchestra.run.smithi139.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 4.2 MB/s | 889 kB 00:00 2024-04-26T20:07:13.475 INFO:teuthology.orchestra.run.smithi139.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.9 MB/s | 145 kB 00:00 2024-04-26T20:07:13.567 INFO:teuthology.orchestra.run.smithi139.stdout:(4/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 9.9 MB/s | 5.4 MB 00:00 2024-04-26T20:07:13.718 INFO:teuthology.orchestra.run.smithi139.stdout:(5/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 9.8 MB/s | 2.4 MB 00:00 2024-04-26T20:07:13.751 INFO:teuthology.orchestra.run.smithi139.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-04-26T20:07:14.193 INFO:teuthology.orchestra.run.smithi139.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 9.9 MB/s | 4.7 MB 00:00 2024-04-26T20:07:14.877 INFO:teuthology.orchestra.run.smithi139.stdout:(8/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x86 15 MB/s | 17 MB 00:01 2024-04-26T20:07:14.927 INFO:teuthology.orchestra.run.smithi139.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 507 kB/s | 25 kB 00:00 2024-04-26T20:07:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:07:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:07:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T20:07:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T20:07:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T20:07:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T20:07:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T20:07:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T20:07:15.182 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T20:07:15.198 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-04-26T20:07:15.209 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-04-26T20:07:15.221 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-04-26T20:07:15.269 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-04-26T20:07:15.280 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-04-26T20:07:15.291 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T20:07:15.354 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T20:07:15.415 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:07:15.422 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T20:07:15.432 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T20:07:15.442 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T20:07:15.449 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T20:07:15.488 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T20:07:15.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T20:07:15.507 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T20:07:15.538 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T20:07:15.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T20:07:15.611 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T20:07:15.619 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T20:07:15.630 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T20:07:15.641 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T20:07:15.650 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T20:07:15.657 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T20:07:15.690 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T20:07:15.743 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T20:07:15.751 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T20:07:15.760 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T20:07:15.769 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T20:07:15.777 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T20:07:15.785 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T20:07:15.797 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T20:07:15.808 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T20:07:15.820 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T20:07:15.885 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T20:07:15.896 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T20:07:15.909 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T20:07:15.922 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T20:07:15.931 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T20:07:15.939 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T20:07:15.949 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:07:16.024 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T20:07:16.105 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T20:07:16.153 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-04-26T20:07:16.164 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T20:07:16.177 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:07:16.188 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T20:07:16.198 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T20:07:16.212 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-04-26T20:07:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T20:07:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T20:07:16.298 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:07:16.309 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T20:07:16.319 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T20:07:16.330 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T20:07:16.337 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T20:07:16.348 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T20:07:16.358 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T20:07:16.399 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T20:07:16.451 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T20:07:16.462 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:07:16.472 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:07:16.485 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:07:16.495 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:07:16.503 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:07:16.513 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T20:07:16.523 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:07:16.534 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:07:16.589 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T20:07:16.608 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:07:16.621 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:07:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:07:16.647 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:07:16.659 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:07:16.673 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T20:07:16.689 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:07:16.744 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:07:16.757 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:07:16.769 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T20:07:16.780 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:07:16.796 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T20:07:16.806 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T20:07:16.819 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T20:07:16.832 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:07:16.845 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:07:16.906 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:07:16.916 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T20:07:16.929 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T20:07:16.942 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T20:07:16.955 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:07:16.970 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T20:07:16.983 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:07:17.024 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:07:17.076 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:07:17.084 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T20:07:17.093 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T20:07:17.103 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:07:17.113 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:07:17.123 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:07:17.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:07:17.151 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T20:07:17.165 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T20:07:17.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:07:17.235 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:07:17.248 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:07:17.259 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T20:07:17.270 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T20:07:17.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:07:17.294 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:07:17.332 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:07:17.384 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:07:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:07:17.406 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:07:17.417 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:07:17.428 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:07:17.439 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:07:17.451 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:07:17.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:07:17.475 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:07:17.525 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:07:17.545 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:07:17.557 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:07:17.571 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:07:17.583 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:07:17.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T20:07:17.605 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:07:17.640 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:07:17.693 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:07:17.704 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:07:17.716 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T20:07:17.726 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:07:17.737 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:07:17.748 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:07:17.760 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:07:17.769 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T20:07:17.777 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:07:17.830 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:07:17.838 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:07:17.847 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:07:17.855 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:07:17.863 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:07:17.871 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:07:17.879 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:07:17.908 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:07:17.967 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:07:17.977 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:07:17.985 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T20:07:17.993 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:07:18.001 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:07:18.008 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:07:18.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:07:18.025 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T20:07:18.033 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T20:07:18.072 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:07:18.080 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:07:18.087 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:07:18.094 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T20:07:18.103 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:07:18.115 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T20:07:18.128 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-04-26T20:07:18.166 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T20:07:18.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:07:18.238 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-04-26T20:07:18.246 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-04-26T20:07:18.254 INFO:teuthology.orchestra.run.smithi135.stdout:Install 148 Packages 2024-04-26T20:07:18.263 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 4 Packages 2024-04-26T20:07:18.271 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:07:18.280 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 222 M 2024-04-26T20:07:18.288 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-04-26T20:07:18.297 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 19 MB 00:19 2024-04-26T20:07:18.356 INFO:teuthology.orchestra.run.smithi135.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-04-26T20:07:18.364 INFO:teuthology.orchestra.run.smithi135.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 635 kB/s | 889 kB 00:01 2024-04-26T20:07:18.373 INFO:teuthology.orchestra.run.smithi135.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.3 MB/s | 145 kB 00:00 2024-04-26T20:07:18.384 INFO:teuthology.orchestra.run.smithi139.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 9.6 MB/s | 11 MB 00:01 2024-04-26T20:07:18.393 INFO:teuthology.orchestra.run.smithi139.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 3.3 MB/s | 225 kB 00:00 2024-04-26T20:07:18.402 INFO:teuthology.orchestra.run.smithi139.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 361 kB/s | 27 kB 00:00 2024-04-26T20:07:18.411 INFO:teuthology.orchestra.run.smithi139.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 476 kB/s | 32 kB 00:00 2024-04-26T20:07:18.456 INFO:teuthology.orchestra.run.smithi139.stdout:(14/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 4.9 MB/s | 747 kB 00:00 2024-04-26T20:07:18.509 INFO:teuthology.orchestra.run.smithi139.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.1 MB/s | 163 kB 00:00 2024-04-26T20:07:18.517 INFO:teuthology.orchestra.run.smithi139.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 1.7 MB/s | 127 kB 00:00 2024-04-26T20:07:18.527 INFO:teuthology.orchestra.run.smithi139.stdout:(17/152): libradosstriper1-19.0.0-3306.gbc612ff 5.3 MB/s | 501 kB 00:00 2024-04-26T20:07:18.536 INFO:teuthology.orchestra.run.smithi139.stdout:(18/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 8.2 MB/s | 5.4 MB 00:00 2024-04-26T20:07:18.543 INFO:teuthology.orchestra.run.smithi139.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 603 kB/s | 45 kB 00:00 2024-04-26T20:07:18.552 INFO:teuthology.orchestra.run.smithi139.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 1.6 MB/s | 135 kB 00:00 2024-04-26T20:07:18.560 INFO:teuthology.orchestra.run.smithi139.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.7 MB/s | 161 kB 00:00 2024-04-26T20:07:18.569 INFO:teuthology.orchestra.run.smithi139.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.1 MB/s | 321 kB 00:00 2024-04-26T20:07:18.577 INFO:teuthology.orchestra.run.smithi139.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 2.9 MB/s | 298 kB 00:00 2024-04-26T20:07:18.646 INFO:teuthology.orchestra.run.smithi139.stdout:(24/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.1 MB/s | 99 kB 00:00 2024-04-26T20:07:18.654 INFO:teuthology.orchestra.run.smithi139.stdout:(25/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 929 kB/s | 85 kB 00:00 2024-04-26T20:07:18.664 INFO:teuthology.orchestra.run.smithi139.stdout:(26/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 17 MB/s | 49 MB 00:02 2024-04-26T20:07:18.677 INFO:teuthology.orchestra.run.smithi139.stdout:(27/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 4.4 MB/s | 3.1 MB 00:00 2024-04-26T20:07:18.687 INFO:teuthology.orchestra.run.smithi139.stdout:(28/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-26T20:07:18.697 INFO:teuthology.orchestra.run.smithi139.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3306.g 686 kB/s | 34 kB 00:00 2024-04-26T20:07:18.707 INFO:teuthology.orchestra.run.smithi139.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 2.8 MB/s | 142 kB 00:00 2024-04-26T20:07:18.808 INFO:teuthology.orchestra.run.smithi135.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-04-26T20:07:18.867 INFO:teuthology.orchestra.run.smithi135.stdout:(5/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-04-26T20:07:18.875 INFO:teuthology.orchestra.run.smithi139.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 6.1 MB/s | 3.5 MB 00:00 2024-04-26T20:07:18.886 INFO:teuthology.orchestra.run.smithi139.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 2.7 MB/s | 249 kB 00:00 2024-04-26T20:07:18.899 INFO:teuthology.orchestra.run.smithi139.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 594 kB/s | 49 kB 00:00 2024-04-26T20:07:18.912 INFO:teuthology.orchestra.run.smithi139.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 180 kB/s | 16 kB 00:00 2024-04-26T20:07:18.926 INFO:teuthology.orchestra.run.smithi139.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 8.1 MB/s | 7.4 MB 00:00 2024-04-26T20:07:18.938 INFO:teuthology.orchestra.run.smithi139.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.3 MB/s | 273 kB 00:00 2024-04-26T20:07:19.001 INFO:teuthology.orchestra.run.smithi139.stdout:(37/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 199 kB/s | 18 kB 00:00 2024-04-26T20:07:19.028 INFO:teuthology.orchestra.run.smithi135.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-04-26T20:07:19.073 INFO:teuthology.orchestra.run.smithi139.stdout:(38/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 5.0 MB/s | 762 kB 00:00 2024-04-26T20:07:19.151 INFO:teuthology.orchestra.run.smithi139.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-04-26T20:07:19.218 INFO:teuthology.orchestra.run.smithi139.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-26T20:07:19.237 INFO:teuthology.orchestra.run.smithi135.stdout:(7/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 6.0 MB/s | 21 MB 00:03 2024-04-26T20:07:19.268 INFO:teuthology.orchestra.run.smithi139.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-26T20:07:19.302 INFO:teuthology.orchestra.run.smithi139.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-04-26T20:07:19.360 INFO:teuthology.orchestra.run.smithi139.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-04-26T20:07:19.386 INFO:teuthology.orchestra.run.smithi139.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-26T20:07:19.443 INFO:teuthology.orchestra.run.smithi139.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-26T20:07:19.461 INFO:teuthology.orchestra.run.smithi139.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T20:07:19.486 INFO:teuthology.orchestra.run.smithi139.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-04-26T20:07:19.662 INFO:teuthology.orchestra.run.smithi139.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-04-26T20:07:19.712 INFO:teuthology.orchestra.run.smithi139.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-26T20:07:19.754 INFO:teuthology.orchestra.run.smithi139.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-04-26T20:07:19.779 INFO:teuthology.orchestra.run.smithi139.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 322 kB/s | 21 kB 00:00 2024-04-26T20:07:19.813 INFO:teuthology.orchestra.run.smithi139.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-26T20:07:19.838 INFO:teuthology.orchestra.run.smithi139.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-04-26T20:07:19.882 INFO:teuthology.orchestra.run.smithi135.stdout:(8/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el9 17 MB/s | 11 MB 00:00 2024-04-26T20:07:19.892 INFO:teuthology.orchestra.run.smithi139.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-04-26T20:07:19.905 INFO:teuthology.orchestra.run.smithi135.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 761 kB/s | 25 kB 00:00 2024-04-26T20:07:19.932 INFO:teuthology.orchestra.run.smithi139.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 214 kB/s | 11 kB 00:00 2024-04-26T20:07:19.983 INFO:teuthology.orchestra.run.smithi139.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-04-26T20:07:20.010 INFO:teuthology.orchestra.run.smithi139.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-26T20:07:20.033 INFO:teuthology.orchestra.run.smithi139.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-26T20:07:20.075 INFO:teuthology.orchestra.run.smithi139.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-04-26T20:07:20.120 INFO:teuthology.orchestra.run.smithi139.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-26T20:07:20.132 INFO:teuthology.orchestra.run.smithi139.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-04-26T20:07:20.151 INFO:teuthology.orchestra.run.smithi139.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-26T20:07:20.176 INFO:teuthology.orchestra.run.smithi139.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-26T20:07:20.201 INFO:teuthology.orchestra.run.smithi139.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-26T20:07:20.227 INFO:teuthology.orchestra.run.smithi139.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-04-26T20:07:20.410 INFO:teuthology.orchestra.run.smithi139.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-04-26T20:07:20.469 INFO:teuthology.orchestra.run.smithi139.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-26T20:07:20.528 INFO:teuthology.orchestra.run.smithi139.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-26T20:07:20.561 INFO:teuthology.orchestra.run.smithi139.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 9.7 MB/s | 911 kB 00:00 2024-04-26T20:07:20.587 INFO:teuthology.orchestra.run.smithi139.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-26T20:07:20.670 INFO:teuthology.orchestra.run.smithi139.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-26T20:07:20.683 INFO:teuthology.orchestra.run.smithi135.stdout:(10/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x8 2.2 MB/s | 4.7 MB 00:02 2024-04-26T20:07:20.720 INFO:teuthology.orchestra.run.smithi139.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T20:07:20.829 INFO:teuthology.orchestra.run.smithi139.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-26T20:07:20.872 INFO:teuthology.orchestra.run.smithi135.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 1.1 MB/s | 225 kB 00:00 2024-04-26T20:07:20.890 INFO:teuthology.orchestra.run.smithi139.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-26T20:07:20.946 INFO:teuthology.orchestra.run.smithi139.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-26T20:07:20.958 INFO:teuthology.orchestra.run.smithi135.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 362 kB/s | 27 kB 00:00 2024-04-26T20:07:21.021 INFO:teuthology.orchestra.run.smithi139.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-26T20:07:21.033 INFO:teuthology.orchestra.run.smithi135.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 423 kB/s | 32 kB 00:00 2024-04-26T20:07:21.046 INFO:teuthology.orchestra.run.smithi139.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-04-26T20:07:21.071 INFO:teuthology.orchestra.run.smithi139.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-26T20:07:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T20:07:21.122 INFO:teuthology.orchestra.run.smithi139.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-04-26T20:07:21.181 INFO:teuthology.orchestra.run.smithi139.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-26T20:07:21.239 INFO:teuthology.orchestra.run.smithi139.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-26T20:07:21.306 INFO:teuthology.orchestra.run.smithi139.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-26T20:07:21.332 INFO:teuthology.orchestra.run.smithi139.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 840 kB/s | 77 kB 00:00 2024-04-26T20:07:21.357 INFO:teuthology.orchestra.run.smithi139.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-04-26T20:07:21.382 INFO:teuthology.orchestra.run.smithi139.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-26T20:07:21.408 INFO:teuthology.orchestra.run.smithi139.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T20:07:21.419 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T20:07:21.469 INFO:teuthology.orchestra.run.smithi139.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-26T20:07:21.508 INFO:teuthology.orchestra.run.smithi139.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T20:07:21.517 INFO:teuthology.orchestra.run.smithi139.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 919 kB/s | 54 kB 00:00 2024-04-26T20:07:21.530 INFO:teuthology.orchestra.run.smithi135.stdout:(14/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 6.8 MB/s | 17 MB 00:02 2024-04-26T20:07:21.540 INFO:teuthology.orchestra.run.smithi135.stdout:(15/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 1.5 MB/s | 747 kB 00:00 2024-04-26T20:07:21.549 INFO:teuthology.orchestra.run.smithi139.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-04-26T20:07:21.565 INFO:teuthology.orchestra.run.smithi135.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 2.5 MB/s | 127 kB 00:00 2024-04-26T20:07:21.590 INFO:teuthology.orchestra.run.smithi135.stdout:(17/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 1.6 MB/s | 163 kB 00:00 2024-04-26T20:07:21.600 INFO:teuthology.orchestra.run.smithi139.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-04-26T20:07:21.651 INFO:teuthology.orchestra.run.smithi139.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T20:07:21.701 INFO:teuthology.orchestra.run.smithi139.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-04-26T20:07:21.751 INFO:teuthology.orchestra.run.smithi139.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-04-26T20:07:21.866 INFO:teuthology.orchestra.run.smithi135.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 1.6 MB/s | 501 kB 00:00 2024-04-26T20:07:21.943 INFO:teuthology.orchestra.run.smithi139.stdout:(96/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-26T20:07:21.968 INFO:teuthology.orchestra.run.smithi139.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-04-26T20:07:21.977 INFO:teuthology.orchestra.run.smithi135.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 416 kB/s | 45 kB 00:00 2024-04-26T20:07:21.994 INFO:teuthology.orchestra.run.smithi139.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T20:07:22.022 INFO:teuthology.orchestra.run.smithi139.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-26T20:07:22.067 INFO:teuthology.orchestra.run.smithi139.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-26T20:07:22.075 INFO:teuthology.orchestra.run.smithi139.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-04-26T20:07:22.084 INFO:teuthology.orchestra.run.smithi135.stdout:(20/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 11 MB/s | 5.4 MB 00:00 2024-04-26T20:07:22.108 INFO:teuthology.orchestra.run.smithi135.stdout:(21/152): python3-ceph-common-19.0.0-3306.gbc61 1.0 MB/s | 135 kB 00:00 2024-04-26T20:07:22.118 INFO:teuthology.orchestra.run.smithi139.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-04-26T20:07:22.159 INFO:teuthology.orchestra.run.smithi135.stdout:(22/152): python3-cephfs-19.0.0-3306.gbc612ffb. 2.1 MB/s | 161 kB 00:00 2024-04-26T20:07:22.245 INFO:teuthology.orchestra.run.smithi139.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-04-26T20:07:22.258 INFO:teuthology.orchestra.run.smithi135.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 3.2 MB/s | 298 kB 00:00 2024-04-26T20:07:22.278 INFO:teuthology.orchestra.run.smithi135.stdout:(24/152): python3-rados-19.0.0-3306.gbc612ffb.e 1.8 MB/s | 321 kB 00:00 2024-04-26T20:07:22.329 INFO:teuthology.orchestra.run.smithi135.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T20:07:22.354 INFO:teuthology.orchestra.run.smithi135.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-26T20:07:22.496 INFO:teuthology.orchestra.run.smithi139.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-26T20:07:22.588 INFO:teuthology.orchestra.run.smithi135.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 731 kB/s | 171 kB 00:00 2024-04-26T20:07:22.596 INFO:teuthology.orchestra.run.smithi139.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-26T20:07:22.646 INFO:teuthology.orchestra.run.smithi139.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 772 kB/s | 309 kB 00:00 2024-04-26T20:07:22.655 INFO:teuthology.orchestra.run.smithi135.stdout:(28/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 9.7 MB/s | 3.1 MB 00:00 2024-04-26T20:07:22.706 INFO:teuthology.orchestra.run.smithi135.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3306.g 408 kB/s | 34 kB 00:00 2024-04-26T20:07:22.741 INFO:teuthology.orchestra.run.smithi139.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-04-26T20:07:22.788 INFO:teuthology.orchestra.run.smithi139.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 648 kB/s | 49 kB 00:00 2024-04-26T20:07:22.855 INFO:teuthology.orchestra.run.smithi139.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-26T20:07:22.997 INFO:teuthology.orchestra.run.smithi139.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-26T20:07:23.098 INFO:teuthology.orchestra.run.smithi135.stdout:(30/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 15 MB/s | 49 MB 00:03 2024-04-26T20:07:23.131 INFO:teuthology.orchestra.run.smithi139.stdout:(111/152): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-04-26T20:07:23.141 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-04-26T20:07:23.152 INFO:teuthology.orchestra.run.smithi135.stdout:(31/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 293 kB/s | 142 kB 00:00 2024-04-26T20:07:23.232 INFO:teuthology.orchestra.run.smithi135.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 2.4 MB/s | 249 kB 00:00 2024-04-26T20:07:23.315 INFO:teuthology.orchestra.run.smithi135.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 592 kB/s | 49 kB 00:00 2024-04-26T20:07:23.399 INFO:teuthology.orchestra.run.smithi135.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 198 kB/s | 16 kB 00:00 2024-04-26T20:07:23.410 INFO:teuthology.orchestra.run.smithi139.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.0 MB/s | 839 kB 00:00 2024-04-26T20:07:23.431 INFO:teuthology.orchestra.run.smithi139.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-04-26T20:07:23.473 INFO:teuthology.orchestra.run.smithi139.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 651 kB/s | 43 kB 00:00 2024-04-26T20:07:23.499 INFO:teuthology.orchestra.run.smithi135.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.7 MB/s | 273 kB 00:00 2024-04-26T20:07:23.540 INFO:teuthology.orchestra.run.smithi139.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-26T20:07:23.572 INFO:teuthology.orchestra.run.smithi139.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-26T20:07:23.625 INFO:teuthology.orchestra.run.smithi135.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-04-26T20:07:23.632 INFO:teuthology.orchestra.run.smithi139.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-26T20:07:23.686 INFO:teuthology.orchestra.run.smithi135.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 4.0 MB/s | 762 kB 00:00 2024-04-26T20:07:23.707 INFO:teuthology.orchestra.run.smithi139.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-26T20:07:23.718 INFO:teuthology.orchestra.run.smithi135.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 198 kB/s | 18 kB 00:00 2024-04-26T20:07:23.733 INFO:teuthology.orchestra.run.smithi139.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-04-26T20:07:23.783 INFO:teuthology.orchestra.run.smithi139.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 470 kB/s | 35 kB 00:00 2024-04-26T20:07:23.850 INFO:teuthology.orchestra.run.smithi135.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 488 kB/s | 80 kB 00:00 2024-04-26T20:07:23.883 INFO:teuthology.orchestra.run.smithi139.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-04-26T20:07:23.958 INFO:teuthology.orchestra.run.smithi135.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-26T20:07:23.983 INFO:teuthology.orchestra.run.smithi139.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-26T20:07:23.997 INFO:teuthology.orchestra.run.smithi135.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-26T20:07:24.026 INFO:teuthology.orchestra.run.smithi135.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-26T20:07:24.059 INFO:teuthology.orchestra.run.smithi139.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-04-26T20:07:24.085 INFO:teuthology.orchestra.run.smithi135.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T20:07:24.097 INFO:teuthology.orchestra.run.smithi139.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 91 kB/s | 11 kB 00:00 2024-04-26T20:07:24.130 INFO:teuthology.orchestra.run.smithi139.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-04-26T20:07:24.183 INFO:teuthology.orchestra.run.smithi139.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-04-26T20:07:24.196 INFO:teuthology.orchestra.run.smithi135.stdout:(44/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 2.4 MB/s | 3.5 MB 00:01 2024-04-26T20:07:24.208 INFO:teuthology.orchestra.run.smithi135.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-04-26T20:07:24.223 INFO:teuthology.orchestra.run.smithi139.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-04-26T20:07:24.235 INFO:teuthology.orchestra.run.smithi139.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T20:07:24.248 INFO:teuthology.orchestra.run.smithi135.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-26T20:07:24.287 INFO:teuthology.orchestra.run.smithi135.stdout:(47/152): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-04-26T20:07:24.370 INFO:teuthology.orchestra.run.smithi135.stdout:(48/152): python3-requests-2.25.1-8.el9.noarch. 574 kB/s | 125 kB 00:00 2024-04-26T20:07:24.469 INFO:teuthology.orchestra.run.smithi139.stdout:(129/152): ceph-common-19.0.0-3306.gbc612ffb.el 1.8 MB/s | 21 MB 00:11 2024-04-26T20:07:24.494 INFO:teuthology.orchestra.run.smithi139.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 179 kB/s | 46 kB 00:00 2024-04-26T20:07:24.506 INFO:teuthology.orchestra.run.smithi135.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-04-26T20:07:24.520 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-26T20:07:24.534 INFO:teuthology.orchestra.run.smithi135.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 671 kB/s | 107 kB 00:00 2024-04-26T20:07:24.555 INFO:teuthology.orchestra.run.smithi135.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-26T20:07:24.585 INFO:teuthology.orchestra.run.smithi139.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 693 kB/s | 58 kB 00:00 2024-04-26T20:07:24.598 INFO:teuthology.orchestra.run.smithi135.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-04-26T20:07:24.630 INFO:teuthology.orchestra.run.smithi135.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-04-26T20:07:24.674 INFO:teuthology.orchestra.run.smithi135.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-04-26T20:07:24.684 INFO:teuthology.orchestra.run.smithi135.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-04-26T20:07:24.694 INFO:teuthology.orchestra.run.smithi139.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 379 kB/s | 79 kB 00:00 2024-04-26T20:07:24.708 INFO:teuthology.orchestra.run.smithi135.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-26T20:07:24.724 INFO:teuthology.orchestra.run.smithi135.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T20:07:24.744 INFO:teuthology.orchestra.run.smithi139.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-04-26T20:07:24.761 INFO:teuthology.orchestra.run.smithi135.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-04-26T20:07:24.772 INFO:teuthology.orchestra.run.smithi139.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-26T20:07:24.803 INFO:teuthology.orchestra.run.smithi139.stdout:(135/152): python3-kubernetes-26.1.0-2.el9.noar 1.7 MB/s | 1.0 MB 00:00 2024-04-26T20:07:24.856 INFO:teuthology.orchestra.run.smithi135.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-26T20:07:24.867 INFO:teuthology.orchestra.run.smithi139.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-26T20:07:24.878 INFO:teuthology.orchestra.run.smithi139.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-04-26T20:07:24.890 INFO:teuthology.orchestra.run.smithi135.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-04-26T20:07:24.901 INFO:teuthology.orchestra.run.smithi135.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 506 kB/s | 25 kB 00:00 2024-04-26T20:07:24.940 INFO:teuthology.orchestra.run.smithi135.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-26T20:07:24.951 INFO:teuthology.orchestra.run.smithi135.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-26T20:07:24.963 INFO:teuthology.orchestra.run.smithi139.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-04-26T20:07:25.007 INFO:teuthology.orchestra.run.smithi135.stdout:(64/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-04-26T20:07:25.018 INFO:teuthology.orchestra.run.smithi135.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-04-26T20:07:25.029 INFO:teuthology.orchestra.run.smithi139.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 537 kB/s | 36 kB 00:00 2024-04-26T20:07:25.040 INFO:teuthology.orchestra.run.smithi135.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-26T20:07:25.096 INFO:teuthology.orchestra.run.smithi139.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 244 kB/s | 59 kB 00:00 2024-04-26T20:07:25.121 INFO:teuthology.orchestra.run.smithi139.stdout:(141/152): python3-repoze-lru-0.7-16.el9.noarch 97 kB/s | 31 kB 00:00 2024-04-26T20:07:25.132 INFO:teuthology.orchestra.run.smithi135.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-26T20:07:25.147 INFO:teuthology.orchestra.run.smithi139.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 406 kB/s | 51 kB 00:00 2024-04-26T20:07:25.194 INFO:teuthology.orchestra.run.smithi135.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-04-26T20:07:25.222 INFO:teuthology.orchestra.run.smithi139.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-04-26T20:07:25.261 INFO:teuthology.orchestra.run.smithi135.stdout:(69/152): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-26T20:07:25.289 INFO:teuthology.orchestra.run.smithi139.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 301 kB/s | 20 kB 00:00 2024-04-26T20:07:25.301 INFO:teuthology.orchestra.run.smithi135.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-04-26T20:07:25.337 INFO:teuthology.orchestra.run.smithi135.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 4.2 MB/s | 911 kB 00:00 2024-04-26T20:07:25.395 INFO:teuthology.orchestra.run.smithi135.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-26T20:07:25.407 INFO:teuthology.orchestra.run.smithi139.stdout:(145/152): python3-websocket-client-1.2.3-2.el9 383 kB/s | 90 kB 00:00 2024-04-26T20:07:25.439 INFO:teuthology.orchestra.run.smithi139.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2024-04-26T20:07:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-04-26T20:07:25.527 INFO:teuthology.orchestra.run.smithi135.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 698 kB/s | 87 kB 00:00 2024-04-26T20:07:25.547 INFO:teuthology.orchestra.run.smithi135.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-04-26T20:07:25.558 INFO:teuthology.orchestra.run.smithi139.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-04-26T20:07:25.672 INFO:teuthology.orchestra.run.smithi135.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-26T20:07:25.697 INFO:teuthology.orchestra.run.smithi135.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-26T20:07:25.723 INFO:teuthology.orchestra.run.smithi135.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-04-26T20:07:25.734 INFO:teuthology.orchestra.run.smithi139.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 7.4 MB/s | 1.3 MB 00:00 2024-04-26T20:07:25.748 INFO:teuthology.orchestra.run.smithi135.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-26T20:07:25.804 INFO:teuthology.orchestra.run.smithi139.stdout:(150/152): librados2-19.0.0-3306.gbc612ffb.el9. 8.7 MB/s | 3.4 MB 00:00 2024-04-26T20:07:25.811 INFO:teuthology.orchestra.run.smithi135.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-26T20:07:25.819 INFO:teuthology.orchestra.run.smithi135.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-04-26T20:07:25.828 INFO:teuthology.orchestra.run.smithi135.stdout:(81/152): python3-devel-3.9.18-3.el9.x86_64.rpm 677 kB/s | 244 kB 00:00 2024-04-26T20:07:25.849 INFO:teuthology.orchestra.run.smithi139.stdout:(151/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 7.2 MB/s | 3.1 MB 00:00 2024-04-26T20:07:25.885 INFO:teuthology.orchestra.run.smithi135.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-04-26T20:07:25.924 INFO:teuthology.orchestra.run.smithi139.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-04-26T20:07:25.947 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:07:25.999 INFO:teuthology.orchestra.run.smithi139.stdout:Total 16 MB/s | 222 MB 00:13 2024-04-26T20:07:26.007 INFO:teuthology.orchestra.run.smithi135.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-26T20:07:26.015 INFO:teuthology.orchestra.run.smithi135.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 543 kB/s | 77 kB 00:00 2024-04-26T20:07:26.034 INFO:teuthology.orchestra.run.smithi135.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-04-26T20:07:26.059 INFO:teuthology.orchestra.run.smithi135.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-26T20:07:26.085 INFO:teuthology.orchestra.run.smithi135.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T20:07:26.110 INFO:teuthology.orchestra.run.smithi135.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-26T20:07:26.136 INFO:teuthology.orchestra.run.smithi135.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T20:07:26.161 INFO:teuthology.orchestra.run.smithi135.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T20:07:26.225 INFO:teuthology.orchestra.run.smithi135.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 651 kB/s | 42 kB 00:00 2024-04-26T20:07:26.287 INFO:teuthology.orchestra.run.smithi135.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 720 kB/s | 44 kB 00:00 2024-04-26T20:07:26.337 INFO:teuthology.orchestra.run.smithi135.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T20:07:26.388 INFO:teuthology.orchestra.run.smithi135.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-04-26T20:07:26.438 INFO:teuthology.orchestra.run.smithi135.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-04-26T20:07:26.488 INFO:teuthology.orchestra.run.smithi135.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-26T20:07:26.530 INFO:teuthology.orchestra.run.smithi135.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-04-26T20:07:26.614 INFO:teuthology.orchestra.run.smithi135.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-26T20:07:26.674 INFO:teuthology.orchestra.run.smithi135.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T20:07:26.698 INFO:teuthology.orchestra.run.smithi135.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-04-26T20:07:27.007 INFO:teuthology.orchestra.run.smithi135.stdout:(101/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-04-26T20:07:27.026 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-26T20:07:27.034 INFO:teuthology.orchestra.run.smithi135.stdout:(102/152): python3-oauthlib-3.1.1-5.el9.noarch. 184 kB/s | 222 kB 00:01 2024-04-26T20:07:27.170 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-26T20:07:27.178 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-26T20:07:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-26T20:07:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-04-26T20:07:27.408 INFO:teuthology.orchestra.run.smithi135.stdout:(105/152): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-04-26T20:07:27.449 INFO:teuthology.orchestra.run.smithi135.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-04-26T20:07:27.484 INFO:teuthology.orchestra.run.smithi135.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-04-26T20:07:27.534 INFO:teuthology.orchestra.run.smithi135.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-04-26T20:07:27.635 INFO:teuthology.orchestra.run.smithi135.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 673 kB/s | 67 kB 00:00 2024-04-26T20:07:27.710 INFO:teuthology.orchestra.run.smithi135.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-26T20:07:27.819 INFO:teuthology.orchestra.run.smithi135.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-04-26T20:07:27.915 INFO:teuthology.orchestra.run.smithi135.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-04-26T20:07:27.944 INFO:teuthology.orchestra.run.smithi135.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-26T20:07:27.969 INFO:teuthology.orchestra.run.smithi135.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 796 kB/s | 43 kB 00:00 2024-04-26T20:07:27.995 INFO:teuthology.orchestra.run.smithi135.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 636 kB/s | 32 kB 00:00 2024-04-26T20:07:28.021 INFO:teuthology.orchestra.run.smithi135.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 295 kB/s | 15 kB 00:00 2024-04-26T20:07:28.071 INFO:teuthology.orchestra.run.smithi135.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-26T20:07:28.096 INFO:teuthology.orchestra.run.smithi135.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-04-26T20:07:28.130 INFO:teuthology.orchestra.run.smithi135.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-04-26T20:07:28.155 INFO:teuthology.orchestra.run.smithi135.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 600 kB/s | 35 kB 00:00 2024-04-26T20:07:28.189 INFO:teuthology.orchestra.run.smithi135.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-26T20:07:28.287 INFO:teuthology.orchestra.run.smithi135.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 22 MB/s | 2.0 MB 00:00 2024-04-26T20:07:28.307 INFO:teuthology.orchestra.run.smithi135.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-26T20:07:28.332 INFO:teuthology.orchestra.run.smithi135.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-26T20:07:28.357 INFO:teuthology.orchestra.run.smithi135.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-26T20:07:28.383 INFO:teuthology.orchestra.run.smithi135.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-04-26T20:07:28.408 INFO:teuthology.orchestra.run.smithi135.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-26T20:07:28.433 INFO:teuthology.orchestra.run.smithi135.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-04-26T20:07:28.475 INFO:teuthology.orchestra.run.smithi135.stdout:(129/152): protobuf-compiler-3.14.0-13.el9.x86_ 588 kB/s | 863 kB 00:01 2024-04-26T20:07:28.518 INFO:teuthology.orchestra.run.smithi135.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-04-26T20:07:28.626 INFO:teuthology.orchestra.run.smithi135.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 241 kB/s | 46 kB 00:00 2024-04-26T20:07:28.652 INFO:teuthology.orchestra.run.smithi135.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 432 kB/s | 58 kB 00:00 2024-04-26T20:07:28.693 INFO:teuthology.orchestra.run.smithi135.stdout:(133/152): python3-more-itertools-8.12.0-2.el9. 363 kB/s | 79 kB 00:00 2024-04-26T20:07:28.719 INFO:teuthology.orchestra.run.smithi135.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-04-26T20:07:28.744 INFO:teuthology.orchestra.run.smithi135.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-26T20:07:28.810 INFO:teuthology.orchestra.run.smithi135.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 312 kB/s | 28 kB 00:00 2024-04-26T20:07:28.837 INFO:teuthology.orchestra.run.smithi135.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 630 kB/s | 90 kB 00:00 2024-04-26T20:07:28.854 INFO:teuthology.orchestra.run.smithi135.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 281 kB/s | 31 kB 00:00 2024-04-26T20:07:28.929 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-26T20:07:28.980 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-26T20:07:28.993 INFO:teuthology.orchestra.run.smithi135.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-04-26T20:07:29.005 INFO:teuthology.orchestra.run.smithi135.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 997 kB/s | 59 kB 00:00 2024-04-26T20:07:29.016 INFO:teuthology.orchestra.run.smithi135.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 607 kB/s | 36 kB 00:00 2024-04-26T20:07:29.027 INFO:teuthology.orchestra.run.smithi135.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-26T20:07:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T20:07:29.072 INFO:teuthology.orchestra.run.smithi135.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-26T20:07:29.114 INFO:teuthology.orchestra.run.smithi135.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-04-26T20:07:29.126 INFO:teuthology.orchestra.run.smithi135.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-04-26T20:07:29.137 INFO:teuthology.orchestra.run.smithi135.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-26T20:07:29.148 INFO:teuthology.orchestra.run.smithi135.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T20:07:29.391 INFO:teuthology.orchestra.run.smithi135.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 1.3 MB 00:00 2024-04-26T20:07:29.517 INFO:teuthology.orchestra.run.smithi135.stdout:(150/152): librados2-19.0.0-3306.gbc612ffb.el9. 7.4 MB/s | 3.4 MB 00:00 2024-04-26T20:07:29.792 INFO:teuthology.orchestra.run.smithi135.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 2.4 MB 00:00 2024-04-26T20:07:29.867 INFO:teuthology.orchestra.run.smithi135.stdout:(152/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-04-26T20:07:29.876 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:07:29.952 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 222 MB 00:14 2024-04-26T20:07:30.415 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-26T20:07:30.943 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-04-26T20:07:31.085 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-04-26T20:07:31.097 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-04-26T20:07:32.831 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-04-26T20:07:32.849 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-04-26T20:07:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:07:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T20:07:32.864 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T20:07:32.865 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T20:07:32.867 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T20:07:32.868 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T20:07:32.870 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T20:07:32.874 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T20:07:32.875 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T20:07:32.945 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-26T20:07:32.964 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-26T20:07:32.964 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-26T20:07:32.964 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-26T20:07:32.964 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-26T20:07:32.964 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T20:07:32.965 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T20:07:32.966 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T20:07:32.967 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:07:32.968 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T20:07:32.969 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T20:07:32.970 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T20:07:32.971 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:07:32.972 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:07:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:07:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:07:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:07:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 4 Packages 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:07:32.977 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 222 M 2024-04-26T20:07:32.978 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-26T20:07:34.025 INFO:teuthology.orchestra.run.smithi082.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-04-26T20:07:34.216 INFO:teuthology.orchestra.run.smithi082.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 4.6 MB/s | 889 kB 00:00 2024-04-26T20:07:34.299 INFO:teuthology.orchestra.run.smithi082.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.7 MB/s | 145 kB 00:00 2024-04-26T20:07:34.650 INFO:teuthology.orchestra.run.smithi082.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 6.7 MB/s | 2.4 MB 00:00 2024-04-26T20:07:34.767 INFO:teuthology.orchestra.run.smithi082.stdout:(5/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 5.4 MB/s | 5.4 MB 00:01 2024-04-26T20:07:34.851 INFO:teuthology.orchestra.run.smithi082.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-04-26T20:07:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-26T20:07:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T20:07:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T20:07:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T20:07:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T20:07:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T20:07:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T20:07:35.259 INFO:teuthology.orchestra.run.smithi082.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 9.6 MB/s | 4.7 MB 00:00 2024-04-26T20:07:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T20:07:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:07:35.750 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:07:35.781 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:07:35.872 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:07:35.901 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:07:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T20:07:36.098 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T20:07:36.126 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:07:36.230 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:07:36.252 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:07:36.315 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:07:36.337 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:07:36.342 INFO:teuthology.orchestra.run.smithi082.stdout:(8/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el9 9.8 MB/s | 11 MB 00:01 2024-04-26T20:07:36.356 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:07:36.544 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:07:36.579 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:07:36.635 INFO:teuthology.orchestra.run.smithi082.stdout:(9/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 7.4 MB/s | 21 MB 00:02 2024-04-26T20:07:36.660 INFO:teuthology.orchestra.run.smithi082.stdout:(10/152): ceph-selinux-19.0.0-3306.gbc612ffb.el 80 kB/s | 25 kB 00:00 2024-04-26T20:07:36.689 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T20:07:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 3.3 MB/s | 225 kB 00:00 2024-04-26T20:07:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T20:07:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T20:07:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 252 kB/s | 27 kB 00:00 2024-04-26T20:07:36.862 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T20:07:36.936 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T20:07:36.970 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T20:07:37.013 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T20:07:37.044 INFO:teuthology.orchestra.run.smithi082.stdout:(13/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 7.7 MB/s | 17 MB 00:02 2024-04-26T20:07:37.062 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T20:07:37.069 INFO:teuthology.orchestra.run.smithi082.stdout:(14/152): libcephfs-devel-19.0.0-3306.gbc612ffb 136 kB/s | 32 kB 00:00 2024-04-26T20:07:37.090 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T20:07:37.158 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T20:07:37.161 INFO:teuthology.orchestra.run.smithi082.stdout:(15/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 6.3 MB/s | 747 kB 00:00 2024-04-26T20:07:37.198 INFO:teuthology.orchestra.run.smithi082.stdout:(16/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 1.3 MB/s | 163 kB 00:00 2024-04-26T20:07:37.211 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T20:07:37.228 INFO:teuthology.orchestra.run.smithi082.stdout:(17/152): librados-devel-19.0.0-3306.gbc612ffb. 1.9 MB/s | 127 kB 00:00 2024-04-26T20:07:37.242 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T20:07:37.277 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T20:07:37.278 INFO:teuthology.orchestra.run.smithi082.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 5.9 MB/s | 501 kB 00:00 2024-04-26T20:07:37.354 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T20:07:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 454 kB/s | 45 kB 00:00 2024-04-26T20:07:37.388 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T20:07:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T20:07:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T20:07:37.488 INFO:teuthology.orchestra.run.smithi082.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 1.2 MB/s | 135 kB 00:00 2024-04-26T20:07:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T20:07:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T20:07:37.579 INFO:teuthology.orchestra.run.smithi082.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.7 MB/s | 161 kB 00:00 2024-04-26T20:07:37.649 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T20:07:37.688 INFO:teuthology.orchestra.run.smithi082.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 2.9 MB/s | 321 kB 00:00 2024-04-26T20:07:37.786 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T20:07:37.835 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T20:07:37.838 INFO:teuthology.orchestra.run.smithi082.stdout:(23/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 8.8 MB/s | 5.4 MB 00:00 2024-04-26T20:07:37.872 INFO:teuthology.orchestra.run.smithi082.stdout:(24/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 1.6 MB/s | 298 kB 00:00 2024-04-26T20:07:37.905 INFO:teuthology.orchestra.run.smithi082.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.5 MB/s | 99 kB 00:00 2024-04-26T20:07:37.956 INFO:teuthology.orchestra.run.smithi082.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-26T20:07:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-26T20:07:38.148 INFO:teuthology.orchestra.run.smithi082.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 343 kB/s | 34 kB 00:00 2024-04-26T20:07:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:(29/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 9.0 MB/s | 3.1 MB 00:00 2024-04-26T20:07:38.282 INFO:teuthology.orchestra.run.smithi082.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.0 MB/s | 142 kB 00:00 2024-04-26T20:07:38.353 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T20:07:38.431 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T20:07:38.460 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T20:07:38.503 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T20:07:38.541 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T20:07:38.582 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T20:07:38.738 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T20:07:38.790 INFO:teuthology.orchestra.run.smithi082.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 6.5 MB/s | 3.5 MB 00:00 2024-04-26T20:07:38.793 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T20:07:38.849 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T20:07:38.866 INFO:teuthology.orchestra.run.smithi082.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 3.3 MB/s | 249 kB 00:00 2024-04-26T20:07:38.920 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T20:07:38.933 INFO:teuthology.orchestra.run.smithi082.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 751 kB/s | 49 kB 00:00 2024-04-26T20:07:38.952 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T20:07:38.989 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T20:07:39.033 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-04-26T20:07:39.035 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T20:07:39.071 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T20:07:39.083 INFO:teuthology.orchestra.run.smithi082.stdout:(34/152): ceph-mgr-diskprediction-local-19.0.0- 9.3 MB/s | 7.4 MB 00:00 2024-04-26T20:07:39.106 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T20:07:39.121 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T20:07:39.125 INFO:teuthology.orchestra.run.smithi082.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3306.gb 86 kB/s | 16 kB 00:00 2024-04-26T20:07:39.148 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T20:07:39.176 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T20:07:39.209 INFO:teuthology.orchestra.run.smithi082.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.2 MB/s | 273 kB 00:00 2024-04-26T20:07:39.238 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T20:07:39.250 INFO:teuthology.orchestra.run.smithi082.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.0 MB/s | 762 kB 00:00 2024-04-26T20:07:39.273 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T20:07:39.283 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T20:07:39.292 INFO:teuthology.orchestra.run.smithi082.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 221 kB/s | 18 kB 00:00 2024-04-26T20:07:39.298 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T20:07:39.328 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T20:07:39.341 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T20:07:39.359 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T20:07:39.400 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T20:07:39.495 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T20:07:39.526 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T20:07:39.565 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T20:07:39.599 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T20:07:39.624 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T20:07:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T20:07:39.734 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T20:07:39.742 INFO:teuthology.orchestra.run.smithi082.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 164 kB/s | 80 kB 00:00 2024-04-26T20:07:39.792 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:07:39.825 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T20:07:39.858 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T20:07:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T20:07:39.898 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:07:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T20:07:39.926 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:07:39.957 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T20:07:39.989 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T20:07:40.018 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:07:40.019 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T20:07:40.048 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:07:40.053 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T20:07:40.086 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T20:07:40.120 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T20:07:40.154 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T20:07:40.197 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T20:07:40.241 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T20:07:40.245 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T20:07:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:07:40.284 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T20:07:40.316 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T20:07:40.362 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T20:07:40.385 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:07:40.416 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:07:40.461 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T20:07:40.479 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:07:40.484 INFO:teuthology.orchestra.run.smithi082.stdout:(40/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 13 MB/s | 49 MB 00:03 2024-04-26T20:07:40.509 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:07:40.517 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T20:07:40.529 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:07:40.735 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:07:40.751 INFO:teuthology.orchestra.run.smithi082.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 194 kB/s | 195 kB 00:01 2024-04-26T20:07:40.768 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:07:40.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T20:07:40.962 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T20:07:41.009 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T20:07:41.044 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T20:07:41.095 INFO:teuthology.orchestra.run.smithi082.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 446 kB/s | 803 kB 00:01 2024-04-26T20:07:41.260 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T20:07:41.310 INFO:teuthology.orchestra.run.smithi082.stdout:(43/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 307 kB/s | 253 kB 00:00 2024-04-26T20:07:41.319 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T20:07:41.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T20:07:41.364 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T20:07:41.371 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T20:07:41.397 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T20:07:41.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T20:07:41.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T20:07:41.495 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T20:07:41.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T20:07:41.546 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T20:07:41.572 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T20:07:41.602 INFO:teuthology.orchestra.run.smithi082.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 210 kB/s | 106 kB 00:00 2024-04-26T20:07:41.610 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T20:07:41.641 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T20:07:41.654 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T20:07:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T20:07:41.732 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T20:07:41.765 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T20:07:41.808 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T20:07:41.837 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T20:07:41.859 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T20:07:41.889 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T20:07:41.894 INFO:teuthology.orchestra.run.smithi082.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 232 kB/s | 135 kB 00:00 2024-04-26T20:07:41.906 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T20:07:41.952 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T20:07:41.966 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T20:07:42.026 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T20:07:42.119 INFO:teuthology.orchestra.run.smithi082.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 242 kB/s | 125 kB 00:00 2024-04-26T20:07:42.178 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T20:07:42.239 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T20:07:42.419 INFO:teuthology.orchestra.run.smithi082.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-04-26T20:07:42.553 INFO:teuthology.orchestra.run.smithi082.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 326 kB/s | 215 kB 00:00 2024-04-26T20:07:42.610 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T20:07:42.686 INFO:teuthology.orchestra.run.smithi082.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-04-26T20:07:42.720 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T20:07:42.728 INFO:teuthology.orchestra.run.smithi082.stdout:(50/152): python3-cryptography-36.0.1-4.el9.x86 635 kB/s | 1.2 MB 00:01 2024-04-26T20:07:42.754 INFO:teuthology.orchestra.run.smithi082.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 326 kB/s | 21 kB 00:00 2024-04-26T20:07:42.761 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T20:07:42.813 INFO:teuthology.orchestra.run.smithi082.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-04-26T20:07:42.852 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T20:07:42.863 INFO:teuthology.orchestra.run.smithi082.stdout:(53/152): boost-program-options-1.75.0-8.el9.x8 346 kB/s | 107 kB 00:00 2024-04-26T20:07:42.889 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T20:07:42.921 INFO:teuthology.orchestra.run.smithi082.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 317 kB/s | 18 kB 00:00 2024-04-26T20:07:42.932 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T20:07:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T20:07:42.979 INFO:teuthology.orchestra.run.smithi082.stdout:(55/152): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-04-26T20:07:43.012 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T20:07:43.013 INFO:teuthology.orchestra.run.smithi082.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 122 kB/s | 11 kB 00:00 2024-04-26T20:07:43.064 INFO:teuthology.orchestra.run.smithi082.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-26T20:07:43.089 INFO:teuthology.orchestra.run.smithi082.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 608 kB/s | 45 kB 00:00 2024-04-26T20:07:43.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T20:07:43.233 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T20:07:43.239 INFO:teuthology.orchestra.run.smithi082.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-26T20:07:43.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T20:07:43.293 INFO:teuthology.orchestra.run.smithi082.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 2.8 MB/s | 582 kB 00:00 2024-04-26T20:07:43.323 INFO:teuthology.orchestra.run.smithi082.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 307 kB/s | 25 kB 00:00 2024-04-26T20:07:43.361 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T20:07:43.393 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T20:07:43.407 INFO:teuthology.orchestra.run.smithi082.stdout:(62/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2024-04-26T20:07:43.429 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T20:07:43.432 INFO:teuthology.orchestra.run.smithi082.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 343 kB/s | 47 kB 00:00 2024-04-26T20:07:43.474 INFO:teuthology.orchestra.run.smithi082.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-04-26T20:07:43.476 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T20:07:43.499 INFO:teuthology.orchestra.run.smithi082.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 35 kB 00:00 2024-04-26T20:07:43.520 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T20:07:43.533 INFO:teuthology.orchestra.run.smithi082.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T20:07:43.564 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T20:07:43.606 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T20:07:43.742 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T20:07:43.795 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T20:07:43.826 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T20:07:43.867 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T20:07:43.938 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T20:07:43.962 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T20:07:43.966 INFO:teuthology.orchestra.run.smithi082.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-04-26T20:07:44.001 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T20:07:44.017 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T20:07:44.041 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T20:07:44.044 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T20:07:44.075 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T20:07:44.078 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T20:07:44.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T20:07:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T20:07:44.267 INFO:teuthology.orchestra.run.smithi082.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 3.0 MB/s | 911 kB 00:00 2024-04-26T20:07:44.325 INFO:teuthology.orchestra.run.smithi082.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-26T20:07:44.390 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T20:07:44.458 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:07:44.487 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T20:07:44.492 INFO:teuthology.orchestra.run.smithi082.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-04-26T20:07:44.526 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T20:07:44.549 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:07:44.554 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T20:07:44.579 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T20:07:44.588 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T20:07:44.601 INFO:teuthology.orchestra.run.smithi082.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.2 MB/s | 4.7 MB 00:01 2024-04-26T20:07:44.614 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T20:07:44.628 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T20:07:44.668 INFO:teuthology.orchestra.run.smithi082.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-26T20:07:44.668 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T20:07:44.698 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T20:07:44.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T20:07:44.743 INFO:teuthology.orchestra.run.smithi082.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-04-26T20:07:44.766 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T20:07:44.808 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T20:07:44.810 INFO:teuthology.orchestra.run.smithi082.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-26T20:07:44.843 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T20:07:44.885 INFO:teuthology.orchestra.run.smithi082.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-04-26T20:07:44.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T20:07:44.952 INFO:teuthology.orchestra.run.smithi082.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 390 kB/s | 26 kB 00:00 2024-04-26T20:07:44.982 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T20:07:45.011 INFO:teuthology.orchestra.run.smithi082.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 333 kB/s | 19 kB 00:00 2024-04-26T20:07:45.022 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T20:07:45.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T20:07:45.077 INFO:teuthology.orchestra.run.smithi082.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-04-26T20:07:45.092 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T20:07:45.118 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:07:45.136 INFO:teuthology.orchestra.run.smithi082.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 605 kB/s | 35 kB 00:00 2024-04-26T20:07:45.169 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T20:07:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:07:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T20:07:45.224 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T20:07:45.403 INFO:teuthology.orchestra.run.smithi082.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-04-26T20:07:45.503 INFO:teuthology.orchestra.run.smithi082.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-04-26T20:07:45.570 INFO:teuthology.orchestra.run.smithi082.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-26T20:07:45.629 INFO:teuthology.orchestra.run.smithi082.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T20:07:45.679 INFO:teuthology.orchestra.run.smithi082.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 859 kB/s | 42 kB 00:00 2024-04-26T20:07:45.829 INFO:teuthology.orchestra.run.smithi082.stdout:(85/152): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-04-26T20:07:45.863 INFO:teuthology.orchestra.run.smithi082.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-04-26T20:07:45.897 INFO:teuthology.orchestra.run.smithi082.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-26T20:07:45.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T20:07:45.997 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T20:07:46.005 INFO:teuthology.orchestra.run.smithi082.stdout:(88/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-04-26T20:07:46.030 INFO:teuthology.orchestra.run.smithi082.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 384 kB/s | 51 kB 00:00 2024-04-26T20:07:46.031 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T20:07:46.064 INFO:teuthology.orchestra.run.smithi082.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-04-26T20:07:46.089 INFO:teuthology.orchestra.run.smithi082.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 647 kB/s | 54 kB 00:00 2024-04-26T20:07:46.129 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T20:07:46.140 INFO:teuthology.orchestra.run.smithi082.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 560 kB/s | 42 kB 00:00 2024-04-26T20:07:46.165 INFO:teuthology.orchestra.run.smithi082.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 592 kB/s | 44 kB 00:00 2024-04-26T20:07:46.198 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T20:07:46.207 INFO:teuthology.orchestra.run.smithi082.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-04-26T20:07:46.232 INFO:teuthology.orchestra.run.smithi082.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 542 kB/s | 36 kB 00:00 2024-04-26T20:07:46.266 INFO:teuthology.orchestra.run.smithi082.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 821 kB/s | 47 kB 00:00 2024-04-26T20:07:46.285 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T20:07:46.318 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T20:07:46.324 INFO:teuthology.orchestra.run.smithi082.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-04-26T20:07:46.349 INFO:teuthology.orchestra.run.smithi082.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 699 kB/s | 58 kB 00:00 2024-04-26T20:07:46.441 INFO:teuthology.orchestra.run.smithi082.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 702 kB/s | 64 kB 00:00 2024-04-26T20:07:46.495 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T20:07:46.500 INFO:teuthology.orchestra.run.smithi082.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 536 kB/s | 94 kB 00:00 2024-04-26T20:07:46.524 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T20:07:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2024-04-26T20:07:46.576 INFO:teuthology.orchestra.run.smithi082.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 301 kB/s | 22 kB 00:00 2024-04-26T20:07:46.610 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T20:07:46.643 INFO:teuthology.orchestra.run.smithi082.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.3 MB/s | 863 kB 00:00 2024-04-26T20:07:47.255 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T20:07:47.383 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T20:07:47.451 INFO:teuthology.orchestra.run.smithi082.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 382 kB/s | 309 kB 00:00 2024-04-26T20:07:47.469 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:07:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:07:47.560 INFO:teuthology.orchestra.run.smithi082.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 181 kB/s | 19 kB 00:00 2024-04-26T20:07:47.802 INFO:teuthology.orchestra.run.smithi082.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 447 kB/s | 548 kB 00:01 2024-04-26T20:07:47.910 INFO:teuthology.orchestra.run.smithi082.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 242 kB/s | 26 kB 00:00 2024-04-26T20:07:48.028 INFO:teuthology.orchestra.run.smithi082.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-04-26T20:07:48.057 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:07:48.094 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:07:48.200 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:07:48.212 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:07:48.294 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:07:48.321 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:07:48.350 INFO:teuthology.orchestra.run.smithi082.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 334 kB/s | 67 kB 00:00 2024-04-26T20:07:48.361 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:07:48.448 INFO:teuthology.orchestra.run.smithi082.stdout:(110/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-04-26T20:07:48.607 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T20:07:48.630 INFO:teuthology.orchestra.run.smithi082.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 378 kB/s | 151 kB 00:00 2024-04-26T20:07:48.700 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T20:07:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T20:07:48.762 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T20:07:49.072 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T20:07:49.117 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:07:49.191 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:07:49.222 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T20:07:49.271 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T20:07:49.414 INFO:teuthology.orchestra.run.smithi082.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 700 kB/s | 548 kB 00:00 2024-04-26T20:07:49.522 INFO:teuthology.orchestra.run.smithi082.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 404 kB/s | 43 kB 00:00 2024-04-26T20:07:49.631 INFO:teuthology.orchestra.run.smithi082.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 299 kB/s | 32 kB 00:00 2024-04-26T20:07:49.736 INFO:teuthology.orchestra.run.smithi082.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 151 kB/s | 15 kB 00:00 2024-04-26T20:07:49.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T20:07:49.779 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:07:49.850 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:07:49.873 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T20:07:50.015 INFO:teuthology.orchestra.run.smithi082.stdout:(116/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 535 kB/s | 839 kB 00:01 2024-04-26T20:07:50.090 INFO:teuthology.orchestra.run.smithi082.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 558 kB/s | 172 kB 00:00 2024-04-26T20:07:50.474 INFO:teuthology.orchestra.run.smithi082.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 701 kB/s | 303 kB 00:00 2024-04-26T20:07:50.532 INFO:teuthology.orchestra.run.smithi082.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 694 kB/s | 358 kB 00:00 2024-04-26T20:07:50.583 INFO:teuthology.orchestra.run.smithi082.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 327 kB/s | 35 kB 00:00 2024-04-26T20:07:50.883 INFO:teuthology.orchestra.run.smithi082.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 588 kB/s | 206 kB 00:00 2024-04-26T20:07:51.158 INFO:teuthology.orchestra.run.smithi082.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 527 kB/s | 144 kB 00:00 2024-04-26T20:07:51.267 INFO:teuthology.orchestra.run.smithi082.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-26T20:07:51.375 INFO:teuthology.orchestra.run.smithi082.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-04-26T20:07:51.484 INFO:teuthology.orchestra.run.smithi082.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 215 kB/s | 23 kB 00:00 2024-04-26T20:07:51.593 INFO:teuthology.orchestra.run.smithi082.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 181 kB/s | 19 kB 00:00 2024-04-26T20:07:51.701 INFO:teuthology.orchestra.run.smithi082.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 183 kB/s | 20 kB 00:00 2024-04-26T20:07:52.161 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:07:52.221 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:07:52.743 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:07:52.783 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:07:52.883 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:07:52.932 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:07:52.941 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:07:52.949 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:07:52.959 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:07:53.110 INFO:teuthology.orchestra.run.smithi082.stdout:(128/152): libarrow-9.0.0-11.el9.x86_64.rpm 815 kB/s | 4.4 MB 00:05 2024-04-26T20:07:53.151 INFO:teuthology.orchestra.run.smithi082.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 721 kB/s | 1.0 MB 00:01 2024-04-26T20:07:53.227 INFO:teuthology.orchestra.run.smithi082.stdout:(130/152): python3-grpcio-1.46.7-10.el9.x86_64. 789 kB/s | 2.0 MB 00:02 2024-04-26T20:07:53.252 INFO:teuthology.orchestra.run.smithi082.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 329 kB/s | 46 kB 00:00 2024-04-26T20:07:53.369 INFO:teuthology.orchestra.run.smithi082.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 364 kB/s | 79 kB 00:00 2024-04-26T20:07:53.419 INFO:teuthology.orchestra.run.smithi082.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 300 kB/s | 58 kB 00:00 2024-04-26T20:07:53.478 INFO:teuthology.orchestra.run.smithi082.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2024-04-26T20:07:53.587 INFO:teuthology.orchestra.run.smithi082.stdout:(135/152): python3-pyperclip-1.8.2-2.el9.noarch 262 kB/s | 28 kB 00:00 2024-04-26T20:07:53.637 INFO:teuthology.orchestra.run.smithi082.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 416 kB/s | 90 kB 00:00 2024-04-26T20:07:53.695 INFO:teuthology.orchestra.run.smithi082.stdout:(137/152): python3-pecan-1.4.2-3.el9.noarch.rpm 615 kB/s | 272 kB 00:00 2024-04-26T20:07:53.721 INFO:teuthology.orchestra.run.smithi082.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2024-04-26T20:07:53.830 INFO:teuthology.orchestra.run.smithi082.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 332 kB/s | 36 kB 00:00 2024-04-26T20:07:53.880 INFO:teuthology.orchestra.run.smithi082.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2024-04-26T20:07:53.934 INFO:teuthology.orchestra.run.smithi082.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 637 kB/s | 188 kB 00:00 2024-04-26T20:07:53.964 INFO:teuthology.orchestra.run.smithi082.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 383 kB/s | 51 kB 00:00 2024-04-26T20:07:54.130 INFO:teuthology.orchestra.run.smithi082.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 458 kB/s | 90 kB 00:00 2024-04-26T20:07:54.261 INFO:teuthology.orchestra.run.smithi082.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 154 kB/s | 20 kB 00:00 2024-04-26T20:07:54.298 INFO:teuthology.orchestra.run.smithi082.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 551 kB/s | 230 kB 00:00 2024-04-26T20:07:54.523 INFO:teuthology.orchestra.run.smithi082.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 735 kB/s | 192 kB 00:00 2024-04-26T20:07:54.598 INFO:teuthology.orchestra.run.smithi082.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 674 kB/s | 427 kB 00:00 2024-04-26T20:07:55.557 INFO:teuthology.orchestra.run.smithi082.stdout:(148/152): librados2-19.0.0-3306.gbc612ffb.el9. 3.3 MB/s | 3.4 MB 00:01 2024-04-26T20:07:55.757 INFO:teuthology.orchestra.run.smithi082.stdout:(149/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-04-26T20:07:56.470 INFO:teuthology.orchestra.run.smithi082.stdout:(150/152): thrift-0.15.0-2.el9.x86_64.rpm 746 kB/s | 1.6 MB 00:02 2024-04-26T20:07:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 873 kB/s | 1.3 MB 00:01 2024-04-26T20:07:58.699 INFO:teuthology.orchestra.run.smithi082.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 833 kB/s | 2.4 MB 00:02 2024-04-26T20:07:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:07:58.720 INFO:teuthology.orchestra.run.smithi082.stdout:Total 8.6 MB/s | 222 MB 00:25 2024-04-26T20:07:59.362 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:07:59.454 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-04-26T20:07:59.483 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-04-26T20:07:59.490 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-04-26T20:07:59.497 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-04-26T20:07:59.504 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-04-26T20:07:59.511 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-04-26T20:07:59.516 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-04-26T20:07:59.521 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:07:59.539 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:07:59.555 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:07:59.562 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:07:59.593 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T20:07:59.598 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:01.025 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:08:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:08:01.060 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:01.072 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:08:01.082 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:08:01.107 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:08:01.118 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:01.276 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:08:01.299 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:08:01.308 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:01.317 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:08:01.328 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:08:01.337 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:08:01.347 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:01.646 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-26T20:08:01.743 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:08:01.803 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:08:01.813 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:01.965 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:08:01.978 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:08:01.988 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:08:01.998 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:02.008 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-26T20:08:02.016 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-26T20:08:02.024 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T20:08:02.030 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T20:08:02.037 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T20:08:02.154 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T20:08:02.233 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T20:08:02.271 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T20:08:02.367 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:08:02.506 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:08:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T20:08:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T20:08:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T20:08:03.008 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:08:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:08:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T20:08:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T20:08:03.175 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:08:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:08:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:08:04.611 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-26T20:08:04.645 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-26T20:08:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:08:04.725 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-04-26T20:08:04.735 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-04-26T20:08:04.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-04-26T20:08:04.754 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-04-26T20:08:04.763 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-04-26T20:08:04.772 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-04-26T20:08:04.781 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-04-26T20:08:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:08:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:08:04.891 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:04.900 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T20:08:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:05.216 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:08:05.243 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:08:05.346 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:08:05.496 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T20:08:05.520 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:08:05.543 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:08:05.593 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:05.603 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:08:05.612 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:08:05.620 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:08:05.626 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:05.692 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:08:05.698 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:08:05.706 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T20:08:05.744 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T20:08:06.354 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:08:06.379 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:08:06.385 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:06.390 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:08:06.477 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:08:06.484 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:08:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:06.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:08:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:08:06.641 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:06.648 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:08:06.654 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:08:06.662 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:08:06.718 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T20:08:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:08:06.785 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:08:06.792 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:06.798 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:08:06.864 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:08:06.870 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:08:06.915 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:06.925 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:08:06.935 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:08:06.944 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:07.001 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:08:07.013 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:07.019 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:08:07.025 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:08:07.032 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:07.093 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T20:08:07.100 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:08:07.109 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:08:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:07.128 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:08:07.219 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:08:07.224 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:07.234 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:08:07.268 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:08:07.277 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:08:07.286 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:07.297 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:08:07.308 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:08:07.317 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:07.326 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:08:07.334 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:08:07.343 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:08:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:07.395 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T20:08:07.404 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T20:08:07.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T20:08:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T20:08:07.584 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T20:08:07.663 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T20:08:07.757 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:08:07.898 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:08:07.934 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T20:08:07.966 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T20:08:07.994 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T20:08:08.407 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:08:08.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:08:08.532 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T20:08:08.573 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T20:08:08.582 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:08:09.594 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:08:09.645 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:08:10.605 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:08:10.682 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:08:10.738 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:08:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T20:08:10.932 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:08:11.023 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:08:11.030 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:11.036 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:08:11.042 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:08:11.049 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:08:11.056 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:11.062 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:08:11.068 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:08:11.115 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T20:08:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T20:08:11.237 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-26T20:08:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T20:08:11.435 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T20:08:11.530 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T20:08:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T20:08:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T20:08:11.770 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T20:08:11.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T20:08:11.839 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T20:08:11.852 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T20:08:11.885 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T20:08:11.912 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T20:08:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T20:08:12.135 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T20:08:12.141 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:08:12.148 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T20:08:12.219 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T20:08:12.238 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:08:12.284 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:12.293 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:08:12.304 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:08:12.314 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:08:12.321 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:12.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:08:12.434 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:08:12.445 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:12.455 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:08:12.465 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:12.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T20:08:12.487 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:08:12.498 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:08:12.508 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:08:12.518 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:12.558 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T20:08:12.598 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:08:12.607 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:08:12.616 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:08:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:08:12.654 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:08:12.665 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:08:12.707 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:12.738 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:08:12.748 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:08:12.757 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:08:12.767 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:12.778 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:08:12.787 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:08:12.797 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:12.826 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:12.858 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:13.149 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T20:08:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T20:08:13.267 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:08:13.436 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:08:13.468 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:08:13.581 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T20:08:13.611 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:08:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T20:08:13.692 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T20:08:13.772 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T20:08:13.813 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T20:08:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T20:08:13.947 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T20:08:13.984 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:08:14.002 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:08:14.013 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:08:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T20:08:14.117 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:08:14.123 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:08:14.142 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:08:14.207 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:08:14.260 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T20:08:14.380 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T20:08:14.420 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T20:08:14.467 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T20:08:14.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T20:08:14.631 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T20:08:14.693 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T20:08:14.736 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T20:08:14.836 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T20:08:14.916 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T20:08:14.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T20:08:15.020 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T20:08:15.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T20:08:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T20:08:15.273 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T20:08:15.328 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T20:08:15.363 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T20:08:15.481 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T20:08:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T20:08:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T20:08:15.815 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T20:08:15.894 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T20:08:16.572 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T20:08:16.673 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T20:08:16.730 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T20:08:16.779 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T20:08:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T20:08:16.889 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T20:08:17.192 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T20:08:17.227 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T20:08:17.270 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T20:08:17.281 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T20:08:17.335 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T20:08:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T20:08:17.378 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T20:08:17.395 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T20:08:17.474 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T20:08:17.522 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T20:08:17.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T20:08:17.579 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T20:08:17.625 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T20:08:17.710 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T20:08:17.719 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T20:08:17.729 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T20:08:17.785 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T20:08:17.854 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T20:08:18.055 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T20:08:18.117 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T20:08:18.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T20:08:18.212 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T20:08:18.277 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:18.315 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:18.335 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T20:08:18.441 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T20:08:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T20:08:18.511 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T20:08:18.563 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T20:08:18.757 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T20:08:18.948 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T20:08:18.992 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T20:08:19.032 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T20:08:19.096 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T20:08:19.165 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T20:08:19.172 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T20:08:19.230 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T20:08:19.281 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T20:08:19.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T20:08:19.328 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T20:08:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T20:08:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T20:08:19.418 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T20:08:19.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T20:08:19.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T20:08:19.555 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:08:19.564 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T20:08:19.573 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:08:19.590 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:08:19.600 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:08:19.678 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T20:08:19.691 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:08:19.750 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T20:08:19.763 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:08:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:08:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T20:08:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T20:08:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T20:08:19.893 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T20:08:19.950 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T20:08:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T20:08:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T20:08:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:08:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:08:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:08:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T20:08:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T20:08:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:08:20.102 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T20:08:20.109 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T20:08:20.118 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T20:08:20.124 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T20:08:20.130 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T20:08:20.137 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T20:08:20.143 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T20:08:20.184 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T20:08:20.284 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T20:08:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T20:08:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T20:08:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T20:08:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T20:08:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T20:08:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T20:08:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T20:08:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T20:08:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T20:08:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T20:08:20.423 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T20:08:20.430 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T20:08:20.440 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T20:08:20.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T20:08:20.459 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T20:08:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T20:08:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T20:08:20.619 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T20:08:20.628 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T20:08:20.637 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T20:08:20.648 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T20:08:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T20:08:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T20:08:20.677 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T20:08:20.687 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T20:08:20.748 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T20:08:20.759 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T20:08:20.769 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T20:08:20.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T20:08:20.789 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T20:08:20.797 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T20:08:20.808 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T20:08:20.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T20:08:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T20:08:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T20:08:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T20:08:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T20:08:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T20:08:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T20:08:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T20:08:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T20:08:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T20:08:21.083 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T20:08:21.089 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T20:08:21.096 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T20:08:21.102 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T20:08:21.114 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T20:08:21.121 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T20:08:21.127 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T20:08:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T20:08:21.259 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T20:08:21.318 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T20:08:21.329 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T20:08:21.339 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T20:08:21.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T20:08:21.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T20:08:21.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T20:08:21.378 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T20:08:21.387 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T20:08:21.424 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T20:08:21.433 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T20:08:21.443 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T20:08:21.452 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T20:08:21.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T20:08:21.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T20:08:21.481 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T20:08:21.543 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T20:08:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T20:08:21.718 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T20:08:21.727 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T20:08:21.736 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T20:08:21.746 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T20:08:21.757 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T20:08:21.767 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T20:08:21.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T20:08:21.786 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T20:08:21.833 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T20:08:21.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T20:08:21.845 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T20:08:21.851 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T20:08:21.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T20:08:21.868 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T20:08:21.876 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T20:08:21.936 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T20:08:21.976 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T20:08:22.008 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T20:08:22.015 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T20:08:22.022 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T20:08:22.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T20:08:22.037 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T20:08:22.043 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T20:08:22.050 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T20:08:22.055 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T20:08:22.108 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T20:08:22.114 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T20:08:22.124 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T20:08:22.134 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T20:08:22.143 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T20:08:22.153 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T20:08:22.161 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:08:22.194 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:08:22.292 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T20:08:22.335 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T20:08:22.345 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T20:08:22.354 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T20:08:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T20:08:22.372 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T20:08:22.384 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T20:08:22.394 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T20:08:22.403 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T20:08:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T20:08:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T20:08:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T20:08:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T20:08:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T20:08:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T20:08:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T20:08:22.568 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T20:08:22.601 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T20:08:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T20:08:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T20:08:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T20:08:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T20:08:22.718 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T20:08:22.726 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T20:08:22.732 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T20:08:22.738 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T20:08:22.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T20:08:22.785 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T20:08:22.794 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T20:08:22.801 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T20:08:22.808 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T20:08:22.816 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T20:08:22.826 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T20:08:22.918 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T20:08:22.987 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:08:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T20:08:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:08:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:23.076 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-04-26T20:08:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T20:08:23.113 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T20:08:23.157 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-26T20:08:23.167 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T20:08:23.176 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T20:08:23.185 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T20:08:23.194 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:08:23.203 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.214 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.267 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.327 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.365 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.374 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.390 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.398 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.406 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.412 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.420 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.471 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.477 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.484 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.491 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.497 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.503 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.510 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.686 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.697 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.702 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:23.708 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T20:08:23.715 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T20:08:23.721 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:08:23.727 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:08:23.736 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:08:23.790 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T20:08:23.802 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:08:23.810 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T20:08:23.822 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T20:08:23.832 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:08:23.842 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:08:23.852 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.907 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:23.956 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.005 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:08:24.016 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:08:24.032 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:08:24.042 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:08:24.052 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:08:24.061 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.072 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.082 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:08:24.143 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.153 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T20:08:24.162 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:08:24.173 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T20:08:24.183 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T20:08:24.194 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:08:24.203 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T20:08:24.291 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T20:08:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T20:08:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:08:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:08:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T20:08:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:08:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T20:08:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T20:08:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T20:08:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T20:08:24.449 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T20:08:24.456 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T20:08:24.534 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:08:24.541 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T20:08:24.548 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:08:24.555 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:08:24.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:08:24.609 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.640 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.681 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:24.690 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:08:24.699 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:08:24.709 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:08:24.716 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:08:24.725 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T20:08:24.734 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T20:08:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:08:24.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:08:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:08:24.869 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T20:08:24.879 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T20:08:24.885 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:08:24.890 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:08:24.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:08:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:08:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:08:25.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:08:25.046 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:08:25.052 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:08:25.059 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:08:25.065 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:08:25.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:08:25.077 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:08:25.083 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:08:25.123 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:08:25.130 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:08:25.192 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:08:25.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:08:25.211 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T20:08:25.220 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:08:25.229 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:08:25.307 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:08:25.314 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:08:25.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T20:08:25.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:08:25.369 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:08:25.378 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:08:25.386 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:08:25.395 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T20:08:25.404 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:08:25.413 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:25.465 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:25.475 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:08:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:08:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:08:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:08:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:08:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:08:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:08:25.650 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:08:25.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:08:25.662 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:08:25.670 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T20:08:25.676 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:08:25.681 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:08:25.687 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:08:25.693 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:08:25.732 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T20:08:25.741 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T20:08:25.784 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T20:08:25.790 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:25.797 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:25.808 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:08:25.882 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:08:25.925 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:08:25.965 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T20:08:25.974 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T20:08:25.981 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:08:25.986 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T20:08:25.992 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:08:25.999 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-26T20:08:26.014 DEBUG:teuthology.parallel:result is None 2024-04-26T20:08:26.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T20:08:26.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T20:08:26.076 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T20:08:26.126 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T20:08:26.136 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T20:08:26.145 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T20:08:26.151 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T20:08:26.158 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T20:08:26.242 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T20:08:26.277 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T20:08:26.321 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T20:08:26.330 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T20:08:26.340 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T20:08:26.350 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T20:08:26.360 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T20:08:26.366 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T20:08:26.373 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T20:08:26.378 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:08:26.420 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T20:08:26.427 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T20:08:26.469 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T20:08:26.478 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T20:08:26.487 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:08:26.497 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T20:08:26.505 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T20:08:26.575 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:08:26.625 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T20:08:26.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T20:08:26.674 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T20:08:26.685 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T20:08:26.694 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T20:08:26.704 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T20:08:26.713 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T20:08:26.721 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:08:26.732 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:08:26.778 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:08:26.788 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T20:08:26.844 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T20:08:26.850 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:08:26.859 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T20:08:26.868 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T20:08:26.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T20:08:26.942 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T20:08:27.064 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T20:08:27.142 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T20:08:27.148 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T20:08:27.158 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T20:08:27.170 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T20:08:27.232 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T20:08:27.278 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T20:08:27.285 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T20:08:27.293 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T20:08:27.358 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T20:08:27.368 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T20:08:27.378 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T20:08:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T20:08:27.396 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T20:08:27.402 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T20:08:27.409 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T20:08:27.451 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T20:08:27.457 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T20:08:27.498 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T20:08:27.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T20:08:27.514 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T20:08:27.584 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T20:08:27.590 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T20:08:27.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T20:08:27.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T20:08:27.680 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T20:08:27.720 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T20:08:27.726 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T20:08:27.732 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T20:08:27.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T20:08:27.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T20:08:27.754 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T20:08:27.769 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T20:08:27.809 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T20:08:27.819 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T20:08:27.864 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T20:08:27.931 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T20:08:27.937 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T20:08:27.944 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T20:08:27.951 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T20:08:28.009 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T20:08:28.014 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T20:08:28.027 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T20:08:28.073 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T20:08:28.083 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T20:08:28.089 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T20:08:28.095 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T20:08:28.101 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T20:08:28.109 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T20:08:28.115 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T20:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T20:08:28.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T20:08:28.214 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T20:08:28.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T20:08:28.275 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T20:08:28.280 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T20:08:28.286 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T20:08:28.373 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T20:08:28.379 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T20:08:28.389 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T20:08:28.431 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T20:08:28.440 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T20:08:28.446 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T20:08:28.452 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T20:08:28.458 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T20:08:28.464 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T20:08:28.477 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T20:08:28.516 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T20:08:28.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T20:08:28.588 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T20:08:28.598 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T20:08:28.609 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T20:08:28.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T20:08:28.636 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T20:08:28.689 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T20:08:28.699 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T20:08:28.706 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T20:08:28.764 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T20:08:28.772 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T20:08:28.780 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T20:08:28.786 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T20:08:28.795 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T20:08:28.802 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T20:08:28.811 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T20:08:28.866 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T20:08:28.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T20:08:28.914 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T20:08:28.920 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T20:08:28.929 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T20:08:28.941 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T20:08:28.950 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T20:08:29.004 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T20:08:29.014 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T20:08:29.023 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T20:08:29.089 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T20:08:29.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T20:08:29.173 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T20:08:29.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T20:08:29.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T20:08:29.203 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T20:08:29.212 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:08:29.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:08:29.272 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T20:08:29.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T20:08:29.317 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T20:08:29.326 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T20:08:29.337 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T20:08:29.346 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T20:08:29.423 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T20:08:29.433 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T20:08:29.482 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T20:08:29.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T20:08:29.539 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T20:08:29.548 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T20:08:29.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T20:08:29.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T20:08:29.568 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T20:08:29.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T20:08:29.616 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T20:08:29.636 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T20:08:29.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T20:08:29.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T20:08:29.752 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T20:08:29.804 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T20:08:29.813 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T20:08:29.823 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T20:08:29.832 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T20:08:29.842 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T20:08:29.906 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T20:08:29.918 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T20:08:29.929 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T20:08:29.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T20:08:29.949 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T20:08:29.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T20:08:29.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T20:08:30.032 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T20:08:30.042 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:08:30.091 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T20:08:30.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:08:30.112 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:30.175 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-04-26T20:08:30.186 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.198 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.207 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T20:08:30.217 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T20:08:30.226 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-04-26T20:08:30.237 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T20:08:30.273 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T20:08:30.313 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T20:08:30.322 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:08:30.332 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.341 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.399 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.493 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.500 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.559 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.567 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.574 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.581 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.595 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.638 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.650 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.658 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.665 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.671 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.678 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.684 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.749 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.755 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.801 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.814 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:30.858 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:08:30.866 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T20:08:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T20:08:30.886 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:08:30.897 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:08:30.907 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:08:30.947 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T20:08:30.957 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:08:30.968 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T20:08:30.977 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T20:08:31.063 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:08:31.073 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:08:31.082 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.140 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.147 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.193 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:08:31.199 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:08:31.205 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:08:31.212 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:08:31.218 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:08:31.225 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.231 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.239 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:08:31.245 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.252 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T20:08:31.260 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:08:31.305 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T20:08:31.380 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T20:08:31.386 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:08:31.391 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T20:08:31.482 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T20:08:31.489 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T20:08:31.530 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:08:31.536 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:08:31.543 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T20:08:31.549 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:08:31.556 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T20:08:31.563 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T20:08:31.570 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T20:08:31.578 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T20:08:31.642 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T20:08:31.650 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T20:08:31.660 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:08:31.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T20:08:31.754 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:08:31.764 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:08:31.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:08:31.852 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.862 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.922 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:31.965 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:08:31.975 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:08:32.045 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:08:32.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:08:32.063 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T20:08:32.072 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T20:08:32.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:08:32.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:08:32.161 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:08:32.170 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T20:08:32.180 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T20:08:32.191 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:08:32.200 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:08:32.210 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:08:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:08:32.296 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:08:32.355 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:08:32.430 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:08:32.436 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:08:32.444 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:08:32.451 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:08:32.457 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:08:32.469 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:08:32.476 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:08:32.532 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:08:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:08:32.652 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:08:32.658 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:08:32.665 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T20:08:32.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:08:32.678 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:08:32.731 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:08:32.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:08:32.804 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T20:08:32.831 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:08:32.839 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:08:32.846 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:08:32.853 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:08:32.859 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T20:08:32.865 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:08:32.871 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:32.921 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:08:32.939 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:08:32.950 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:08:32.959 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:32.969 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:08:32.978 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:08:33.040 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:08:33.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:08:33.112 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:08:33.118 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:08:33.157 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:08:33.199 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T20:08:33.208 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:08:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:08:33.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:08:33.226 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:08:33.327 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T20:08:33.335 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T20:08:33.344 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T20:08:33.353 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:33.362 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:33.371 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:08:33.382 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:08:33.434 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:08:33.445 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:08:33.488 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T20:08:33.497 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T20:08:33.506 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:08:33.515 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T20:08:33.526 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-26T20:08:33.534 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-04-26T20:08:33.545 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:08:33.554 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:08:33.604 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T20:08:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:08:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T20:08:33.750 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:08:33.823 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:08:33.844 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:33.853 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:08:33.931 DEBUG:teuthology.parallel:result is None 2024-04-26T20:08:43.101 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T20:08:43.112 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-04-26T20:08:43.122 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-04-26T20:08:43.136 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-04-26T20:08:43.151 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-04-26T20:08:43.165 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-04-26T20:08:43.179 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-04-26T20:08:43.187 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-04-26T20:08:43.201 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:43.368 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:08:43.418 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T20:08:43.455 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:43.464 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T20:08:43.476 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:08:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T20:08:45.185 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:45.197 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:08:45.209 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:08:45.262 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:08:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:08:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T20:08:45.538 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:45.548 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:08:45.558 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:08:45.569 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:08:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:08:46.159 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T20:08:46.175 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:08:46.273 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:08:46.288 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:08:46.303 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:46.320 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T20:08:46.409 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T20:08:46.424 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T20:08:46.603 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T20:08:46.658 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T20:08:46.744 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T20:08:46.861 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:08:47.052 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:08:47.110 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T20:08:47.149 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T20:08:47.187 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T20:08:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:08:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T20:08:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T20:08:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T20:08:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:08:49.405 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T20:08:49.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:08:50.576 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T20:08:50.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:08:50.753 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T20:08:50.930 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T20:08:50.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:08:51.031 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T20:08:51.041 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:51.050 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:08:51.059 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:08:51.066 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:08:51.071 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:51.092 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:08:51.202 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T20:08:51.275 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T20:08:51.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T20:08:52.315 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T20:08:52.353 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:08:52.419 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T20:08:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:08:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:08:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:08:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:08:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T20:08:52.547 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:08:52.628 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:52.638 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:08:52.712 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T20:08:52.832 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T20:08:52.857 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:08:52.917 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:08:52.996 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:53.063 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:08:53.131 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T20:08:53.141 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:08:53.150 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:08:53.205 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:08:53.217 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:08:53.228 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:08:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T20:08:58.265 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T20:08:58.358 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T20:08:58.400 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T20:08:58.448 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T20:08:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T20:08:58.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T20:08:58.879 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T20:08:59.805 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:59.861 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:08:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T20:09:01.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T20:09:01.398 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T20:09:01.487 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T20:09:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T20:09:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T20:09:01.811 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:09:01.868 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T20:09:01.922 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:09:01.930 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:09:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T20:09:02.219 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:09:02.545 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:09:02.552 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T20:09:02.561 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:09:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T20:09:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T20:09:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T20:09:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T20:09:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T20:09:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T20:09:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T20:09:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T20:09:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T20:09:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T20:09:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T20:09:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T20:09:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T20:09:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T20:09:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T20:09:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T20:09:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T20:09:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T20:09:08.756 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T20:09:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T20:09:08.847 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T20:09:08.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T20:09:08.872 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T20:09:08.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T20:09:08.892 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T20:09:08.901 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T20:09:08.910 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T20:09:08.919 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T20:09:08.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T20:09:08.951 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T20:09:08.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T20:09:08.969 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T20:09:08.979 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T20:09:08.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T20:09:08.995 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T20:09:09.043 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T20:09:09.070 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T20:09:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T20:09:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T20:09:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T20:09:09.165 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T20:09:09.171 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T20:09:09.178 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T20:09:09.186 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T20:09:09.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T20:09:09.200 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T20:09:09.207 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T20:09:09.213 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T20:09:09.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T20:09:09.226 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T20:09:09.232 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T20:09:09.239 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T20:09:09.293 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T20:09:09.343 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T20:09:09.454 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T20:09:09.465 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T20:09:09.476 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T20:09:09.486 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T20:09:09.497 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T20:09:09.506 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T20:09:09.516 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T20:09:09.525 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T20:09:09.535 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T20:09:09.544 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T20:09:09.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T20:09:09.563 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T20:09:09.572 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T20:09:09.583 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T20:09:09.591 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T20:09:09.643 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T20:09:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T20:09:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T20:09:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T20:09:09.813 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T20:09:09.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T20:09:09.830 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T20:09:09.840 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T20:09:09.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T20:09:09.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T20:09:09.862 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T20:09:09.875 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T20:09:09.881 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T20:09:09.934 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T20:09:09.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T20:09:09.949 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T20:09:10.008 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T20:09:10.014 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T20:09:10.150 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T20:09:10.158 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T20:09:10.164 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T20:09:10.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T20:09:10.176 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T20:09:10.182 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T20:09:10.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T20:09:10.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T20:09:10.200 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T20:09:10.208 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T20:09:10.215 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T20:09:10.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T20:09:10.232 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T20:09:10.242 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T20:09:10.253 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T20:09:10.317 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T20:09:10.330 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T20:09:10.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T20:09:10.408 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T20:09:10.417 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T20:09:10.426 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T20:09:10.438 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T20:09:10.447 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T20:09:10.458 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T20:09:10.467 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T20:09:10.477 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T20:09:10.534 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T20:09:10.543 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T20:09:10.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T20:09:10.562 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T20:09:10.569 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T20:09:10.577 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T20:09:10.642 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T20:09:10.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T20:09:10.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T20:09:10.734 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T20:09:10.742 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T20:09:10.749 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T20:09:10.755 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T20:09:10.760 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T20:09:10.767 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T20:09:10.773 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T20:09:10.779 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T20:09:10.875 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T20:09:10.896 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T20:09:10.902 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T20:09:10.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T20:09:10.913 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T20:09:10.919 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T20:09:10.973 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T20:09:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T20:09:11.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T20:09:11.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T20:09:11.085 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T20:09:11.096 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T20:09:11.105 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T20:09:11.115 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T20:09:11.124 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T20:09:11.134 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T20:09:11.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T20:09:11.208 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T20:09:11.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T20:09:11.226 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T20:09:11.235 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T20:09:11.244 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T20:09:11.253 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T20:09:11.309 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T20:09:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T20:09:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T20:09:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:09:11.369 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-26T20:09:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T20:09:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T20:09:11.422 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-26T20:09:11.480 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T20:09:11.487 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T20:09:11.493 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T20:09:11.499 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:09:11.505 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.511 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.517 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.696 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.722 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.741 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.750 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.760 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.769 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.778 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.843 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.854 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.936 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T20:09:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T20:09:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T20:09:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:09:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:09:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:09:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T20:09:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:09:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T20:09:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T20:09:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:09:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:09:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.184 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.222 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:09:12.228 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.230 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T20:09:12.231 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:09:12.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:09:12.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:09:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T20:09:12.235 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:09:12.236 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:09:12.237 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:09:12.238 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T20:09:12.238 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T20:09:12.238 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:09:12.238 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T20:09:12.238 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:09:12.238 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-26T20:09:12.242 DEBUG:teuthology.parallel:result is None 2024-04-26T20:09:12.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:12.391 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:09:12.444 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T20:09:12.445 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T20:09:12.445 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T20:09:12.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:12.592 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T20:09:12.618 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T20:09:12.618 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T20:09:12.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:12.879 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:09:12.905 INFO:teuthology.orchestra.run.smithi139.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T20:09:12.905 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T20:09:12.906 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T20:09:12.907 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T20:09:12.908 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:09:12.908 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:09:12.978 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:09:12.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:09:13.010 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:09:13.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:09:13.040 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T20:09:13.040 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:09:13.040 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:09:13.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:09:13.211 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:09:13.212 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:09:13.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:09:13.310 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:09:13.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:09:13.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:09:13.405 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T20:09:13.406 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:09:13.406 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:09:13.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:09:13.576 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:09:13.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:09:13.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:09:13.666 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:09:13.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:09:13.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:09:13.762 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T20:09:13.763 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:09:13.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:09:13.823 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:09:13.926 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:09:13.926 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:09:13.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:09:14.013 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:09:14.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:09:14.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:09:14.100 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T20:09:14.201 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-04-26T20:09:14.201 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:14.202 INFO:tasks.cephadm:Cluster fsid is da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:09:14.203 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T20:09:14.203 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.135', 'mon.c': '172.21.15.139'} 2024-04-26T20:09:14.203 INFO:tasks.cephadm:First mon is mon.a on smithi082 2024-04-26T20:09:14.203 INFO:tasks.cephadm:First mgr is x 2024-04-26T20:09:14.203 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T20:09:14.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-04-26T20:09:14.266 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-04-26T20:09:14.289 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2024-04-26T20:09:14.313 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-26T20:09:14.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:14.588 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78918/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3306-gbc612ffb', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3306.gbc612ffb'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-26 13:02:42.256491', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240426.111959', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-26T20:09:14.724 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240426.111959, sha1 bc612ffb9c1d5bc27536bc917a705262a36d4387 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:09:14.726 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm 2024-04-26T20:09:14.726 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:15.201 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 781514 Apr 26 20:09 /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:15.201 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:16.218 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 781514 Apr 26 20:09 /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:16.219 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:16.856 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r--. 1 ubuntu ubuntu 781514 Apr 26 20:09 /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:16.862 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:16.914 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:16.942 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:09:17.036 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 on all hosts... 2024-04-26T20:09:17.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 pull 2024-04-26T20:09:17.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 pull 2024-04-26T20:09:17.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 pull 2024-04-26T20:09:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:09:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:09:19.567 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:10:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-26T20:10:01.060 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:10:01.062 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07", 2024-04-26T20:10:01.062 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-04-26T20:10:01.062 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2" 2024-04-26T20:10:01.063 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-26T20:10:01.063 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07", 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2" 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:10:09.107 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:10:15.030 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T20:10:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:10:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07", 2024-04-26T20:10:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2024-04-26T20:10:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2" 2024-04-26T20:10:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-04-26T20:10:15.031 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T20:10:15.055 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-04-26T20:10:15.147 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-04-26T20:10:15.180 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2024-04-26T20:10:15.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-04-26T20:10:15.292 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-04-26T20:10:15.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2024-04-26T20:10:15.342 INFO:tasks.cephadm:Writing seed config... 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-26T20:10:15.344 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T20:10:15.345 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T20:10:15.346 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T20:10:15.347 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T20:10:15.347 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T20:10:15.347 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T20:10:15.347 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T20:10:15.347 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-26T20:10:15.347 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-26T20:10:15.347 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:10:15.348 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T20:10:15.404 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = da6438ae-0408-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T20:10:15.404 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service 2024-04-26T20:10:15.452 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x.service 2024-04-26T20:10:15.497 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T20:10:15.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 -v bootstrap --fsid da6438ae-0408-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:10:15.764 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:10:15.764 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387', '-v', 'bootstrap', '--fsid', 'da6438ae-0408-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-04-26T20:10:15.765 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T20:10:15.765 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-04-26T20:10:15.840 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:10:15.840 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-04-26T20:10:15.840 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-04-26T20:10:15.857 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T20:10:15.857 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T20:10:15.872 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T20:10:15.873 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-26T20:10:15.897 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-04-26T20:10:15.918 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-04-26T20:10:15.919 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-04-26T20:10:15.919 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-04-26T20:10:15.989 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:10:15.990 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T20:10:15.990 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-04-26T20:10:15.990 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-04-26T20:10:16.010 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T20:10:16.010 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T20:10:16.032 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T20:10:16.032 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-26T20:10:16.057 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-04-26T20:10:16.080 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-04-26T20:10:16.080 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-04-26T20:10:16.080 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-04-26T20:10:16.080 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:16.081 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 139651393801376 on /run/cephadm/da6438ae-0408-11ef-bc93-c7b262605968.lock 2024-04-26T20:10:16.081 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 139651393801376 acquired on /run/cephadm/da6438ae-0408-11ef-bc93-c7b262605968.lock 2024-04-26T20:10:16.082 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-04-26T20:10:16.083 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-04-26T20:10:16.084 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-04-26T20:10:16.098 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-04-26T20:10:16.099 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-04-26T20:10:16.111 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T20:10:16.112 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-26T20:10:16.112 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1705sec hoplimit 64 pref medium 2024-04-26T20:10:16.123 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T20:10:16.123 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T20:10:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T20:10:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-26T20:10:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-04-26T20:10:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T20:10:16.126 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-04-26T20:10:16.126 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-04-26T20:10:16.127 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T20:10:16.129 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T20:10:16.132 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:10:16.823 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 2024-04-26T20:10:16.823 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387... 2024-04-26T20:10:16.823 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T20:10:16.823 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:f340d36a00bce3feed0ad509aeafc9092c1c625bf553b8a613c380a79149b87e 2024-04-26T20:10:16.823 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T20:10:16.824 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 2024-04-26T20:10:16.824 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T20:10:18.110 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:10:18.111 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:10:18.111 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T20:10:19.467 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-04-26T20:10:19.467 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-04-26T20:10:20.636 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQArCixm4QFNOBAAtelRGp4B3lJOX7+xvk2ujA== 2024-04-26T20:10:21.902 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAtCixmTEdSCxAA/rc0RiYoZM9u4jufIBRrXw== 2024-04-26T20:10:23.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAuCixmpZeZHBAAMI2TGWTKZiYB5TC5PaNLGQ== 2024-04-26T20:10:23.197 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-04-26T20:10:24.409 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:10:24.410 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-04-26T20:10:25.641 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2024-04-26T20:10:25.992 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T20:10:26.225 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T20:10:26.514 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-da6438ae-0408-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-da6438ae-0408-11ef-bc93-c7b262605968.target. 2024-04-26T20:10:26.514 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-da6438ae-0408-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-da6438ae-0408-11ef-bc93-c7b262605968.target. 2024-04-26T20:10:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a 2024-04-26T20:10:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-26T20:10:27.379 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-da6438ae-0408-11ef-bc93-c7b262605968.target.wants/ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-da6438ae-0408-11ef-bc93-c7b262605968@.service. 2024-04-26T20:10:28.084 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:27 smithi082 podman[27708]: 2024-04-26 20:10:27.886022622 +0000 UTC m=+0.183405696 container create e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T20:10:28.345 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:10:28.345 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-26T20:10:28.362 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:10:28.362 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-26T20:10:28.362 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-26T20:10:28.362 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T20:10:28.363 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-04-26T20:10:28.363 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-04-26T20:10:28.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:28 smithi082 podman[27708]: 2024-04-26 20:10:28.223060883 +0000 UTC m=+0.520443963 container init e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T20:10:28.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:28 smithi082 podman[27708]: 2024-04-26 20:10:28.233365918 +0000 UTC m=+0.530748999 container start e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T20:10:28.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:28 smithi082 bash[27708]: e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd 2024-04-26T20:10:28.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:28 smithi082 ceph-mon[27727]: mkfs da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:28.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:28 smithi082 systemd[1]: Started Ceph mon.a for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:10:28.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:28 smithi082 ceph-mon[27727]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: monmap epoch 1 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: last_changed 2024-04-26T20:10:23.735385+0000 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: min_mon_release 19 (squid) 2024-04-26T20:10:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: election_strategy: 1 2024-04-26T20:10:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:10:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: fsmap 2024-04-26T20:10:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T20:10:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: mgrmap e1: no daemons active 2024-04-26T20:10:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:29 smithi082 ceph-mon[27727]: from='client.? 172.21.15.82:0/3270393254' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-26T20:10:29.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T20:10:29.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:29.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T20:10:29.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.747323s) 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T20:10:29.756 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.966+0000 7f24e3200700 1 Processor -- start 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.966+0000 7f24e3200700 1 -- start start 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.966+0000 7f24e3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e4111d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.966+0000 7f24e3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24e41122d0 con 0x7f24e40832e0 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.968+0000 7f24e1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e4111d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.968+0000 7f24e1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e4111d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47090/0 (socket says 172.21.15.82:47090) 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.968+0000 7f24e1e00700 1 -- 172.21.15.82:0/1338791154 learned_addr learned my addr 172.21.15.82:0/1338791154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.968+0000 7f24e1e00700 1 -- 172.21.15.82:0/1338791154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e4112450 con 0x7f24e40832e0 2024-04-26T20:10:29.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.969+0000 7f24e1e00700 1 --2- 172.21.15.82:0/1338791154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e4111d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098a0 tx=0x7f24d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8f253e0d70f1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.969+0000 7f24e0a00700 1 -- 172.21.15.82:0/1338791154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d4004160 con 0x7f24e40832e0 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.969+0000 7f24e0a00700 1 -- 172.21.15.82:0/1338791154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d4004300 con 0x7f24e40832e0 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.969+0000 7f24e0a00700 1 -- 172.21.15.82:0/1338791154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d40036a0 con 0x7f24e40832e0 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 -- 172.21.15.82:0/1338791154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 msgr2=0x7f24e4111d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 --2- 172.21.15.82:0/1338791154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e4111d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098a0 tx=0x7f24d4009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 -- 172.21.15.82:0/1338791154 shutdown_connections 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 --2- 172.21.15.82:0/1338791154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e4111d00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 -- 172.21.15.82:0/1338791154 >> 172.21.15.82:0/1338791154 conn(0x7f24e407e0d0 msgr2=0x7f24e4080510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 -- 172.21.15.82:0/1338791154 shutdown_connections 2024-04-26T20:10:29.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.970+0000 7f24e3200700 1 -- 172.21.15.82:0/1338791154 wait complete. 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.971+0000 7f24e3200700 1 Processor -- start 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.971+0000 7f24e3200700 1 -- start start 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.972+0000 7f24e3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e41a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.972+0000 7f24e3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24e4112980 con 0x7f24e40832e0 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.972+0000 7f24e1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e41a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.972+0000 7f24e1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e41a27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47106/0 (socket says 172.21.15.82:47106) 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.972+0000 7f24e1e00700 1 -- 172.21.15.82:0/3270393254 learned_addr learned my addr 172.21.15.82:0/3270393254 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.972+0000 7f24e1e00700 1 -- 172.21.15.82:0/3270393254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e41a2ce0 con 0x7f24e40832e0 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24e1e00700 1 --2- 172.21.15.82:0/3270393254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e41a27a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009fb0 tx=0x7f24d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d4003de0 con 0x7f24e40832e0 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d4011630 con 0x7f24e40832e0 2024-04-26T20:10:29.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d4011930 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e41a2f70 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e41a5c60 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.973+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24d4011ad0 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.974+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f24d401b450 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.974+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e4064a80 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:28.977+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f24d4004260 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.056+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f24e402e5e0 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.057+0000 7f24daa00700 1 -- 172.21.15.82:0/3270393254 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f24d4025480 con 0x7f24e40832e0 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 msgr2=0x7f24e41a27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 --2- 172.21.15.82:0/3270393254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e41a27a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009fb0 tx=0x7f24d4004750 comp rx=0 tx=0).stop 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 shutdown_connections 2024-04-26T20:10:29.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 --2- 172.21.15.82:0/3270393254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e40832e0 0x7f24e41a27a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:29.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 >> 172.21.15.82:0/3270393254 conn(0x7f24e407e0d0 msgr2=0x7f24e4080400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:29.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 shutdown_connections 2024-04-26T20:10:29.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:29.059+0000 7f24e3200700 1 -- 172.21.15.82:0/3270393254 wait complete. 2024-04-26T20:10:29.761 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-04-26T20:10:29.761 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T20:10:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:30 smithi082 ceph-mon[27727]: from='client.? 172.21.15.82:0/3297358214' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T20:10:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:30 smithi082 ceph-mon[27727]: from='client.? 172.21.15.82:0/3297358214' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T20:10:31.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:31.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T20:10:31.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:31.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T20:10:31.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.339+0000 7fd18c400700 1 Processor -- start 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.339+0000 7fd18c400700 1 -- start start 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.339+0000 7fd18c400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:31.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.339+0000 7fd18c400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd184083500 con 0x7fd18410fcf0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.340+0000 7fd189a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.340+0000 7fd189a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47116/0 (socket says 172.21.15.82:47116) 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.340+0000 7fd189a00700 1 -- 172.21.15.82:0/353248434 learned_addr learned my addr 172.21.15.82:0/353248434 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.340+0000 7fd189a00700 1 -- 172.21.15.82:0/353248434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd184112620 con 0x7fd18410fcf0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.341+0000 7fd189a00700 1 --2- 172.21.15.82:0/353248434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841120e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd1780098a0 tx=0x7fd178009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845975b409197555 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.341+0000 7fd183e00700 1 -- 172.21.15.82:0/353248434 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178004160 con 0x7fd18410fcf0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.341+0000 7fd183e00700 1 -- 172.21.15.82:0/353248434 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178004300 con 0x7fd18410fcf0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.341+0000 7fd183e00700 1 -- 172.21.15.82:0/353248434 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1780036a0 con 0x7fd18410fcf0 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 -- 172.21.15.82:0/353248434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 msgr2=0x7fd1841120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:31.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 --2- 172.21.15.82:0/353248434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841120e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd1780098a0 tx=0x7fd178009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 -- 172.21.15.82:0/353248434 shutdown_connections 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 --2- 172.21.15.82:0/353248434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841120e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 -- 172.21.15.82:0/353248434 >> 172.21.15.82:0/353248434 conn(0x7fd18407e2a0 msgr2=0x7fd1840806c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 -- 172.21.15.82:0/353248434 shutdown_connections 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.342+0000 7fd18c400700 1 -- 172.21.15.82:0/353248434 wait complete. 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.343+0000 7fd18c400700 1 Processor -- start 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.343+0000 7fd18c400700 1 -- start start 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.344+0000 7fd18c400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841a2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.344+0000 7fd18c400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd184112af0 con 0x7fd18410fcf0 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.344+0000 7fd189a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841a2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.344+0000 7fd189a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841a2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47132/0 (socket says 172.21.15.82:47132) 2024-04-26T20:10:31.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.344+0000 7fd189a00700 1 -- 172.21.15.82:0/3297358214 learned_addr learned my addr 172.21.15.82:0/3297358214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.344+0000 7fd189a00700 1 -- 172.21.15.82:0/3297358214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1841a2e80 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.345+0000 7fd189a00700 1 --2- 172.21.15.82:0/3297358214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841a2940 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd178000c00 tx=0x7fd178004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.345+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178003db0 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.345+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178011630 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.345+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1841a3110 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.345+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178011950 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.345+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1841a5e00 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.346+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd178011af0 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.346+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd17801c450 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.347+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd184064a80 con 0x7fd18410fcf0 2024-04-26T20:10:31.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.349+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd178032020 con 0x7fd18410fcf0 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.425+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fd18402e610 con 0x7fd18410fcf0 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.435+0000 7fd182000700 1 -- 172.21.15.82:0/3297358214 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7fd178004260 con 0x7fd18410fcf0 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.435+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 msgr2=0x7fd1841a2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.435+0000 7fd18c400700 1 --2- 172.21.15.82:0/3297358214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841a2940 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd178000c00 tx=0x7fd178004750 comp rx=0 tx=0).stop 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.437+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 shutdown_connections 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.437+0000 7fd18c400700 1 --2- 172.21.15.82:0/3297358214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd18410fcf0 0x7fd1841a2940 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.437+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 >> 172.21.15.82:0/3297358214 conn(0x7fd18407e2a0 msgr2=0x7fd184080560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.437+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 shutdown_connections 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:30.437+0000 7fd18c400700 1 -- 172.21.15.82:0/3297358214 wait complete. 2024-04-26T20:10:31.148 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-04-26T20:10:34.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:34 smithi082 ceph-mon[27727]: from='client.? 172.21.15.82:0/118277384' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:41.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.312+0000 7f6846800700 1 Processor -- start 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.312+0000 7f6846800700 1 -- start start 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.312+0000 7f6846800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f6840111d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.312+0000 7f6846800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68401122d0 con 0x7f68400832e0 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.313+0000 7f6845400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f6840111d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.313+0000 7f6845400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f6840111d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48552/0 (socket says 172.21.15.82:48552) 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.313+0000 7f6845400700 1 -- 172.21.15.82:0/3194760180 learned_addr learned my addr 172.21.15.82:0/3194760180 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.313+0000 7f6845400700 1 -- 172.21.15.82:0/3194760180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6840112450 con 0x7f68400832e0 2024-04-26T20:10:41.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.314+0000 7f6845400700 1 --2- 172.21.15.82:0/3194760180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f6840111d00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f68340098a0 tx=0x7f6834009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbab6d3af88ca62 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.314+0000 7f683fe00700 1 -- 172.21.15.82:0/3194760180 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6834004160 con 0x7f68400832e0 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.314+0000 7f683fe00700 1 -- 172.21.15.82:0/3194760180 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6834004300 con 0x7f68400832e0 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.314+0000 7f683fe00700 1 -- 172.21.15.82:0/3194760180 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6834011af0 con 0x7f68400832e0 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 -- 172.21.15.82:0/3194760180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 msgr2=0x7f6840111d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 --2- 172.21.15.82:0/3194760180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f6840111d00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f68340098a0 tx=0x7f6834009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 -- 172.21.15.82:0/3194760180 shutdown_connections 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 --2- 172.21.15.82:0/3194760180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f6840111d00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 -- 172.21.15.82:0/3194760180 >> 172.21.15.82:0/3194760180 conn(0x7f684007e0d0 msgr2=0x7f6840080510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 -- 172.21.15.82:0/3194760180 shutdown_connections 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.315+0000 7f6846800700 1 -- 172.21.15.82:0/3194760180 wait complete. 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.316+0000 7f6846800700 1 Processor -- start 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.316+0000 7f6846800700 1 -- start start 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.316+0000 7f6846800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f68401a3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.316+0000 7f6846800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6840113480 con 0x7f68400832e0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.317+0000 7f6845400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f68401a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.317+0000 7f6845400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f68401a3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48566/0 (socket says 172.21.15.82:48566) 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.317+0000 7f6845400700 1 -- 172.21.15.82:0/118277384 learned_addr learned my addr 172.21.15.82:0/118277384 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.317+0000 7f6845400700 1 -- 172.21.15.82:0/118277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68401a3580 con 0x7f68400832e0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.317+0000 7f6845400700 1 --2- 172.21.15.82:0/118277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f68401a3040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6834011ac0 tx=0x7f6834011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6834003970 con 0x7f68400832e0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6834003b10 con 0x7f68400832e0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6834024610 con 0x7f68400832e0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68401a3810 con 0x7f68400832e0 2024-04-26T20:10:41.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68401a6500 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6834024bd0 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.318+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6834019700 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.320+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6840064a80 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.322+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f683402ddf0 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.401+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f68401a6a40 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.402+0000 7f683e000700 1 -- 172.21.15.82:0/118277384 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f683401a9e0 con 0x7f68400832e0 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 msgr2=0x7f68401a3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 --2- 172.21.15.82:0/118277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f68401a3040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6834011ac0 tx=0x7f6834011ba0 comp rx=0 tx=0).stop 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 shutdown_connections 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 --2- 172.21.15.82:0/118277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68400832e0 0x7f68401a3040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 >> 172.21.15.82:0/118277384 conn(0x7f684007e0d0 msgr2=0x7f684007ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 shutdown_connections 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:34.403+0000 7f6846800700 1 -- 172.21.15.82:0/118277384 wait complete. 2024-04-26T20:10:41.247 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-04-26T20:10:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:41 smithi082 systemd[1]: Stopping Ceph mon.a for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:10:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[27723]: 2024-04-26T20:10:41.798+0000 7f0e6dc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:10:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[27723]: 2024-04-26T20:10:41.798+0000 7f0e6dc00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T20:10:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:42 smithi082 podman[27981]: 2024-04-26 20:10:42.035569049 +0000 UTC m=+0.440851976 container died e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:10:42.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:42 smithi082 podman[27981]: 2024-04-26 20:10:42.456093733 +0000 UTC m=+0.861376682 container cleanup e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-26T20:10:42.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:42 smithi082 bash[27981]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a 2024-04-26T20:10:42.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:42 smithi082 podman[27995]: 2024-04-26 20:10:42.720711992 +0000 UTC m=+0.670878770 container remove e3519db8edbdfd1a683459d3432a88902382fd342aff5e0421190c83b16d23fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T20:10:43.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-26T20:10:43.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 systemd[1]: Stopped Ceph mon.a for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:10:43.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service: Consumed 1.964s CPU time. 2024-04-26T20:10:43.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 systemd[1]: Starting Ceph mon.a for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:10:43.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 podman[28087]: 2024-04-26 20:10:43.557804653 +0000 UTC m=+0.033540007 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:10:43.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 podman[28087]: 2024-04-26 20:10:43.67085561 +0000 UTC m=+0.146591001 container create 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-26T20:10:43.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 podman[28087]: 2024-04-26 20:10:43.911362427 +0000 UTC m=+0.387097824 container init 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:10:44.039 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 podman[28087]: 2024-04-26 20:10:43.922175292 +0000 UTC m=+0.397910690 container start 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: pidfile_write: ignore empty --pid-file 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: load: jerasure load: lrc 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Git sha 0 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: DB SUMMARY 2024-04-26T20:10:44.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: DB Session ID: T2GIF4S79FMS21VEFGXR 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104082 ; 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.env: 0x563ca7121cc0 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.info_log: 0x563cd4b85dc0 2024-04-26T20:10:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.statistics: (nil) 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.use_fsync: 0 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:10:44.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.db_log_dir: 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.wal_dir: 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:10:44.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.write_buffer_manager: 0x563cd4b570e0 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.unordered_write: 0 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:10:44.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.row_cache: None 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.wal_filter: None 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.wal_compression: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:10:44.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:10:44.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_open_files: -1 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:10:44.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Compression algorithms supported: 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kZSTD supported: 0 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:10:44.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.merge_operator: 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_filter: None 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563cd4b85f80) 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2024-04-26T20:10:44.199 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x563cd4b891f0 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2024-04-26T20:10:44.200 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:10:44.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression: NoCompression 2024-04-26T20:10:44.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:10:44.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:10:44.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:10:44.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.num_levels: 7 2024-04-26T20:10:44.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:10:44.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:10:44.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:10:44.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T20:10:44.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.ttl: 2592000 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:10:44.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9f8d16db-7544-4ee2-922e-483632cad288 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162243978973, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-26T20:10:44.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162243980862, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99309, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 97255, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13919, "raw_average_key_size": 49, "raw_value_size": 89648, "raw_average_value_size": 319, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714162243, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9f8d16db-7544-4ee2-922e-483632cad288", "db_session_id": "T2GIF4S79FMS21VEFGXR", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162243981024, "job": 1, "event": "recovery_finished"} 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563cd4ca6000 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: DB pointer 0x563cd4c92000 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:10:44.209 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 98.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 98.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-04-26T20:10:44.210 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 14.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 14.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x563cd4b891f0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:44.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???) e1 preinit fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).mds e1 new map 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).mds e1 print_map 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:10:44.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:43 smithi082 ceph-mon[28105]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 bash[28087]: 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 systemd[1]: Started Ceph mon.a for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: monmap epoch 1 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: last_changed 2024-04-26T20:10:23.735385+0000 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: min_mon_release 19 (squid) 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: election_strategy: 1 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: fsmap 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T20:10:44.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:44 smithi082 ceph-mon[28105]: mgrmap e1: no daemons active 2024-04-26T20:10:45.557 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.766+0000 7fa39f800700 1 Processor -- start 2024-04-26T20:10:45.562 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.766+0000 7fa39f800700 1 -- start start 2024-04-26T20:10:45.562 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.767+0000 7fa39f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39807d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.767+0000 7fa39f800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa39807d930 con 0x7fa39807ef00 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.768+0000 7fa39ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39807d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.768+0000 7fa39ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39807d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38306/0 (socket says 172.21.15.82:38306) 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.768+0000 7fa39ce00700 1 -- 172.21.15.82:0/781421491 learned_addr learned my addr 172.21.15.82:0/781421491 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.768+0000 7fa39ce00700 1 -- 172.21.15.82:0/781421491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39807dab0 con 0x7fa39807ef00 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.769+0000 7fa39ce00700 1 --2- 172.21.15.82:0/781421491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39807d360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0098a0 tx=0x7fa38c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5d09e5a533884 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.769+0000 7fa397400700 1 -- 172.21.15.82:0/781421491 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa38c004160 con 0x7fa39807ef00 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.769+0000 7fa397400700 1 -- 172.21.15.82:0/781421491 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa38c004300 con 0x7fa39807ef00 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.769+0000 7fa397400700 1 -- 172.21.15.82:0/781421491 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa38c011af0 con 0x7fa39807ef00 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 -- 172.21.15.82:0/781421491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 msgr2=0x7fa39807d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 --2- 172.21.15.82:0/781421491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39807d360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0098a0 tx=0x7fa38c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 -- 172.21.15.82:0/781421491 shutdown_connections 2024-04-26T20:10:45.563 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 --2- 172.21.15.82:0/781421491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39807d360 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 -- 172.21.15.82:0/781421491 >> 172.21.15.82:0/781421491 conn(0x7fa398104280 msgr2=0x7fa3981066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 -- 172.21.15.82:0/781421491 shutdown_connections 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.770+0000 7fa39f800700 1 -- 172.21.15.82:0/781421491 wait complete. 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.771+0000 7fa39f800700 1 Processor -- start 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.771+0000 7fa39f800700 1 -- start start 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.772+0000 7fa39f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.772+0000 7fa39f800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa39810f280 con 0x7fa39807ef00 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.772+0000 7fa39ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.772+0000 7fa39ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38308/0 (socket says 172.21.15.82:38308) 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.772+0000 7fa39ce00700 1 -- 172.21.15.82:0/1453267390 learned_addr learned my addr 172.21.15.82:0/1453267390 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa39ce00700 1 -- 172.21.15.82:0/1453267390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39819f370 con 0x7fa39807ef00 2024-04-26T20:10:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa39ce00700 1 --2- 172.21.15.82:0/1453267390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39819ee30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa38c003f40 tx=0x7fa38c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa38c0038b0 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa38c003a50 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39819f600 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa38c01a5c0 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.773+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3981a22f0 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.774+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa38c01ac00 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.774+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa38c019700 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.775+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa398064a80 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.778+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa38c019900 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.854+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fa3981a24c0 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.858+0000 7fa395600700 1 -- 172.21.15.82:0/1453267390 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fa38c019ae0 con 0x7fa39807ef00 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.860+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 msgr2=0x7fa39819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:45.565 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.860+0000 7fa39f800700 1 --2- 172.21.15.82:0/1453267390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39819ee30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa38c003f40 tx=0x7fa38c011890 comp rx=0 tx=0).stop 2024-04-26T20:10:45.566 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.860+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 shutdown_connections 2024-04-26T20:10:45.566 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.860+0000 7fa39f800700 1 --2- 172.21.15.82:0/1453267390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa39807ef00 0x7fa39819ee30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:45.566 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.860+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 >> 172.21.15.82:0/1453267390 conn(0x7fa398104280 msgr2=0x7fa398104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:45.566 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.861+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 shutdown_connections 2024-04-26T20:10:45.566 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:44.861+0000 7fa39f800700 1 -- 172.21.15.82:0/1453267390 wait complete. 2024-04-26T20:10:45.566 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T20:10:45.583 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:10:45.584 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-04-26T20:10:45.585 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-26T20:10:45.586 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-26T20:10:46.040 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x 2024-04-26T20:10:46.040 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-26T20:10:46.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:45 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1453267390' entity='client.admin' 2024-04-26T20:10:46.385 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-da6438ae-0408-11ef-bc93-c7b262605968.target.wants/ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-da6438ae-0408-11ef-bc93-c7b262605968@.service. 2024-04-26T20:10:46.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:46 smithi082 systemd[1]: Starting Ceph mgr.x for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:10:47.093 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:46 smithi082 podman[28323]: 2024-04-26 20:10:46.689208102 +0000 UTC m=+0.034823352 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:10:47.093 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:46 smithi082 podman[28323]: 2024-04-26 20:10:46.819184873 +0000 UTC m=+0.164800155 container create 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:10:47.093 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 podman[28323]: 2024-04-26 20:10:47.091981203 +0000 UTC m=+0.437596492 container init 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-26T20:10:47.242 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:10:47.242 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-26T20:10:47.266 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:10:47.266 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-26T20:10:47.266 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-26T20:10:47.266 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T20:10:47.293 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:10:47.294 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-26T20:10:47.318 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:10:47.319 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-26T20:10:47.319 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-26T20:10:47.320 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-26T20:10:47.320 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-04-26T20:10:47.320 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-04-26T20:10:47.343 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 podman[28323]: 2024-04-26 20:10:47.102483933 +0000 UTC m=+0.448099227 container start 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-26T20:10:47.343 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 bash[28323]: 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea 2024-04-26T20:10:47.343 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 systemd[1]: Started Ceph mgr.x for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:10:47.604 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:47.341+0000 7fd48bd5b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:10:47.883 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:47.603+0000 7fd48bd5b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:10:47.883 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:47.739+0000 7fd48bd5b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:10:48.171 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:48 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3058772568' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:10:48.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:48.170+0000 7fd48bd5b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:10:48.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:48.314+0000 7fd48bd5b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:10:48.862 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:48.862 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:10:48.862 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:10:48.862 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:10:48.862 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:10:48.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:10:48.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:10:48.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:10:48.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:10:48.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:10:48.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:48.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:10:48.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:10:48.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:48.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:10:48.876 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:48.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:10:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:10:28.313722+0000", 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.945+0000 7f96b4800700 1 Processor -- start 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.946+0000 7f96b4800700 1 -- start start 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.946+0000 7f96b4800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac10bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.946+0000 7f96b4800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac07cdf0 con 0x7f96ac109820 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.946+0000 7f96b1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac10bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.947+0000 7f96b1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac10bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38334/0 (socket says 172.21.15.82:38334) 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.947+0000 7f96b1e00700 1 -- 172.21.15.82:0/2488259059 learned_addr learned my addr 172.21.15.82:0/2488259059 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:48.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.947+0000 7f96b1e00700 1 -- 172.21.15.82:0/2488259059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac10c150 con 0x7f96ac109820 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.947+0000 7f96b1e00700 1 --2- 172.21.15.82:0/2488259059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac10bc10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f96a00098a0 tx=0x7f96a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf16c2e4625214c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.948+0000 7f96b0a00700 1 -- 172.21.15.82:0/2488259059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a0004160 con 0x7f96ac109820 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.948+0000 7f96b0a00700 1 -- 172.21.15.82:0/2488259059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f96a0004300 con 0x7f96ac109820 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.948+0000 7f96b0a00700 1 -- 172.21.15.82:0/2488259059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a0011af0 con 0x7f96ac109820 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.948+0000 7f96b4800700 1 -- 172.21.15.82:0/2488259059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 msgr2=0x7f96ac10bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.948+0000 7f96b4800700 1 --2- 172.21.15.82:0/2488259059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac10bc10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f96a00098a0 tx=0x7f96a0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.949+0000 7f96b4800700 1 -- 172.21.15.82:0/2488259059 shutdown_connections 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.949+0000 7f96b4800700 1 --2- 172.21.15.82:0/2488259059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac10bc10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.949+0000 7f96b4800700 1 -- 172.21.15.82:0/2488259059 >> 172.21.15.82:0/2488259059 conn(0x7f96ac1031d0 msgr2=0x7f96ac1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.949+0000 7f96b4800700 1 -- 172.21.15.82:0/2488259059 shutdown_connections 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.949+0000 7f96b4800700 1 -- 172.21.15.82:0/2488259059 wait complete. 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b4800700 1 Processor -- start 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b4800700 1 -- start start 2024-04-26T20:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b4800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b4800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac10d050 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38338/0 (socket says 172.21.15.82:38338) 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.950+0000 7f96b1e00700 1 -- 172.21.15.82:0/3058772568 learned_addr learned my addr 172.21.15.82:0/3058772568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96b1e00700 1 -- 172.21.15.82:0/3058772568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac19d190 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96b1e00700 1 --2- 172.21.15.82:0/3058772568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac19cc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f96a0011ac0 tx=0x7f96a0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a0003970 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f96a0003b10 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac19d420 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a0024610 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.951+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac1a0110 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.952+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96a0024bd0 con 0x7f96ac109820 2024-04-26T20:10:48.881 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.952+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f96a0019700 con 0x7f96ac109820 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.953+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac064a80 con 0x7f96ac109820 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:47.955+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f96a0043ec0 con 0x7f96ac109820 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.035+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f96ac1a02e0 con 0x7f96ac109820 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.035+0000 7f96a6a00700 1 -- 172.21.15.82:0/3058772568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f96a0032020 con 0x7f96ac109820 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 msgr2=0x7f96ac19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 --2- 172.21.15.82:0/3058772568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac19cc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f96a0011ac0 tx=0x7f96a0011ba0 comp rx=0 tx=0).stop 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 shutdown_connections 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 --2- 172.21.15.82:0/3058772568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96ac109820 0x7f96ac19cc50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 >> 172.21.15.82:0/3058772568 conn(0x7f96ac1031d0 msgr2=0x7f96ac103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 shutdown_connections 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:48.037+0000 7f96b4800700 1 -- 172.21.15.82:0/3058772568 wait complete. 2024-04-26T20:10:48.882 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-04-26T20:10:50.174 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:49 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:49.951+0000 7fd48bd5b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:10:50.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:50.173+0000 7fd48bd5b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:10:50.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:50.383+0000 7fd48bd5b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:10:50.887 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:50.764+0000 7fd48bd5b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:10:50.888 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:50.886+0000 7fd48bd5b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:10:51.406 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:51.145+0000 7fd48bd5b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:10:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:51 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3689165749' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:10:51.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:51.406+0000 7fd48bd5b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:10:52.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:10:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:10:52.250 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.250 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:10:52.250 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:52.250 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:10:52.250 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:10:52.250 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:10:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:10:28.313722+0000", 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:52.260 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.406+0000 7f42a7200700 1 Processor -- start 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.407+0000 7f42a7200700 1 -- start start 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.407+0000 7f42a7200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a807d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.407+0000 7f42a7200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42a807d8b0 con 0x7f42a807ee80 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.407+0000 7f42a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a807d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.407+0000 7f42a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a807d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56356/0 (socket says 172.21.15.82:56356) 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.407+0000 7f42a5e00700 1 -- 172.21.15.82:0/1714755721 learned_addr learned my addr 172.21.15.82:0/1714755721 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.408+0000 7f42a5e00700 1 -- 172.21.15.82:0/1714755721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a807da30 con 0x7f42a807ee80 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.408+0000 7f42a5e00700 1 --2- 172.21.15.82:0/1714755721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a807d2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42980098a0 tx=0x7f4298009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6474066c68d4ce80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.408+0000 7f42a4a00700 1 -- 172.21.15.82:0/1714755721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4298004160 con 0x7f42a807ee80 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a4a00700 1 -- 172.21.15.82:0/1714755721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4298004300 con 0x7f42a807ee80 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a4a00700 1 -- 172.21.15.82:0/1714755721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4298011af0 con 0x7f42a807ee80 2024-04-26T20:10:52.261 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 -- 172.21.15.82:0/1714755721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 msgr2=0x7f42a807d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 --2- 172.21.15.82:0/1714755721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a807d2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42980098a0 tx=0x7f4298009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 -- 172.21.15.82:0/1714755721 shutdown_connections 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 --2- 172.21.15.82:0/1714755721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a807d2e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 -- 172.21.15.82:0/1714755721 >> 172.21.15.82:0/1714755721 conn(0x7f42a81040c0 msgr2=0x7f42a81064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 -- 172.21.15.82:0/1714755721 shutdown_connections 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.409+0000 7f42a7200700 1 -- 172.21.15.82:0/1714755721 wait complete. 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.410+0000 7f42a7200700 1 Processor -- start 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a7200700 1 -- start start 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a7200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a7200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42a810f070 con 0x7f42a807ee80 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a819ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56366/0 (socket says 172.21.15.82:56366) 2024-04-26T20:10:52.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a5e00700 1 -- 172.21.15.82:0/3689165749 learned_addr learned my addr 172.21.15.82:0/3689165749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.411+0000 7f42a5e00700 1 -- 172.21.15.82:0/3689165749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a819f140 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.412+0000 7f42a5e00700 1 --2- 172.21.15.82:0/3689165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a819ec00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4298003f40 tx=0x7f4298011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.412+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42980038b0 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.412+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4298003a50 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.412+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a819f3d0 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.412+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f429801a5c0 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.412+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81a20c0 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.413+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f429801ac00 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.413+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4298019700 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.413+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a8064a80 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.418+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f42980199a0 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.497+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f42a81a2290 con 0x7f42a807ee80 2024-04-26T20:10:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.498+0000 7f429ea00700 1 -- 172.21.15.82:0/3689165749 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f4298019b80 con 0x7f42a807ee80 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.499+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 msgr2=0x7f42a819ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.499+0000 7f42a7200700 1 --2- 172.21.15.82:0/3689165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a819ec00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4298003f40 tx=0x7f4298011890 comp rx=0 tx=0).stop 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.499+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 shutdown_connections 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.499+0000 7f42a7200700 1 --2- 172.21.15.82:0/3689165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42a807ee80 0x7f42a819ec00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.499+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 >> 172.21.15.82:0/3689165749 conn(0x7f42a81040c0 msgr2=0x7f42a8104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.500+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 shutdown_connections 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:51.500+0000 7f42a7200700 1 -- 172.21.15.82:0/3689165749 wait complete. 2024-04-26T20:10:52.264 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-04-26T20:10:52.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:52.243+0000 7fd48bd5b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:10:53.184 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:52.791+0000 7fd48bd5b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:10:53.185 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:52.921+0000 7fd48bd5b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:10:53.185 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:53.183+0000 7fd48bd5b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:10:54.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:53.827+0000 7fd48bd5b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:10:54.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:53.948+0000 7fd48bd5b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:10:54.576 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:54.266+0000 7fd48bd5b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:10:54.576 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:54.455+0000 7fd48bd5b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:10:54.845 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:54.583+0000 7fd48bd5b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:10:54.845 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:54.736+0000 7fd48bd5b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:10:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:55 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1534811097' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:10:55.408 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:55.119+0000 7fd48bd5b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:10:55.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:55.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:10:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:10:55.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:55.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:10:55.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:10:55.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:55.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:55.764 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:10:55.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:10:55.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:55.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:10:28.313722+0000", 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.897+0000 7f647ba00700 1 Processor -- start 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.898+0000 7f647ba00700 1 -- start start 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.898+0000 7f647ba00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647407d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.898+0000 7f647ba00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f647407d910 con 0x7f647407eee0 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.898+0000 7f6479000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647407d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.899+0000 7f6479000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647407d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56382/0 (socket says 172.21.15.82:56382) 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.899+0000 7f6479000700 1 -- 172.21.15.82:0/1563332934 learned_addr learned my addr 172.21.15.82:0/1563332934 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.899+0000 7f6479000700 1 -- 172.21.15.82:0/1563332934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647407da90 con 0x7f647407eee0 2024-04-26T20:10:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.899+0000 7f6479000700 1 --2- 172.21.15.82:0/1563332934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647407d340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64680098a0 tx=0x7f6468009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8d6f4dd6da883e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.899+0000 7f6473400700 1 -- 172.21.15.82:0/1563332934 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6468004160 con 0x7f647407eee0 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.900+0000 7f6473400700 1 -- 172.21.15.82:0/1563332934 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6468004300 con 0x7f647407eee0 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.900+0000 7f6473400700 1 -- 172.21.15.82:0/1563332934 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6468011af0 con 0x7f647407eee0 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.900+0000 7f647ba00700 1 -- 172.21.15.82:0/1563332934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 msgr2=0x7f647407d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.900+0000 7f647ba00700 1 --2- 172.21.15.82:0/1563332934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647407d340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64680098a0 tx=0x7f6468009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.901+0000 7f647ba00700 1 -- 172.21.15.82:0/1563332934 shutdown_connections 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.901+0000 7f647ba00700 1 --2- 172.21.15.82:0/1563332934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647407d340 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.901+0000 7f647ba00700 1 -- 172.21.15.82:0/1563332934 >> 172.21.15.82:0/1563332934 conn(0x7f64741042a0 msgr2=0x7f64741066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.901+0000 7f647ba00700 1 -- 172.21.15.82:0/1563332934 shutdown_connections 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.901+0000 7f647ba00700 1 -- 172.21.15.82:0/1563332934 wait complete. 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.902+0000 7f647ba00700 1 Processor -- start 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.902+0000 7f647ba00700 1 -- start start 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.902+0000 7f647ba00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:55.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.902+0000 7f647ba00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f647410f270 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6479000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6479000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56388/0 (socket says 172.21.15.82:56388) 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6479000700 1 -- 172.21.15.82:0/1534811097 learned_addr learned my addr 172.21.15.82:0/1534811097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6479000700 1 -- 172.21.15.82:0/1534811097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647419f350 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6479000700 1 --2- 172.21.15.82:0/1534811097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647419ee10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6468000c00 tx=0x7f6468011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6468003b20 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.903+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f646801a8c0 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.904+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6468024940 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.904+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647419f5e0 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.904+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64741a22d0 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.904+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6468022020 con 0x7f647407eee0 2024-04-26T20:10:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.904+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64680195c0 con 0x7f647407eee0 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.905+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474064a80 con 0x7f647407eee0 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.907+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f64680042c0 con 0x7f647407eee0 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.987+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64741a2810 con 0x7f647407eee0 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.987+0000 7f6471600700 1 -- 172.21.15.82:0/1534811097 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f646801aa70 con 0x7f647407eee0 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.988+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 msgr2=0x7f647419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.988+0000 7f647ba00700 1 --2- 172.21.15.82:0/1534811097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647419ee10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6468000c00 tx=0x7f6468011b70 comp rx=0 tx=0).stop 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.988+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 shutdown_connections 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.988+0000 7f647ba00700 1 --2- 172.21.15.82:0/1534811097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647407eee0 0x7f647419ee10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.988+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 >> 172.21.15.82:0/1534811097 conn(0x7f64741042a0 msgr2=0x7f6474104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.989+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 shutdown_connections 2024-04-26T20:10:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:54.989+0000 7f647ba00700 1 -- 172.21.15.82:0/1534811097 wait complete. 2024-04-26T20:10:55.772 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2024-04-26T20:10:56.166 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:55.885+0000 7fd48bd5b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:10:56.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:10:56.165+0000 7fd48bd5b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:10:56.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: Activating manager daemon x 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: mgrmap e2: x(active, starting, since 0.011816s) 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: Manager daemon x is now available 2024-04-26T20:10:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:10:56.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:10:56.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' 2024-04-26T20:10:56.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:56 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' 2024-04-26T20:10:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:57 smithi082 ceph-mon[28105]: from='mgr.14100 172.21.15.82:0/3075768679' entity='mgr.x' 2024-04-26T20:10:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:57 smithi082 ceph-mon[28105]: mgrmap e3: x(active, since 1.02173s) 2024-04-26T20:10:59.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:59 smithi082 ceph-mon[28105]: mgrmap e4: x(active, since 2s) 2024-04-26T20:10:59.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:10:59 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3688600277' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:10:59.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:59.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:10:59.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:10:59.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:10:59.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:10:28.313722+0000", 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.380+0000 7fb48d800700 1 Processor -- start 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.380+0000 7fb48d800700 1 -- start start 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.380+0000 7fb48d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb48810bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.380+0000 7fb48d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb48807cdf0 con 0x7fb488109820 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.381+0000 7fb486a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb48810bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.381+0000 7fb486a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb48810bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56462/0 (socket says 172.21.15.82:56462) 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.381+0000 7fb486a00700 1 -- 172.21.15.82:0/3919237831 learned_addr learned my addr 172.21.15.82:0/3919237831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.382+0000 7fb486a00700 1 -- 172.21.15.82:0/3919237831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48810c150 con 0x7fb488109820 2024-04-26T20:10:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.382+0000 7fb486a00700 1 --2- 172.21.15.82:0/3919237831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb48810bc10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4780098a0 tx=0x7fb478009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3afbb023d81d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:59.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.382+0000 7fb485600700 1 -- 172.21.15.82:0/3919237831 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478004160 con 0x7fb488109820 2024-04-26T20:10:59.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.382+0000 7fb485600700 1 -- 172.21.15.82:0/3919237831 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb478004300 con 0x7fb488109820 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.382+0000 7fb485600700 1 -- 172.21.15.82:0/3919237831 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478011af0 con 0x7fb488109820 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 -- 172.21.15.82:0/3919237831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 msgr2=0x7fb48810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 --2- 172.21.15.82:0/3919237831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb48810bc10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4780098a0 tx=0x7fb478009bb0 comp rx=0 tx=0).stop 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 -- 172.21.15.82:0/3919237831 shutdown_connections 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 --2- 172.21.15.82:0/3919237831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb48810bc10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 -- 172.21.15.82:0/3919237831 >> 172.21.15.82:0/3919237831 conn(0x7fb4881031d0 msgr2=0x7fb4881055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 -- 172.21.15.82:0/3919237831 shutdown_connections 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.383+0000 7fb48d800700 1 -- 172.21.15.82:0/3919237831 wait complete. 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.384+0000 7fb48d800700 1 Processor -- start 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.384+0000 7fb48d800700 1 -- start start 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.385+0000 7fb48d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb4881090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.385+0000 7fb48d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb48810d050 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.385+0000 7fb486a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb4881090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.385+0000 7fb486a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb4881090a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56474/0 (socket says 172.21.15.82:56474) 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.385+0000 7fb486a00700 1 -- 172.21.15.82:0/3688600277 learned_addr learned my addr 172.21.15.82:0/3688600277 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.385+0000 7fb486a00700 1 -- 172.21.15.82:0/3688600277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4881095e0 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.386+0000 7fb486a00700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb4881090a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb478011ac0 tx=0x7fb478011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.386+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478003970 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.386+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb478003b10 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.386+0000 7fb48d800700 1 -- 172.21.15.82:0/3688600277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4881077d0 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.386+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb478024610 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.386+0000 7fb48d800700 1 -- 172.21.15.82:0/3688600277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb488107d10 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.387+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fb47801a9e0 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.387+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb460005330 con 0x7fb488109820 2024-04-26T20:10:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.388+0000 7fb47f400700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fb46c0395b0 0x7fb46c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.388+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb47804dcc0 con 0x7fb488109820 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.388+0000 7fb486000700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fb46c0395b0 0x7fb46c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.389+0000 7fb486000700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fb46c0395b0 0x7fb46c03ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb474006fd0 tx=0x7fb474006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.394+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb47804d6e0 con 0x7fb488109820 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.706+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb460005620 con 0x7fb488109820 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.707+0000 7fb47f400700 1 -- 172.21.15.82:0/3688600277 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb478024d60 con 0x7fb488109820 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fb46c0395b0 msgr2=0x7fb46c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fb46c0395b0 0x7fb46c03ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb474006fd0 tx=0x7fb474006e40 comp rx=0 tx=0).stop 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 msgr2=0x7fb4881090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:10:59.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb4881090a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb478011ac0 tx=0x7fb478011ba0 comp rx=0 tx=0).stop 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 shutdown_connections 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fb46c0395b0 0x7fb46c03ba70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 --2- 172.21.15.82:0/3688600277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488109820 0x7fb4881090a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 >> 172.21.15.82:0/3688600277 conn(0x7fb4881031d0 msgr2=0x7fb488103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 shutdown_connections 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:10:58.710+0000 7fb47cc00700 1 -- 172.21.15.82:0/3688600277 wait complete. 2024-04-26T20:10:59.498 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-04-26T20:11:00.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:00 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/984296663' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T20:11:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.119+0000 7f01ad000700 1 Processor -- start 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.119+0000 7f01ad000700 1 -- start start 2024-04-26T20:11:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.120+0000 7f01ad000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a810bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.120+0000 7f01ad000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01a807ce90 con 0x7f01a8109770 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.120+0000 7f01a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a810bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.120+0000 7f01a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a810bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56488/0 (socket says 172.21.15.82:56488) 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.120+0000 7f01a5e00700 1 -- 172.21.15.82:0/1890519296 learned_addr learned my addr 172.21.15.82:0/1890519296 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.121+0000 7f01a5e00700 1 -- 172.21.15.82:0/1890519296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a810c0a0 con 0x7f01a8109770 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.121+0000 7f01a5e00700 1 --2- 172.21.15.82:0/1890519296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a810bb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01980098a0 tx=0x7f0198009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d902f341bd58862b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.121+0000 7f01a4a00700 1 -- 172.21.15.82:0/1890519296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0198004160 con 0x7f01a8109770 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.121+0000 7f01a4a00700 1 -- 172.21.15.82:0/1890519296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0198004300 con 0x7f01a8109770 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.121+0000 7f01a4a00700 1 -- 172.21.15.82:0/1890519296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0198011af0 con 0x7f01a8109770 2024-04-26T20:11:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 -- 172.21.15.82:0/1890519296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 msgr2=0x7f01a810bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 --2- 172.21.15.82:0/1890519296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a810bb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01980098a0 tx=0x7f0198009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 -- 172.21.15.82:0/1890519296 shutdown_connections 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 --2- 172.21.15.82:0/1890519296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a810bb60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 -- 172.21.15.82:0/1890519296 >> 172.21.15.82:0/1890519296 conn(0x7f01a81031a0 msgr2=0x7f01a81055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 -- 172.21.15.82:0/1890519296 shutdown_connections 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.122+0000 7f01ad000700 1 -- 172.21.15.82:0/1890519296 wait complete. 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.123+0000 7f01ad000700 1 Processor -- start 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.123+0000 7f01ad000700 1 -- start start 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.124+0000 7f01ad000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a8108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.124+0000 7f01ad000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01a810d060 con 0x7f01a8109770 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.124+0000 7f01a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a8108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.124+0000 7f01a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a8108ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56504/0 (socket says 172.21.15.82:56504) 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.124+0000 7f01a5e00700 1 -- 172.21.15.82:0/984296663 learned_addr learned my addr 172.21.15.82:0/984296663 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.124+0000 7f01a5e00700 1 -- 172.21.15.82:0/984296663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a8109530 con 0x7f01a8109770 2024-04-26T20:11:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.125+0000 7f01a5e00700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a8108ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0198011ac0 tx=0x7f0198011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.125+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0198003b20 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.125+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f019801a8c0 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.125+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01980248d0 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.125+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a8107720 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.125+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a8107c60 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.126+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f0198022020 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.126+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a8064a80 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.127+0000 7f019ea00700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f018c0395b0 0x7f018c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.127+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f019804d490 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.127+0000 7f01a5400700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f018c0395b0 0x7f018c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.128+0000 7f01a5400700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f018c0395b0 0x7f018c03ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0194006fd0 tx=0x7f0194006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.132+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f019801ab20 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.356+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f01a8107ee0 con 0x7f01a8109770 2024-04-26T20:11:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.359+0000 7f019ea00700 1 -- 172.21.15.82:0/984296663 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f019804d1f0 con 0x7f01a8109770 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f018c0395b0 msgr2=0x7f018c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f018c0395b0 0x7f018c03ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0194006fd0 tx=0x7f0194006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 msgr2=0x7f01a8108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a8108ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0198011ac0 tx=0x7f0198011ba0 comp rx=0 tx=0).stop 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 shutdown_connections 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f018c0395b0 0x7f018c03ba70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 --2- 172.21.15.82:0/984296663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8109770 0x7f01a8108ff0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 >> 172.21.15.82:0/984296663 conn(0x7f01a81031a0 msgr2=0x7f01a8103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 shutdown_connections 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:00.363+0000 7f01ad000700 1 -- 172.21.15.82:0/984296663 wait complete. 2024-04-26T20:11:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-04-26T20:11:02.336 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:02 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1522025456' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T20:11:02.364 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: ignoring --setuser ceph since I am not root 2024-04-26T20:11:02.364 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: ignoring --setgroup ceph since I am not root 2024-04-26T20:11:02.364 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:02.334+0000 7fa06c0e8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:11:02.885 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:02.599+0000 7fa06c0e8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:11:02.885 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:02.731+0000 7fa06c0e8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:11:02.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.694+0000 7fda62a00700 1 Processor -- start 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.695+0000 7fda62a00700 1 -- start start 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.695+0000 7fda62a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.695+0000 7fda62a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c1085c0 con 0x7fda5c107bd0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.695+0000 7fda5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.695+0000 7fda5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48622/0 (socket says 172.21.15.82:48622) 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.696+0000 7fda5be00700 1 -- 172.21.15.82:0/870684958 learned_addr learned my addr 172.21.15.82:0/870684958 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.696+0000 7fda5be00700 1 -- 172.21.15.82:0/870684958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c108dd0 con 0x7fda5c107bd0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.696+0000 7fda5be00700 1 --2- 172.21.15.82:0/870684958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c107ff0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0098a0 tx=0x7fda4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbcb8d16b2435e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.696+0000 7fda5aa00700 1 -- 172.21.15.82:0/870684958 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4c004160 con 0x7fda5c107bd0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda5aa00700 1 -- 172.21.15.82:0/870684958 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fda4c004300 con 0x7fda5c107bd0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda5aa00700 1 -- 172.21.15.82:0/870684958 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4c011af0 con 0x7fda5c107bd0 2024-04-26T20:11:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda62a00700 1 -- 172.21.15.82:0/870684958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 msgr2=0x7fda5c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda62a00700 1 --2- 172.21.15.82:0/870684958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c107ff0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0098a0 tx=0x7fda4c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda62a00700 1 -- 172.21.15.82:0/870684958 shutdown_connections 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda62a00700 1 --2- 172.21.15.82:0/870684958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c107ff0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.697+0000 7fda62a00700 1 -- 172.21.15.82:0/870684958 >> 172.21.15.82:0/870684958 conn(0x7fda5c1031d0 msgr2=0x7fda5c1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.698+0000 7fda62a00700 1 -- 172.21.15.82:0/870684958 shutdown_connections 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.698+0000 7fda62a00700 1 -- 172.21.15.82:0/870684958 wait complete. 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.699+0000 7fda62a00700 1 Processor -- start 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.699+0000 7fda62a00700 1 -- start start 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.699+0000 7fda62a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c192d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.699+0000 7fda62a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c10c180 con 0x7fda5c107bd0 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.700+0000 7fda5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c192d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.700+0000 7fda5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c192d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48630/0 (socket says 172.21.15.82:48630) 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.700+0000 7fda5be00700 1 -- 172.21.15.82:0/1522025456 learned_addr learned my addr 172.21.15.82:0/1522025456 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.700+0000 7fda5be00700 1 -- 172.21.15.82:0/1522025456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c193280 con 0x7fda5c107bd0 2024-04-26T20:11:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.700+0000 7fda5be00700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c192d40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0117b0 tx=0x7fda4c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.701+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4c003af0 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.701+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fda4c020070 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.701+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c191470 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.701+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4c019630 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.701+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c1919b0 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.702+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fda4c01a430 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.702+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5c064a80 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.703+0000 7fda58c00700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fda400395b0 0x7fda4003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.703+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda4c04da90 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.703+0000 7fda5b400700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fda400395b0 0x7fda4003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.704+0000 7fda5b400700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fda400395b0 0x7fda4003ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda48006fd0 tx=0x7fda48006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.708+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fda4c0042a0 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:01.993+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fda5c196ac0 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.047+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fda4c00e260 con 0x7fda5c107bd0 2024-04-26T20:11:02.912 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.051+0000 7fda58c00700 1 -- 172.21.15.82:0/1522025456 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fda4c019850 con 0x7fda5c107bd0 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.051+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fda400395b0 msgr2=0x7fda4003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.051+0000 7fda62a00700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fda400395b0 0x7fda4003ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda48006fd0 tx=0x7fda48006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.051+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 msgr2=0x7fda5c192d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.051+0000 7fda62a00700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c192d40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0117b0 tx=0x7fda4c011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.052+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 shutdown_connections 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.052+0000 7fda62a00700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fda400395b0 0x7fda4003ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.052+0000 7fda62a00700 1 --2- 172.21.15.82:0/1522025456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5c107bd0 0x7fda5c192d40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.052+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 >> 172.21.15.82:0/1522025456 conn(0x7fda5c1031d0 msgr2=0x7fda5c1040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.052+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 shutdown_connections 2024-04-26T20:11:02.913 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:02.052+0000 7fda62a00700 1 -- 172.21.15.82:0/1522025456 wait complete. 2024-04-26T20:11:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:03 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1522025456' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T20:11:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:03 smithi082 ceph-mon[28105]: mgrmap e5: x(active, since 5s) 2024-04-26T20:11:03.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:03.131+0000 7fa06c0e8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:11:03.512 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:03.250+0000 7fa06c0e8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:11:04.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:04 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/239511759' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T20:11:04.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.536+0000 7f543dc00700 1 Processor -- start 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.536+0000 7f543dc00700 1 -- start start 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.536+0000 7f543dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543807d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:04.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.536+0000 7f543dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f543807d8d0 con 0x7f543807eea0 2024-04-26T20:11:04.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.537+0000 7f5436a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543807d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:04.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.537+0000 7f5436a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543807d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48654/0 (socket says 172.21.15.82:48654) 2024-04-26T20:11:04.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.537+0000 7f5436a00700 1 -- 172.21.15.82:0/3190342909 learned_addr learned my addr 172.21.15.82:0/3190342909 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.537+0000 7f5436a00700 1 -- 172.21.15.82:0/3190342909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543807da50 con 0x7f543807eea0 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.537+0000 7f5436a00700 1 --2- 172.21.15.82:0/3190342909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543807d300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54280098a0 tx=0x7f5428009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8311aa45ed3f1a93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.538+0000 7f5435600700 1 -- 172.21.15.82:0/3190342909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5428004160 con 0x7f543807eea0 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.538+0000 7f5435600700 1 -- 172.21.15.82:0/3190342909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5428004300 con 0x7f543807eea0 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.538+0000 7f5435600700 1 -- 172.21.15.82:0/3190342909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5428011af0 con 0x7f543807eea0 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.538+0000 7f543dc00700 1 -- 172.21.15.82:0/3190342909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 msgr2=0x7f543807d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.538+0000 7f543dc00700 1 --2- 172.21.15.82:0/3190342909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543807d300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54280098a0 tx=0x7f5428009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.539+0000 7f543dc00700 1 -- 172.21.15.82:0/3190342909 shutdown_connections 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.539+0000 7f543dc00700 1 --2- 172.21.15.82:0/3190342909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543807d300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.539+0000 7f543dc00700 1 -- 172.21.15.82:0/3190342909 >> 172.21.15.82:0/3190342909 conn(0x7f54381042a0 msgr2=0x7f54381066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.539+0000 7f543dc00700 1 -- 172.21.15.82:0/3190342909 shutdown_connections 2024-04-26T20:11:04.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.539+0000 7f543dc00700 1 -- 172.21.15.82:0/3190342909 wait complete. 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f543dc00700 1 Processor -- start 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f543dc00700 1 -- start start 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f543dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f543dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f543810f2b0 con 0x7f543807eea0 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f5436a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f5436a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543819edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48658/0 (socket says 172.21.15.82:48658) 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.540+0000 7f5436a00700 1 -- 172.21.15.82:0/239511759 learned_addr learned my addr 172.21.15.82:0/239511759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.541+0000 7f5436a00700 1 -- 172.21.15.82:0/239511759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543819f2f0 con 0x7f543807eea0 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.541+0000 7f5436a00700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543819edb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5428011ac0 tx=0x7f5428011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:04.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.541+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5428003b20 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.541+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f542801a8c0 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.541+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543819f580 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.541+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54280248d0 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.542+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54381a2270 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.543+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f5428022020 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.543+0000 7f542f400700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 0x7f541c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.543+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f542804d660 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.543+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5438064a80 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.543+0000 7f5436000700 1 -- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 msgr2=0x7f541c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.543+0000 7f5436000700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 0x7f541c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.548+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f542802cdf0 con 0x7f543807eea0 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.744+0000 7f5436000700 1 -- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 msgr2=0x7f541c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:04.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.744+0000 7f5436000700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 0x7f541c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.870+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f54381a27a0 con 0x7f543807eea0 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.871+0000 7f542f400700 1 -- 172.21.15.82:0/239511759 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f542801ade0 con 0x7f543807eea0 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 msgr2=0x7f541c03bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 0x7f541c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 msgr2=0x7f543819edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543819edb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5428011ac0 tx=0x7f5428011ba0 comp rx=0 tx=0).stop 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 shutdown_connections 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7f541c039600 0x7f541c03bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 --2- 172.21.15.82:0/239511759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543807eea0 0x7f543819edb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.873+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 >> 172.21.15.82:0/239511759 conn(0x7f54381042a0 msgr2=0x7f5438104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:04.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.874+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 shutdown_connections 2024-04-26T20:11:04.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:03.874+0000 7f543dc00700 1 -- 172.21.15.82:0/239511759 wait complete. 2024-04-26T20:11:04.599 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-04-26T20:11:04.599 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-04-26T20:11:05.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:04.859+0000 7fa06c0e8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:11:05.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:05.089+0000 7fa06c0e8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:11:05.683 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:05.309+0000 7fa06c0e8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:11:05.683 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:05.681+0000 7fa06c0e8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:11:05.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:05.807+0000 7fa06c0e8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:11:06.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:06 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:06.060+0000 7fa06c0e8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:11:06.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:06 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:06.311+0000 7fa06c0e8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:11:07.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:07 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:07.093+0000 7fa06c0e8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:11:07.782 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:07 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:07.645+0000 7fa06c0e8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:11:07.782 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:07 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:07.780+0000 7fa06c0e8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:11:08.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:08 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:08.052+0000 7fa06c0e8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:11:09.022 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:08 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:08.713+0000 7fa06c0e8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:11:09.022 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:08 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:08.838+0000 7fa06c0e8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:11:09.339 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:09.162+0000 7fa06c0e8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:11:09.339 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:09.336+0000 7fa06c0e8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:11:09.613 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:09.463+0000 7fa06c0e8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:11:09.613 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:09.610+0000 7fa06c0e8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:11:10.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:09.976+0000 7fa06c0e8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:11:10.998 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:10 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:10.718+0000 7fa06c0e8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:11:11.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:10 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:10.996+0000 7fa06c0e8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:11:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: Active manager daemon x restarted 2024-04-26T20:11:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: Activating manager daemon x 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: mgrmap e6: x(active, starting, since 0.00471269s) 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: Manager daemon x is now available 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:11 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:12.407 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: Found migration_current of "None". Setting to last migration. 2024-04-26T20:11:12.407 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:12.407 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:12.407 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:11:12.407 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:11:12.407 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: mgrmap e7: x(active, since 1.01447s) 2024-04-26T20:11:12.408 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:12.408 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:12 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:12.807 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:11:12.808 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T20:11:12.808 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.228+0000 7fc7cfa00700 1 Processor -- start 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.228+0000 7fc7cfa00700 1 -- start start 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.228+0000 7fc7cfa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c8109100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.228+0000 7fc7cfa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81096d0 con 0x7fc7c8108ce0 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.229+0000 7fc7cd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c8109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:12.809 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.229+0000 7fc7cd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c8109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48670/0 (socket says 172.21.15.82:48670) 2024-04-26T20:11:12.811 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.229+0000 7fc7cd000700 1 -- 172.21.15.82:0/3817679563 learned_addr learned my addr 172.21.15.82:0/3817679563 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.229+0000 7fc7cd000700 1 -- 172.21.15.82:0/3817679563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c8109ee0 con 0x7fc7c8108ce0 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.230+0000 7fc7cd000700 1 --2- 172.21.15.82:0/3817679563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c8109100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098a0 tx=0x7fc7bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348ebeaabcd557a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.230+0000 7fc7c7400700 1 -- 172.21.15.82:0/3817679563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc004160 con 0x7fc7c8108ce0 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.230+0000 7fc7c7400700 1 -- 172.21.15.82:0/3817679563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc7bc004300 con 0x7fc7c8108ce0 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.230+0000 7fc7c7400700 1 -- 172.21.15.82:0/3817679563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc011af0 con 0x7fc7c8108ce0 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 -- 172.21.15.82:0/3817679563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 msgr2=0x7fc7c8109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/3817679563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c8109100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098a0 tx=0x7fc7bc009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 -- 172.21.15.82:0/3817679563 shutdown_connections 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/3817679563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c8109100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 -- 172.21.15.82:0/3817679563 >> 172.21.15.82:0/3817679563 conn(0x7fc7c81042a0 msgr2=0x7fc7c81066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 -- 172.21.15.82:0/3817679563 shutdown_connections 2024-04-26T20:11:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.231+0000 7fc7cfa00700 1 -- 172.21.15.82:0/3817679563 wait complete. 2024-04-26T20:11:12.813 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.232+0000 7fc7cfa00700 1 Processor -- start 2024-04-26T20:11:12.813 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.232+0000 7fc7cfa00700 1 -- start start 2024-04-26T20:11:12.813 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.233+0000 7fc7cfa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:12.813 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.233+0000 7fc7cfa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c810d290 con 0x7fc7c8108ce0 2024-04-26T20:11:12.813 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.233+0000 7fc7cd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:12.818 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.233+0000 7fc7cd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48678/0 (socket says 172.21.15.82:48678) 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.233+0000 7fc7cd000700 1 -- 172.21.15.82:0/242448504 learned_addr learned my addr 172.21.15.82:0/242448504 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.233+0000 7fc7cd000700 1 -- 172.21.15.82:0/242448504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c819f3a0 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.234+0000 7fc7cd000700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c819ee60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.234+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc003b20 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.234+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc7bc01a8c0 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.234+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c819f630 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.234+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc024940 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.234+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81a2320 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.235+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fc7bc022020 con 0x7fc7c8108ce0 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.236+0000 7fc7c5600700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.236+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 --> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7b003c1d0 con 0x7fc7b0039600 2024-04-26T20:11:12.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.236+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc7bc04d490 con 0x7fc7c8108ce0 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.236+0000 7fc7c7e00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 msgr2=0x7fc7b003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.236+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.437+0000 7fc7c7e00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 msgr2=0x7fc7b003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.437+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.838+0000 7fc7c7e00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 msgr2=0x7fc7b003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:05.838+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:06.639+0000 7fc7c7e00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 msgr2=0x7fc7b003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:06.639+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:08.241+0000 7fc7c7e00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 msgr2=0x7fc7b003bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2488160347 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:08.241+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T20:11:12.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:11.004+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7fc7bc01aa70 con 0x7fc7c8108ce0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:11.005+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 msgr2=0x7fc7b003bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:11.005+0000 7fc7c5600700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.009+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7fc7bc04ebf0 con 0x7fc7c8108ce0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.009+0000 7fc7c5600700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fc7b003cef0 0x7fc7b003f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.009+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7bc001d30 con 0x7fc7b003cef0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.011+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fc7b003cef0 0x7fc7b003f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.013+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fc7b003cef0 0x7fc7b003f2e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4003a10 tx=0x7fc7b40092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.015+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc7bc001d30 con 0x7fc7b003cef0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.024+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc7c8064a80 con 0x7fc7b003cef0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.024+0000 7fc7c5600700 1 -- 172.21.15.82:0/242448504 <== mgr.14120 v2:172.21.15.82:6800/3159671154 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc7c8064a80 con 0x7fc7b003cef0 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.024+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fc7b003cef0 msgr2=0x7fc7b003f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.024+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fc7b003cef0 0x7fc7b003f2e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4003a10 tx=0x7fc7b40092b0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.821 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.024+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 msgr2=0x7fc7c819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.024+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c819ee60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 shutdown_connections 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8108ce0 0x7fc7c819ee60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fc7b003cef0 0x7fc7b003f2e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 --2- 172.21.15.82:0/242448504 >> [v2:172.21.15.82:6800/2488160347,v1:172.21.15.82:6801/2488160347] conn(0x7fc7b0039600 0x7fc7b003bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 >> 172.21.15.82:0/242448504 conn(0x7fc7c81042a0 msgr2=0x7fc7c8104ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 shutdown_connections 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:12.025+0000 7fc7cfa00700 1 -- 172.21.15.82:0/242448504 wait complete. 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-04-26T20:11:12.822 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-04-26T20:11:13.359 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:13 smithi082 ceph-mon[28105]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T20:11:13.359 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:13 smithi082 ceph-mon[28105]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T20:11:13.360 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:13 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:14.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:12] ENGINE Bus STARTING 2024-04-26T20:11:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:12] ENGINE Serving on http://172.21.15.82:8765 2024-04-26T20:11:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:12] ENGINE Serving on https://172.21.15.82:7150 2024-04-26T20:11:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:12] ENGINE Bus STARTED 2024-04-26T20:11:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: mgrmap e8: x(active, since 2s) 2024-04-26T20:11:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:14 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:14.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.525+0000 7f1356000700 1 Processor -- start 2024-04-26T20:11:14.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.525+0000 7f1356000700 1 -- start start 2024-04-26T20:11:14.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.526+0000 7f1356000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135007d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:14.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.526+0000 7f1356000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f135007d910 con 0x7f135007eee0 2024-04-26T20:11:14.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.526+0000 7f134f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135007d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:14.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.526+0000 7f134f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135007d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46258/0 (socket says 172.21.15.82:46258) 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.526+0000 7f134f400700 1 -- 172.21.15.82:0/1299698009 learned_addr learned my addr 172.21.15.82:0/1299698009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.527+0000 7f134f400700 1 -- 172.21.15.82:0/1299698009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135007da90 con 0x7f135007eee0 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.527+0000 7f134f400700 1 --2- 172.21.15.82:0/1299698009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135007d340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13400098a0 tx=0x7f1340009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be4e306905747d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.527+0000 7f134e000700 1 -- 172.21.15.82:0/1299698009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1340004160 con 0x7f135007eee0 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.527+0000 7f134e000700 1 -- 172.21.15.82:0/1299698009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1340004300 con 0x7f135007eee0 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.527+0000 7f134e000700 1 -- 172.21.15.82:0/1299698009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1340011af0 con 0x7f135007eee0 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 -- 172.21.15.82:0/1299698009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 msgr2=0x7f135007d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 --2- 172.21.15.82:0/1299698009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135007d340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13400098a0 tx=0x7f1340009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 -- 172.21.15.82:0/1299698009 shutdown_connections 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 --2- 172.21.15.82:0/1299698009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135007d340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 -- 172.21.15.82:0/1299698009 >> 172.21.15.82:0/1299698009 conn(0x7f13501042a0 msgr2=0x7f13501066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 -- 172.21.15.82:0/1299698009 shutdown_connections 2024-04-26T20:11:14.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.528+0000 7f1356000700 1 -- 172.21.15.82:0/1299698009 wait complete. 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.529+0000 7f1356000700 1 Processor -- start 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.529+0000 7f1356000700 1 -- start start 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.529+0000 7f1356000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.529+0000 7f1356000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f135010f270 con 0x7f135007eee0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.530+0000 7f134f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.530+0000 7f134f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135019ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46262/0 (socket says 172.21.15.82:46262) 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.530+0000 7f134f400700 1 -- 172.21.15.82:0/2723468156 learned_addr learned my addr 172.21.15.82:0/2723468156 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.530+0000 7f134f400700 1 -- 172.21.15.82:0/2723468156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135019f350 con 0x7f135007eee0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.530+0000 7f134f400700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135019ee10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1340000c00 tx=0x7f1340011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.531+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1340003b20 con 0x7f135007eee0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.531+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f134001a8c0 con 0x7f135007eee0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.531+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135019f5e0 con 0x7f135007eee0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.531+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1340024940 con 0x7f135007eee0 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.531+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13501a22d0 con 0x7f135007eee0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.532+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1350064a80 con 0x7f135007eee0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.532+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f1340022020 con 0x7f135007eee0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.532+0000 7f1347e00700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f1334039600 0x7f133403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.533+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f134004d8a0 con 0x7f135007eee0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.533+0000 7f134ea00700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f1334039600 0x7f133403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.533+0000 7f134ea00700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f1334039600 0x7f133403bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f133c006fd0 tx=0x7f133c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.539+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f134002c3a0 con 0x7f135007eee0 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.765+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1350105450 con 0x7f1334039600 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.778+0000 7f1347e00700 1 -- 172.21.15.82:0/2723468156 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1350105450 con 0x7f1334039600 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f1334039600 msgr2=0x7f133403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f1334039600 0x7f133403bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f133c006fd0 tx=0x7f133c006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 msgr2=0x7f135019ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135019ee10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1340000c00 tx=0x7f1340011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:14.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 shutdown_connections 2024-04-26T20:11:14.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f1334039600 0x7f133403bac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:14.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.781+0000 7f1356000700 1 --2- 172.21.15.82:0/2723468156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135007eee0 0x7f135019ee10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:14.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.782+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 >> 172.21.15.82:0/2723468156 conn(0x7f13501042a0 msgr2=0x7f1350104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:14.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.782+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 shutdown_connections 2024-04-26T20:11:14.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:13.782+0000 7f1356000700 1 -- 172.21.15.82:0/2723468156 wait complete. 2024-04-26T20:11:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:15 smithi082 ceph-mon[28105]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.255+0000 7ffb2e000700 1 Processor -- start 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.255+0000 7ffb2e000700 1 -- start start 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.255+0000 7ffb2e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb28109100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.255+0000 7ffb2e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281096d0 con 0x7ffb28108ce0 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.256+0000 7ffb27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb28109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.256+0000 7ffb27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb28109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46266/0 (socket says 172.21.15.82:46266) 2024-04-26T20:11:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.256+0000 7ffb27400700 1 -- 172.21.15.82:0/2541271327 learned_addr learned my addr 172.21.15.82:0/2541271327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.257+0000 7ffb27400700 1 -- 172.21.15.82:0/2541271327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb28109ee0 con 0x7ffb28108ce0 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.257+0000 7ffb27400700 1 --2- 172.21.15.82:0/2541271327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb28109100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb180098a0 tx=0x7ffb18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f616efb15f4cec5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.257+0000 7ffb26000700 1 -- 172.21.15.82:0/2541271327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb18004160 con 0x7ffb28108ce0 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.257+0000 7ffb26000700 1 -- 172.21.15.82:0/2541271327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffb18004300 con 0x7ffb28108ce0 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.257+0000 7ffb26000700 1 -- 172.21.15.82:0/2541271327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb18011af0 con 0x7ffb28108ce0 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 -- 172.21.15.82:0/2541271327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 msgr2=0x7ffb28109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 --2- 172.21.15.82:0/2541271327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb28109100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb180098a0 tx=0x7ffb18009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 -- 172.21.15.82:0/2541271327 shutdown_connections 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 --2- 172.21.15.82:0/2541271327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb28109100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 -- 172.21.15.82:0/2541271327 >> 172.21.15.82:0/2541271327 conn(0x7ffb281042a0 msgr2=0x7ffb281066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 -- 172.21.15.82:0/2541271327 shutdown_connections 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.258+0000 7ffb2e000700 1 -- 172.21.15.82:0/2541271327 wait complete. 2024-04-26T20:11:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb2e000700 1 Processor -- start 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb2e000700 1 -- start start 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb2e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb2807eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb2e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2810d290 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb2807eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb2807eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46270/0 (socket says 172.21.15.82:46270) 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.260+0000 7ffb27400700 1 -- 172.21.15.82:0/3293375317 learned_addr learned my addr 172.21.15.82:0/3293375317 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.261+0000 7ffb27400700 1 -- 172.21.15.82:0/3293375317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2807f080 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.261+0000 7ffb27400700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb2807eb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb18000c00 tx=0x7ffb18011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.261+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb18003b20 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.261+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffb1801a8c0 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.261+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb18024940 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.261+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2807d2c0 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.262+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2807d7a0 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.263+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ffb18022020 con 0x7ffb28108ce0 2024-04-26T20:11:16.211 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.263+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb28064a80 con 0x7ffb28108ce0 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.263+0000 7ffb1fe00700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ffb0c039600 0x7ffb0c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.263+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffb1804d8a0 con 0x7ffb28108ce0 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.263+0000 7ffb26a00700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ffb0c039600 0x7ffb0c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.264+0000 7ffb26a00700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ffb0c039600 0x7ffb0c03bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb14006fd0 tx=0x7ffb14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.269+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ffb1800be50 con 0x7ffb28108ce0 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.495+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7ffb2807e000 con 0x7ffb0c039600 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.497+0000 7ffb1fe00700 1 -- 172.21.15.82:0/3293375317 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7ffb2807e000 con 0x7ffb0c039600 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ffb0c039600 msgr2=0x7ffb0c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ffb0c039600 0x7ffb0c03bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb14006fd0 tx=0x7ffb14006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 msgr2=0x7ffb2807eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb2807eb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb18000c00 tx=0x7ffb18011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 shutdown_connections 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ffb0c039600 0x7ffb0c03bac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:16.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 --2- 172.21.15.82:0/3293375317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb28108ce0 0x7ffb2807eb40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:16.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.499+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 >> 172.21.15.82:0/3293375317 conn(0x7ffb281042a0 msgr2=0x7ffb28104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:16.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.500+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 shutdown_connections 2024-04-26T20:11:16.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:15.500+0000 7ffb2e000700 1 -- 172.21.15.82:0/3293375317 wait complete. 2024-04-26T20:11:16.213 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-04-26T20:11:16.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:16 smithi082 ceph-mon[28105]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:17.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-mon[28105]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:17.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-mon[28105]: Generating ssh key... 2024-04-26T20:11:17.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: Generating public/private rsa key pair. 2024-04-26T20:11:17.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: Your identification has been saved in /tmp/tmpgea2ac0e/key. 2024-04-26T20:11:17.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: Your public key has been saved in /tmp/tmpgea2ac0e/key.pub. 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: The key fingerprint is: 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: SHA256:8akN3A2B2TSGDR+p14SzNMUspL2tDLZ0in4rHEnk7dA ceph-da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: The key's randomart image is: 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: +---[RSA 3072]----+ 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | .XB*. | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | . +=X++ | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | o ooo+B | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | +.E+o*. | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | . +S.* o | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | o+.X . | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | ...+ + | 2024-04-26T20:11:17.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | .o . | 2024-04-26T20:11:17.939 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: | .o.. | 2024-04-26T20:11:17.939 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: +----[SHA256]-----+ 2024-04-26T20:11:18.422 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.841+0000 7f8772800700 1 Processor -- start 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.841+0000 7f8772800700 1 -- start start 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.841+0000 7f8772800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c10b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.841+0000 7f8772800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f876c10b700 con 0x7f876c10ad10 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.842+0000 7f8771400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c10b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.842+0000 7f8771400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c10b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46282/0 (socket says 172.21.15.82:46282) 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.842+0000 7f8771400700 1 -- 172.21.15.82:0/3224357558 learned_addr learned my addr 172.21.15.82:0/3224357558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.842+0000 7f8771400700 1 -- 172.21.15.82:0/3224357558 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c10bf10 con 0x7f876c10ad10 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.843+0000 7f8771400700 1 --2- 172.21.15.82:0/3224357558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c10b130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87600098a0 tx=0x7f8760009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6694d314cf0a32e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:18.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.843+0000 7f876be00700 1 -- 172.21.15.82:0/3224357558 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760004160 con 0x7f876c10ad10 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.843+0000 7f876be00700 1 -- 172.21.15.82:0/3224357558 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8760004300 con 0x7f876c10ad10 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.843+0000 7f876be00700 1 -- 172.21.15.82:0/3224357558 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760011af0 con 0x7f876c10ad10 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 -- 172.21.15.82:0/3224357558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 msgr2=0x7f876c10b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 --2- 172.21.15.82:0/3224357558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c10b130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87600098a0 tx=0x7f8760009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 -- 172.21.15.82:0/3224357558 shutdown_connections 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 --2- 172.21.15.82:0/3224357558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c10b130 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 -- 172.21.15.82:0/3224357558 >> 172.21.15.82:0/3224357558 conn(0x7f876c07e0d0 msgr2=0x7f876c07e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 -- 172.21.15.82:0/3224357558 shutdown_connections 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.844+0000 7f8772800700 1 -- 172.21.15.82:0/3224357558 wait complete. 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.845+0000 7f8772800700 1 Processor -- start 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.845+0000 7f8772800700 1 -- start start 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.845+0000 7f8772800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.845+0000 7f8772800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f876c10f2c0 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.846+0000 7f8771400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.846+0000 7f8771400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46298/0 (socket says 172.21.15.82:46298) 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.846+0000 7f8771400700 1 -- 172.21.15.82:0/3305350389 learned_addr learned my addr 172.21.15.82:0/3305350389 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.846+0000 7f8771400700 1 -- 172.21.15.82:0/3305350389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c19f1c0 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.846+0000 7f8771400700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c19ec80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87600117b0 tx=0x7f8760011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.847+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760003af0 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.847+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8760020070 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.847+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8760019630 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.847+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c19f450 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.847+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c1a2140 con 0x7f876c10ad10 2024-04-26T20:11:18.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.848+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f876001a9c0 con 0x7f876c10ad10 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.848+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c064a80 con 0x7f876c10ad10 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.848+0000 7f876a000700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f8754039600 0x7f875403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.848+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f876004db30 con 0x7f876c10ad10 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.849+0000 7f8770a00700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f8754039600 0x7f875403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.849+0000 7f8770a00700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f8754039600 0x7f875403bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8758006fd0 tx=0x7f8758006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:16.854+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f87600042a0 con 0x7f876c10ad10 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.080+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f876c108bd0 con 0x7f8754039600 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.689+0000 7f876a000700 1 -- 172.21.15.82:0/3305350389 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f876c108bd0 con 0x7f8754039600 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f8754039600 msgr2=0x7f875403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:18.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f8754039600 0x7f875403bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8758006fd0 tx=0x7f8758006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 msgr2=0x7f876c19ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c19ec80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87600117b0 tx=0x7f8760011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 shutdown_connections 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f8754039600 0x7f875403bac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 --2- 172.21.15.82:0/3305350389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f876c10ad10 0x7f876c19ec80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 >> 172.21.15.82:0/3305350389 conn(0x7f876c07e0d0 msgr2=0x7f876c1084c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 shutdown_connections 2024-04-26T20:11:18.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:17.692+0000 7f8772800700 1 -- 172.21.15.82:0/3305350389 wait complete. 2024-04-26T20:11:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:18 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:18 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:19.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:11:19.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.029+0000 7f96e5200700 1 Processor -- start 2024-04-26T20:11:19.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.029+0000 7f96e5200700 1 -- start start 2024-04-26T20:11:19.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.030+0000 7f96e5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e0109100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:19.934 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.030+0000 7f96e5200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96e01096d0 con 0x7f96e0108ce0 2024-04-26T20:11:19.934 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.030+0000 7f96dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e0109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:19.934 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.030+0000 7f96dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e0109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46300/0 (socket says 172.21.15.82:46300) 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.030+0000 7f96dde00700 1 -- 172.21.15.82:0/1968690370 learned_addr learned my addr 172.21.15.82:0/1968690370 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.031+0000 7f96dde00700 1 -- 172.21.15.82:0/1968690370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e0109ee0 con 0x7f96e0108ce0 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.031+0000 7f96dde00700 1 --2- 172.21.15.82:0/1968690370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e0109100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f96d00098a0 tx=0x7f96d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880ad242dcbb25cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.031+0000 7f96dd400700 1 -- 172.21.15.82:0/1968690370 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d0004160 con 0x7f96e0108ce0 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96dd400700 1 -- 172.21.15.82:0/1968690370 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f96d0004300 con 0x7f96e0108ce0 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96dd400700 1 -- 172.21.15.82:0/1968690370 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d0011af0 con 0x7f96e0108ce0 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96e5200700 1 -- 172.21.15.82:0/1968690370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 msgr2=0x7f96e0109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96e5200700 1 --2- 172.21.15.82:0/1968690370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e0109100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f96d00098a0 tx=0x7f96d0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96e5200700 1 -- 172.21.15.82:0/1968690370 shutdown_connections 2024-04-26T20:11:19.935 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96e5200700 1 --2- 172.21.15.82:0/1968690370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e0109100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.032+0000 7f96e5200700 1 -- 172.21.15.82:0/1968690370 >> 172.21.15.82:0/1968690370 conn(0x7f96e01042a0 msgr2=0x7f96e01066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.033+0000 7f96e5200700 1 -- 172.21.15.82:0/1968690370 shutdown_connections 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.033+0000 7f96e5200700 1 -- 172.21.15.82:0/1968690370 wait complete. 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.034+0000 7f96e5200700 1 Processor -- start 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.034+0000 7f96e5200700 1 -- start start 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.035+0000 7f96e5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.035+0000 7f96e5200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96e010d290 con 0x7f96e0108ce0 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.035+0000 7f96dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.035+0000 7f96dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46316/0 (socket says 172.21.15.82:46316) 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.035+0000 7f96dde00700 1 -- 172.21.15.82:0/4277850447 learned_addr learned my addr 172.21.15.82:0/4277850447 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96dde00700 1 -- 172.21.15.82:0/4277850447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e019d150 con 0x7f96e0108ce0 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96dde00700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e019cc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000c00 tx=0x7f96d0011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d0003b20 con 0x7f96e0108ce0 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f96d001a8c0 con 0x7f96e0108ce0 2024-04-26T20:11:19.936 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e019d3e0 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d0024940 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.036+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e01a00d0 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.038+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f96d0022020 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.038+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e0064a80 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.039+0000 7f96d7400700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f96c40395b0 0x7f96c403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.039+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f96d004d920 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.039+0000 7f96d5400700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f96c40395b0 0x7f96c403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.040+0000 7f96d5400700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f96c40395b0 0x7f96c403ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f96c8006fd0 tx=0x7f96c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.050+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f96d002c3a0 con 0x7f96e0108ce0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.278+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f96e01054a0 con 0x7f96c40395b0 2024-04-26T20:11:19.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.280+0000 7f96d7400700 1 -- 172.21.15.82:0/4277850447 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f96e01054a0 con 0x7f96c40395b0 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f96c40395b0 msgr2=0x7f96c403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f96c40395b0 0x7f96c403ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f96c8006fd0 tx=0x7f96c8006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 msgr2=0x7f96e019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e019cc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000c00 tx=0x7f96d0011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 shutdown_connections 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f96c40395b0 0x7f96c403ba70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 --2- 172.21.15.82:0/4277850447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e0108ce0 0x7f96e019cc10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 >> 172.21.15.82:0/4277850447 conn(0x7f96e01042a0 msgr2=0x7f96e0104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 shutdown_connections 2024-04-26T20:11:19.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:19.283+0000 7f96e5200700 1 -- 172.21.15.82:0/4277850447 wait complete. 2024-04-26T20:11:19.941 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:11:19.941 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T20:11:19.963 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-04-26T20:11:20.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:20 smithi082 ceph-mon[28105]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:21.403 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:21 smithi082 ceph-mon[28105]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:22.254 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:22 smithi082 ceph-mon[28105]: Deploying cephadm binary to smithi082 2024-04-26T20:11:27.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-04-26T20:11:27.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.571+0000 7f7272e00700 1 Processor -- start 2024-04-26T20:11:27.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.571+0000 7f7272e00700 1 -- start start 2024-04-26T20:11:27.584 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.572+0000 7f7272e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c109100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.572+0000 7f7272e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1096d0 con 0x7f726c108ce0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.572+0000 7f726be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.572+0000 7f726be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46330/0 (socket says 172.21.15.82:46330) 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.572+0000 7f726be00700 1 -- 172.21.15.82:0/435370268 learned_addr learned my addr 172.21.15.82:0/435370268 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.573+0000 7f726be00700 1 -- 172.21.15.82:0/435370268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c109ee0 con 0x7f726c108ce0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.573+0000 7f726be00700 1 --2- 172.21.15.82:0/435370268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c109100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f725c0098a0 tx=0x7f725c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69d78101df85141 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.573+0000 7f726aa00700 1 -- 172.21.15.82:0/435370268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c004160 con 0x7f726c108ce0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.573+0000 7f726aa00700 1 -- 172.21.15.82:0/435370268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f725c004300 con 0x7f726c108ce0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.573+0000 7f726aa00700 1 -- 172.21.15.82:0/435370268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c011af0 con 0x7f726c108ce0 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 -- 172.21.15.82:0/435370268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 msgr2=0x7f726c109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 --2- 172.21.15.82:0/435370268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c109100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f725c0098a0 tx=0x7f725c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:27.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 -- 172.21.15.82:0/435370268 shutdown_connections 2024-04-26T20:11:27.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 --2- 172.21.15.82:0/435370268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c109100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:27.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 -- 172.21.15.82:0/435370268 >> 172.21.15.82:0/435370268 conn(0x7f726c1042a0 msgr2=0x7f726c1066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 -- 172.21.15.82:0/435370268 shutdown_connections 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.574+0000 7f7272e00700 1 -- 172.21.15.82:0/435370268 wait complete. 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.575+0000 7f7272e00700 1 Processor -- start 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.575+0000 7f7272e00700 1 -- start start 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.576+0000 7f7272e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.576+0000 7f7272e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f726c10d290 con 0x7f726c108ce0 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.576+0000 7f726be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.576+0000 7f726be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46342/0 (socket says 172.21.15.82:46342) 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.576+0000 7f726be00700 1 -- 172.21.15.82:0/102657141 learned_addr learned my addr 172.21.15.82:0/102657141 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.576+0000 7f726be00700 1 -- 172.21.15.82:0/102657141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c19f370 con 0x7f726c108ce0 2024-04-26T20:11:27.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.577+0000 7f726be00700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c19ee30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f725c000c00 tx=0x7f725c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.577+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c003b20 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.577+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f725c01a8c0 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.577+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c024940 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.577+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c19f600 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.577+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1a22f0 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.578+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f725c022020 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.578+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c064a80 con 0x7f726c108ce0 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.579+0000 7f7268c00700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f72500395b0 0x7f725003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:27.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.579+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f725c04d920 con 0x7f726c108ce0 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.579+0000 7f726b400700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f72500395b0 0x7f725003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.580+0000 7f726b400700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f72500395b0 0x7f725003ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7258006fd0 tx=0x7f7258006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.584+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f725c02c3a0 con 0x7f726c108ce0 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:20.813+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) -- 0x7f726c105410 con 0x7f72500395b0 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.831+0000 7f7268c00700 1 -- 172.21.15.82:0/102657141 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f726c105410 con 0x7f72500395b0 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.834+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f72500395b0 msgr2=0x7f725003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.834+0000 7f7272e00700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f72500395b0 0x7f725003ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7258006fd0 tx=0x7f7258006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.834+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 msgr2=0x7f726c19ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.834+0000 7f7272e00700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c19ee30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f725c000c00 tx=0x7f725c011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.835+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 shutdown_connections 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.835+0000 7f7272e00700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f72500395b0 0x7f725003ba70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.835+0000 7f7272e00700 1 --2- 172.21.15.82:0/102657141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f726c108ce0 0x7f726c19ee30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.835+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 >> 172.21.15.82:0/102657141 conn(0x7f726c1042a0 msgr2=0x7f726c104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.835+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 shutdown_connections 2024-04-26T20:11:27.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:26.835+0000 7f7272e00700 1 -- 172.21.15.82:0/102657141 wait complete. 2024-04-26T20:11:27.593 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2024-04-26T20:11:28.136 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:27 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:28.136 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:27 smithi082 ceph-mon[28105]: Added host smithi082 2024-04-26T20:11:28.136 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:27 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:29.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T20:11:29.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.304+0000 7f5d1e000700 1 Processor -- start 2024-04-26T20:11:29.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.305+0000 7f5d1e000700 1 -- start start 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.305+0000 7f5d1e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1807d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.305+0000 7f5d1e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1807d8f0 con 0x7f5d1807eec0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.305+0000 7f5d17400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1807d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.305+0000 7f5d17400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1807d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57664/0 (socket says 172.21.15.82:57664) 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.305+0000 7f5d17400700 1 -- 172.21.15.82:0/1386422269 learned_addr learned my addr 172.21.15.82:0/1386422269 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.306+0000 7f5d17400700 1 -- 172.21.15.82:0/1386422269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1807da70 con 0x7f5d1807eec0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.306+0000 7f5d17400700 1 --2- 172.21.15.82:0/1386422269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1807d320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d080098a0 tx=0x7f5d08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b92fbc06f51078d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.307+0000 7f5d16000700 1 -- 172.21.15.82:0/1386422269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d08004160 con 0x7f5d1807eec0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.307+0000 7f5d16000700 1 -- 172.21.15.82:0/1386422269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5d08004300 con 0x7f5d1807eec0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.307+0000 7f5d16000700 1 -- 172.21.15.82:0/1386422269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d08011af0 con 0x7f5d1807eec0 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 -- 172.21.15.82:0/1386422269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 msgr2=0x7f5d1807d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 --2- 172.21.15.82:0/1386422269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1807d320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d080098a0 tx=0x7f5d08009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 -- 172.21.15.82:0/1386422269 shutdown_connections 2024-04-26T20:11:29.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 --2- 172.21.15.82:0/1386422269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1807d320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 -- 172.21.15.82:0/1386422269 >> 172.21.15.82:0/1386422269 conn(0x7f5d181042a0 msgr2=0x7f5d181066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 -- 172.21.15.82:0/1386422269 shutdown_connections 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.308+0000 7f5d1e000700 1 -- 172.21.15.82:0/1386422269 wait complete. 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.309+0000 7f5d1e000700 1 Processor -- start 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.309+0000 7f5d1e000700 1 -- start start 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.310+0000 7f5d1e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.310+0000 7f5d1e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1810f290 con 0x7f5d1807eec0 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.310+0000 7f5d17400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.310+0000 7f5d17400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57676/0 (socket says 172.21.15.82:57676) 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.310+0000 7f5d17400700 1 -- 172.21.15.82:0/3624178279 learned_addr learned my addr 172.21.15.82:0/3624178279 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:29.396 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.310+0000 7f5d17400700 1 -- 172.21.15.82:0/3624178279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1819f330 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.311+0000 7f5d17400700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1819edf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5d08000c00 tx=0x7f5d08011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.311+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d08003b20 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.311+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5d0801a8c0 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.311+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d08024940 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.311+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1819f5c0 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.311+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d181a22b0 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.312+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d18064a80 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.312+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f5d08022020 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.313+0000 7f5d0fe00700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f5cfc039600 0x7f5cfc03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.313+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5d0804d8a0 con 0x7f5d1807eec0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.313+0000 7f5d16a00700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f5cfc039600 0x7f5cfc03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.314+0000 7f5d16a00700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f5cfc039600 0x7f5cfc03bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d04006fd0 tx=0x7f5d04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:29.397 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.318+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5d0800be50 con 0x7f5d1807eec0 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.584+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f5d181054a0 con 0x7f5cfc039600 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.593+0000 7f5d0fe00700 1 -- 172.21.15.82:0/3624178279 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5d181054a0 con 0x7f5cfc039600 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.596+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f5cfc039600 msgr2=0x7f5cfc03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.596+0000 7f5d1e000700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f5cfc039600 0x7f5cfc03bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d04006fd0 tx=0x7f5d04006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.596+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 msgr2=0x7f5d1819edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.596+0000 7f5d1e000700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1819edf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5d08000c00 tx=0x7f5d08011b70 comp rx=0 tx=0).stop 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.597+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 shutdown_connections 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.597+0000 7f5d1e000700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f5cfc039600 0x7f5cfc03bac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.597+0000 7f5d1e000700 1 --2- 172.21.15.82:0/3624178279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d1807eec0 0x7f5d1819edf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.597+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 >> 172.21.15.82:0/3624178279 conn(0x7f5d181042a0 msgr2=0x7f5d18104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.597+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 shutdown_connections 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:28.597+0000 7f5d1e000700 1 -- 172.21.15.82:0/3624178279 wait complete. 2024-04-26T20:11:29.398 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2024-04-26T20:11:29.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:29 smithi082 ceph-mon[28105]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:29.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:29 smithi082 ceph-mon[28105]: Saving service mon spec with placement count:5 2024-04-26T20:11:29.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:29 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:31.836 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:31 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:31.836 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:31 smithi082 ceph-mon[28105]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:11:31.836 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:31 smithi082 ceph-mon[28105]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:31.836 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:31 smithi082 ceph-mon[28105]: Saving service mgr spec with placement count:2 2024-04-26T20:11:31.836 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:31 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:31.836 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:31 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.850+0000 7ff8ed800700 1 Processor -- start 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.850+0000 7ff8ed800700 1 -- start start 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.851+0000 7ff8ed800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e807d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.851+0000 7ff8ed800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e807d8d0 con 0x7ff8e807eea0 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.852+0000 7ff8e6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e807d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.852+0000 7ff8e6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e807d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58616/0 (socket says 172.21.15.82:58616) 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.852+0000 7ff8e6a00700 1 -- 172.21.15.82:0/1739232229 learned_addr learned my addr 172.21.15.82:0/1739232229 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.852+0000 7ff8e6a00700 1 -- 172.21.15.82:0/1739232229 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e807da50 con 0x7ff8e807eea0 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.852+0000 7ff8e6a00700 1 --2- 172.21.15.82:0/1739232229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e807d300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80098a0 tx=0x7ff8d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8404435e57ec7eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:31.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.853+0000 7ff8e5600700 1 -- 172.21.15.82:0/1739232229 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d8004160 con 0x7ff8e807eea0 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.853+0000 7ff8e5600700 1 -- 172.21.15.82:0/1739232229 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d8004300 con 0x7ff8e807eea0 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.853+0000 7ff8e5600700 1 -- 172.21.15.82:0/1739232229 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d8011a20 con 0x7ff8e807eea0 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.853+0000 7ff8ed800700 1 -- 172.21.15.82:0/1739232229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 msgr2=0x7ff8e807d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.853+0000 7ff8ed800700 1 --2- 172.21.15.82:0/1739232229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e807d300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80098a0 tx=0x7ff8d8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.854+0000 7ff8ed800700 1 -- 172.21.15.82:0/1739232229 shutdown_connections 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.854+0000 7ff8ed800700 1 --2- 172.21.15.82:0/1739232229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e807d300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.854+0000 7ff8ed800700 1 -- 172.21.15.82:0/1739232229 >> 172.21.15.82:0/1739232229 conn(0x7ff8e81042a0 msgr2=0x7ff8e81066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.854+0000 7ff8ed800700 1 -- 172.21.15.82:0/1739232229 shutdown_connections 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.854+0000 7ff8ed800700 1 -- 172.21.15.82:0/1739232229 wait complete. 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8ed800700 1 Processor -- start 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8ed800700 1 -- start start 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8ed800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:31.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8ed800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e810f300 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8e6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8e6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58618/0 (socket says 172.21.15.82:58618) 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.855+0000 7ff8e6a00700 1 -- 172.21.15.82:0/2549184002 learned_addr learned my addr 172.21.15.82:0/2549184002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8e6a00700 1 -- 172.21.15.82:0/2549184002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e819f280 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8e6a00700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e819ed40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8000c00 tx=0x7ff8d8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d8003aa0 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8d801b8f0 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e819f510 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d8023870 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.856+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81a2200 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.858+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e8064a80 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.858+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff8d8023b70 con 0x7ff8e807eea0 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.859+0000 7ff8df400700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff8cc0395b0 0x7ff8cc03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:31.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.859+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff8d804df20 con 0x7ff8e807eea0 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.859+0000 7ff8e6000700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff8cc0395b0 0x7ff8cc03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.860+0000 7ff8e6000700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff8cc0395b0 0x7ff8cc03ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4006fd0 tx=0x7ff8d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:30.864+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff8d801f030 con 0x7ff8e807eea0 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.108+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff8e81053d0 con 0x7ff8cc0395b0 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.119+0000 7ff8df400700 1 -- 172.21.15.82:0/2549184002 <== mgr.14120 v2:172.21.15.82:6800/3159671154 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff8e81053d0 con 0x7ff8cc0395b0 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.121+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff8cc0395b0 msgr2=0x7ff8cc03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.121+0000 7ff8ed800700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff8cc0395b0 0x7ff8cc03ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4006fd0 tx=0x7ff8d4006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.121+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 msgr2=0x7ff8e819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.121+0000 7ff8ed800700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e819ed40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8000c00 tx=0x7ff8d8011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.122+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 shutdown_connections 2024-04-26T20:11:31.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.122+0000 7ff8ed800700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff8cc0395b0 0x7ff8cc03ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:31.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.122+0000 7ff8ed800700 1 --2- 172.21.15.82:0/2549184002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8e807eea0 0x7ff8e819ed40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:31.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.122+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 >> 172.21.15.82:0/2549184002 conn(0x7ff8e81042a0 msgr2=0x7ff8e8104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:31.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.122+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 shutdown_connections 2024-04-26T20:11:31.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:31.122+0000 7ff8ed800700 1 -- 172.21.15.82:0/2549184002 wait complete. 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.465+0000 7fe4a3800700 1 Processor -- start 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.465+0000 7fe4a3800700 1 -- start start 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.465+0000 7fe4a3800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c07d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.465+0000 7fe4a3800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c07d930 con 0x7fe49c07ef00 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.466+0000 7fe4a0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c07d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.466+0000 7fe4a0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c07d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58634/0 (socket says 172.21.15.82:58634) 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.466+0000 7fe4a0e00700 1 -- 172.21.15.82:0/1736424725 learned_addr learned my addr 172.21.15.82:0/1736424725 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.466+0000 7fe4a0e00700 1 -- 172.21.15.82:0/1736424725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c07dab0 con 0x7fe49c07ef00 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.467+0000 7fe4a0e00700 1 --2- 172.21.15.82:0/1736424725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c07d360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4900098a0 tx=0x7fe490009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b6d033bd654195 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.467+0000 7fe49b400700 1 -- 172.21.15.82:0/1736424725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490004160 con 0x7fe49c07ef00 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.467+0000 7fe49b400700 1 -- 172.21.15.82:0/1736424725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe490004300 con 0x7fe49c07ef00 2024-04-26T20:11:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.467+0000 7fe49b400700 1 -- 172.21.15.82:0/1736424725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490011a20 con 0x7fe49c07ef00 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 -- 172.21.15.82:0/1736424725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 msgr2=0x7fe49c07d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 --2- 172.21.15.82:0/1736424725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c07d360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4900098a0 tx=0x7fe490009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 -- 172.21.15.82:0/1736424725 shutdown_connections 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 --2- 172.21.15.82:0/1736424725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c07d360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 -- 172.21.15.82:0/1736424725 >> 172.21.15.82:0/1736424725 conn(0x7fe49c1042a0 msgr2=0x7fe49c1066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 -- 172.21.15.82:0/1736424725 shutdown_connections 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.468+0000 7fe4a3800700 1 -- 172.21.15.82:0/1736424725 wait complete. 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.469+0000 7fe4a3800700 1 Processor -- start 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.469+0000 7fe4a3800700 1 -- start start 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.469+0000 7fe4a3800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c1a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.469+0000 7fe4a3800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c10aee0 con 0x7fe49c07ef00 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.470+0000 7fe4a0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c1a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:33.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.470+0000 7fe4a0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c1a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58646/0 (socket says 172.21.15.82:58646) 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.470+0000 7fe4a0e00700 1 -- 172.21.15.82:0/622418774 learned_addr learned my addr 172.21.15.82:0/622418774 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.470+0000 7fe4a0e00700 1 -- 172.21.15.82:0/622418774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c1a36f0 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.470+0000 7fe4a0e00700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c1a31b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe490009520 tx=0x7fe490011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.471+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490003af0 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.471+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe49001a8e0 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.471+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4900247a0 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.471+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c1a3980 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.471+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c1a6670 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.472+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fe490022020 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.472+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49c064a80 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.473+0000 7fe499600700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fe484039600 0x7fe48403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.473+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe49004d970 con 0x7fe49c07ef00 2024-04-26T20:11:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.473+0000 7fe49be00700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fe484039600 0x7fe48403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.474+0000 7fe49be00700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fe484039600 0x7fe48403bac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe488006fd0 tx=0x7fe488006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.478+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe49002dde0 con 0x7fe49c07ef00 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.731+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fe49c02e720 con 0x7fe49c07ef00 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.734+0000 7fe499600700 1 -- 172.21.15.82:0/622418774 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fe49004d2c0 con 0x7fe49c07ef00 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fe484039600 msgr2=0x7fe48403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fe484039600 0x7fe48403bac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe488006fd0 tx=0x7fe488006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 msgr2=0x7fe49c1a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c1a31b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe490009520 tx=0x7fe490011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 shutdown_connections 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fe484039600 0x7fe48403bac0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 --2- 172.21.15.82:0/622418774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c07ef00 0x7fe49c1a31b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 >> 172.21.15.82:0/622418774 conn(0x7fe49c1042a0 msgr2=0x7fe49c106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 shutdown_connections 2024-04-26T20:11:33.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:32.738+0000 7fe4a3800700 1 -- 172.21.15.82:0/622418774 wait complete. 2024-04-26T20:11:33.846 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:33 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/622418774' entity='client.admin' 2024-04-26T20:11:33.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:33 smithi082 ceph-mon[28105]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:11:35.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.637+0000 7f15dc600700 1 Processor -- start 2024-04-26T20:11:35.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.637+0000 7f15dc600700 1 -- start start 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.637+0000 7f15dc600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d4109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.637+0000 7f15dc600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4109700 con 0x7f15d4108d10 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.638+0000 7f15d9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d4109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.638+0000 7f15d9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d4109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58650/0 (socket says 172.21.15.82:58650) 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.638+0000 7f15d9c00700 1 -- 172.21.15.82:0/4174639867 learned_addr learned my addr 172.21.15.82:0/4174639867 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.638+0000 7f15d9c00700 1 -- 172.21.15.82:0/4174639867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d4109f10 con 0x7f15d4108d10 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.639+0000 7f15d9c00700 1 --2- 172.21.15.82:0/4174639867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d4109130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15c80098a0 tx=0x7f15c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111e2e4de46b9fc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:35.635 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.639+0000 7f15d3e00700 1 -- 172.21.15.82:0/4174639867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15c8004160 con 0x7f15d4108d10 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.639+0000 7f15d3e00700 1 -- 172.21.15.82:0/4174639867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c8004300 con 0x7f15d4108d10 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.639+0000 7f15d3e00700 1 -- 172.21.15.82:0/4174639867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15c8011a20 con 0x7f15d4108d10 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 -- 172.21.15.82:0/4174639867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 msgr2=0x7f15d4109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 --2- 172.21.15.82:0/4174639867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d4109130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15c80098a0 tx=0x7f15c8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 -- 172.21.15.82:0/4174639867 shutdown_connections 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 --2- 172.21.15.82:0/4174639867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d4109130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:35.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 -- 172.21.15.82:0/4174639867 >> 172.21.15.82:0/4174639867 conn(0x7f15d41042f0 msgr2=0x7f15d4106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 -- 172.21.15.82:0/4174639867 shutdown_connections 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.640+0000 7f15dc600700 1 -- 172.21.15.82:0/4174639867 wait complete. 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.641+0000 7f15dc600700 1 Processor -- start 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.641+0000 7f15dc600700 1 -- start start 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.642+0000 7f15dc600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.642+0000 7f15dc600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15d410d2c0 con 0x7f15d4108d10 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.642+0000 7f15d9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.642+0000 7f15d9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58662/0 (socket says 172.21.15.82:58662) 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.642+0000 7f15d9c00700 1 -- 172.21.15.82:0/865274590 learned_addr learned my addr 172.21.15.82:0/865274590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.642+0000 7f15d9c00700 1 -- 172.21.15.82:0/865274590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d419d1e0 con 0x7f15d4108d10 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.643+0000 7f15d9c00700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d419cca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15c8000c00 tx=0x7f15c8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:35.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.643+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15c8003aa0 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.643+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c801b8f0 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.643+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d419d470 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.643+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15c8023890 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.643+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a0110 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.644+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f15c801b440 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.645+0000 7f15d2000700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f15bc039600 0x7f15bc03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.645+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f15c804dec0 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.645+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d4064a80 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.645+0000 7f15d9200700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f15bc039600 0x7f15bc03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.646+0000 7f15d9200700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f15bc039600 0x7f15bc03bac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.651+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f15c801f030 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.875+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f15d41a06d0 con 0x7f15d4108d10 2024-04-26T20:11:35.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.883+0000 7f15d2000700 1 -- 172.21.15.82:0/865274590 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f15c80292a0 con 0x7f15d4108d10 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f15bc039600 msgr2=0x7f15bc03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f15bc039600 0x7f15bc03bac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 msgr2=0x7f15d419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d419cca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15c8000c00 tx=0x7f15c8011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 shutdown_connections 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f15bc039600 0x7f15bc03bac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 --2- 172.21.15.82:0/865274590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4108d10 0x7f15d419cca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 >> 172.21.15.82:0/865274590 conn(0x7f15d41042f0 msgr2=0x7f15d4104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.886+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 shutdown_connections 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:34.887+0000 7f15dc600700 1 -- 172.21.15.82:0/865274590 wait complete. 2024-04-26T20:11:35.643 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-04-26T20:11:35.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:35 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:35.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/865274590' entity='client.admin' 2024-04-26T20:11:35.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:35 smithi082 ceph-mon[28105]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:11:37.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:37 smithi082 ceph-mon[28105]: from='mgr.14120 172.21.15.82:0/367884400' entity='mgr.x' 2024-04-26T20:11:37.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:37 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2240918341' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T20:11:37.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:37 smithi082 ceph-mon[28105]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:11:37.877 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: ignoring --setuser ceph since I am not root 2024-04-26T20:11:37.877 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: ignoring --setgroup ceph since I am not root 2024-04-26T20:11:37.878 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:37.764+0000 7f12d36d9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:11:38.132 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:38.001+0000 7f12d36d9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:11:38.132 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:38.131+0000 7f12d36d9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:11:38.894 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2240918341' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T20:11:38.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:38 smithi082 ceph-mon[28105]: mgrmap e9: x(active, since 26s) 2024-04-26T20:11:38.895 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:38.526+0000 7f12d36d9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:11:38.895 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:38.638+0000 7f12d36d9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:11:39.240 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.242+0000 7ff960400700 1 Processor -- start 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.242+0000 7ff960400700 1 -- start start 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.242+0000 7ff960400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95807d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.243+0000 7ff960400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff95807d8d0 con 0x7ff95807eea0 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.243+0000 7ff95da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95807d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.243+0000 7ff95da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95807d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58678/0 (socket says 172.21.15.82:58678) 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.243+0000 7ff95da00700 1 -- 172.21.15.82:0/618629939 learned_addr learned my addr 172.21.15.82:0/618629939 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.243+0000 7ff95da00700 1 -- 172.21.15.82:0/618629939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95807da50 con 0x7ff95807eea0 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.244+0000 7ff95da00700 1 --2- 172.21.15.82:0/618629939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95807d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0098a0 tx=0x7ff94c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57931b47977cd998 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.244+0000 7ff957e00700 1 -- 172.21.15.82:0/618629939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94c004160 con 0x7ff95807eea0 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.244+0000 7ff957e00700 1 -- 172.21.15.82:0/618629939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff94c004300 con 0x7ff95807eea0 2024-04-26T20:11:39.241 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.244+0000 7ff957e00700 1 -- 172.21.15.82:0/618629939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94c011a20 con 0x7ff95807eea0 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 -- 172.21.15.82:0/618629939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 msgr2=0x7ff95807d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 --2- 172.21.15.82:0/618629939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95807d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0098a0 tx=0x7ff94c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 -- 172.21.15.82:0/618629939 shutdown_connections 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 --2- 172.21.15.82:0/618629939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95807d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 -- 172.21.15.82:0/618629939 >> 172.21.15.82:0/618629939 conn(0x7ff9581042a0 msgr2=0x7ff9581066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 -- 172.21.15.82:0/618629939 shutdown_connections 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.245+0000 7ff960400700 1 -- 172.21.15.82:0/618629939 wait complete. 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.246+0000 7ff960400700 1 Processor -- start 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.246+0000 7ff960400700 1 -- start start 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.247+0000 7ff960400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.247+0000 7ff960400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff95810f300 con 0x7ff95807eea0 2024-04-26T20:11:39.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.247+0000 7ff95da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.247+0000 7ff95da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58694/0 (socket says 172.21.15.82:58694) 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.247+0000 7ff95da00700 1 -- 172.21.15.82:0/2240918341 learned_addr learned my addr 172.21.15.82:0/2240918341 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.247+0000 7ff95da00700 1 -- 172.21.15.82:0/2240918341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95819f280 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.248+0000 7ff95da00700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95819ed40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff94c000c00 tx=0x7ff94c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.248+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94c003aa0 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.248+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff94c01b8f0 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.248+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94c023870 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.248+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95819f510 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.248+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9581a2200 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.250+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff94c01b440 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.249+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff958064a80 con 0x7ff95807eea0 2024-04-26T20:11:39.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.250+0000 7ff956000700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff940039600 0x7ff94003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.250+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff94c04dea0 con 0x7ff95807eea0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.250+0000 7ff95d000700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff940039600 0x7ff94003bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.251+0000 7ff95d000700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff940039600 0x7ff94003bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff944006fd0 tx=0x7ff944006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.256+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff94c01f030 con 0x7ff95807eea0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:36.551+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff9581a27f0 con 0x7ff95807eea0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.464+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff94c01bd30 con 0x7ff95807eea0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.467+0000 7ff956000700 1 -- 172.21.15.82:0/2240918341 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7ff94c053020 con 0x7ff95807eea0 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.469+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff940039600 msgr2=0x7ff94003bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.469+0000 7ff960400700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff940039600 0x7ff94003bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff944006fd0 tx=0x7ff944006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.469+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 msgr2=0x7ff95819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.469+0000 7ff960400700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95819ed40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff94c000c00 tx=0x7ff94c011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:39.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.470+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 shutdown_connections 2024-04-26T20:11:39.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.470+0000 7ff960400700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7ff940039600 0x7ff94003bac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:39.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.470+0000 7ff960400700 1 --2- 172.21.15.82:0/2240918341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff95807eea0 0x7ff95819ed40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:39.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.470+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 >> 172.21.15.82:0/2240918341 conn(0x7ff9581042a0 msgr2=0x7ff958104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:39.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.470+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 shutdown_connections 2024-04-26T20:11:39.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:37.470+0000 7ff960400700 1 -- 172.21.15.82:0/2240918341 wait complete. 2024-04-26T20:11:40.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:40 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1885554217' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T20:11:40.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:40.238+0000 7f12d36d9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:11:40.820 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:40.475+0000 7f12d36d9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:11:40.821 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:40.697+0000 7f12d36d9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:11:40.831 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.847+0000 7fba0d600700 1 Processor -- start 2024-04-26T20:11:40.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.847+0000 7fba0d600700 1 -- start start 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.848+0000 7fba0d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba08107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.848+0000 7fba0d600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba081085c0 con 0x7fba08107bd0 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.848+0000 7fba06a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba08107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.848+0000 7fba06a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba08107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58720/0 (socket says 172.21.15.82:58720) 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.848+0000 7fba06a00700 1 -- 172.21.15.82:0/930511575 learned_addr learned my addr 172.21.15.82:0/930511575 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.849+0000 7fba06a00700 1 -- 172.21.15.82:0/930511575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08108dd0 con 0x7fba08107bd0 2024-04-26T20:11:40.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.849+0000 7fba06a00700 1 --2- 172.21.15.82:0/930511575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba08107ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800bb40 tx=0x7fb9f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4269de90df7f91fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:40.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.849+0000 7fba05600700 1 -- 172.21.15.82:0/930511575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f800dbe0 con 0x7fba08107bd0 2024-04-26T20:11:40.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.849+0000 7fba05600700 1 -- 172.21.15.82:0/930511575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9f80044e0 con 0x7fba08107bd0 2024-04-26T20:11:40.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.849+0000 7fba05600700 1 -- 172.21.15.82:0/930511575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f8010470 con 0x7fba08107bd0 2024-04-26T20:11:40.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 -- 172.21.15.82:0/930511575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 msgr2=0x7fba08107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:40.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 --2- 172.21.15.82:0/930511575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba08107ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800bb40 tx=0x7fb9f800be50 comp rx=0 tx=0).stop 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 -- 172.21.15.82:0/930511575 shutdown_connections 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 --2- 172.21.15.82:0/930511575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba08107ff0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 -- 172.21.15.82:0/930511575 >> 172.21.15.82:0/930511575 conn(0x7fba081031d0 msgr2=0x7fba081055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 -- 172.21.15.82:0/930511575 shutdown_connections 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.850+0000 7fba0d600700 1 -- 172.21.15.82:0/930511575 wait complete. 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.851+0000 7fba0d600700 1 Processor -- start 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.852+0000 7fba0d600700 1 -- start start 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.852+0000 7fba0d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba0819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.852+0000 7fba0d600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba0807bff0 con 0x7fba08107bd0 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.852+0000 7fba06a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba0819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.852+0000 7fba06a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba0819aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58732/0 (socket says 172.21.15.82:58732) 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.852+0000 7fba06a00700 1 -- 172.21.15.82:0/1885554217 learned_addr learned my addr 172.21.15.82:0/1885554217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fba06a00700 1 -- 172.21.15.82:0/1885554217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0819af70 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fba06a00700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba0819aa30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8003c30 tx=0x7fb9f8003ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f8027070 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9f8010bd0 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0819b200 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f8022a60 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.853+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0819dea0 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.855+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba08064a80 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.855+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fb9f802a070 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.855+0000 7fb9ff400700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 0x7fb9ec03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.855+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb9f801f070 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.855+0000 7fba06000700 1 -- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 msgr2=0x7fb9ec03bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.856+0000 7fba06000700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 0x7fb9ec03bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:39.865+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb9f8015070 con 0x7fba08107bd0 2024-04-26T20:11:40.839 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.057+0000 7fba06000700 1 -- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 msgr2=0x7fb9ec03bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.057+0000 7fba06000700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 0x7fb9ec03bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.157+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fba08193f90 con 0x7fba08107bd0 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.158+0000 7fb9ff400700 1 -- 172.21.15.82:0/1885554217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fba08193f90 con 0x7fba08107bd0 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 msgr2=0x7fb9ec03bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 0x7fb9ec03bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 msgr2=0x7fba0819aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba0819aa30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8003c30 tx=0x7fb9f8003ff0 comp rx=0 tx=0).stop 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 shutdown_connections 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7fb9ec039660 0x7fb9ec03bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 --2- 172.21.15.82:0/1885554217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba08107bd0 0x7fba0819aa30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 >> 172.21.15.82:0/1885554217 conn(0x7fba081031d0 msgr2=0x7fba08191050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 shutdown_connections 2024-04-26T20:11:40.840 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:40.161+0000 7fba0d600700 1 -- 172.21.15.82:0/1885554217 wait complete. 2024-04-26T20:11:40.841 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-04-26T20:11:40.841 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-04-26T20:11:41.358 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:41.093+0000 7f12d36d9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:11:41.358 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:41.229+0000 7f12d36d9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:11:41.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:41.489+0000 7f12d36d9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:11:42.123 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:41.743+0000 7f12d36d9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:11:42.924 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:42 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:42.529+0000 7f12d36d9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:11:43.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:43.079+0000 7f12d36d9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:11:43.473 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:43.207+0000 7f12d36d9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:11:43.474 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:43.472+0000 7f12d36d9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:11:44.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:44.119+0000 7f12d36d9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:11:44.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:44.244+0000 7f12d36d9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:11:44.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:44.565+0000 7f12d36d9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:11:44.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:44.743+0000 7f12d36d9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:11:44.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:44.869+0000 7f12d36d9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:11:45.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:45.019+0000 7f12d36d9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:11:45.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:45.383+0000 7f12d36d9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:11:46.419 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:46.131+0000 7f12d36d9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:11:46.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:11:46.418+0000 7f12d36d9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:11:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: Active manager daemon x restarted 2024-04-26T20:11:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: Activating manager daemon x 2024-04-26T20:11:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T20:11:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: mgrmap e10: x(active, starting, since 0.0118872s) 2024-04-26T20:11:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:11:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T20:11:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:11:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:11:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:11:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:46 smithi082 ceph-mon[28105]: Manager daemon x is now available 2024-04-26T20:11:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:11:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T20:11:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:47 smithi082 ceph-mon[28105]: mgrmap e11: x(active, since 1.01584s) 2024-04-26T20:11:48.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:11:48.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T20:11:48.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T20:11:48.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:11:48.131 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.512+0000 7f30d5800700 1 Processor -- start 2024-04-26T20:11:48.131 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.513+0000 7f30d5800700 1 -- start start 2024-04-26T20:11:48.131 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.513+0000 7f30d5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d0109100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:48.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.513+0000 7f30d5800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01096d0 con 0x7f30d0108ce0 2024-04-26T20:11:48.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.513+0000 7f30cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d0109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:48.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.513+0000 7f30cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d0109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59262/0 (socket says 172.21.15.82:59262) 2024-04-26T20:11:48.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.513+0000 7f30cea00700 1 -- 172.21.15.82:0/681806852 learned_addr learned my addr 172.21.15.82:0/681806852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.514+0000 7f30cea00700 1 -- 172.21.15.82:0/681806852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d0109ee0 con 0x7f30d0108ce0 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.514+0000 7f30cea00700 1 --2- 172.21.15.82:0/681806852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d0109100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30c00098a0 tx=0x7f30c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59ef4d4d73e8c0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.514+0000 7f30cd600700 1 -- 172.21.15.82:0/681806852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0004160 con 0x7f30d0108ce0 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30cd600700 1 -- 172.21.15.82:0/681806852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c0004300 con 0x7f30d0108ce0 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30cd600700 1 -- 172.21.15.82:0/681806852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0011a20 con 0x7f30d0108ce0 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30d5800700 1 -- 172.21.15.82:0/681806852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 msgr2=0x7f30d0109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30d5800700 1 --2- 172.21.15.82:0/681806852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d0109100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30c00098a0 tx=0x7f30c0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30d5800700 1 -- 172.21.15.82:0/681806852 shutdown_connections 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30d5800700 1 --2- 172.21.15.82:0/681806852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d0109100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.515+0000 7f30d5800700 1 -- 172.21.15.82:0/681806852 >> 172.21.15.82:0/681806852 conn(0x7f30d01042a0 msgr2=0x7f30d01066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.516+0000 7f30d5800700 1 -- 172.21.15.82:0/681806852 shutdown_connections 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.516+0000 7f30d5800700 1 -- 172.21.15.82:0/681806852 wait complete. 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30d5800700 1 Processor -- start 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30d5800700 1 -- start start 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30d5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30d5800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f30d010d290 con 0x7f30d0108ce0 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d019edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59264/0 (socket says 172.21.15.82:59264) 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.517+0000 7f30cea00700 1 -- 172.21.15.82:0/416230839 learned_addr learned my addr 172.21.15.82:0/416230839 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.518+0000 7f30cea00700 1 -- 172.21.15.82:0/416230839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d019f310 con 0x7f30d0108ce0 2024-04-26T20:11:48.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.518+0000 7f30cea00700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d019edd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30c00116e0 tx=0x7f30c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.518+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c00039e0 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.518+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c001b8f0 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.518+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0023760 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.518+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d019f5a0 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.519+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d01a2290 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.520+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f30c0023920 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.520+0000 7f30c7400700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.520+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 --> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f30b403c1e0 con 0x7f30b4039610 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.520+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f30c004def0 con 0x7f30d0108ce0 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.520+0000 7f30ce000700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 msgr2=0x7f30b403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.520+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.721+0000 7f30ce000700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 msgr2=0x7f30b403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:48.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:41.721+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:42.122+0000 7f30ce000700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 msgr2=0x7f30b403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:42.122+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:42.923+0000 7f30ce000700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 msgr2=0x7f30b403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:42.923+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:44.525+0000 7f30ce000700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 msgr2=0x7f30b403bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3159671154 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:44.525+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:46.430+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7f30c001b440 con 0x7f30d0108ce0 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:46.431+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 msgr2=0x7f30b403bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:46.431+0000 7f30c7400700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.432+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f30c0021b60 con 0x7f30d0108ce0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.433+0000 7f30c7400700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f30b403cff0 0x7f30b403f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.433+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f30b403c1e0 con 0x7f30b403cff0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.434+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f30b403cff0 0x7f30b403f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.435+0000 7f30ce000700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f30b403cff0 0x7f30b403f3e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003a10 tx=0x7f30bc009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.436+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f30b403c1e0 con 0x7f30b403cff0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.445+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f30d010d0e0 con 0x7f30b403cff0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.445+0000 7f30c7400700 1 -- 172.21.15.82:0/416230839 <== mgr.14152 v2:172.21.15.82:6800/893198693 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f30d010d0e0 con 0x7f30b403cff0 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f30b403cff0 msgr2=0x7f30b403f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f30b403cff0 0x7f30b403f3e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003a10 tx=0x7f30bc009270 comp rx=0 tx=0).stop 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 msgr2=0x7f30d019edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d019edd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30c00116e0 tx=0x7f30c0011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 shutdown_connections 2024-04-26T20:11:48.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f30b403cff0 0x7f30b403f3e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30d0108ce0 0x7f30d019edd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 --2- 172.21.15.82:0/416230839 >> [v2:172.21.15.82:6800/3159671154,v1:172.21.15.82:6801/3159671154] conn(0x7f30b4039610 0x7f30b403bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 >> 172.21.15.82:0/416230839 conn(0x7f30d01042a0 msgr2=0x7f30d0104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 shutdown_connections 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:47.446+0000 7f30d5800700 1 -- 172.21.15.82:0/416230839 wait complete. 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-04-26T20:11:48.144 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-04-26T20:11:48.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:48 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:46] ENGINE Bus STARTING 2024-04-26T20:11:48.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:48 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:46] ENGINE Serving on https://172.21.15.82:7150 2024-04-26T20:11:48.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:48 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:47] ENGINE Serving on http://172.21.15.82:8765 2024-04-26T20:11:48.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:48 smithi082 ceph-mon[28105]: [26/Apr/2024:20:11:47] ENGINE Bus STARTED 2024-04-26T20:11:48.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:48 smithi082 ceph-mon[28105]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T20:11:48.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:48 smithi082 ceph-mon[28105]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T20:11:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:49 smithi082 ceph-mon[28105]: mgrmap e12: x(active, since 2s) 2024-04-26T20:11:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:11:50.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T20:11:50.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.452+0000 7f7c5be00700 1 Processor -- start 2024-04-26T20:11:50.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.452+0000 7f7c5be00700 1 -- start start 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.453+0000 7f7c5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c54109100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.453+0000 7f7c5be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541096d0 con 0x7f7c54108ce0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.453+0000 7f7c59400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c54109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.453+0000 7f7c59400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c54109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59340/0 (socket says 172.21.15.82:59340) 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.453+0000 7f7c59400700 1 -- 172.21.15.82:0/2257892214 learned_addr learned my addr 172.21.15.82:0/2257892214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.454+0000 7f7c59400700 1 -- 172.21.15.82:0/2257892214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c54109ee0 con 0x7f7c54108ce0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.454+0000 7f7c59400700 1 --2- 172.21.15.82:0/2257892214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c54109100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c480098a0 tx=0x7f7c48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525909355d746508 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.454+0000 7f7c53e00700 1 -- 172.21.15.82:0/2257892214 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c48004160 con 0x7f7c54108ce0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.454+0000 7f7c53e00700 1 -- 172.21.15.82:0/2257892214 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c48004300 con 0x7f7c54108ce0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.454+0000 7f7c53e00700 1 -- 172.21.15.82:0/2257892214 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c48011a20 con 0x7f7c54108ce0 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 -- 172.21.15.82:0/2257892214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 msgr2=0x7f7c54109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:50.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 --2- 172.21.15.82:0/2257892214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c54109100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c480098a0 tx=0x7f7c48009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 -- 172.21.15.82:0/2257892214 shutdown_connections 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 --2- 172.21.15.82:0/2257892214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c54109100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 -- 172.21.15.82:0/2257892214 >> 172.21.15.82:0/2257892214 conn(0x7f7c541042a0 msgr2=0x7f7c541066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 -- 172.21.15.82:0/2257892214 shutdown_connections 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.455+0000 7f7c5be00700 1 -- 172.21.15.82:0/2257892214 wait complete. 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.457+0000 7f7c5be00700 1 Processor -- start 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.457+0000 7f7c5be00700 1 -- start start 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.457+0000 7f7c5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c5407eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.457+0000 7f7c5be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5410d290 con 0x7f7c54108ce0 2024-04-26T20:11:50.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.458+0000 7f7c59400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c5407eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.458+0000 7f7c59400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c5407eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59348/0 (socket says 172.21.15.82:59348) 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.458+0000 7f7c59400700 1 -- 172.21.15.82:0/2855973455 learned_addr learned my addr 172.21.15.82:0/2855973455 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.458+0000 7f7c59400700 1 -- 172.21.15.82:0/2855973455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5407f0d0 con 0x7f7c54108ce0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.458+0000 7f7c59400700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c5407eb90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009520 tx=0x7f7c48011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.459+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c480039e0 con 0x7f7c54108ce0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.459+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c4801b8f0 con 0x7f7c54108ce0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.459+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5407d2c0 con 0x7f7c54108ce0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.459+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c48019770 con 0x7f7c54108ce0 2024-04-26T20:11:50.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.459+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5407d800 con 0x7f7c54108ce0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.460+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f7c48019a20 con 0x7f7c54108ce0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.460+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c54064a80 con 0x7f7c54108ce0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.461+0000 7f7c52000700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7c3c039650 0x7f7c3c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.461+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7c4804e090 con 0x7f7c54108ce0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.461+0000 7f7c58a00700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7c3c039650 0x7f7c3c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.462+0000 7f7c58a00700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7c3c039650 0x7f7c3c03bb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c40006fd0 tx=0x7f7c40006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.467+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7c4801f030 con 0x7f7c54108ce0 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.706+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f7c5407e150 con 0x7f7c3c039650 2024-04-26T20:11:50.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.958+0000 7f7c52000700 1 -- 172.21.15.82:0/2855973455 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f7c5407e150 con 0x7f7c3c039650 2024-04-26T20:11:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7c3c039650 msgr2=0x7f7c3c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7c3c039650 0x7f7c3c03bb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c40006fd0 tx=0x7f7c40006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 msgr2=0x7f7c5407eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c5407eb90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009520 tx=0x7f7c48011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 shutdown_connections 2024-04-26T20:11:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7c3c039650 0x7f7c3c03bb10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:50.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 --2- 172.21.15.82:0/2855973455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c54108ce0 0x7f7c5407eb90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:50.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 >> 172.21.15.82:0/2855973455 conn(0x7f7c541042a0 msgr2=0x7f7c54104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:50.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 shutdown_connections 2024-04-26T20:11:50.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:49.961+0000 7f7c5be00700 1 -- 172.21.15.82:0/2855973455 wait complete. 2024-04-26T20:11:50.722 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-04-26T20:11:51.258 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:50 smithi082 ceph-mon[28105]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:51.258 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:11:51.258 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:11:52.637 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7VT6NFhEEOywATs3Vbp/Mev9XG6Wvtpmp.gHw7HIQySElb/xFzPFy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714162311, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T20:11:52.637 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.341+0000 7f4966e00700 1 Processor -- start 2024-04-26T20:11:52.637 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.341+0000 7f4966e00700 1 -- start start 2024-04-26T20:11:52.637 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.341+0000 7f4966e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f496010bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.341+0000 7f4966e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f496007ceb0 con 0x7f4960109760 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.342+0000 7f495fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f496010bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.342+0000 7f495fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f496010bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51816/0 (socket says 172.21.15.82:51816) 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.342+0000 7f495fe00700 1 -- 172.21.15.82:0/756549541 learned_addr learned my addr 172.21.15.82:0/756549541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.342+0000 7f495fe00700 1 -- 172.21.15.82:0/756549541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496010c090 con 0x7f4960109760 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.343+0000 7f495fe00700 1 --2- 172.21.15.82:0/756549541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f496010bb50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49500098a0 tx=0x7f4950009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760b24d7d314efc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.343+0000 7f495ea00700 1 -- 172.21.15.82:0/756549541 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950004160 con 0x7f4960109760 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.343+0000 7f495ea00700 1 -- 172.21.15.82:0/756549541 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4950004300 con 0x7f4960109760 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.343+0000 7f495ea00700 1 -- 172.21.15.82:0/756549541 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950011a20 con 0x7f4960109760 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 -- 172.21.15.82:0/756549541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 msgr2=0x7f496010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 --2- 172.21.15.82:0/756549541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f496010bb50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49500098a0 tx=0x7f4950009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:52.638 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 -- 172.21.15.82:0/756549541 shutdown_connections 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 --2- 172.21.15.82:0/756549541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f496010bb50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 -- 172.21.15.82:0/756549541 >> 172.21.15.82:0/756549541 conn(0x7f49601031d0 msgr2=0x7f49601055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 -- 172.21.15.82:0/756549541 shutdown_connections 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.344+0000 7f4966e00700 1 -- 172.21.15.82:0/756549541 wait complete. 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.345+0000 7f4966e00700 1 Processor -- start 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.345+0000 7f4966e00700 1 -- start start 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.345+0000 7f4966e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f4960108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.345+0000 7f4966e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f496010d090 con 0x7f4960109760 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.346+0000 7f495fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f4960108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.346+0000 7f495fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f4960108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51822/0 (socket says 172.21.15.82:51822) 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.346+0000 7f495fe00700 1 -- 172.21.15.82:0/370653230 learned_addr learned my addr 172.21.15.82:0/370653230 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:52.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.346+0000 7f495fe00700 1 -- 172.21.15.82:0/370653230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960109520 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.346+0000 7f495fe00700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f4960108fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4950004660 tx=0x7f4950011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.347+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950003aa0 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.347+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495001b8f0 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.347+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4950023900 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.347+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4960107710 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.347+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4960107c50 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.348+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f495001baa0 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.348+0000 7f495cc00700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4944039660 0x7f494403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.348+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f495004e050 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.349+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4960064a80 con 0x7f4960109760 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.349+0000 7f495f400700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4944039660 0x7f494403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:52.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.350+0000 7f495f400700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4944039660 0x7f494403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f494c006fd0 tx=0x7f494c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.354+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f495001f030 con 0x7f4960109760 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.602+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f49601085b0 con 0x7f4944039660 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.835+0000 7f495cc00700 1 -- 172.21.15.82:0/370653230 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f49601085b0 con 0x7f4944039660 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4944039660 msgr2=0x7f494403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4944039660 0x7f494403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f494c006fd0 tx=0x7f494c006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 msgr2=0x7f4960108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f4960108fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4950004660 tx=0x7f4950011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 shutdown_connections 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4944039660 0x7f494403bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 --2- 172.21.15.82:0/370653230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960109760 0x7f4960108fe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 >> 172.21.15.82:0/370653230 conn(0x7f49601031d0 msgr2=0x7f4960103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 shutdown_connections 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:51.838+0000 7f4966e00700 1 -- 172.21.15.82:0/370653230 wait complete. 2024-04-26T20:11:52.641 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-04-26T20:11:52.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:11:52.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:52 smithi082 ceph-mon[28105]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:11:52.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:11:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:53 smithi082 ceph-mon[28105]: mgrmap e13: x(active, since 6s) 2024-04-26T20:11:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:53 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1001307477' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T20:11:54.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.264+0000 7f36b1400700 1 Processor -- start 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.265+0000 7f36b1400700 1 -- start start 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.265+0000 7f36b1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac07d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.265+0000 7f36b1400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac07d8d0 con 0x7f36ac07eea0 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.265+0000 7f36aa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac07d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.265+0000 7f36aa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac07d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51828/0 (socket says 172.21.15.82:51828) 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.265+0000 7f36aa800700 1 -- 172.21.15.82:0/3704877660 learned_addr learned my addr 172.21.15.82:0/3704877660 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.266+0000 7f36aa800700 1 -- 172.21.15.82:0/3704877660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac07da50 con 0x7f36ac07eea0 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.266+0000 7f36aa800700 1 --2- 172.21.15.82:0/3704877660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac07d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098a0 tx=0x7f369c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c007b2a972c62df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.266+0000 7f36a9400700 1 -- 172.21.15.82:0/3704877660 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369c004160 con 0x7f36ac07eea0 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.266+0000 7f36a9400700 1 -- 172.21.15.82:0/3704877660 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f369c004300 con 0x7f36ac07eea0 2024-04-26T20:11:54.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.266+0000 7f36a9400700 1 -- 172.21.15.82:0/3704877660 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369c011a20 con 0x7f36ac07eea0 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 -- 172.21.15.82:0/3704877660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 msgr2=0x7f36ac07d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 --2- 172.21.15.82:0/3704877660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac07d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098a0 tx=0x7f369c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 -- 172.21.15.82:0/3704877660 shutdown_connections 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 --2- 172.21.15.82:0/3704877660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac07d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 -- 172.21.15.82:0/3704877660 >> 172.21.15.82:0/3704877660 conn(0x7f36ac1042a0 msgr2=0x7f36ac1066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 -- 172.21.15.82:0/3704877660 shutdown_connections 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.267+0000 7f36b1400700 1 -- 172.21.15.82:0/3704877660 wait complete. 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.268+0000 7f36b1400700 1 Processor -- start 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.269+0000 7f36b1400700 1 -- start start 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.269+0000 7f36b1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.269+0000 7f36b1400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10f300 con 0x7f36ac07eea0 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.269+0000 7f36aa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.269+0000 7f36aa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51844/0 (socket says 172.21.15.82:51844) 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.269+0000 7f36aa800700 1 -- 172.21.15.82:0/1001307477 learned_addr learned my addr 172.21.15.82:0/1001307477 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:54.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.270+0000 7f36aa800700 1 -- 172.21.15.82:0/1001307477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac19f280 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.270+0000 7f36aa800700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac19ed40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f369c000c00 tx=0x7f369c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.270+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369c003aa0 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.270+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f369c01b8f0 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.270+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac19f510 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.270+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369c023870 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.271+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac1a2200 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.272+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac064a80 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.272+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f369c01b440 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.272+0000 7f36a3400700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3690039750 0x7f369003bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.272+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f369c04e0e0 con 0x7f36ac07eea0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.273+0000 7f36a9e00700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3690039750 0x7f369003bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.274+0000 7f36a9e00700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3690039750 0x7f369003bc10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3698006fd0 tx=0x7f3698006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:54.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.278+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f369c01f030 con 0x7f36ac07eea0 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.510+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f36ac1a27f0 con 0x7f36ac07eea0 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.511+0000 7f36a3400700 1 -- 172.21.15.82:0/1001307477 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f369c0292a0 con 0x7f36ac07eea0 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3690039750 msgr2=0x7f369003bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3690039750 0x7f369003bc10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3698006fd0 tx=0x7f3698006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 msgr2=0x7f36ac19ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac19ed40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f369c000c00 tx=0x7f369c011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 shutdown_connections 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3690039750 0x7f369003bc10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 --2- 172.21.15.82:0/1001307477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ac07eea0 0x7f36ac19ed40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.515+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 >> 172.21.15.82:0/1001307477 conn(0x7f36ac1042a0 msgr2=0x7f36ac104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.516+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 shutdown_connections 2024-04-26T20:11:54.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:53.516+0000 7f36b1400700 1 -- 172.21.15.82:0/1001307477 wait complete. 2024-04-26T20:11:54.760 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:11:54.760 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-26T20:11:54.781 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:11:54.781 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-26T20:11:54.781 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-26T20:11:54.782 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T20:11:54.789 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-04-26T20:11:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-04-26T20:11:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-04-26T20:11:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: Password: 5yqbcv2srk 2024-04-26T20:11:54.789 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:54.790 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config directory 2024-04-26T20:11:54.792 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-04-26T20:11:56.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.814+0000 7f8313800700 1 Processor -- start 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.814+0000 7f8313800700 1 -- start start 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.815+0000 7f8313800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c07d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.815+0000 7f8313800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f830c07d930 con 0x7f830c07ef00 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.815+0000 7f8310e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c07d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.815+0000 7f8310e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c07d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51852/0 (socket says 172.21.15.82:51852) 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.815+0000 7f8310e00700 1 -- 172.21.15.82:0/3252420946 learned_addr learned my addr 172.21.15.82:0/3252420946 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.816+0000 7f8310e00700 1 -- 172.21.15.82:0/3252420946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c07dab0 con 0x7f830c07ef00 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.816+0000 7f8310e00700 1 --2- 172.21.15.82:0/3252420946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c07d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f83000098a0 tx=0x7f8300009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24945d3afe98cce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.816+0000 7f830b400700 1 -- 172.21.15.82:0/3252420946 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300004160 con 0x7f830c07ef00 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f830b400700 1 -- 172.21.15.82:0/3252420946 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8300004300 con 0x7f830c07ef00 2024-04-26T20:11:56.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f830b400700 1 -- 172.21.15.82:0/3252420946 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300011a20 con 0x7f830c07ef00 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f8313800700 1 -- 172.21.15.82:0/3252420946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 msgr2=0x7f830c07d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f8313800700 1 --2- 172.21.15.82:0/3252420946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c07d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f83000098a0 tx=0x7f8300009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f8313800700 1 -- 172.21.15.82:0/3252420946 shutdown_connections 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f8313800700 1 --2- 172.21.15.82:0/3252420946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c07d360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.817+0000 7f8313800700 1 -- 172.21.15.82:0/3252420946 >> 172.21.15.82:0/3252420946 conn(0x7f830c104260 msgr2=0x7f830c106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.818+0000 7f8313800700 1 -- 172.21.15.82:0/3252420946 shutdown_connections 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.818+0000 7f8313800700 1 -- 172.21.15.82:0/3252420946 wait complete. 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.819+0000 7f8313800700 1 Processor -- start 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.819+0000 7f8313800700 1 -- start start 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.820+0000 7f8313800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.820+0000 7f8313800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f830c10f290 con 0x7f830c07ef00 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.820+0000 7f8310e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.820+0000 7f8310e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c19ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51862/0 (socket says 172.21.15.82:51862) 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.820+0000 7f8310e00700 1 -- 172.21.15.82:0/1035355423 learned_addr learned my addr 172.21.15.82:0/1035355423 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.820+0000 7f8310e00700 1 -- 172.21.15.82:0/1035355423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c19f290 con 0x7f830c07ef00 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.821+0000 7f8310e00700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c19ed50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8300009520 tx=0x7f8300011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.821+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300003af0 con 0x7f830c07ef00 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.821+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f830001a8e0 con 0x7f830c07ef00 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.821+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830c19f520 con 0x7f830c07ef00 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.821+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83000247a0 con 0x7f830c07ef00 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.821+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830c1a2210 con 0x7f830c07ef00 2024-04-26T20:11:56.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.822+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830c064a80 con 0x7f830c07ef00 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.823+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f8300022020 con 0x7f830c07ef00 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.823+0000 7f8309600700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82f4039700 0x7f82f403bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.823+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f830004db60 con 0x7f830c07ef00 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.823+0000 7f830be00700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82f4039700 0x7f82f403bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.824+0000 7f830be00700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82f4039700 0x7f82f403bbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82fc006fd0 tx=0x7f82fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:55.829+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f830000b3e0 con 0x7f830c07ef00 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.053+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f830c1a2830 con 0x7f830c07ef00 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.054+0000 7f8309600700 1 -- 172.21.15.82:0/1035355423 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f830002ddb0 con 0x7f830c07ef00 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82f4039700 msgr2=0x7f82f403bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82f4039700 0x7f82f403bbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82fc006fd0 tx=0x7f82fc006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 msgr2=0x7f830c19ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c19ed50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8300009520 tx=0x7f8300011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 shutdown_connections 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82f4039700 0x7f82f403bbc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:56.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 --2- 172.21.15.82:0/1035355423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f830c07ef00 0x7f830c19ed50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:56.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.057+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 >> 172.21.15.82:0/1035355423 conn(0x7f830c104260 msgr2=0x7f830c104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:56.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.058+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 shutdown_connections 2024-04-26T20:11:56.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:56.058+0000 7f8313800700 1 -- 172.21.15.82:0/1035355423 wait complete. 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.395+0000 7ffa50600700 1 Processor -- start 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.395+0000 7ffa50600700 1 -- start start 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.396+0000 7ffa50600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa481073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.396+0000 7ffa50600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa481079b0 con 0x7ffa48106fc0 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.396+0000 7ffa4dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa481073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.396+0000 7ffa4dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa481073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51866/0 (socket says 172.21.15.82:51866) 2024-04-26T20:11:58.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.396+0000 7ffa4dc00700 1 -- 172.21.15.82:0/4142335755 learned_addr learned my addr 172.21.15.82:0/4142335755 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.396+0000 7ffa4dc00700 1 -- 172.21.15.82:0/4142335755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa48109f50 con 0x7ffa48106fc0 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.397+0000 7ffa4dc00700 1 --2- 172.21.15.82:0/4142335755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa481073e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0098a0 tx=0x7ffa3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed986cbf2db8f20f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.397+0000 7ffa47e00700 1 -- 172.21.15.82:0/4142335755 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa3c004160 con 0x7ffa48106fc0 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.397+0000 7ffa47e00700 1 -- 172.21.15.82:0/4142335755 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa3c004300 con 0x7ffa48106fc0 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.397+0000 7ffa47e00700 1 -- 172.21.15.82:0/4142335755 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa3c011a20 con 0x7ffa48106fc0 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 -- 172.21.15.82:0/4142335755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 msgr2=0x7ffa481073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 --2- 172.21.15.82:0/4142335755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa481073e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0098a0 tx=0x7ffa3c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 -- 172.21.15.82:0/4142335755 shutdown_connections 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 --2- 172.21.15.82:0/4142335755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa481073e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 -- 172.21.15.82:0/4142335755 >> 172.21.15.82:0/4142335755 conn(0x7ffa48102930 msgr2=0x7ffa48104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 -- 172.21.15.82:0/4142335755 shutdown_connections 2024-04-26T20:11:58.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.398+0000 7ffa50600700 1 -- 172.21.15.82:0/4142335755 wait complete. 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.399+0000 7ffa50600700 1 Processor -- start 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.400+0000 7ffa50600700 1 -- start start 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.400+0000 7ffa50600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa4819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.400+0000 7ffa50600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4810d300 con 0x7ffa48106fc0 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.400+0000 7ffa4dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa4819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.400+0000 7ffa4dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa4819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51878/0 (socket says 172.21.15.82:51878) 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.400+0000 7ffa4dc00700 1 -- 172.21.15.82:0/1041793027 learned_addr learned my addr 172.21.15.82:0/1041793027 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.401+0000 7ffa4dc00700 1 -- 172.21.15.82:0/1041793027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4819d0e0 con 0x7ffa48106fc0 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.401+0000 7ffa4dc00700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa4819cba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009520 tx=0x7ffa3c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.401+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa3c0039e0 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.401+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa3c01b8f0 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.401+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa3c019770 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.401+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4819d370 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.402+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa481a0060 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.403+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7ffa3c01b440 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.403+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa48064a80 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.403+0000 7ffa46000700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa300396f0 0x7ffa3003bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.403+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffa3c04e0f0 con 0x7ffa48106fc0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.404+0000 7ffa4d200700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa300396f0 0x7ffa3003bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:11:58.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.404+0000 7ffa4d200700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa300396f0 0x7ffa3003bbb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006fd0 tx=0x7ffa34006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.409+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ffa3c01f030 con 0x7ffa48106fc0 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.757+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7ffa481a0650 con 0x7ffa48106fc0 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.764+0000 7ffa46000700 1 -- 172.21.15.82:0/1041793027 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7ffa3c00e260 con 0x7ffa48106fc0 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.766+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa300396f0 msgr2=0x7ffa3003bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.766+0000 7ffa50600700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa300396f0 0x7ffa3003bbb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006fd0 tx=0x7ffa34006e40 comp rx=0 tx=0).stop 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.766+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 msgr2=0x7ffa4819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.766+0000 7ffa50600700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa4819cba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009520 tx=0x7ffa3c011aa0 comp rx=0 tx=0).stop 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.766+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 shutdown_connections 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.766+0000 7ffa50600700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa300396f0 0x7ffa3003bbb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.767+0000 7ffa50600700 1 --2- 172.21.15.82:0/1041793027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa48106fc0 0x7ffa4819cba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.767+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 >> 172.21.15.82:0/1041793027 conn(0x7ffa48102930 msgr2=0x7ffa481032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.767+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 shutdown_connections 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-26T20:11:57.767+0000 7ffa50600700 1 -- 172.21.15.82:0/1041793027 wait complete. 2024-04-26T20:11:58.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.501 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-04-26T20:11:58.502 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.502 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-04-26T20:11:58.502 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.502 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-26T20:11:58.502 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:11:58.502 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-04-26T20:11:58.592 INFO:tasks.cephadm:Fetching config... 2024-04-26T20:11:58.592 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:11:58.592 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T20:11:58.644 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T20:11:58.644 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:11:58.644 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T20:11:58.687 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T20:11:58.687 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:11:58.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-26T20:11:58.800 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T20:11:58.800 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:11:58.801 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T20:11:58.893 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T20:11:58.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:11:59.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:11:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1041793027' entity='client.admin' 2024-04-26T20:11:59.036 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:11:59.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:11:59.108 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:11:59.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:11:59.162 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTREbS88jQOzHzovukl+wmsD7lRC4GO5p2NeDMHCRL42ssd9SVavQtXs8lPNHefqpWqn2NUBuDZqDmXO/xg4l220dLnH+tqcBXZfvWU6YBFulPkWl4JNinLicEtz3VclYRdZyx4H9iWP8neXeozKyaAPV4NQCz5zd3Ttw1/TpNbkeV7BMNtEGkZwejCII9hSAHkbS4LwtX3r81f4CE6K7cV0bVm6my1YYjA+t30AGom0uMNLNdvVaOj3AL7kXSHjeCrCWeb1wXGPj6OBIe3SaUC3BAjj90waScq//hP0GulLubFN4dUrnDdLLaBdlRT0wciVRPpSRuBfMXwC9Grjzg4ro7aertz2N/xyeYqsWVAsu9Cg/5aKGJGE91gJzw7bUO/JqQf8nDIC1hYtMNoUH9/CVdLwOpHw+BrNlTskfaGEGk2RBLNCshpsPk/7iiBYcljsjUmNmyRleeJG9714M6ztI4IYEuSV9uL9LdSoaeNlnQAhTAKzzTVm6NelCcpc= ceph-da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:11:59.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T20:11:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:02.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 -- 172.21.15.82:0/1642631399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 msgr2=0x7f1b381032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:02.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 --2- 172.21.15.82:0/1642631399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b381032a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009910 tx=0x7f1b28009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:02.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 -- 172.21.15.82:0/1642631399 shutdown_connections 2024-04-26T20:12:02.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 --2- 172.21.15.82:0/1642631399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b381032a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 -- 172.21.15.82:0/1642631399 >> 172.21.15.82:0/1642631399 conn(0x7f1b380fe420 msgr2=0x7f1b38100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 -- 172.21.15.82:0/1642631399 shutdown_connections 2024-04-26T20:12:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.274+0000 7f1b3ee00700 1 -- 172.21.15.82:0/1642631399 wait complete. 2024-04-26T20:12:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.275+0000 7f1b3ee00700 1 Processor -- start 2024-04-26T20:12:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.275+0000 7f1b3ee00700 1 -- start start 2024-04-26T20:12:02.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.275+0000 7f1b3ee00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b38077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.275+0000 7f1b3ee00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38108d40 con 0x7f1b38102e80 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b2fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b38077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b2fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b38077090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33464/0 (socket says 172.21.15.82:33464) 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b2fe00700 1 -- 172.21.15.82:0/4102979411 learned_addr learned my addr 172.21.15.82:0/4102979411 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b2fe00700 1 -- 172.21.15.82:0/4102979411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b380775d0 con 0x7f1b38102e80 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b2fe00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b38077090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005190 tx=0x7f1b28004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:02.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28027070 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.276+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b28022470 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.277+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b38075810 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.277+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b2800f5f0 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.277+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b38075cf0 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.278+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f1b2802a070 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.278+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b381094c0 con 0x7f1b38102e80 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.278+0000 7f1b35600700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b1c0396b0 0x7f1b1c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:02.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.278+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b2801e030 con 0x7f1b38102e80 2024-04-26T20:12:02.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.279+0000 7f1b37e00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b1c0396b0 0x7f1b1c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:02.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.279+0000 7f1b37e00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b1c0396b0 0x7f1b1c03bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b20006fd0 tx=0x7f1b20006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:02.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.284+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1b28013070 con 0x7f1b38102e80 2024-04-26T20:12:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.508+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f1b38191770 con 0x7f1b38102e80 2024-04-26T20:12:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.512+0000 7f1b35600700 1 -- 172.21.15.82:0/4102979411 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1b28031020 con 0x7f1b38102e80 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b1c0396b0 msgr2=0x7f1b1c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b1c0396b0 0x7f1b1c03bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b20006fd0 tx=0x7f1b20006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 msgr2=0x7f1b38077090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b38077090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005190 tx=0x7f1b28004f80 comp rx=0 tx=0).stop 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 shutdown_connections 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b1c0396b0 0x7f1b1c03bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:02.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 --2- 172.21.15.82:0/4102979411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b38102e80 0x7f1b38077090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.515+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 >> 172.21.15.82:0/4102979411 conn(0x7f1b380fe420 msgr2=0x7f1b380fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.516+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 shutdown_connections 2024-04-26T20:12:02.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:02.516+0000 7f1b3ee00700 1 -- 172.21.15.82:0/4102979411 wait complete. 2024-04-26T20:12:02.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:02.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:02.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:02.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4102979411' entity='client.admin' 2024-04-26T20:12:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:03.355 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T20:12:03.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T20:12:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:06.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.543+0000 7fd38d800700 1 -- 172.21.15.82:0/1802027977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 msgr2=0x7fd3880781f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.543+0000 7fd38d800700 1 --2- 172.21.15.82:0/1802027977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd3880781f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd37800b0a0 tx=0x7fd37800b3b0 comp rx=0 tx=0).stop 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.544+0000 7fd38d800700 1 -- 172.21.15.82:0/1802027977 shutdown_connections 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.544+0000 7fd38d800700 1 --2- 172.21.15.82:0/1802027977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd3880781f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.544+0000 7fd38d800700 1 -- 172.21.15.82:0/1802027977 >> 172.21.15.82:0/1802027977 conn(0x7fd388100640 msgr2=0x7fd388102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.544+0000 7fd38d800700 1 -- 172.21.15.82:0/1802027977 shutdown_connections 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.544+0000 7fd38d800700 1 -- 172.21.15.82:0/1802027977 wait complete. 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.545+0000 7fd38d800700 1 Processor -- start 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.545+0000 7fd38d800700 1 -- start start 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.545+0000 7fd38d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd38819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.545+0000 7fd38d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd38810f480 con 0x7fd388077dd0 2024-04-26T20:12:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.546+0000 7fd386a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd38819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.546+0000 7fd386a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd38819ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33476/0 (socket says 172.21.15.82:33476) 2024-04-26T20:12:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.546+0000 7fd386a00700 1 -- 172.21.15.82:0/3408216359 learned_addr learned my addr 172.21.15.82:0/3408216359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.546+0000 7fd386a00700 1 -- 172.21.15.82:0/3408216359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38819ef50 con 0x7fd388077dd0 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.546+0000 7fd386a00700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd38819ea10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd378007730 tx=0x7fd378003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.547+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd378021020 con 0x7fd388077dd0 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.547+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3780044b0 con 0x7fd388077dd0 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.547+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38819f1e0 con 0x7fd388077dd0 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.547+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd378017040 con 0x7fd388077dd0 2024-04-26T20:12:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.547+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3881a1ed0 con 0x7fd388077dd0 2024-04-26T20:12:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.548+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd378024020 con 0x7fd388077dd0 2024-04-26T20:12:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.548+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38819f6a0 con 0x7fd388077dd0 2024-04-26T20:12:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.548+0000 7fd37fe00700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd36c0396f0 0x7fd36c03bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.548+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd37800f050 con 0x7fd388077dd0 2024-04-26T20:12:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.549+0000 7fd37e000700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd36c0396f0 0x7fd36c03bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:06.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.549+0000 7fd37e000700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd36c0396f0 0x7fd36c03bbb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd370006fd0 tx=0x7fd370006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:06.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.554+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd37802b020 con 0x7fd388077dd0 2024-04-26T20:12:06.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.787+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fd38802e5a0 con 0x7fd36c0396f0 2024-04-26T20:12:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.794+0000 7fd37fe00700 1 -- 172.21.15.82:0/3408216359 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd38802e5a0 con 0x7fd36c0396f0 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd36c0396f0 msgr2=0x7fd36c03bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd36c0396f0 0x7fd36c03bbb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd370006fd0 tx=0x7fd370006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 msgr2=0x7fd38819ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd38819ea10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd378007730 tx=0x7fd378003ce0 comp rx=0 tx=0).stop 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 shutdown_connections 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd36c0396f0 0x7fd36c03bbb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:06.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 --2- 172.21.15.82:0/3408216359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd388077dd0 0x7fd38819ea10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:06.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.797+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 >> 172.21.15.82:0/3408216359 conn(0x7fd388100640 msgr2=0x7fd388101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:06.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.798+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 shutdown_connections 2024-04-26T20:12:06.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:06.798+0000 7fd38d800700 1 -- 172.21.15.82:0/3408216359 wait complete. 2024-04-26T20:12:07.614 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-04-26T20:12:07.614 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:12:07.615 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-04-26T20:12:07.633 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:12:07.633 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:07.690 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-04-26T20:12:07.690 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch host add smithi135 2024-04-26T20:12:07.748 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:07 smithi082 ceph-mon[28105]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:07.748 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:07.748 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:07.748 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:07.748 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:08.108 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:08 smithi082 ceph-mon[28105]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:08 smithi082 ceph-mon[28105]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-26T20:12:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:08 smithi082 ceph-mon[28105]: Updating smithi082:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:09.741 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:09 smithi082 ceph-mon[28105]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:09.741 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:09 smithi082 ceph-mon[28105]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:09.741 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:09.741 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:09.741 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 -- 172.21.15.82:0/1937225078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 msgr2=0x7fcb6810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 --2- 172.21.15.82:0/1937225078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb6810f740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009910 tx=0x7fcb58009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 -- 172.21.15.82:0/1937225078 shutdown_connections 2024-04-26T20:12:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 --2- 172.21.15.82:0/1937225078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb6810f740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 -- 172.21.15.82:0/1937225078 >> 172.21.15.82:0/1937225078 conn(0x7fcb68078a30 msgr2=0x7fcb6807ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 -- 172.21.15.82:0/1937225078 shutdown_connections 2024-04-26T20:12:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.233+0000 7fcb67e00700 1 -- 172.21.15.82:0/1937225078 wait complete. 2024-04-26T20:12:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.234+0000 7fcb67e00700 1 Processor -- start 2024-04-26T20:12:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.235+0000 7fcb67e00700 1 -- start start 2024-04-26T20:12:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.235+0000 7fcb67e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb681a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.235+0000 7fcb67e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68113760 con 0x7fcb6810f360 2024-04-26T20:12:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.235+0000 7fcb66a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb681a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.235+0000 7fcb66a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb681a4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33490/0 (socket says 172.21.15.82:33490) 2024-04-26T20:12:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.235+0000 7fcb66a00700 1 -- 172.21.15.82:0/1391599182 learned_addr learned my addr 172.21.15.82:0/1391599182 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb66a00700 1 -- 172.21.15.82:0/1391599182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb681a4d90 con 0x7fcb6810f360 2024-04-26T20:12:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb66a00700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb681a4850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcb580056d0 tx=0x7fcb580057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:10.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb58026070 con 0x7fcb6810f360 2024-04-26T20:12:10.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb58004370 con 0x7fcb6810f360 2024-04-26T20:12:10.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb580039b0 con 0x7fcb6810f360 2024-04-26T20:12:10.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb681a5080 con 0x7fcb6810f360 2024-04-26T20:12:10.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.236+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6819ea10 con 0x7fcb6810f360 2024-04-26T20:12:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.238+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6810a9a0 con 0x7fcb6810f360 2024-04-26T20:12:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.238+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fcb58029070 con 0x7fcb6810f360 2024-04-26T20:12:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.238+0000 7fcb6ca00700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcb4c0396b0 0x7fcb4c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.238+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcb5801e070 con 0x7fcb6810f360 2024-04-26T20:12:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.239+0000 7fcb66000700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcb4c0396b0 0x7fcb4c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.239+0000 7fcb66000700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcb4c0396b0 0x7fcb4c03bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcb54006fd0 tx=0x7fcb54006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:10.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.244+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcb58013070 con 0x7fcb6810f360 2024-04-26T20:12:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:10.457+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}) -- 0x7fcb6819ffe0 con 0x7fcb4c0396b0 2024-04-26T20:12:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:10 smithi082 ceph-mon[28105]: Updating smithi082:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:11 smithi082 ceph-mon[28105]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:11 smithi082 ceph-mon[28105]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:12.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:12 smithi082 ceph-mon[28105]: Deploying cephadm binary to smithi135 2024-04-26T20:12:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:13 smithi082 ceph-mon[28105]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:15.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.131+0000 7fcb6ca00700 1 -- 172.21.15.82:0/1391599182 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fcb6819ffe0 con 0x7fcb4c0396b0 2024-04-26T20:12:15.132 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-04-26T20:12:15.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcb4c0396b0 msgr2=0x7fcb4c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcb4c0396b0 0x7fcb4c03bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcb54006fd0 tx=0x7fcb54006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 msgr2=0x7fcb681a4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb681a4850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcb580056d0 tx=0x7fcb580057b0 comp rx=0 tx=0).stop 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 shutdown_connections 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcb4c0396b0 0x7fcb4c03bb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 --2- 172.21.15.82:0/1391599182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb6810f360 0x7fcb681a4850 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 >> 172.21.15.82:0/1391599182 conn(0x7fcb68078a30 msgr2=0x7fcb6807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 shutdown_connections 2024-04-26T20:12:15.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:15.135+0000 7fcb67e00700 1 -- 172.21.15.82:0/1391599182 wait complete. 2024-04-26T20:12:15.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:15 smithi082 ceph-mon[28105]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:15.839 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:15.839 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:15.907 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T20:12:16.337 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:16.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:16 smithi082 ceph-mon[28105]: Added host smithi135 2024-04-26T20:12:16.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:16 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:16.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:16 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:17.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:17 smithi082 ceph-mon[28105]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:18.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.524+0000 7fb663000700 1 -- 172.21.15.82:0/2186888900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 msgr2=0x7fb65c103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:18.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.524+0000 7fb663000700 1 --2- 172.21.15.82:0/2186888900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c103470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00b0a0 tx=0x7fb64c00b3b0 comp rx=0 tx=0).stop 2024-04-26T20:12:18.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.524+0000 7fb663000700 1 -- 172.21.15.82:0/2186888900 shutdown_connections 2024-04-26T20:12:18.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.524+0000 7fb663000700 1 --2- 172.21.15.82:0/2186888900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c103470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:18.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.524+0000 7fb663000700 1 -- 172.21.15.82:0/2186888900 >> 172.21.15.82:0/2186888900 conn(0x7fb65c0fe960 msgr2=0x7fb65c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:18.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.525+0000 7fb663000700 1 -- 172.21.15.82:0/2186888900 shutdown_connections 2024-04-26T20:12:18.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.525+0000 7fb663000700 1 -- 172.21.15.82:0/2186888900 wait complete. 2024-04-26T20:12:18.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.526+0000 7fb663000700 1 Processor -- start 2024-04-26T20:12:18.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.526+0000 7fb663000700 1 -- start start 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.526+0000 7fb663000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.526+0000 7fb663000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c10d310 con 0x7fb65c103090 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.527+0000 7fb65be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.527+0000 7fb65be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c1a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60530/0 (socket says 172.21.15.82:60530) 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.527+0000 7fb65be00700 1 -- 172.21.15.82:0/1693997450 learned_addr learned my addr 172.21.15.82:0/1693997450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.527+0000 7fb65be00700 1 -- 172.21.15.82:0/1693997450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c1a0be0 con 0x7fb65c103090 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.527+0000 7fb65be00700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c1a06a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00d010 tx=0x7fb64c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.527+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb64c021020 con 0x7fb65c103090 2024-04-26T20:12:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.528+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb64c0044b0 con 0x7fb65c103090 2024-04-26T20:12:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.528+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c1a0e70 con 0x7fb65c103090 2024-04-26T20:12:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.528+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb64c017040 con 0x7fb65c103090 2024-04-26T20:12:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.528+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c19a820 con 0x7fb65c103090 2024-04-26T20:12:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.529+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65c104570 con 0x7fb65c103090 2024-04-26T20:12:18.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.529+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fb64c024020 con 0x7fb65c103090 2024-04-26T20:12:18.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.530+0000 7fb659600700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb640039700 0x7fb64003bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:18.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.530+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb64c00f050 con 0x7fb65c103090 2024-04-26T20:12:18.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.530+0000 7fb653400700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb640039700 0x7fb64003bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:18.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.531+0000 7fb653400700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb640039700 0x7fb64003bbc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb644006fd0 tx=0x7fb644006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.536+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb64c02b020 con 0x7fb65c103090 2024-04-26T20:12:18.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.767+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb65c19bd50 con 0x7fb640039700 2024-04-26T20:12:18.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.769+0000 7fb659600700 1 -- 172.21.15.82:0/1693997450 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fb65c19bd50 con 0x7fb640039700 2024-04-26T20:12:18.770 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:12:18.770 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb640039700 msgr2=0x7fb64003bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb640039700 0x7fb64003bbc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb644006fd0 tx=0x7fb644006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 msgr2=0x7fb65c1a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c1a06a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00d010 tx=0x7fb64c003ce0 comp rx=0 tx=0).stop 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 shutdown_connections 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb640039700 0x7fb64003bbc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 --2- 172.21.15.82:0/1693997450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c103090 0x7fb65c1a06a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 >> 172.21.15.82:0/1693997450 conn(0x7fb65c0fe960 msgr2=0x7fb65c075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 shutdown_connections 2024-04-26T20:12:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:18.772+0000 7fb663000700 1 -- 172.21.15.82:0/1693997450 wait complete. 2024-04-26T20:12:19.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:18 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:19.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:18 smithi082 ceph-mon[28105]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:19.701 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi139 2024-04-26T20:12:19.701 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:12:19.701 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.conf 2024-04-26T20:12:19.719 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:12:19.719 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:19.777 INFO:tasks.cephadm:Adding host smithi139 to orchestrator... 2024-04-26T20:12:19.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch host add smithi139 2024-04-26T20:12:20.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:19 smithi082 ceph-mon[28105]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:12:20.207 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:21.169 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:20 smithi082 ceph-mon[28105]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.329+0000 7f4c2fe00700 1 -- 172.21.15.82:0/4074288412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 msgr2=0x7f4c301032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.329+0000 7f4c2fe00700 1 --2- 172.21.15.82:0/4074288412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301032b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009910 tx=0x7f4c20009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.329+0000 7f4c2fe00700 1 -- 172.21.15.82:0/4074288412 shutdown_connections 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.329+0000 7f4c2fe00700 1 --2- 172.21.15.82:0/4074288412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301032b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.329+0000 7f4c2fe00700 1 -- 172.21.15.82:0/4074288412 >> 172.21.15.82:0/4074288412 conn(0x7f4c300fe780 msgr2=0x7f4c30100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.330+0000 7f4c2fe00700 1 -- 172.21.15.82:0/4074288412 shutdown_connections 2024-04-26T20:12:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.330+0000 7f4c2fe00700 1 -- 172.21.15.82:0/4074288412 wait complete. 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.331+0000 7f4c2fe00700 1 Processor -- start 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.331+0000 7f4c2fe00700 1 -- start start 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.331+0000 7f4c2fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.331+0000 7f4c2fe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3010d150 con 0x7f4c30102ed0 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c2ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c2ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59990/0 (socket says 172.21.15.82:59990) 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c2ea00700 1 -- 172.21.15.82:0/2626184819 learned_addr learned my addr 172.21.15.82:0/2626184819 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c2ea00700 1 -- 172.21.15.82:0/2626184819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c301a0b70 con 0x7f4c30102ed0 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c2ea00700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301a0630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c200056d0 tx=0x7f4c200057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c20026070 con 0x7f4c30102ed0 2024-04-26T20:12:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c2000bba0 con 0x7f4c30102ed0 2024-04-26T20:12:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.332+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c301a0e60 con 0x7f4c30102ed0 2024-04-26T20:12:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.333+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c20003920 con 0x7f4c30102ed0 2024-04-26T20:12:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.333+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3019a7b0 con 0x7f4c30102ed0 2024-04-26T20:12:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.334+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4c20029070 con 0x7f4c30102ed0 2024-04-26T20:12:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.334+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c301043b0 con 0x7f4c30102ed0 2024-04-26T20:12:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.334+0000 7f4c27400700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4c140396b0 0x7f4c1403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.334+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4c2001e070 con 0x7f4c30102ed0 2024-04-26T20:12:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.335+0000 7f4c2e000700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4c140396b0 0x7f4c1403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.335+0000 7f4c2e000700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4c140396b0 0x7f4c1403bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.340+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4c20013070 con 0x7f4c30102ed0 2024-04-26T20:12:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:22.570+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}) -- 0x7f4c3019bce0 con 0x7f4c140396b0 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:22.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:22 smithi082 ceph-mon[28105]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-26T20:12:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:24 smithi082 ceph-mon[28105]: Deploying cephadm binary to smithi139 2024-04-26T20:12:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:25 smithi082 ceph-mon[28105]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:27.245 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi139' with addr '172.21.15.139' 2024-04-26T20:12:27.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.243+0000 7f4c27400700 1 -- 172.21.15.82:0/2626184819 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4c3019bce0 con 0x7f4c140396b0 2024-04-26T20:12:27.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4c140396b0 msgr2=0x7f4c1403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:27.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4c140396b0 0x7f4c1403bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 msgr2=0x7f4c301a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301a0630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c200056d0 tx=0x7f4c200057b0 comp rx=0 tx=0).stop 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 shutdown_connections 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4c140396b0 0x7f4c1403bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.247+0000 7f4c2fe00700 1 --2- 172.21.15.82:0/2626184819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c30102ed0 0x7f4c301a0630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.248+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 >> 172.21.15.82:0/2626184819 conn(0x7f4c300fe780 msgr2=0x7f4c30075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.248+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 shutdown_connections 2024-04-26T20:12:27.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:27.248+0000 7f4c2fe00700 1 -- 172.21.15.82:0/2626184819 wait complete. 2024-04-26T20:12:27.903 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:27 smithi082 ceph-mon[28105]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:27.904 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:27.904 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:27.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T20:12:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:28.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:28 smithi082 ceph-mon[28105]: Added host smithi139 2024-04-26T20:12:28.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:28.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:29.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:29 smithi082 ceph-mon[28105]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.470+0000 7f7349600700 1 -- 172.21.15.82:0/3917319636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 msgr2=0x7f7344105690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.470+0000 7f7349600700 1 --2- 172.21.15.82:0/3917319636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f7344105690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7334009910 tx=0x7f7334009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.471+0000 7f7349600700 1 -- 172.21.15.82:0/3917319636 shutdown_connections 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.471+0000 7f7349600700 1 --2- 172.21.15.82:0/3917319636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f7344105690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.471+0000 7f7349600700 1 -- 172.21.15.82:0/3917319636 >> 172.21.15.82:0/3917319636 conn(0x7f7344100b40 msgr2=0x7f7344102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.471+0000 7f7349600700 1 -- 172.21.15.82:0/3917319636 shutdown_connections 2024-04-26T20:12:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.471+0000 7f7349600700 1 -- 172.21.15.82:0/3917319636 wait complete. 2024-04-26T20:12:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.472+0000 7f7349600700 1 Processor -- start 2024-04-26T20:12:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.472+0000 7f7349600700 1 -- start start 2024-04-26T20:12:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.472+0000 7f7349600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f73441a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.472+0000 7f7349600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f734410f530 con 0x7f73441052b0 2024-04-26T20:12:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.473+0000 7f7342a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f73441a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.473+0000 7f7342a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f73441a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60004/0 (socket says 172.21.15.82:60004) 2024-04-26T20:12:30.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.473+0000 7f7342a00700 1 -- 172.21.15.82:0/3459650131 learned_addr learned my addr 172.21.15.82:0/3459650131 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:30.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.473+0000 7f7342a00700 1 -- 172.21.15.82:0/3459650131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73441a0c50 con 0x7f73441052b0 2024-04-26T20:12:30.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.473+0000 7f7342a00700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f73441a0710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7334006010 tx=0x7f7334005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.473+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334026070 con 0x7f73441052b0 2024-04-26T20:12:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.474+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f733400bba0 con 0x7f73441052b0 2024-04-26T20:12:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.474+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334003910 con 0x7f73441052b0 2024-04-26T20:12:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.474+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73441a0f40 con 0x7f73441052b0 2024-04-26T20:12:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.474+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734419a8d0 con 0x7f73441052b0 2024-04-26T20:12:30.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.475+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f7334029070 con 0x7f73441052b0 2024-04-26T20:12:30.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.475+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7344106790 con 0x7f73441052b0 2024-04-26T20:12:30.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.476+0000 7f733b400700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f73280396b0 0x7f732803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:30.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.476+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f733401e070 con 0x7f73441052b0 2024-04-26T20:12:30.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.476+0000 7f733be00700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f73280396b0 0x7f732803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:30.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.477+0000 7f733be00700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f73280396b0 0x7f732803bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f732c006fd0 tx=0x7f732c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:30.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.481+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7334013070 con 0x7f73441052b0 2024-04-26T20:12:30.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.715+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f734419be70 con 0x7f73280396b0 2024-04-26T20:12:30.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.717+0000 7f733b400700 1 -- 172.21.15.82:0/3459650131 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f734419be70 con 0x7f73280396b0 2024-04-26T20:12:30.718 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:12:30.718 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}] 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f73280396b0 msgr2=0x7f732803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f73280396b0 0x7f732803bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f732c006fd0 tx=0x7f732c006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 msgr2=0x7f73441a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f73441a0710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7334006010 tx=0x7f7334005780 comp rx=0 tx=0).stop 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 shutdown_connections 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f73280396b0 0x7f732803bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 --2- 172.21.15.82:0/3459650131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441052b0 0x7f73441a0710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 >> 172.21.15.82:0/3459650131 conn(0x7f7344100b40 msgr2=0x7f7344108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 shutdown_connections 2024-04-26T20:12:30.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:30.720+0000 7f7349600700 1 -- 172.21.15.82:0/3459650131 wait complete. 2024-04-26T20:12:31.381 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:31.382 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:30 smithi082 ceph-mon[28105]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:31.455 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T20:12:31.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T20:12:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:32.257 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:31 smithi082 ceph-mon[28105]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:12:33.108 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:33 smithi082 ceph-mon[28105]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 -- 172.21.15.82:0/2776278591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 msgr2=0x7f8b9c103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 --2- 172.21.15.82:0/2776278591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c103470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009910 tx=0x7f8b90009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 -- 172.21.15.82:0/2776278591 shutdown_connections 2024-04-26T20:12:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 --2- 172.21.15.82:0/2776278591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c103470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 -- 172.21.15.82:0/2776278591 >> 172.21.15.82:0/2776278591 conn(0x7f8b9c0fe960 msgr2=0x7f8b9c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 -- 172.21.15.82:0/2776278591 shutdown_connections 2024-04-26T20:12:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.929+0000 7f8ba4000700 1 -- 172.21.15.82:0/2776278591 wait complete. 2024-04-26T20:12:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.930+0000 7f8ba4000700 1 Processor -- start 2024-04-26T20:12:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.931+0000 7f8ba4000700 1 -- start start 2024-04-26T20:12:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.931+0000 7f8ba4000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.931+0000 7f8ba4000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c10d310 con 0x7f8b9c103090 2024-04-26T20:12:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.931+0000 7f8ba1600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.931+0000 7f8ba1600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57054/0 (socket says 172.21.15.82:57054) 2024-04-26T20:12:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.931+0000 7f8ba1600700 1 -- 172.21.15.82:0/2624463581 learned_addr learned my addr 172.21.15.82:0/2624463581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.932+0000 7f8ba1600700 1 -- 172.21.15.82:0/2624463581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c077360 con 0x7f8b9c103090 2024-04-26T20:12:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.932+0000 7f8ba1600700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c075720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b900056d0 tx=0x7f8b900057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.932+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b90026070 con 0x7f8b9c103090 2024-04-26T20:12:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.932+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b9000bba0 con 0x7f8b9c103090 2024-04-26T20:12:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.933+0000 7f8ba4000700 1 -- 172.21.15.82:0/2624463581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c077650 con 0x7f8b9c103090 2024-04-26T20:12:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.933+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b90003920 con 0x7f8b9c103090 2024-04-26T20:12:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.933+0000 7f8ba4000700 1 -- 172.21.15.82:0/2624463581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c075e30 con 0x7f8b9c103090 2024-04-26T20:12:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.934+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b78005330 con 0x7f8b9c103090 2024-04-26T20:12:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.934+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f8b90029070 con 0x7f8b9c103090 2024-04-26T20:12:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.934+0000 7f8b9a000700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b840396b0 0x7f8b8403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.935+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b9001e070 con 0x7f8b9c103090 2024-04-26T20:12:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.935+0000 7f8ba0c00700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b840396b0 0x7f8b8403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.935+0000 7f8ba0c00700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b840396b0 0x7f8b8403bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:33.942+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8b90013070 con 0x7f8b9c103090 2024-04-26T20:12:34.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.174+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8b78005620 con 0x7f8b9c103090 2024-04-26T20:12:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.237+0000 7f8b9a000700 1 -- 172.21.15.82:0/2624463581 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8b900282c0 con 0x7f8b9c103090 2024-04-26T20:12:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.241+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b840396b0 msgr2=0x7f8b8403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.241+0000 7f8b8f400700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b840396b0 0x7f8b8403bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.241+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 msgr2=0x7f8b9c075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.241+0000 7f8b8f400700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c075720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b900056d0 tx=0x7f8b900057b0 comp rx=0 tx=0).stop 2024-04-26T20:12:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.242+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 shutdown_connections 2024-04-26T20:12:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.242+0000 7f8b8f400700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b840396b0 0x7f8b8403bb70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.242+0000 7f8b8f400700 1 --2- 172.21.15.82:0/2624463581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9c103090 0x7f8b9c075720 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.242+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 >> 172.21.15.82:0/2624463581 conn(0x7f8b9c0fe960 msgr2=0x7f8b9c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.243+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 shutdown_connections 2024-04-26T20:12:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:34.243+0000 7f8b8f400700 1 -- 172.21.15.82:0/2624463581 wait complete. 2024-04-26T20:12:34.244 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-04-26T20:12:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-26T20:12:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:34 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2624463581' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:12:35.124 INFO:tasks.cephadm:Adding mon.a on smithi082 2024-04-26T20:12:35.124 INFO:tasks.cephadm:Adding mon.b on smithi135 2024-04-26T20:12:35.124 INFO:tasks.cephadm:Adding mon.c on smithi139 2024-04-26T20:12:35.124 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c' 2024-04-26T20:12:35.348 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:35.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:35.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2624463581' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:12:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:35 smithi082 ceph-mon[28105]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.769+0000 7f75a3425700 1 -- 172.21.15.139:0/2342344871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 msgr2=0x7f759c107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.769+0000 7f75a3425700 1 --2- 172.21.15.139:0/2342344871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c107900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f759800aa20 tx=0x7f759800ad30 comp rx=0 tx=0).stop 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.769+0000 7f75a3425700 1 -- 172.21.15.139:0/2342344871 shutdown_connections 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.769+0000 7f75a3425700 1 --2- 172.21.15.139:0/2342344871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c107900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.769+0000 7f75a3425700 1 -- 172.21.15.139:0/2342344871 >> 172.21.15.139:0/2342344871 conn(0x7f759c0792b0 msgr2=0x7f759c0796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.769+0000 7f75a3425700 1 -- 172.21.15.139:0/2342344871 shutdown_connections 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.770+0000 7f75a3425700 1 -- 172.21.15.139:0/2342344871 wait complete. 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.770+0000 7f75a3425700 1 Processor -- start 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.770+0000 7f75a3425700 1 -- start start 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.770+0000 7f75a3425700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:36.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.770+0000 7f75a3425700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f759c10b100 con 0x7f759c107520 2024-04-26T20:12:36.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.771+0000 7f75a11c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:36.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.771+0000 7f75a11c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.139:43836/0 (socket says 172.21.15.139:43836) 2024-04-26T20:12:36.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.771+0000 7f75a11c1700 1 -- 172.21.15.139:0/3553229212 learned_addr learned my addr 172.21.15.139:0/3553229212 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:12:36.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75a11c1700 1 -- 172.21.15.139:0/3553229212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c198c90 con 0x7f759c107520 2024-04-26T20:12:36.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75a11c1700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c198750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f759800c6d0 tx=0x7f7598005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:36.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598005530 con 0x7f759c107520 2024-04-26T20:12:36.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c198f20 con 0x7f759c107520 2024-04-26T20:12:36.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75980056d0 con 0x7f759c107520 2024-04-26T20:12:36.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f759800e6b0 con 0x7f759c107520 2024-04-26T20:12:36.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.772+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c19d020 con 0x7f759c107520 2024-04-26T20:12:36.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.773+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c102c00 con 0x7f759c107520 2024-04-26T20:12:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.774+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f7598016a40 con 0x7f759c107520 2024-04-26T20:12:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.774+0000 7f75927fc700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7588039650 0x7f758803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.774+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f759801e070 con 0x7f759c107520 2024-04-26T20:12:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.775+0000 7f75a09c0700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7588039650 0x7f758803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.775+0000 7f75a09c0700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7588039650 0x7f758803bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f758c006fd0 tx=0x7f758c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:36.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:36.789+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f759804c700 con 0x7f759c107520 2024-04-26T20:12:37.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.000+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c", "target": ["mon-mgr", ""]}) -- 0x7f759c199ab0 con 0x7f7588039650 2024-04-26T20:12:37.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.016+0000 7f75927fc700 1 -- 172.21.15.139:0/3553229212 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f759c199ab0 con 0x7f7588039650 2024-04-26T20:12:37.016 INFO:teuthology.orchestra.run.smithi139.stdout:Scheduled mon update... 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7588039650 msgr2=0x7f758803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7588039650 0x7f758803bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f758c006fd0 tx=0x7f758c006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 msgr2=0x7f759c198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c198750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f759800c6d0 tx=0x7f7598005050 comp rx=0 tx=0).stop 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 shutdown_connections 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7588039650 0x7f758803bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 --2- 172.21.15.139:0/3553229212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f759c107520 0x7f759c198750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:37.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 >> 172.21.15.139:0/3553229212 conn(0x7f759c0792b0 msgr2=0x7f759c100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:37.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 shutdown_connections 2024-04-26T20:12:37.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:37.017+0000 7f75a3425700 1 -- 172.21.15.139:0/3553229212 wait complete. 2024-04-26T20:12:37.617 DEBUG:teuthology.orchestra.run.smithi135:mon.b> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.b.service 2024-04-26T20:12:37.619 DEBUG:teuthology.orchestra.run.smithi139:mon.c> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.c.service 2024-04-26T20:12:37.622 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T20:12:37.622 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:38.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:38 smithi082 ceph-mon[28105]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:38.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:38 smithi082 ceph-mon[28105]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c;count:3 2024-04-26T20:12:38.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:38 smithi082 ceph-mon[28105]: Deploying daemon mon.c on smithi139 2024-04-26T20:12:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:39 smithi082 ceph-mon[28105]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.198 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 podman[32951]: 2024-04-26 20:12:41.062284128 +0000 UTC m=+0.253215865 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:12:41.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 -- 172.21.15.139:0/3460023191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 msgr2=0x7ff5941043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 --2- 172.21.15.139:0/3460023191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff5941043d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff584009910 tx=0x7ff584009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 -- 172.21.15.139:0/3460023191 shutdown_connections 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 --2- 172.21.15.139:0/3460023191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff5941043d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 -- 172.21.15.139:0/3460023191 >> 172.21.15.139:0/3460023191 conn(0x7ff5940fd820 msgr2=0x7ff5940ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 -- 172.21.15.139:0/3460023191 shutdown_connections 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.298+0000 7ff599611700 1 -- 172.21.15.139:0/3460023191 wait complete. 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.299+0000 7ff599611700 1 Processor -- start 2024-04-26T20:12:41.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.299+0000 7ff599611700 1 -- start start 2024-04-26T20:12:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.299+0000 7ff599611700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff59419e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.299+0000 7ff599611700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff59410d370 con 0x7ff594103ff0 2024-04-26T20:12:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.300+0000 7ff592ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff59419e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.300+0000 7ff592ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff59419e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.139:56142/0 (socket says 172.21.15.139:56142) 2024-04-26T20:12:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.300+0000 7ff592ffd700 1 -- 172.21.15.139:0/2132450012 learned_addr learned my addr 172.21.15.139:0/2132450012 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:12:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.300+0000 7ff592ffd700 1 -- 172.21.15.139:0/2132450012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59419eb60 con 0x7ff594103ff0 2024-04-26T20:12:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.301+0000 7ff592ffd700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff59419e620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5840056d0 tx=0x7ff5840057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:41.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.301+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584026070 con 0x7ff594103ff0 2024-04-26T20:12:41.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.301+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59419edf0 con 0x7ff594103ff0 2024-04-26T20:12:41.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.301+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941986f0 con 0x7ff594103ff0 2024-04-26T20:12:41.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.301+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff584004370 con 0x7ff594103ff0 2024-04-26T20:12:41.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.301+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584030060 con 0x7ff594103ff0 2024-04-26T20:12:41.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.302+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59406bb10 con 0x7ff594103ff0 2024-04-26T20:12:41.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.302+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7ff584029070 con 0x7ff594103ff0 2024-04-26T20:12:41.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.303+0000 7ff57bfff700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff57c039650 0x7ff57c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:41.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.303+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff58401e070 con 0x7ff594103ff0 2024-04-26T20:12:41.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.303+0000 7ff5927fc700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff57c039650 0x7ff57c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:41.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.304+0000 7ff5927fc700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff57c039650 0x7ff57c03bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff588006fd0 tx=0x7ff588006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:41.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.318+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff584013070 con 0x7ff594103ff0 2024-04-26T20:12:41.480 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 podman[32951]: 2024-04-26 20:12:41.39766229 +0000 UTC m=+0.588594011 container create b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T20:12:41.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.609+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff594199c20 con 0x7ff594103ff0 2024-04-26T20:12:41.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.610+0000 7ff57bfff700 1 -- 172.21.15.139:0/2132450012 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7ff58400b750 con 0x7ff594103ff0 2024-04-26T20:12:41.612 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:12:41.612 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","modified":"2024-04-26T20:10:23.735385Z","created":"2024-04-26T20:10:23.735385Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.612+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff57c039650 msgr2=0x7ff57c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.612+0000 7ff599611700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff57c039650 0x7ff57c03bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff588006fd0 tx=0x7ff588006e40 comp rx=0 tx=0).stop 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.612+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 msgr2=0x7ff59419e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.612+0000 7ff599611700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff59419e620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5840056d0 tx=0x7ff5840057b0 comp rx=0 tx=0).stop 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.613+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 shutdown_connections 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.613+0000 7ff599611700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff57c039650 0x7ff57c03bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.613+0000 7ff599611700 1 --2- 172.21.15.139:0/2132450012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff594103ff0 0x7ff59419e620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.613+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 >> 172.21.15.139:0/2132450012 conn(0x7ff5940fd820 msgr2=0x7ff594104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.613+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 shutdown_connections 2024-04-26T20:12:41.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:41.613+0000 7ff599611700 1 -- 172.21.15.139:0/2132450012 wait complete. 2024-04-26T20:12:41.616 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-04-26T20:12:41.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 podman[32951]: 2024-04-26 20:12:41.575133993 +0000 UTC m=+0.766065717 container init b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T20:12:41.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 podman[32951]: 2024-04-26 20:12:41.579582649 +0000 UTC m=+0.770514370 container start b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T20:12:41.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pidfile_write: ignore empty --pid-file 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: load: jerasure load: lrc 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Git sha 0 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: DB SUMMARY 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: DB Session ID: 0B4UBM7H3Q7JSCFEIB9D 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-26T20:12:41.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.env: 0x555f76378cc0 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.info_log: 0x555f78567d80 2024-04-26T20:12:41.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:12:41.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.statistics: (nil) 2024-04-26T20:12:41.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.use_fsync: 0 2024-04-26T20:12:41.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:12:41.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:12:41.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:12:41.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.db_log_dir: 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.wal_dir: 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:12:41.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.write_buffer_manager: 0x555f785390e0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:12:41.827 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.unordered_write: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.row_cache: None 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.wal_filter: None 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.wal_compression: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:12:41.828 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:12:41.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_open_files: -1 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:12:41.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Compression algorithms supported: 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kZSTD supported: 0 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:12:41.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.merge_operator: 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_filter: None 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555f78567f40) 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout: index_type: 0 2024-04-26T20:12:41.832 INFO:journalctl@ceph.mon.c.smithi139.stdout: data_block_index_type: 0 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: index_shortening: 1 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: checksum: 4 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: no_block_cache: 0 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_cache: 0x555f7856b1f0 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_cache_options: 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: capacity : 536870912 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: num_shard_bits : 4 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: strict_capacity_limit : 0 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_cache_compressed: (nil) 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: persistent_cache: (nil) 2024-04-26T20:12:41.833 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_size: 4096 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_size_deviation: 10 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_restart_interval: 16 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: index_block_restart_interval: 1 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: metadata_block_size: 4096 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: partition_filters: 0 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: use_delta_encoding: 1 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: filter_policy: bloomfilter 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: whole_key_filtering: 1 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: verify_compression: 0 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: format_version: 5 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: enable_index_compression: 1 2024-04-26T20:12:41.834 INFO:journalctl@ceph.mon.c.smithi139.stdout: block_align: 0 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout: max_auto_readahead_size: 262144 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout: prepopulate_block_cache: 0 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression: NoCompression 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.num_levels: 7 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:12:41.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:12:41.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:12:41.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:12:41.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:12:41.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.ttl: 2592000 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:12:41.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a090eb36-965f-44a3-aa20-81288587bc4f 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162361609449, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162361609864, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714162361, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a090eb36-965f-44a3-aa20-81288587bc4f", "db_session_id": "0B4UBM7H3Q7JSCFEIB9D", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162361609959, "job": 1, "event": "recovery_finished"} 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555f78688000 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: DB pointer 0x555f78674000 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:12:41.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: ** DB Stats ** 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: ** Compaction Stats [default] ** 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:12:41.842 INFO:journalctl@ceph.mon.c.smithi139.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: ** Compaction Stats [default] ** 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:12:41.843 INFO:journalctl@ceph.mon.c.smithi139.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: Block cache BinnedLRUCache@0x555f7856b1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: using public_addr v2:172.21.15.139:0/0 -> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: starting mon.c rank -1 at public addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] at bind addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(???) e0 preinit fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:41.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 bash[32951]: b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 systemd[1]: Started Ceph mon.c for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).mds e1 new map 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout: e1 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout: legacy client fscid: -1 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout: 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout: No filesystems configured 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T20:12:41.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Added host smithi135 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:41.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Deploying cephadm binary to smithi139 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Added host smithi139 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:41.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2624463581' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2624463581' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:41.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c;count:3 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: Deploying daemon mon.c on smithi139 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:41.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:41 smithi139 ceph-mon[32999]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T20:12:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:41 smithi082 ceph-mon[28105]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:43.206 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T20:12:43.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:12:43.461 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: mon.a calling monitor election 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: mon.c calling monitor election 2024-04-26T20:12:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: monmap epoch 2 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: last_changed 2024-04-26T20:12:41.647736+0000 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: min_mon_release 19 (squid) 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: election_strategy: 1 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:47.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:47.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: fsmap 2024-04-26T20:12:47.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:47.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: mgrmap e13: x(active, since 60s) 2024-04-26T20:12:47.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: overall HEALTH_OK 2024-04-26T20:12:47.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:47.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:12:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: mon.a calling monitor election 2024-04-26T20:12:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: mon.c calling monitor election 2024-04-26T20:12:47.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:47.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:47.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:47.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:12:47.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: monmap epoch 2 2024-04-26T20:12:47.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:47.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: last_changed 2024-04-26T20:12:41.647736+0000 2024-04-26T20:12:47.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:47.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: min_mon_release 19 (squid) 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: election_strategy: 1 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: fsmap 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: mgrmap e13: x(active, since 60s) 2024-04-26T20:12:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: overall HEALTH_OK 2024-04-26T20:12:47.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:47.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 -- 172.21.15.139:0/1809972069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 msgr2=0x7f76d4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 --2- 172.21.15.139:0/1809972069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76d4005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76ec101d40 tx=0x7f76dc00feb0 comp rx=0 tx=0).stop 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 -- 172.21.15.139:0/1809972069 shutdown_connections 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 --2- 172.21.15.139:0/1809972069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76d4005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 -- 172.21.15.139:0/1809972069 >> 172.21.15.139:0/1809972069 conn(0x7f76ec0fd900 msgr2=0x7f76ec0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 -- 172.21.15.139:0/1809972069 shutdown_connections 2024-04-26T20:12:47.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.915+0000 7f76f18d4700 1 -- 172.21.15.139:0/1809972069 wait complete. 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.916+0000 7f76f18d4700 1 Processor -- start 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.916+0000 7f76f18d4700 1 -- start start 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.916+0000 7f76f18d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76ec19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76f18d4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76f18d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec109d60 con 0x7f76d40035c0 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76f18d4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec109be0 con 0x7f76ec19eb60 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37480/0 (socket says 172.21.15.139:37480) 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 -- 172.21.15.139:0/2349218158 learned_addr learned my addr 172.21.15.139:0/2349218158 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 -- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 msgr2=0x7f76ec1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:12:47.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 -- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 msgr2=0x7f76ec1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:12:47.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:12:47.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76ea7fc700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:12:47.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.917+0000 7f76eaffd700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76ec19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.918+0000 7f76eaffd700 1 -- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 msgr2=0x7f76ec1987a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.918+0000 7f76eaffd700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.918+0000 7f76eaffd700 1 -- 172.21.15.139:0/2349218158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec19f1a0 con 0x7f76d40035c0 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.918+0000 7f76eaffd700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76ec19e620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76dc000c00 tx=0x7f76dc0046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.919+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f76dc013b00 con 0x7f76d40035c0 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.919+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec198d40 con 0x7f76d40035c0 2024-04-26T20:12:47.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.919+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76dc0044e0 con 0x7f76d40035c0 2024-04-26T20:12:47.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.919+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f76dc011470 con 0x7f76d40035c0 2024-04-26T20:12:47.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.919+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec1992a0 con 0x7f76d40035c0 2024-04-26T20:12:47.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.920+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec103550 con 0x7f76d40035c0 2024-04-26T20:12:47.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.920+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f76dc023070 con 0x7f76d40035c0 2024-04-26T20:12:47.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.920+0000 7f76f08d2700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f76d80393f0 0x7f76d803b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:47.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.920+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f76dc020050 con 0x7f76d40035c0 2024-04-26T20:12:47.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.921+0000 7f76ea7fc700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f76d80393f0 0x7f76d803b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:47.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.922+0000 7f76ea7fc700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f76d80393f0 0x7f76d803b8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009180 tx=0x7f76e0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:47.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:47.935+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f76dc028020 con 0x7f76d40035c0 2024-04-26T20:12:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:47 smithi139 ceph-mon[32999]: Deploying daemon mon.b on smithi135 2024-04-26T20:12:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:48.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:48.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:48.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:48.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:47 smithi082 ceph-mon[28105]: Deploying daemon mon.b on smithi135 2024-04-26T20:12:48.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:48.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.217+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f76ec1995b0 con 0x7f76d40035c0 2024-04-26T20:12:48.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.218+0000 7f76f08d2700 1 -- 172.21.15.139:0/2349218158 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f76dc003680 con 0x7f76d40035c0 2024-04-26T20:12:48.219 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:12:48.219 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":2,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","modified":"2024-04-26T20:12:41.647736Z","created":"2024-04-26T20:10:23.735385Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T20:12:48.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f76d80393f0 msgr2=0x7f76d803b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:48.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f76d80393f0 0x7f76d803b8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009180 tx=0x7f76e0008040 comp rx=0 tx=0).stop 2024-04-26T20:12:48.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 msgr2=0x7f76ec19e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:48.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76ec19e620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76dc000c00 tx=0x7f76dc0046f0 comp rx=0 tx=0).stop 2024-04-26T20:12:48.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 shutdown_connections 2024-04-26T20:12:48.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f76d80393f0 0x7f76d803b8b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d40035c0 0x7f76ec19e620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 --2- 172.21.15.139:0/2349218158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76ec19eb60 0x7f76ec1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 >> 172.21.15.139:0/2349218158 conn(0x7f76ec0fd900 msgr2=0x7f76ec0fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 shutdown_connections 2024-04-26T20:12:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:48.220+0000 7f76f18d4700 1 -- 172.21.15.139:0/2349218158 wait complete. 2024-04-26T20:12:48.222 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 2 2024-04-26T20:12:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:48 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/2349218158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:12:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:48 smithi139 ceph-mon[32999]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:48 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/2349218158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:12:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:48 smithi082 ceph-mon[28105]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:48.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:12:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:12:48.646+0000 7f1298600700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T20:12:49.870 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T20:12:49.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:12:50.132 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:12:50.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 podman[32796]: 2024-04-26 20:12:50.390021715 +0000 UTC m=+0.029043054 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:12:50.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 podman[32796]: 2024-04-26 20:12:50.533874091 +0000 UTC m=+0.172895413 container create c10f668c38508e81aa6ce2c9f9b752d87aaacd5c2c9d851b19f1308d8cbefff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T20:12:50.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 podman[32796]: 2024-04-26 20:12:50.736954007 +0000 UTC m=+0.375975341 container init c10f668c38508e81aa6ce2c9f9b752d87aaacd5c2c9d851b19f1308d8cbefff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 podman[32796]: 2024-04-26 20:12:50.740491122 +0000 UTC m=+0.379512448 container start c10f668c38508e81aa6ce2c9f9b752d87aaacd5c2c9d851b19f1308d8cbefff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pidfile_write: ignore empty --pid-file 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: load: jerasure load: lrc 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Git sha 0 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: DB SUMMARY 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: DB Session ID: 60W6F7VUQ7OY31UQJRTN 2024-04-26T20:12:50.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.env: 0x55c6d05cccc0 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.info_log: 0x55c6d26cbd80 2024-04-26T20:12:50.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.statistics: (nil) 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.use_fsync: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:12:50.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.db_log_dir: 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.wal_dir: 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.write_buffer_manager: 0x55c6d269d0e0 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:12:50.803 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.unordered_write: 0 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.row_cache: None 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.wal_filter: None 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:12:50.804 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.wal_compression: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:12:50.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_open_files: -1 2024-04-26T20:12:50.806 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Compression algorithms supported: 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kZSTD supported: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:12:50.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.merge_operator: 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_filter: None 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c6d26cbf40) 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:12:50.808 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_type: 0 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_index_type: 0 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_shortening: 1 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: checksum: 4 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: no_block_cache: 0 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache: 0x55c6d26cf1f0 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_options: 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: capacity : 536870912 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_shard_bits : 4 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: strict_capacity_limit : 0 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:12:50.809 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_compressed: (nil) 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: persistent_cache: (nil) 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size: 4096 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size_deviation: 10 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_restart_interval: 16 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_block_restart_interval: 1 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: metadata_block_size: 4096 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: partition_filters: 0 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: use_delta_encoding: 1 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: filter_policy: bloomfilter 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: whole_key_filtering: 1 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: verify_compression: 0 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: format_version: 5 2024-04-26T20:12:50.810 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_index_compression: 1 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_align: 0 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout: max_auto_readahead_size: 262144 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout: prepopulate_block_cache: 0 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression: NoCompression 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.num_levels: 7 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:12:50.811 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:12:50.812 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:12:50.813 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:12:50.814 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:12:50.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:12:50.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.ttl: 2592000 2024-04-26T20:12:50.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T20:12:50.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 73d1eec2-fa0b-4527-b5b8-80136d53e643 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162370770873, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162370771447, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714162370, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "73d1eec2-fa0b-4527-b5b8-80136d53e643", "db_session_id": "60W6F7VUQ7OY31UQJRTN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714162370771550, "job": 1, "event": "recovery_finished"} 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c6d27ec000 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: DB pointer 0x55c6d27d8000 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** DB Stats ** 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:12:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2024-04-26T20:12:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:12:50.821 INFO:journalctl@ceph.mon.b.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache BinnedLRUCache@0x55c6d26cf1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: using public_addr v2:172.21.15.135:0/0 -> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: starting mon.b rank -1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(???) e0 preinit fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).mds e1 new map 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: e1 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:12:50.822 INFO:journalctl@ceph.mon.b.smithi135.stdout: legacy client fscid: -1 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout: No filesystems configured 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Added host smithi135 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:50.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Deploying cephadm binary to smithi139 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Added host smithi139 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2624463581' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2624463581' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c;count:3 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Deploying daemon mon.c on smithi139 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.a calling monitor election 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.c calling monitor election 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: monmap epoch 2 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: last_changed 2024-04-26T20:12:41.647736+0000 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:50.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: min_mon_release 19 (squid) 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: election_strategy: 1 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: fsmap 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mgrmap e13: x(active, since 60s) 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: overall HEALTH_OK 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: Deploying daemon mon.b on smithi135 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:50.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/2349218158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:12:50.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:50.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 ceph-mon[32816]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T20:12:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 bash[32796]: c10f668c38508e81aa6ce2c9f9b752d87aaacd5c2c9d851b19f1308d8cbefff9 2024-04-26T20:12:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:50 smithi135 systemd[1]: Started Ceph mon.b for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:12:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 -- 172.21.15.139:0/1562129448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7f40035c0 msgr2=0x7fd7f4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 --2- 172.21.15.139:0/1562129448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7f40035c0 0x7fd7f4005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd80c101d60 tx=0x7fd80000fe60 comp rx=0 tx=0).stop 2024-04-26T20:12:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 -- 172.21.15.139:0/1562129448 shutdown_connections 2024-04-26T20:12:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 --2- 172.21.15.139:0/1562129448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7f40035c0 0x7fd7f4005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 -- 172.21.15.139:0/1562129448 >> 172.21.15.139:0/1562129448 conn(0x7fd80c0fd960 msgr2=0x7fd80c0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 -- 172.21.15.139:0/1562129448 shutdown_connections 2024-04-26T20:12:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.892+0000 7fd811f52700 1 -- 172.21.15.139:0/1562129448 wait complete. 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 Processor -- start 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 -- start start 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd80c19ec90 0x7fd80c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 0x7fd80c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c109d20 con 0x7fd80c19ec90 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c109ba0 con 0x7fd80c198ea0 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.893+0000 7fd811f52700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c109ea0 con 0x7fd7f40035c0 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45854/0 (socket says 172.21.15.139:45854) 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 -- 172.21.15.139:0/1354454977 learned_addr learned my addr 172.21.15.139:0/1354454977 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 msgr2=0x7fd80c19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-26T20:12:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 msgr2=0x7fd80c19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80bfff700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 0x7fd80c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80b7fe700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80affd700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd80c19ec90 0x7fd80c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80bfff700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 msgr2=0x7fd80c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80bfff700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 msgr2=0x7fd80c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80bfff700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 0x7fd80c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:12:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.894+0000 7fd80bfff700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 0x7fd80c199350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.895+0000 7fd80affd700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 msgr2=0x7fd80c19e750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.895+0000 7fd80affd700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.895+0000 7fd80affd700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 msgr2=0x7fd80c199350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.895+0000 7fd80affd700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 0x7fd80c199350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.895+0000 7fd80affd700 1 -- 172.21.15.139:0/1354454977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c1a5620 con 0x7fd80c19ec90 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.895+0000 7fd80affd700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd80c19ec90 0x7fd80c198960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00b550 tx=0x7fd7fc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.896+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc004230 con 0x7fd80c19ec90 2024-04-26T20:12:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.896+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7fc0043d0 con 0x7fd80c19ec90 2024-04-26T20:12:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.896+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80c1a5850 con 0x7fd80c19ec90 2024-04-26T20:12:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.896+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011b90 con 0x7fd80c19ec90 2024-04-26T20:12:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.896+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80c1a5de0 con 0x7fd80c19ec90 2024-04-26T20:12:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.897+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd80c064a80 con 0x7fd80c19ec90 2024-04-26T20:12:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.897+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd7fc0036a0 con 0x7fd80c19ec90 2024-04-26T20:12:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.897+0000 7fd808ff9700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7f8039ae0 0x7fd7f803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.898+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd7fc04c350 con 0x7fd80c19ec90 2024-04-26T20:12:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.898+0000 7fd80b7fe700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7f8039ae0 0x7fd7f803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.899+0000 7fd80b7fe700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7f8039ae0 0x7fd7f803bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd80000fa10 tx=0x7fd8000038d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:55.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:55.916+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd7fc010380 con 0x7fd80c19ec90 2024-04-26T20:12:56.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: mon.c calling monitor election 2024-04-26T20:12:56.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: mon.a calling monitor election 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: monmap epoch 3 2024-04-26T20:12:56.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: last_changed 2024-04-26T20:12:50.804166+0000 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: min_mon_release 19 (squid) 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: election_strategy: 1 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: fsmap 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: mgrmap e13: x(active, since 69s) 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: overall HEALTH_OK 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:56.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:56.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.203+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd80c1a6100 con 0x7fd80c19ec90 2024-04-26T20:12:56.204 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: mon.c calling monitor election 2024-04-26T20:12:56.204 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:12:56.204 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: mon.a calling monitor election 2024-04-26T20:12:56.204 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.204 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: monmap epoch 3 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: last_changed 2024-04-26T20:12:50.804166+0000 2024-04-26T20:12:56.205 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: min_mon_release 19 (squid) 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: election_strategy: 1 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: fsmap 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: mgrmap e13: x(active, since 69s) 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: overall HEALTH_OK 2024-04-26T20:12:56.206 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:56.207 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:56.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.204+0000 7fd808ff9700 1 -- 172.21.15.139:0/1354454977 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fd7fc003990 con 0x7fd80c19ec90 2024-04-26T20:12:56.207 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T20:12:56.208 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":3,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","modified":"2024-04-26T20:12:50.804166Z","created":"2024-04-26T20:10:23.735385Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T20:12:56.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7f8039ae0 msgr2=0x7fd7f803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:56.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7f8039ae0 0x7fd7f803bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd80000fa10 tx=0x7fd8000038d0 comp rx=0 tx=0).stop 2024-04-26T20:12:56.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd80c19ec90 msgr2=0x7fd80c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd80c19ec90 0x7fd80c198960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00b550 tx=0x7fd7fc00b910 comp rx=0 tx=0).stop 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 shutdown_connections 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7f8039ae0 0x7fd7f803bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80c198ea0 0x7fd80c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7f40035c0 0x7fd80c19e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 --2- 172.21.15.139:0/1354454977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd80c19ec90 0x7fd80c198960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 >> 172.21.15.139:0/1354454977 conn(0x7fd80c0fd960 msgr2=0x7fd80c0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 shutdown_connections 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:12:56.206+0000 7fd811f52700 1 -- 172.21.15.139:0/1354454977 wait complete. 2024-04-26T20:12:56.209 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 3 2024-04-26T20:12:56.837 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T20:12:56.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/1354454977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/1354454977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: mon.c calling monitor election 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: mon.a calling monitor election 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: monmap epoch 3 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: last_changed 2024-04-26T20:12:50.804166+0000 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: min_mon_release 19 (squid) 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: election_strategy: 1 2024-04-26T20:12:58.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: fsmap 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: mgrmap e13: x(active, since 69s) 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: overall HEALTH_OK 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/1354454977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: mon.b calling monitor election 2024-04-26T20:12:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: mon.b calling monitor election 2024-04-26T20:12:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: mon.c calling monitor election 2024-04-26T20:12:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: mon.a calling monitor election 2024-04-26T20:12:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: monmap epoch 3 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: last_changed 2024-04-26T20:12:50.804166+0000 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: min_mon_release 19 (squid) 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: election_strategy: 1 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: fsmap 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: mgrmap e13: x(active, since 71s) 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: overall HEALTH_OK 2024-04-26T20:12:58.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: mon.b calling monitor election 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: mon.b calling monitor election 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: mon.c calling monitor election 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: mon.a calling monitor election 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: monmap epoch 3 2024-04-26T20:12:58.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: last_changed 2024-04-26T20:12:50.804166+0000 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: min_mon_release 19 (squid) 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: election_strategy: 1 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: fsmap 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: mgrmap e13: x(active, since 71s) 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: overall HEALTH_OK 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: mon.b calling monitor election 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: mon.b calling monitor election 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: mon.c calling monitor election 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: mon.a calling monitor election 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: monmap epoch 3 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: last_changed 2024-04-26T20:12:50.804166+0000 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: created 2024-04-26T20:10:23.735385+0000 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: min_mon_release 19 (squid) 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: election_strategy: 1 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: 1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.c 2024-04-26T20:12:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: fsmap 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: mgrmap e13: x(active, since 71s) 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: overall HEALTH_OK 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:58.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 -- 172.21.15.82:0/711724718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac0757c0 msgr2=0x7f0fac075ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 --2- 172.21.15.82:0/711724718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac0757c0 0x7f0fac075ba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009910 tx=0x7f0fa0009c20 comp rx=0 tx=0).stop 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 -- 172.21.15.82:0/711724718 shutdown_connections 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 --2- 172.21.15.82:0/711724718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac0757c0 0x7f0fac075ba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 -- 172.21.15.82:0/711724718 >> 172.21.15.82:0/711724718 conn(0x7f0fac0fe960 msgr2=0x7f0fac100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 -- 172.21.15.82:0/711724718 shutdown_connections 2024-04-26T20:12:59.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.324+0000 7f0fb3400700 1 -- 172.21.15.82:0/711724718 wait complete. 2024-04-26T20:12:59.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.325+0000 7f0fb3400700 1 Processor -- start 2024-04-26T20:12:59.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 -- start start 2024-04-26T20:12:59.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fac0757c0 0x7f0fac19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:59.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 0x7f0fac1a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:59.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fac1a3fa0 0x7f0fac1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:59.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac113980 con 0x7f0fac19f6d0 2024-04-26T20:12:59.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac113800 con 0x7f0fac1a3fa0 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fb3400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac113b00 con 0x7f0fac0757c0 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.326+0000 7f0fabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 0x7f0fac1a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 0x7f0fac1a3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60116/0 (socket says 172.21.15.82:60116) 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 -- 172.21.15.82:0/3457903441 learned_addr learned my addr 172.21.15.82:0/3457903441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fb0a00700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fac0757c0 0x7f0fac19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fb1400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fac1a3fa0 0x7f0fac1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 -- 172.21.15.82:0/3457903441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fac0757c0 msgr2=0x7f0fac19f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fac0757c0 0x7f0fac19f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 -- 172.21.15.82:0/3457903441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fac1a3fa0 msgr2=0x7f0fac1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fac1a3fa0 0x7f0fac1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fabe00700 1 -- 172.21.15.82:0/3457903441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac1abd10 con 0x7f0fac19f6d0 2024-04-26T20:12:59.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.327+0000 7f0fb1400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fac1a3fa0 0x7f0fac1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:12:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.328+0000 7f0fabe00700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 0x7f0fac1a3a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800b780 tx=0x7f0f9800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.328+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004230 con 0x7f0fac19f6d0 2024-04-26T20:12:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.328+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980043d0 con 0x7f0fac19f6d0 2024-04-26T20:12:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.328+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011b20 con 0x7f0fac19f6d0 2024-04-26T20:12:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.328+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac1abf40 con 0x7f0fac19f6d0 2024-04-26T20:12:59.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.328+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac1ac3f0 con 0x7f0fac19f6d0 2024-04-26T20:12:59.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.329+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fac064a80 con 0x7f0fac19f6d0 2024-04-26T20:12:59.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.330+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f0f98011cc0 con 0x7f0fac19f6d0 2024-04-26T20:12:59.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.330+0000 7f0fa9600700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0f94039ae0 0x7f0f9403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:12:59.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.331+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0f9804c4d0 con 0x7f0fac19f6d0 2024-04-26T20:12:59.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.331+0000 7f0fb0a00700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0f94039ae0 0x7f0f9403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:12:59.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.332+0000 7f0fb0a00700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0f94039ae0 0x7f0f9403bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0006010 tx=0x7f0fa001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:12:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.337+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0f98021e00 con 0x7f0fac19f6d0 2024-04-26T20:12:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.568+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0fac1ac770 con 0x7f0fac19f6d0 2024-04-26T20:12:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.569+0000 7f0fa9600700 1 -- 172.21.15.82:0/3457903441 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f0f98017d70 con 0x7f0fac19f6d0 2024-04-26T20:12:59.571 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:59.571 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-04-26T20:12:59.571 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:12:59.571 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] 2024-04-26T20:12:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.572+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0f94039ae0 msgr2=0x7f0f9403bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.572+0000 7f0fb3400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0f94039ae0 0x7f0f9403bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0006010 tx=0x7f0fa001a040 comp rx=0 tx=0).stop 2024-04-26T20:12:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.572+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 msgr2=0x7f0fac1a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.572+0000 7f0fb3400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 0x7f0fac1a3a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800b780 tx=0x7f0f9800ba90 comp rx=0 tx=0).stop 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 shutdown_connections 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0f94039ae0 0x7f0f9403bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fac1a3fa0 0x7f0fac1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fac0757c0 0x7f0fac19f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 --2- 172.21.15.82:0/3457903441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac19f6d0 0x7f0fac1a3a60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 >> 172.21.15.82:0/3457903441 conn(0x7f0fac0fe960 msgr2=0x7f0fac0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 shutdown_connections 2024-04-26T20:12:59.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:12:59.573+0000 7f0fb3400700 1 -- 172.21.15.82:0/3457903441 wait complete. 2024-04-26T20:12:59.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: Updating smithi082:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:59.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:12:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: Updating smithi082:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:12:59.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:12:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:59.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: Updating smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: Updating smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: Updating smithi082:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:12:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:12:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:00.024 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:12:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:12:59.803+0000 7f1298600700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T20:13:00.289 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T20:13:00.289 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:13:00.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:13:00.361 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:13:00.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:13:00.479 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:13:00.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:13:00.511 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:13:00.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:13:00.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:00 smithi082 ceph-mon[28105]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T20:13:00.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:00 smithi082 ceph-mon[28105]: Reconfiguring daemon mon.a on smithi082 2024-04-26T20:13:00.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:00 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3457903441' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:00.580 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:13:00.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:13:00.606 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:13:00.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:13:00.670 INFO:tasks.cephadm:Adding mgr.x on smithi082 2024-04-26T20:13:00.670 INFO:tasks.cephadm:Adding mgr.y on smithi135 2024-04-26T20:13:00.670 INFO:tasks.cephadm:Adding mgr.z on smithi139 2024-04-26T20:13:00.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi082=x;smithi135=y;smithi139=z' 2024-04-26T20:13:00.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:00 smithi139 ceph-mon[32999]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T20:13:00.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:00 smithi139 ceph-mon[32999]: Reconfiguring daemon mon.a on smithi082 2024-04-26T20:13:00.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:00 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3457903441' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:00.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:00 smithi135 ceph-mon[32816]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T20:13:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:00 smithi135 ceph-mon[32816]: Reconfiguring daemon mon.a on smithi082 2024-04-26T20:13:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:00 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3457903441' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:13:01.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:01 smithi139 ceph-mon[32999]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:01.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:01 smithi135 ceph-mon[32816]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:01 smithi082 ceph-mon[28105]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 -- 172.21.15.139:0/149899566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304103480 msgr2=0x7fc3041038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 --2- 172.21.15.139:0/149899566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304103480 0x7fc3041038a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009910 tx=0x7fc2f4009c20 comp rx=0 tx=0).stop 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 -- 172.21.15.139:0/149899566 shutdown_connections 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 --2- 172.21.15.139:0/149899566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304103480 0x7fc3041038a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 -- 172.21.15.139:0/149899566 >> 172.21.15.139:0/149899566 conn(0x7fc3040fcbd0 msgr2=0x7fc3040ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 -- 172.21.15.139:0/149899566 shutdown_connections 2024-04-26T20:13:02.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.395+0000 7fc309d9e700 1 -- 172.21.15.139:0/149899566 wait complete. 2024-04-26T20:13:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 Processor -- start 2024-04-26T20:13:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 -- start start 2024-04-26T20:13:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc304103480 0x7fc304197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304197ba0 0x7fc30419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 0x7fc30419f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc304107df0 con 0x7fc304197ba0 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc304107c70 con 0x7fc304103480 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc309d9e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc304107f70 con 0x7fc304198020 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc303fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 0x7fc30419f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc303fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 0x7fc30419f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55344/0 (socket says 172.21.15.139:55344) 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.396+0000 7fc303fff700 1 -- 172.21.15.139:0/758308710 learned_addr learned my addr 172.21.15.139:0/758308710 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc3037fe700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc304103480 0x7fc304197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc302ffd700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304197ba0 0x7fc30419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc303fff700 1 -- 172.21.15.139:0/758308710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc304103480 msgr2=0x7fc304197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc303fff700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc304103480 0x7fc304197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc303fff700 1 -- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304197ba0 msgr2=0x7fc30419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc303fff700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304197ba0 0x7fc30419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc303fff700 1 -- 172.21.15.139:0/758308710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30419fa70 con 0x7fc304198020 2024-04-26T20:13:02.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc302ffd700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304197ba0 0x7fc30419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc303fff700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 0x7fc30419f1a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00ba50 tx=0x7fc2fc00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc019070 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2fc014440 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30419fd60 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00ce60 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.397+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3041a0270 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.398+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fc2fc01c070 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.398+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc304064a80 con 0x7fc304198020 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.398+0000 7fc300ff9700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2f0039ae0 0x7fc2f003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:02.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.398+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc2fc04be30 con 0x7fc304198020 2024-04-26T20:13:02.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.399+0000 7fc3037fe700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2f0039ae0 0x7fc2f003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:02.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.400+0000 7fc3037fe700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2f0039ae0 0x7fc2f003bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4005190 tx=0x7fc2f401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:02.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.404+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc2fc012500 con 0x7fc304198020 2024-04-26T20:13:02.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.612+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi139=z", "target": ["mon-mgr", ""]}) -- 0x7fc304101090 con 0x7fc2f0039ae0 2024-04-26T20:13:02.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.625+0000 7fc300ff9700 1 -- 172.21.15.139:0/758308710 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc304101090 con 0x7fc2f0039ae0 2024-04-26T20:13:02.626 INFO:teuthology.orchestra.run.smithi139.stdout:Scheduled mgr update... 2024-04-26T20:13:02.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2f0039ae0 msgr2=0x7fc2f003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:02.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2f0039ae0 0x7fc2f003bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4005190 tx=0x7fc2f401a040 comp rx=0 tx=0).stop 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 msgr2=0x7fc30419f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 0x7fc30419f1a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00ba50 tx=0x7fc2fc00bd60 comp rx=0 tx=0).stop 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 shutdown_connections 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc304198020 0x7fc30419f1a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2f0039ae0 0x7fc2f003bfa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc304103480 0x7fc304197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 --2- 172.21.15.139:0/758308710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc304197ba0 0x7fc30419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.627+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 >> 172.21.15.139:0/758308710 conn(0x7fc3040fcbd0 msgr2=0x7fc3040fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.628+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 shutdown_connections 2024-04-26T20:13:02.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:13:02.628+0000 7fc309d9e700 1 -- 172.21.15.139:0/758308710 wait complete. 2024-04-26T20:13:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: Reconfiguring mon.b (monmap changed)... 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: Reconfiguring daemon mon.b on smithi135 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi139=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: Saving service mgr spec with placement smithi082=x;smithi135=y;smithi139=z;count:3 2024-04-26T20:13:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: Reconfiguring mon.b (monmap changed)... 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: Reconfiguring daemon mon.b on smithi135 2024-04-26T20:13:03.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:03.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi139=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:03.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: Saving service mgr spec with placement smithi082=x;smithi135=y;smithi139=z;count:3 2024-04-26T20:13:03.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: Reconfiguring mon.b (monmap changed)... 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: Reconfiguring daemon mon.b on smithi135 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi135=y;smithi139=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: Saving service mgr spec with placement smithi082=x;smithi135=y;smithi139=z;count:3 2024-04-26T20:13:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:03.221 DEBUG:teuthology.orchestra.run.smithi135:mgr.y> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.y.service 2024-04-26T20:13:03.224 DEBUG:teuthology.orchestra.run.smithi139:mgr.z> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.z.service 2024-04-26T20:13:03.227 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T20:13:03.227 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:13:03.227 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:13:03.283 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:13:03.284 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-26T20:13:03.331 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:13:03.331 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:03.331 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-04-26T20:13:03.331 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:03.332 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:03.332 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 20:12:03.180773699 +0000 2024-04-26T20:13:03.332 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 20:06:25.112462547 +0000 2024-04-26T20:13:03.332 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 20:06:25.112462547 +0000 2024-04-26T20:13:03.332 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 20:06:25.112462547 +0000 2024-04-26T20:13:03.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:13:03.452 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T20:13:03.453 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T20:13:03.453 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000361474 s, 1.4 MB/s 2024-04-26T20:13:03.457 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:13:03.509 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-26T20:13:03.560 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:13:03.560 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:03.560 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-04-26T20:13:03.561 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:03.561 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:03.561 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 20:12:03.274771855 +0000 2024-04-26T20:13:03.561 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 20:06:25.717450966 +0000 2024-04-26T20:13:03.561 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 20:06:25.717450966 +0000 2024-04-26T20:13:03.561 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 20:06:25.717450966 +0000 2024-04-26T20:13:03.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:13:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T20:13:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T20:13:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000356716 s, 1.4 MB/s 2024-04-26T20:13:03.644 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:13:03.703 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 20:12:03.362770128 +0000 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 20:06:26.308439652 +0000 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 20:06:26.308439652 +0000 2024-04-26T20:13:03.753 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 20:06:26.308439652 +0000 2024-04-26T20:13:03.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:13:03.825 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T20:13:03.825 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T20:13:03.825 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000368162 s, 1.4 MB/s 2024-04-26T20:13:03.828 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:13:03.881 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-26T20:13:03.928 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:13:03.928 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 20:12:03.424768912 +0000 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 20:06:26.929427764 +0000 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 20:06:26.929427764 +0000 2024-04-26T20:13:03.929 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 20:06:26.929427764 +0000 2024-04-26T20:13:03.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:13:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T20:13:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T20:13:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000574218 s, 892 kB/s 2024-04-26T20:13:04.003 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:13:04.060 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-26T20:13:04.060 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:13:04.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:13:04.078 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-04-26T20:13:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:13:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:04.134 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-26T20:13:04.134 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:04.135 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:04.135 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-26 20:12:50.182871363 +0000 2024-04-26T20:13:04.135 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-26 20:05:20.127490217 +0000 2024-04-26T20:13:04.135 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-26 20:05:20.127490217 +0000 2024-04-26T20:13:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-26 20:05:20.127490217 +0000 2024-04-26T20:13:04.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:13:04.199 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-26T20:13:04.199 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-26T20:13:04.199 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000297099 s, 1.7 MB/s 2024-04-26T20:13:04.201 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:13:04.258 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-04-26T20:13:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:13:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:04.314 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T20:13:04.314 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:04.314 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:04.315 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-26 20:12:50.183871342 +0000 2024-04-26T20:13:04.315 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-26 20:05:20.460483142 +0000 2024-04-26T20:13:04.315 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-26 20:05:20.460483142 +0000 2024-04-26T20:13:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-26 20:05:20.460483142 +0000 2024-04-26T20:13:04.315 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:13:04.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:04.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:04.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: Reconfiguring mon.c (monmap changed)... 2024-04-26T20:13:04.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:13:04.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:13:04.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:04.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:04 smithi139 ceph-mon[32999]: Reconfiguring daemon mon.c on smithi139 2024-04-26T20:13:04.376 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-26T20:13:04.377 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-26T20:13:04.377 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000209305 s, 2.4 MB/s 2024-04-26T20:13:04.378 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:13:04.433 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-04-26T20:13:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:13:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-26 20:12:50.183871342 +0000 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-26 20:05:20.790476130 +0000 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-26 20:05:20.790476130 +0000 2024-04-26T20:13:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-26 20:05:20.790476130 +0000 2024-04-26T20:13:04.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: Reconfiguring mon.c (monmap changed)... 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:04.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:04 smithi135 ceph-mon[32816]: Reconfiguring daemon mon.c on smithi139 2024-04-26T20:13:04.551 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-26T20:13:04.551 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-26T20:13:04.551 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000193325 s, 2.6 MB/s 2024-04-26T20:13:04.552 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:13:04.608 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-04-26T20:13:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-26 20:12:50.183871342 +0000 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-26 20:05:21.131468884 +0000 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-26 20:05:21.131468884 +0000 2024-04-26T20:13:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-26 20:05:21.131468884 +0000 2024-04-26T20:13:04.663 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:13:04.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:04.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:04.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: Reconfiguring mon.c (monmap changed)... 2024-04-26T20:13:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:13:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:13:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:04 smithi082 ceph-mon[28105]: Reconfiguring daemon mon.c on smithi139 2024-04-26T20:13:04.725 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-26T20:13:04.725 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-26T20:13:04.725 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000168054 s, 3.0 MB/s 2024-04-26T20:13:04.726 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:13:04.781 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T20:13:04.781 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:13:04.796 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:13:04.796 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-04-26T20:13:04.851 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 20:12:40.490963513 +0000 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 20:05:20.177171388 +0000 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 20:05:20.177171388 +0000 2024-04-26T20:13:04.852 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 20:05:20.177171388 +0000 2024-04-26T20:13:04.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:13:04.915 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T20:13:04.915 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T20:13:04.915 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000251381 s, 2.0 MB/s 2024-04-26T20:13:04.916 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:13:04.972 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-04-26T20:13:05.027 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:13:05.027 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:05.027 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T20:13:05.027 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:05.028 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:05.028 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 20:12:40.490963513 +0000 2024-04-26T20:13:05.028 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 20:05:20.510164222 +0000 2024-04-26T20:13:05.028 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 20:05:20.510164222 +0000 2024-04-26T20:13:05.028 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 20:05:20.510164222 +0000 2024-04-26T20:13:05.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:13:05.089 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T20:13:05.089 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T20:13:05.090 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000198406 s, 2.6 MB/s 2024-04-26T20:13:05.091 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:13:05.146 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-04-26T20:13:05.201 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 20:12:40.491963492 +0000 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 20:05:20.862156646 +0000 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 20:05:20.862156646 +0000 2024-04-26T20:13:05.202 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 20:05:20.862156646 +0000 2024-04-26T20:13:05.203 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:13:05.265 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T20:13:05.265 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T20:13:05.265 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000184075 s, 2.8 MB/s 2024-04-26T20:13:05.266 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:13:05.322 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 20:12:40.491963492 +0000 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 20:05:21.196149458 +0000 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 20:05:21.196149458 +0000 2024-04-26T20:13:05.377 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 20:05:21.196149458 +0000 2024-04-26T20:13:05.378 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:13:05.439 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T20:13:05.439 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T20:13:05.440 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000210247 s, 2.4 MB/s 2024-04-26T20:13:05.441 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:13:05.496 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-04-26T20:13:05.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:05.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:13:05.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:05.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:05.573 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:05.573 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.573 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.573 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:05.573 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:05.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:05.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:05.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:13:05.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:05.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:05.927 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:13:06.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:06 smithi082 ceph-mon[28105]: Deploying daemon mgr.z on smithi139 2024-04-26T20:13:06.425 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:06 smithi139 ceph-mon[32999]: Deploying daemon mgr.z on smithi139 2024-04-26T20:13:06.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:06 smithi135 ceph-mon[32816]: Deploying daemon mgr.z on smithi139 2024-04-26T20:13:06.807 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:06 smithi139 systemd[1]: Starting Ceph mgr.z for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:13:07.070 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:06 smithi139 podman[34863]: 2024-04-26 20:13:06.709779814 +0000 UTC m=+0.017947460 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:13:07.070 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:06 smithi139 podman[34863]: 2024-04-26 20:13:06.80726038 +0000 UTC m=+0.115428058 container create 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:13:07.070 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 podman[34863]: 2024-04-26 20:13:07.042622468 +0000 UTC m=+0.350790103 container init 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T20:13:07.070 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 podman[34863]: 2024-04-26 20:13:07.045174408 +0000 UTC m=+0.353342052 container start 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-mon[32999]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-mgr[34882]: -- 172.21.15.139:0/2006526960 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b0295a5a0 con 0x557b0292e800 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 bash[34863]: 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 systemd[1]: Started Ceph mgr.z for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:13:07.321 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:07.205+0000 7f50a8273200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:13:07.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:07 smithi082 ceph-mon[28105]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:07.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:07.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:07.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:07 smithi135 ceph-mon[32816]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:07.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:07.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:07.806 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:07.395+0000 7f50a8273200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:07.806 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:07.498+0000 7f50a8273200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:13:07.806 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:07.805+0000 7f50a8273200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:13:08.071 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:07.888+0000 7f50a8273200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:13:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:13:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:08 smithi139 ceph-mon[32999]: Deploying daemon mgr.y on smithi135 2024-04-26T20:13:08.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:08.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:08.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:13:08.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:08.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:08.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:08 smithi135 ceph-mon[32816]: Deploying daemon mgr.y on smithi135 2024-04-26T20:13:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:13:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:08 smithi082 ceph-mon[28105]: Deploying daemon mgr.y on smithi135 2024-04-26T20:13:08.820 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:13:08.820 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:13:08.820 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T20:13:08.820 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T20:13:08.820 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0337216 s, 311 MB/s 2024-04-26T20:13:08.821 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 2024-04-26T20:13:08.821 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T20:13:09.427 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:09 smithi139 ceph-mon[32999]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:09.428 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:09.084+0000 7f50a8273200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:13:09.428 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:09.254+0000 7f50a8273200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:09.428 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:09.426+0000 7f50a8273200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:13:09.540 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:09 smithi135 ceph-mon[32816]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:09.541 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 systemd[1]: Starting Ceph mgr.y for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:13:09.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:09 smithi082 ceph-mon[28105]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:09.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-04-26T20:13:09.862 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 podman[34183]: 2024-04-26 20:13:09.540032474 +0000 UTC m=+0.096772265 container create 56ae30959cbeac542278c8e0a48c68a3bfc70b6b30b73d100880b7a8c38e6192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:13:09.862 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 podman[34183]: 2024-04-26 20:13:09.461123253 +0000 UTC m=+0.017863057 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:13:09.862 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 podman[34183]: 2024-04-26 20:13:09.753326556 +0000 UTC m=+0.310066347 container init 56ae30959cbeac542278c8e0a48c68a3bfc70b6b30b73d100880b7a8c38e6192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:13:09.862 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 podman[34183]: 2024-04-26 20:13:09.755722535 +0000 UTC m=+0.312462345 container start 56ae30959cbeac542278c8e0a48c68a3bfc70b6b30b73d100880b7a8c38e6192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:13:09.862 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 ceph-mgr[34202]: -- 172.21.15.135:0/2544434902 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e03dbea5a0 con 0x55e03dbbec00 2024-04-26T20:13:09.862 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 bash[34183]: 56ae30959cbeac542278c8e0a48c68a3bfc70b6b30b73d100880b7a8c38e6192 2024-04-26T20:13:10.009 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:09.708+0000 7f50a8273200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:13:10.009 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:09.800+0000 7f50a8273200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:13:10.010 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:10.008+0000 7f50a8273200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:13:10.118 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 systemd[1]: Started Ceph mgr.y for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:13:10.119 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:09.914+0000 7f95a5386200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:13:10.119 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:10.101+0000 7f95a5386200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:10.127 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:13:10.320 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:10.199+0000 7f50a8273200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:10.531 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:10.206+0000 7f95a5386200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:13:10.531 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:10.529+0000 7f95a5386200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:13:10.868 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:10.617+0000 7f95a5386200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:10.840+0000 7f50a8273200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:11.145 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:10 smithi139 ceph-mon[32999]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:11.223 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.223 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.223 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.224 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.224 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:11.224 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:10 smithi135 ceph-mon[32816]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:11.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:10 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:10 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:10 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:10 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:11.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:10 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:11.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:10 smithi082 ceph-mon[28105]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:11.570 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:11.279+0000 7f50a8273200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:13:11.571 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:11.374+0000 7f50a8273200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:13:12.071 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:11.584+0000 7f50a8273200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:13:12.220 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:11.879+0000 7f95a5386200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:13:12.220 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:12.048+0000 7f95a5386200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:12.220 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:12.219+0000 7f95a5386200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 -- 172.21.15.82:0/3440917951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350106900 msgr2=0x7fa350108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 --2- 172.21.15.82:0/3440917951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350106900 0x7fa350108cf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009990 tx=0x7fa33c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 -- 172.21.15.82:0/3440917951 shutdown_connections 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 --2- 172.21.15.82:0/3440917951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa350109230 0x7fa35010b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 --2- 172.21.15.82:0/3440917951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350103fd0 0x7fa3501063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 --2- 172.21.15.82:0/3440917951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350106900 0x7fa350108cf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 -- 172.21.15.82:0/3440917951 >> 172.21.15.82:0/3440917951 conn(0x7fa3500fd920 msgr2=0x7fa3500ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 -- 172.21.15.82:0/3440917951 shutdown_connections 2024-04-26T20:13:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.282+0000 7fa354c00700 1 -- 172.21.15.82:0/3440917951 wait complete. 2024-04-26T20:13:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.283+0000 7fa354c00700 1 Processor -- start 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.283+0000 7fa354c00700 1 -- start start 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa354c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa350103fd0 0x7fa350103930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa354c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 0x7fa350101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa354c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350109230 0x7fa3501024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa354c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa35010ef20 con 0x7fa350103fd0 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa354c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa35010eda0 con 0x7fa350109230 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa354c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa35010f0a0 con 0x7fa350106900 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 0x7fa350101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa350103fd0 0x7fa350103930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34e800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350109230 0x7fa3501024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 0x7fa350101f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34580/0 (socket says 172.21.15.82:34580) 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 -- 172.21.15.82:0/2267253639 learned_addr learned my addr 172.21.15.82:0/2267253639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:13:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 -- 172.21.15.82:0/2267253639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350109230 msgr2=0x7fa3501024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350109230 0x7fa3501024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 -- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa350103fd0 msgr2=0x7fa350103930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa350103fd0 0x7fa350103930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.284+0000 7fa34d400700 1 -- 172.21.15.82:0/2267253639 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa350102a00 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.285+0000 7fa34d400700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 0x7fa350101f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00b760 tx=0x7fa33c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.285+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c026070 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.285+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa350102c90 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.285+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa33c021410 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.285+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c017650 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.285+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3501a8050 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.286+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fa33c029070 con 0x7fa350106900 2024-04-26T20:13:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.286+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35006a110 con 0x7fa350106900 2024-04-26T20:13:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.287+0000 7fa346a00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa334039890 0x7fa33403bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.287+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa33c04d850 con 0x7fa350106900 2024-04-26T20:13:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.287+0000 7fa34de00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa334039890 0x7fa33403bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.288+0000 7fa34de00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa334039890 0x7fa33403bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa340009680 tx=0x7fa340009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.297+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa33c013070 con 0x7fa350106900 2024-04-26T20:13:12.449 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:12.114+0000 7f50a8273200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:13:12.449 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:12.205+0000 7f50a8273200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:13:12.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:12.534+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa350063860 con 0x7fa334039890 2024-04-26T20:13:12.788 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:12.448+0000 7f50a8273200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:12.579+0000 7f50a8273200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:12.673+0000 7f50a8273200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:12.787+0000 7f50a8273200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:12.789 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.790 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:12.790 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:12.790 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:12.503+0000 7f95a5386200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:12.595+0000 7f95a5386200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:12.799+0000 7f95a5386200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:12.801 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:12.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:12.802 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:13:12.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:13.118 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:12.993+0000 7f95a5386200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:13.512 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:13.110+0000 7f50a8273200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:13.706+0000 7f50a8273200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: Reconfiguring daemon mgr.x on smithi082 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:13:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: Reconfiguring daemon mgr.x on smithi082 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:13:13.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:13.868 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:13.612+0000 7f95a5386200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: Reconfiguring daemon mgr.x on smithi082 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:13:13.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:14.321 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:13:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z[34878]: 2024-04-26T20:13:13.921+0000 7f50a8273200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:13:14.336 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:14.035+0000 7f95a5386200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:13:14.336 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:14.132+0000 7f95a5386200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:13:14.336 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:14.336+0000 7f95a5386200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T20:13:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:14.531+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7fa33c009d10 con 0x7fa350106900 2024-04-26T20:13:14.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: Standby manager daemon z started 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:14.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: Standby manager daemon z started 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:14 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: Standby manager daemon z started 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.139:0/1272620081' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:14.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:14.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:14.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:14 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:15.213 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:14.878+0000 7f95a5386200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:13:15.213 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:14.969+0000 7f95a5386200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:13:15.531 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:15.213+0000 7f95a5386200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:13:15.531 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:15.343+0000 7f95a5386200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:13:15.531 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:15.439+0000 7f95a5386200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:13:15.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:15 smithi082 ceph-mon[28105]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:15.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:15 smithi082 ceph-mon[28105]: mgrmap e14: x(active, since 88s), standbys: z 2024-04-26T20:13:15.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:13:15.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:15 smithi139 ceph-mon[32999]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:15.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:15 smithi139 ceph-mon[32999]: mgrmap e14: x(active, since 88s), standbys: z 2024-04-26T20:13:15.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:15 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:13:15.858 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:15.554+0000 7f95a5386200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:15.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-mon[32816]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:15.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-mon[32816]: mgrmap e14: x(active, since 88s), standbys: z 2024-04-26T20:13:15.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T20:13:16.118 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:15.857+0000 7f95a5386200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:13:16.868 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:16 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:16.451+0000 7f95a5386200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:13:16.869 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:13:16 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y[34198]: 2024-04-26T20:13:16.664+0000 7f95a5386200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:13:17.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:17.559+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mon.1 v2:172.21.15.139:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fa33c029360 con 0x7fa350106900 2024-04-26T20:13:17.809 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: Standby manager daemon y started 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/603119539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]: dispatch 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]: dispatch 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]': finished 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T20:13:17.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: Standby manager daemon y started 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/603119539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]: dispatch 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]': finished 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T20:13:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: Standby manager daemon y started 2024-04-26T20:13:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T20:13:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='mgr.? 172.21.15.135:0/1376022793' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/603119539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]: dispatch 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]: dispatch 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80c3dc83-f48e-4004-88fb-6912e18b0f9d"}]': finished 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T20:13:17.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:18.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:18 smithi139 ceph-mon[32999]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-04-26T20:13:18.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:18 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:13:18.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:18 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1178754992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:13:18.846 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:18 smithi082 ceph-mon[28105]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-04-26T20:13:18.846 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:18 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:13:18.846 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:18 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1178754992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:13:18.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:18 smithi135 ceph-mon[32816]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-04-26T20:13:18.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:18 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T20:13:18.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:18 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1178754992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:13:19.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:19 smithi139 ceph-mon[32999]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:19.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:19 smithi135 ceph-mon[32816]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:19 smithi082 ceph-mon[28105]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:21 smithi139 ceph-mon[32999]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:21.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:21 smithi135 ceph-mon[32816]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:21.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:21 smithi082 ceph-mon[28105]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:23.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:23 smithi135 ceph-mon[32816]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:23 smithi082 ceph-mon[28105]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:23 smithi139 ceph-mon[32999]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:25.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:25 smithi135 ceph-mon[32816]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:25.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:25 smithi082 ceph-mon[28105]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:26.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:25 smithi139 ceph-mon[32999]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:26.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:13:26.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:26.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:13:26.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:13:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:27.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:27 smithi082 ceph-mon[28105]: Deploying daemon osd.0 on smithi082 2024-04-26T20:13:27.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:27 smithi082 ceph-mon[28105]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:27 smithi135 ceph-mon[32816]: Deploying daemon osd.0 on smithi082 2024-04-26T20:13:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:27 smithi135 ceph-mon[32816]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:27 smithi139 ceph-mon[32999]: Deploying daemon osd.0 on smithi082 2024-04-26T20:13:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:27 smithi139 ceph-mon[32999]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:29.860 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:29 smithi082 ceph-mon[28105]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:29.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:29 smithi135 ceph-mon[32816]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:29.873 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:29 smithi139 ceph-mon[32999]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:31.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:31 smithi082 ceph-mon[28105]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:31.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:31 smithi135 ceph-mon[32816]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:32.057 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:31 smithi139 ceph-mon[32999]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:33.856 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:33 smithi082 ceph-mon[28105]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:33.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:33 smithi135 ceph-mon[32816]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:34.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:33 smithi139 ceph-mon[32999]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:35.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:35 smithi135 ceph-mon[32816]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:35.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:35 smithi082 ceph-mon[28105]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:35.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:35.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:35.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:35 smithi139 ceph-mon[32999]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:37.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:37 smithi082 ceph-mon[28105]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:37.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:37 smithi135 ceph-mon[32816]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:37 smithi139 ceph-mon[32999]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:13:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:38 smithi082 ceph-mon[28105]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:13:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:38 smithi139 ceph-mon[32999]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:13:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:38 smithi135 ceph-mon[32816]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:13:39.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.729+0000 7fa346a00700 1 -- 172.21.15.82:0/2267253639 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa350063860 con 0x7fa334039890 2024-04-26T20:13:39.731 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-04-26T20:13:39.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa334039890 msgr2=0x7fa33403bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa334039890 0x7fa33403bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa340009680 tx=0x7fa340009260 comp rx=0 tx=0).stop 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 msgr2=0x7fa350101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 0x7fa350101f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00b760 tx=0x7fa33c0057c0 comp rx=0 tx=0).stop 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 shutdown_connections 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa334039890 0x7fa33403bd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa350109230 0x7fa3501024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa350103fd0 0x7fa350103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 --2- 172.21.15.82:0/2267253639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa350106900 0x7fa350101f80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 >> 172.21.15.82:0/2267253639 conn(0x7fa3500fd920 msgr2=0x7fa350104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 shutdown_connections 2024-04-26T20:13:39.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:13:39.733+0000 7fa354c00700 1 -- 172.21.15.82:0/2267253639 wait complete. 2024-04-26T20:13:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:13:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:13:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:13:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:13:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:40.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:13:40.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:13:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:13:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:13:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:40.579 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T20:13:40.584 INFO:tasks.cephadm:Deploying osd.1 on smithi135 with /dev/vg_nvme/lv_4... 2024-04-26T20:13:40.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:13:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:13:40.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:40 smithi135 ceph-mon[32816]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:13:40.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:40 smithi135 ceph-mon[32816]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:13:40.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:40.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:40.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:40 smithi135 ceph-mon[32816]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:41.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:40 smithi082 ceph-mon[28105]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:13:41.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:40 smithi082 ceph-mon[28105]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:13:41.110 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:41.110 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:41.110 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:40 smithi082 ceph-mon[28105]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:40 smithi139 ceph-mon[32999]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:13:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:40 smithi139 ceph-mon[32999]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:13:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:40 smithi139 ceph-mon[32999]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:13:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:41 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:13:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:41 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:13:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:41 smithi082 ceph-mon[28105]: osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] boot 2024-04-26T20:13:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:41 smithi082 ceph-mon[28105]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T20:13:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:42.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:41 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:13:42.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:41 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:13:42.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:42.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:41 smithi139 ceph-mon[32999]: osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] boot 2024-04-26T20:13:42.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:41 smithi139 ceph-mon[32999]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T20:13:42.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:41 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:13:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:41 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:13:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:41 smithi135 ceph-mon[32816]: osd.0 [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] boot 2024-04-26T20:13:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:41 smithi135 ceph-mon[32816]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T20:13:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:13:42.697 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:13:42.698 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:13:42.698 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-26T20:13:42.698 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-26T20:13:42.698 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113749 s, 922 MB/s 2024-04-26T20:13:42.698 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-26T20:13:42.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:42 smithi082 ceph-mon[28105]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:13:42.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:42 smithi082 ceph-mon[28105]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:43.016 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:42 smithi135 ceph-mon[32816]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:13:43.017 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:42 smithi135 ceph-mon[32816]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:43.293 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-04-26T20:13:43.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:42 smithi139 ceph-mon[32999]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:13:43.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:42 smithi139 ceph-mon[32999]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:43.527 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.927+0000 7fb92fcc5700 1 -- 172.21.15.135:0/3519425549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 msgr2=0x7fb928104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.927+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/3519425549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928104b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9180099c0 tx=0x7fb918009cd0 comp rx=0 tx=0).stop 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- 172.21.15.135:0/3519425549 shutdown_connections 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/3519425549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb928105070 0x7fb92810b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/3519425549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9281034d0 0x7fb9281038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/3519425549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928104b30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- 172.21.15.135:0/3519425549 >> 172.21.15.135:0/3519425549 conn(0x7fb9280fea70 msgr2=0x7fb928100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- 172.21.15.135:0/3519425549 shutdown_connections 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- 172.21.15.135:0/3519425549 wait complete. 2024-04-26T20:13:44.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 Processor -- start 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- start start 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9281034d0 0x7fb928199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb928105070 0x7fb9281a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb92810f010 con 0x7fb9281034d0 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb92810ee90 con 0x7fb9281046d0 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92fcc5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb92810f190 con 0x7fb928105070 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92d260700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.928+0000 7fb92d260700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58678/0 (socket says 172.21.15.135:58678) 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 -- 172.21.15.135:0/772975504 learned_addr learned my addr 172.21.15.135:0/772975504 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92e262700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb928105070 0x7fb9281a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 -- 172.21.15.135:0/772975504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb928105070 msgr2=0x7fb9281a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:44.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb928105070 0x7fb9281a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 -- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9281034d0 msgr2=0x7fb928199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9281034d0 0x7fb928199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 -- 172.21.15.135:0/772975504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9281a12e0 con 0x7fb9281046d0 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92d260700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928199bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb918005910 tx=0x7fb91800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918027070 con 0x7fb9281046d0 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb918022920 con 0x7fb9281046d0 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918009e60 con 0x7fb9281046d0 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9281a1570 con 0x7fb9281046d0 2024-04-26T20:13:44.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.929+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9281a1aa0 con 0x7fb9281046d0 2024-04-26T20:13:44.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.930+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92806a110 con 0x7fb9281046d0 2024-04-26T20:13:44.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.931+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fb91802a070 con 0x7fb9281046d0 2024-04-26T20:13:44.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.932+0000 7fb91effd700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9140a3c30 0x7fb9140a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:44.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.932+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fb9180cf770 con 0x7fb9281046d0 2024-04-26T20:13:44.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.932+0000 7fb92da61700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9140a3c30 0x7fb9140a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:44.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.933+0000 7fb92da61700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9140a3c30 0x7fb9140a60f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb928104530 tx=0x7fb924006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:44.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:44.936+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb918013070 con 0x7fb9281046d0 2024-04-26T20:13:45.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:13:45.142+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb928063860 con 0x7fb9140a3c30 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:45.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:13:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:13:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:13:45.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:45.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:45.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:45.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:13:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:46 smithi135 ceph-mon[32816]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:46 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi082 2024-04-26T20:13:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:46 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi082 to 17089M 2024-04-26T20:13:46.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:46 smithi139 ceph-mon[32999]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:46.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:46 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi082 2024-04-26T20:13:46.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:46 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi082 to 17089M 2024-04-26T20:13:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:46 smithi082 ceph-mon[28105]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:13:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:46 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi082 2024-04-26T20:13:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:46 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi082 to 17089M 2024-04-26T20:13:47.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:47 smithi139 ceph-mon[32999]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:47.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:47 smithi135 ceph-mon[32816]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:47 smithi082 ceph-mon[28105]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:48 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/1881044498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]: dispatch 2024-04-26T20:13:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:48 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]: dispatch 2024-04-26T20:13:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:48 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]': finished 2024-04-26T20:13:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:48 smithi139 ceph-mon[32999]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T20:13:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:48 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:13:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:48 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/259671573' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:13:48.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:48 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/1881044498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]: dispatch 2024-04-26T20:13:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:48 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]: dispatch 2024-04-26T20:13:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:48 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]': finished 2024-04-26T20:13:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:48 smithi135 ceph-mon[32816]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T20:13:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:48 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:13:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:48 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/259671573' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:13:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:48 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/1881044498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]: dispatch 2024-04-26T20:13:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:48 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]: dispatch 2024-04-26T20:13:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:48 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "385f5baf-d127-4e28-a50b-3bbfa29eb384"}]': finished 2024-04-26T20:13:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:48 smithi082 ceph-mon[28105]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T20:13:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:48 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:13:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:48 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/259671573' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:13:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:49 smithi139 ceph-mon[32999]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:49 smithi135 ceph-mon[32816]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:49 smithi082 ceph-mon[28105]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:51 smithi135 ceph-mon[32816]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:51.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:51 smithi139 ceph-mon[32999]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:51 smithi082 ceph-mon[28105]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:53.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:53 smithi135 ceph-mon[32816]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:53.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:53 smithi139 ceph-mon[32999]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:53 smithi082 ceph-mon[28105]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:55 smithi139 ceph-mon[32999]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:13:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:55 smithi139 ceph-mon[32999]: Deploying daemon osd.1 on smithi135 2024-04-26T20:13:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:55 smithi135 ceph-mon[32816]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:13:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:55 smithi135 ceph-mon[32816]: Deploying daemon osd.1 on smithi135 2024-04-26T20:13:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:55 smithi082 ceph-mon[28105]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:13:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:55 smithi082 ceph-mon[28105]: Deploying daemon osd.1 on smithi135 2024-04-26T20:13:57.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:57 smithi139 ceph-mon[32999]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:57.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:57 smithi135 ceph-mon[32816]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:57 smithi082 ceph-mon[28105]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:59.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:13:59 smithi139 ceph-mon[32999]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:13:59 smithi135 ceph-mon[32816]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:13:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:13:59 smithi082 ceph-mon[28105]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:00.891 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:00.891 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:00.891 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:00.891 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:00 smithi139 ceph-mon[32999]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:00 smithi135 ceph-mon[32816]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:00 smithi082 ceph-mon[28105]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:03.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.229+0000 7fb91effd700 1 -- 172.21.15.135:0/772975504 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb928063860 con 0x7fb9140a3c30 2024-04-26T20:14:03.229 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 1 on host 'smithi135' 2024-04-26T20:14:03.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9140a3c30 msgr2=0x7fb9140a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:03.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9140a3c30 0x7fb9140a60f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb928104530 tx=0x7fb924006d20 comp rx=0 tx=0).stop 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 msgr2=0x7fb928199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928199bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb918005910 tx=0x7fb91800fa00 comp rx=0 tx=0).stop 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 shutdown_connections 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb928105070 0x7fb9281a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9281034d0 0x7fb928199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9140a3c30 0x7fb9140a60f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 --2- 172.21.15.135:0/772975504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9281046d0 0x7fb928199bc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 >> 172.21.15.135:0/772975504 conn(0x7fb9280fea70 msgr2=0x7fb928107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 shutdown_connections 2024-04-26T20:14:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:14:03.231+0000 7fb92fcc5700 1 -- 172.21.15.135:0/772975504 wait complete. 2024-04-26T20:14:03.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:03.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:03.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:03.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:03.796 DEBUG:teuthology.orchestra.run.smithi135:osd.1> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T20:14:03.799 INFO:tasks.cephadm:Deploying osd.2 on smithi139 with /dev/vg_nvme/lv_4... 2024-04-26T20:14:03.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:14:03.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:03.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:04.044 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:14:04.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:04 smithi139 ceph-mon[32999]: from='osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:14:04.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:04 smithi139 ceph-mon[32999]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:14:04.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:04 smithi135 ceph-mon[32816]: from='osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:14:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:04 smithi135 ceph-mon[32816]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:14:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:04 smithi082 ceph-mon[28105]: from='osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:14:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:04 smithi082 ceph-mon[28105]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:14:05.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:05 smithi139 ceph-mon[32999]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:05.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:05 smithi139 ceph-mon[32999]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:14:05.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:05 smithi139 ceph-mon[32999]: from='osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:14:05.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:05 smithi139 ceph-mon[32999]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:14:05.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:05.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:05 smithi139 ceph-mon[32999]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:14:05.859 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:14:05.859 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:14:05.859 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-26T20:14:05.860 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-26T20:14:05.860 INFO:teuthology.orchestra.run.smithi139.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115011 s, 912 MB/s 2024-04-26T20:14:05.860 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-26T20:14:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-mon[32816]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-mon[32816]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:14:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-mon[32816]: from='osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:14:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-mon[32816]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:14:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-mon[32816]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:14:05.869 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1[37399]: 2024-04-26T20:14:05.541+0000 7fb6fcd50700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T20:14:05.869 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1[37399]: 2024-04-26T20:14:05.550+0000 7fb6f8b43700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:05 smithi082 ceph-mon[28105]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:05 smithi082 ceph-mon[28105]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:14:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:05 smithi082 ceph-mon[28105]: from='osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:14:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:05 smithi082 ceph-mon[28105]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:14:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:05 smithi082 ceph-mon[28105]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:14:06.463 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_4 2024-04-26T20:14:06.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:06 smithi135 ceph-mon[32816]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:14:06.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:06 smithi135 ceph-mon[32816]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:14:06.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:06.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:06.734 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:14:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:06 smithi139 ceph-mon[32999]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:14:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:06 smithi139 ceph-mon[32999]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:14:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:06 smithi082 ceph-mon[28105]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:14:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:06 smithi082 ceph-mon[28105]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:14:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:14:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:14:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] boot 2024-04-26T20:14:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:07.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:14:07.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] boot 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:07.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: osd.1 [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] boot 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:07.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:08.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 -- 172.21.15.139:0/2464686897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 msgr2=0x7f001c1038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:08.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 --2- 172.21.15.139:0/2464686897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1038b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f000c009990 tx=0x7f000c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:14:08.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 -- 172.21.15.139:0/2464686897 shutdown_connections 2024-04-26T20:14:08.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 --2- 172.21.15.139:0/2464686897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f001c105030 0x7f001c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:08.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 --2- 172.21.15.139:0/2464686897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1038b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 --2- 172.21.15.139:0/2464686897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f001c104690 0x7f001c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 -- 172.21.15.139:0/2464686897 >> 172.21.15.139:0/2464686897 conn(0x7f001c0fea30 msgr2=0x7f001c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 -- 172.21.15.139:0/2464686897 shutdown_connections 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 -- 172.21.15.139:0/2464686897 wait complete. 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.359+0000 7f00214a4700 1 Processor -- start 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 -- start start 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f001c104690 0x7f001c199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f001c105030 0x7f001c1a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f001c10f000 con 0x7f001c105030 2024-04-26T20:14:08.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f001c10ee80 con 0x7f001c104690 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00214a4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f001c10f180 con 0x7f001c103490 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53822/0 (socket says 172.21.15.139:53822) 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 -- 172.21.15.139:0/824482853 learned_addr learned my addr 172.21.15.139:0/824482853 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f00127fc700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f001c104690 0x7f001c199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 -- 172.21.15.139:0/824482853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f001c104690 msgr2=0x7f001c199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f001c104690 0x7f001c199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 -- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f001c105030 msgr2=0x7f001c1a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f001c105030 0x7f001c1a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:08.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.360+0000 7f001affd700 1 -- 172.21.15.139:0/824482853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c1a1300 con 0x7f001c103490 2024-04-26T20:14:08.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.361+0000 7f001affd700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1996a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f000c0047b0 tx=0x7f000c003940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:08.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.361+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c027070 con 0x7f001c103490 2024-04-26T20:14:08.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.361+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f000c022470 con 0x7f001c103490 2024-04-26T20:14:08.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.361+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c1a1590 con 0x7f001c103490 2024-04-26T20:14:08.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.361+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c00f6c0 con 0x7f001c103490 2024-04-26T20:14:08.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.361+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1a1ac0 con 0x7f001c103490 2024-04-26T20:14:08.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.362+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c06a110 con 0x7f001c103490 2024-04-26T20:14:08.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.363+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f000c02a070 con 0x7f001c103490 2024-04-26T20:14:08.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.363+0000 7f0018ff9700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00080a3c30 0x7f00080a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:08.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.364+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f000c0cfed0 con 0x7f001c103490 2024-04-26T20:14:08.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.364+0000 7f00127fc700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00080a3c30 0x7f00080a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:08.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.365+0000 7f00127fc700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00080a3c30 0x7f00080a60f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0004006fd0 tx=0x7f0004008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:08.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.369+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f000c013070 con 0x7f001c103490 2024-04-26T20:14:08.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:08.575+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f001c063860 con 0x7f00080a3c30 2024-04-26T20:14:08.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:08 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi135 2024-04-26T20:14:08.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:08 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi135 to 17088M 2024-04-26T20:14:08.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:08 smithi139 ceph-mon[32999]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:14:08.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:08 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi135 2024-04-26T20:14:08.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:08 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi135 to 17088M 2024-04-26T20:14:08.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:08 smithi135 ceph-mon[32816]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:14:08.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:08 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi135 2024-04-26T20:14:08.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:08 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi135 to 17088M 2024-04-26T20:14:08.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:08 smithi082 ceph-mon[28105]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:14:09.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:09 smithi139 ceph-mon[32999]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:09.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:09 smithi139 ceph-mon[32999]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:14:09.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:14:09.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:14:09.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:09.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:09 smithi135 ceph-mon[32816]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:09.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:09 smithi135 ceph-mon[32816]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:14:09.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:14:09.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:14:09.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:09 smithi082 ceph-mon[28105]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:09 smithi082 ceph-mon[28105]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:14:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:14:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:14:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:11.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:11 smithi135 ceph-mon[32816]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:11.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:11 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/3899456454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]: dispatch 2024-04-26T20:14:11.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:11 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]: dispatch 2024-04-26T20:14:11.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:11 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]': finished 2024-04-26T20:14:11.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:11 smithi135 ceph-mon[32816]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T20:14:11.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:11 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:11.880 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:11 smithi139 ceph-mon[32999]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:11.880 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:11 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/3899456454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]: dispatch 2024-04-26T20:14:11.880 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:11 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]: dispatch 2024-04-26T20:14:11.880 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:11 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]': finished 2024-04-26T20:14:11.880 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:11 smithi139 ceph-mon[32999]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T20:14:11.880 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:11 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:11 smithi082 ceph-mon[28105]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:11 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/3899456454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]: dispatch 2024-04-26T20:14:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:11 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]: dispatch 2024-04-26T20:14:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:11 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c32ad5-c88e-4a60-a35b-2920afb27c89"}]': finished 2024-04-26T20:14:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:11 smithi082 ceph-mon[28105]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T20:14:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:11 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:12.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:12 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/3087647370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:14:12.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:12 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/3087647370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:14:13.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:12 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/3087647370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:14:13.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:13 smithi135 ceph-mon[32816]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:13 smithi082 ceph-mon[28105]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:14.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:13 smithi139 ceph-mon[32999]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:15.642 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:15 smithi139 ceph-mon[32999]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:15.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:15 smithi135 ceph-mon[32816]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:15 smithi082 ceph-mon[28105]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:17.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:17 smithi139 ceph-mon[32999]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:17 smithi135 ceph-mon[32816]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:17.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:17 smithi082 ceph-mon[28105]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:18.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:18 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T20:14:18.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:18 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:18 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T20:14:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:18 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:18 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T20:14:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:18 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:19.775 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:19 smithi139 ceph-mon[32999]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:19.775 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:19 smithi139 ceph-mon[32999]: Deploying daemon osd.2 on smithi139 2024-04-26T20:14:19.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:19 smithi135 ceph-mon[32816]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:19.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:19 smithi135 ceph-mon[32816]: Deploying daemon osd.2 on smithi139 2024-04-26T20:14:19.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:19 smithi082 ceph-mon[28105]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:19.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:19 smithi082 ceph-mon[28105]: Deploying daemon osd.2 on smithi139 2024-04-26T20:14:21.768 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:21 smithi139 ceph-mon[32999]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:21 smithi135 ceph-mon[32816]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:21 smithi082 ceph-mon[28105]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:23.804 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:23 smithi139 ceph-mon[32999]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:23.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:23 smithi135 ceph-mon[32816]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:23 smithi082 ceph-mon[28105]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:25.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:25.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:25.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:25 smithi135 ceph-mon[32816]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:25.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:25 smithi082 ceph-mon[28105]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:25.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:25.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:25.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:25.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:25 smithi139 ceph-mon[32999]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:27.649 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:27 smithi139 ceph-mon[32999]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:27.649 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.649 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.649 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:27.649 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:27.650 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.709+0000 7f0018ff9700 1 -- 172.21.15.139:0/824482853 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f001c063860 con 0x7f00080a3c30 2024-04-26T20:14:27.711 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 2 on host 'smithi139' 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00080a3c30 msgr2=0x7f00080a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00080a3c30 0x7f00080a60f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0004006fd0 tx=0x7f0004008040 comp rx=0 tx=0).stop 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 msgr2=0x7f001c1996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1996a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f000c0047b0 tx=0x7f000c003940 comp rx=0 tx=0).stop 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 shutdown_connections 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f001c105030 0x7f001c1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f001c103490 0x7f001c1996a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00080a3c30 0x7f00080a60f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 --2- 172.21.15.139:0/824482853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f001c104690 0x7f001c199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:27.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 >> 172.21.15.139:0/824482853 conn(0x7f001c0fea30 msgr2=0x7f001c107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:27.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 shutdown_connections 2024-04-26T20:14:27.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:14:27.712+0000 7f00214a4700 1 -- 172.21.15.139:0/824482853 wait complete. 2024-04-26T20:14:27.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:27 smithi135 ceph-mon[32816]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:27 smithi082 ceph-mon[28105]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:28.394 DEBUG:teuthology.orchestra.run.smithi139:osd.2> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T20:14:28.397 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2024-04-26T20:14:28.397 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:14:28.831 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:14:28.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:28 smithi082 ceph-mon[28105]: from='osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:14:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:28 smithi082 ceph-mon[28105]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:14:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:28 smithi082 ceph-mon[28105]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:28.954 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:28 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:28.954 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:28 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:28.955 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:28 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:28.955 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:28 smithi135 ceph-mon[32816]: from='osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:14:28.955 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:28 smithi135 ceph-mon[32816]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:14:28.955 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:28 smithi135 ceph-mon[32816]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:28 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:28 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:28 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:28 smithi139 ceph-mon[32999]: from='osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:14:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:28 smithi139 ceph-mon[32999]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T20:14:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:28 smithi139 ceph-mon[32999]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:29 smithi139 ceph-mon[32999]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T20:14:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:29 smithi139 ceph-mon[32999]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T20:14:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:29 smithi139 ceph-mon[32999]: from='osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:14:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:29 smithi139 ceph-mon[32999]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:14:29.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:29 smithi082 ceph-mon[28105]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T20:14:29.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:29 smithi082 ceph-mon[28105]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T20:14:29.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:29.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:29 smithi082 ceph-mon[28105]: from='osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:14:29.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:29 smithi082 ceph-mon[28105]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:14:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:29 smithi135 ceph-mon[32816]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T20:14:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:29 smithi135 ceph-mon[32816]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T20:14:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:29 smithi135 ceph-mon[32816]: from='osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:14:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:29 smithi135 ceph-mon[32816]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:14:30.727 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2[38171]: 2024-04-26T20:14:30.459+0000 7fc0a1a9c700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T20:14:30.728 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2[38171]: 2024-04-26T20:14:30.468+0000 7fc099887700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:30 smithi082 ceph-mon[28105]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:14:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:30 smithi082 ceph-mon[28105]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T20:14:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:30 smithi082 ceph-mon[28105]: from='osd.2 ' entity='osd.2' 2024-04-26T20:14:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:30 smithi082 ceph-mon[28105]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:31.042 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-mon[32999]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:14:31.042 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-mon[32999]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T20:14:31.042 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:31.043 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:31.043 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-mon[32999]: from='osd.2 ' entity='osd.2' 2024-04-26T20:14:31.043 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:30 smithi139 ceph-mon[32999]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:30 smithi135 ceph-mon[32816]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:14:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:30 smithi135 ceph-mon[32816]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T20:14:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:30 smithi135 ceph-mon[32816]: from='osd.2 ' entity='osd.2' 2024-04-26T20:14:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:30 smithi135 ceph-mon[32816]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:14:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:14:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:14:31.460 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T20:14:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T20:14:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0338269 s, 310 MB/s 2024-04-26T20:14:31.461 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T20:14:31.982 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:14:31.982 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:14:31.982 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:31.982 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi139 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] boot 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi139 to 17088M 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:31.983 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:31.984 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:31.984 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:14:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:14:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi139 2024-04-26T20:14:32.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] boot 2024-04-26T20:14:32.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T20:14:32.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:32.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:14:32.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi139 to 17088M 2024-04-26T20:14:32.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:32.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:32.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi139 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: osd.2 [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] boot 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:14:32.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi139 to 17088M 2024-04-26T20:14:32.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:32.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:32.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:32.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-04-26T20:14:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:14:33.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:32 smithi139 ceph-mon[32999]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:33.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:32 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:14:33.104 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:32 smithi082 ceph-mon[28105]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:33.104 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:32 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:14:33.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:32 smithi135 ceph-mon[32816]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:33.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:32 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:14:33.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T20:14:33.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:33 smithi082 ceph-mon[28105]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T20:14:33.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:14:34.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T20:14:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:33 smithi139 ceph-mon[32999]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T20:14:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:14:34.089 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T20:14:34.089 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:33 smithi135 ceph-mon[32816]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T20:14:34.089 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:33 smithi082 sudo[47364]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:33 smithi082 sudo[47364]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:33 smithi082 sudo[47364]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47364]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47367]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47367]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.257 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47367]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.258 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47367]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.361 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41112]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41112]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41115]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41115]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.362 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41115]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.523 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47389]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:14:34.523 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47389]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47389]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47389]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47393]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:14:34.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47393]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47393]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.524 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 sudo[47393]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42225]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42225]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42225]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42225]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42228]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42228]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42228]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.571 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42219]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:14:34.571 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42219]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.572 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42219]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.572 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42219]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.572 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42222]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:14:34.572 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42222]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.572 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42222]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.572 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:14:34 smithi139 sudo[42222]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41118]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41118]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41118]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41121]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41121]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41121]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T20:14:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 sudo[41121]: pam_unix(sudo:session): session closed for user root 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3307929047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e410b660 msgr2=0x7fa3e4111f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3307929047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e410b660 0x7fa3e4111f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00b0a0 tx=0x7fa3dc00b3b0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3307929047 shutdown_connections 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3307929047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e410b660 0x7fa3e4111f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3307929047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e4109ac0 0x7fa3e4109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3307929047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 0x7fa3e410b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3307929047 >> 172.21.15.82:0/3307929047 conn(0x7fa3e4078a90 msgr2=0x7fa3e407aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.821+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3307929047 shutdown_connections 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:34.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:34.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:34 smithi082 ceph-mon[28105]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.822+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3307929047 wait complete. 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.823+0000 7fa3ebc00700 1 Processor -- start 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 -- start start 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 0x7fa3e419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 0x7fa3e41a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e410b660 0x7fa3e41a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4115590 con 0x7fa3e410acc0 2024-04-26T20:14:34.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4115410 con 0x7fa3e410b660 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3ebc00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4115710 con 0x7fa3e4109ac0 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3e9200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 0x7fa3e419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3e9200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 0x7fa3e419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37838/0 (socket says 172.21.15.82:37838) 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3e9200700 1 -- 172.21.15.82:0/3818805118 learned_addr learned my addr 172.21.15.82:0/3818805118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.824+0000 7fa3e9c00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e410b660 0x7fa3e41a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3dbe00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 0x7fa3e41a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e9200700 1 -- 172.21.15.82:0/3818805118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e410b660 msgr2=0x7fa3e41a7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e9200700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e410b660 0x7fa3e41a7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e9200700 1 -- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 msgr2=0x7fa3e41a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e9200700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 0x7fa3e41a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e9200700 1 -- 172.21.15.82:0/3818805118 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41a77a0 con 0x7fa3e4109ac0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3dbe00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 0x7fa3e41a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e9200700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 0x7fa3e419fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d9b0 tx=0x7fa3d400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4017030 con 0x7fa3e4109ac0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3d40044d0 con 0x7fa3e4109ac0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e41a7a90 con 0x7fa3e4109ac0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.825+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40039e0 con 0x7fa3e4109ac0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.826+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41a8020 con 0x7fa3e4109ac0 2024-04-26T20:14:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.827+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e406a110 con 0x7fa3e4109ac0 2024-04-26T20:14:34.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.829+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fa3d401a070 con 0x7fa3e4109ac0 2024-04-26T20:14:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.830+0000 7fa3e2000700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3c80a3c30 0x7fa3c80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.831+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7fa3d40ce880 con 0x7fa3e4109ac0 2024-04-26T20:14:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.831+0000 7fa3dbe00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3c80a3c30 0x7fa3c80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.831+0000 7fa3dbe00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3c80a3c30 0x7fa3c80a60f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009be0 tx=0x7fa3cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:34.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:34.835+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa3d40232f0 con 0x7fa3e4109ac0 2024-04-26T20:14:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:14:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T20:14:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:35.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:35.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:35.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:34 smithi139 ceph-mon[32999]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:35.074+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa3e4063860 con 0x7fa3c80a3c30 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T20:14:35.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:34 smithi135 ceph-mon[32816]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:35.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:14:35.241+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa3d40d0cf0 con 0x7fa3e4109ac0 2024-04-26T20:14:36.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:35 smithi082 ceph-mon[28105]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T20:14:36.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:35 smithi082 ceph-mon[28105]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:14:36.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:14:36.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:14:36.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:36.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:35 smithi082 ceph-mon[28105]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T20:14:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:35 smithi139 ceph-mon[32999]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T20:14:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:35 smithi139 ceph-mon[32999]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:14:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:14:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:14:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:35 smithi139 ceph-mon[32999]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T20:14:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:35 smithi135 ceph-mon[32816]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T20:14:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:35 smithi135 ceph-mon[32816]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:14:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:14:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:14:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:35 smithi135 ceph-mon[32816]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T20:14:37.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:36 smithi082 ceph-mon[28105]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:36 smithi139 ceph-mon[32999]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:37.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:36 smithi135 ceph-mon[32816]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:39 smithi082 ceph-mon[28105]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:39 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3136343301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]: dispatch 2024-04-26T20:14:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:39 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]: dispatch 2024-04-26T20:14:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:39 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]': finished 2024-04-26T20:14:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:39 smithi082 ceph-mon[28105]: osdmap e22: 4 total, 3 up, 4 in 2024-04-26T20:14:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:14:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:39 smithi139 ceph-mon[32999]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:39 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3136343301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]: dispatch 2024-04-26T20:14:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:39 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]: dispatch 2024-04-26T20:14:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:39 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]': finished 2024-04-26T20:14:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:39 smithi139 ceph-mon[32999]: osdmap e22: 4 total, 3 up, 4 in 2024-04-26T20:14:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:14:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:39 smithi135 ceph-mon[32816]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:39 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3136343301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]: dispatch 2024-04-26T20:14:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:39 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]: dispatch 2024-04-26T20:14:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:39 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8aac68fa-5146-49fd-9727-22515d9800c9"}]': finished 2024-04-26T20:14:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:39 smithi135 ceph-mon[32816]: osdmap e22: 4 total, 3 up, 4 in 2024-04-26T20:14:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:14:40.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:40 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4083839245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:14:40.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:40 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4083839245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:14:40.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:40 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4083839245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:14:41.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:41 smithi139 ceph-mon[32999]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:41.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:41 smithi135 ceph-mon[32816]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:41 smithi082 ceph-mon[28105]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:43.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:43 smithi139 ceph-mon[32999]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:43.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:43 smithi135 ceph-mon[32816]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:43 smithi082 ceph-mon[28105]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:45.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:45 smithi082 ceph-mon[28105]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:45 smithi139 ceph-mon[32999]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:45.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:45 smithi135 ceph-mon[32816]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:47.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:47 smithi139 ceph-mon[32999]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:47.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:47 smithi135 ceph-mon[32816]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:47 smithi082 ceph-mon[28105]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:48 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T20:14:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:48 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:48 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T20:14:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:48 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:48.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:48 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T20:14:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:48 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:49 smithi082 ceph-mon[28105]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:49 smithi082 ceph-mon[28105]: Deploying daemon osd.3 on smithi082 2024-04-26T20:14:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:49 smithi139 ceph-mon[32999]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:49 smithi139 ceph-mon[32999]: Deploying daemon osd.3 on smithi082 2024-04-26T20:14:49.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:49 smithi135 ceph-mon[32816]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:49 smithi135 ceph-mon[32816]: Deploying daemon osd.3 on smithi082 2024-04-26T20:14:51.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:51 smithi139 ceph-mon[32999]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:51.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:51 smithi135 ceph-mon[32816]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:51 smithi082 ceph-mon[28105]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:53.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:53 smithi082 ceph-mon[28105]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:53.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:53 smithi135 ceph-mon[32816]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:53 smithi139 ceph-mon[32999]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:55 smithi135 ceph-mon[32816]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:55.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:55 smithi082 ceph-mon[28105]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:55 smithi139 ceph-mon[32999]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:57.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:57 smithi135 ceph-mon[32816]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:57.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:57 smithi082 ceph-mon[28105]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:57.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:57.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:57.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:58.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:57 smithi139 ceph-mon[32999]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:14:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:59.839 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:14:59 smithi082 ceph-mon[28105]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:59.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:14:59 smithi135 ceph-mon[32816]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:14:59.872 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:14:59 smithi139 ceph-mon[32999]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:01.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:01 smithi135 ceph-mon[32816]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T20:15:01.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:01 smithi082 ceph-mon[28105]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T20:15:01.503 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.503 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.503 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:01.504 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:01.504 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:01.504 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:01.504 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:01 smithi139 ceph-mon[32999]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T20:15:01.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.771+0000 7fa3e2000700 1 -- 172.21.15.82:0/3818805118 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa3e4063860 con 0x7fa3c80a3c30 2024-04-26T20:15:01.772 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3c80a3c30 msgr2=0x7fa3c80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3c80a3c30 0x7fa3c80a60f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009be0 tx=0x7fa3cc009260 comp rx=0 tx=0).stop 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 msgr2=0x7fa3e419fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 0x7fa3e419fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d9b0 tx=0x7fa3d400dcc0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 shutdown_connections 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3c80a3c30 0x7fa3c80a60f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e410b660 0x7fa3e41a7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3e4109ac0 0x7fa3e419fb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 --2- 172.21.15.82:0/3818805118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3e410acc0 0x7fa3e41a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.774+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 >> 172.21.15.82:0/3818805118 conn(0x7fa3e4078a90 msgr2=0x7fa3e410dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.775+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 shutdown_connections 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:15:01.775+0000 7fa3ebc00700 1 -- 172.21.15.82:0/3818805118 wait complete. 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:02 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:02 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:02.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T20:15:02.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T20:15:02.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:15:02.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:02.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:02.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:02.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:02 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:02.640 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T20:15:02.645 INFO:tasks.cephadm:Deploying osd.4 on smithi135 with /dev/vg_nvme/lv_3... 2024-04-26T20:15:02.646 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:15:02.892 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:15:03.326 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:03 smithi135 ceph-mon[32816]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:15:03.326 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:03 smithi135 ceph-mon[32816]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T20:15:03.326 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:03.326 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:03 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:03.326 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:03 smithi135 ceph-mon[32816]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:03 smithi082 ceph-mon[28105]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:15:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:03 smithi082 ceph-mon[28105]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T20:15:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:03.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:03 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:03.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:03 smithi082 ceph-mon[28105]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:03.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:03 smithi139 ceph-mon[32999]: from='osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:15:03.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:03 smithi139 ceph-mon[32999]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T20:15:03.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:03.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:03 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:03.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:03 smithi139 ceph-mon[32999]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-26T20:15:04.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:15:04.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:15:04.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:04.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] boot 2024-04-26T20:15:04.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: osdmap e25: 4 total, 4 up, 4 in 2024-04-26T20:15:04.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:04.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:04 smithi082 ceph-mon[28105]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T20:15:04.362 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:15:04.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:15:04.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:04.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] boot 2024-04-26T20:15:04.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: osdmap e25: 4 total, 4 up, 4 in 2024-04-26T20:15:04.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:04.363 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:04 smithi135 ceph-mon[32816]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: osd.3 [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] boot 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: osdmap e25: 4 total, 4 up, 4 in 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T20:15:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:04 smithi139 ceph-mon[32999]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T20:15:04.970 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:15:04.971 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:15:04.971 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-26T20:15:04.971 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-26T20:15:04.971 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114167 s, 918 MB/s 2024-04-26T20:15:04.971 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-26T20:15:05.274 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:05 smithi135 ceph-mon[32816]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:05.274 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:05 smithi135 ceph-mon[32816]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T20:15:05.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:05 smithi082 ceph-mon[28105]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:05.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:05 smithi082 ceph-mon[28105]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T20:15:05.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-04-26T20:15:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:05 smithi139 ceph-mon[32999]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:05 smithi139 ceph-mon[32999]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T20:15:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:15:07.189 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:07 smithi135 ceph-mon[32816]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T20:15:07.189 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:07 smithi135 ceph-mon[32816]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:07.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:07 smithi082 ceph-mon[28105]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T20:15:07.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:07 smithi082 ceph-mon[28105]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:07.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.415+0000 7f6fd62e3700 1 -- 172.21.15.135:0/2692749072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 msgr2=0x7f6fd010a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:07.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.415+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/2692749072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd010a7c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800b0d0 tx=0x7f6fc800b3e0 comp rx=0 tx=0).stop 2024-04-26T20:15:07.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 -- 172.21.15.135:0/2692749072 shutdown_connections 2024-04-26T20:15:07.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/2692749072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd010a7c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:07.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/2692749072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 0x7f6fd0102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/2692749072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd0103570 0x7f6fd01039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 -- 172.21.15.135:0/2692749072 >> 172.21.15.135:0/2692749072 conn(0x7f6fd00fd910 msgr2=0x7f6fd00ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 -- 172.21.15.135:0/2692749072 shutdown_connections 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 -- 172.21.15.135:0/2692749072 wait complete. 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 Processor -- start 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.416+0000 7f6fd62e3700 1 -- start start 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 0x7f6fd0199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd0103570 0x7f6fd0199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd01a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd010de10 con 0x7f6fd0102370 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd010dc90 con 0x7f6fd0103f10 2024-04-26T20:15:07.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd010df90 con 0x7f6fd0103570 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd01a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd01a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40388/0 (socket says 172.21.15.135:40388) 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 -- 172.21.15.135:0/3495515148 learned_addr learned my addr 172.21.15.135:0/3495515148 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fcffff700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 0x7f6fd0199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fcf7fe700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd0103570 0x7f6fd0199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 -- 172.21.15.135:0/3495515148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd0103570 msgr2=0x7f6fd0199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd0103570 0x7f6fd0199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 -- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 msgr2=0x7f6fd0199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 0x7f6fd0199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 -- 172.21.15.135:0/3495515148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd01a11a0 con 0x7f6fd0103f10 2024-04-26T20:15:07.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fcffff700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 0x7f6fd0199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:15:07.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd4880700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd01a0b00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009040 tx=0x7f6fc8004e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:07.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc801f030 con 0x7f6fd0103f10 2024-04-26T20:15:07.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fc8007a80 con 0x7f6fd0103f10 2024-04-26T20:15:07.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80047d0 con 0x7f6fd0103f10 2024-04-26T20:15:07.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd01a1430 con 0x7f6fd0103f10 2024-04-26T20:15:07.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.417+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd01a1830 con 0x7f6fd0103f10 2024-04-26T20:15:07.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.419+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd006a110 con 0x7f6fd0103f10 2024-04-26T20:15:07.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.419+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6fc8003a00 con 0x7f6fd0103f10 2024-04-26T20:15:07.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.420+0000 7f6fcd7fa700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6fb80a3c40 0x7f6fb80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:07.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.420+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7f6fc80d0070 con 0x7f6fd0103f10 2024-04-26T20:15:07.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.421+0000 7f6fcffff700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6fb80a3c40 0x7f6fb80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:07.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.421+0000 7f6fcffff700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6fb80a3c40 0x7f6fb80a6100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fd01033d0 tx=0x7f6fc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:07.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.425+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6fc809dd00 con 0x7f6fd0103f10 2024-04-26T20:15:07.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:07 smithi139 ceph-mon[32999]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T20:15:07.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:07 smithi139 ceph-mon[32999]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:07.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:07.627+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6fd006c2c0 con 0x7f6fb80a3c40 2024-04-26T20:15:08.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:08 smithi135 ceph-mon[32816]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T20:15:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:08 smithi135 ceph-mon[32816]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:15:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:15:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:15:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:08 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:08.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:08 smithi082 ceph-mon[28105]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T20:15:08.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:08 smithi082 ceph-mon[28105]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:15:08.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:15:08.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:15:08.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:08 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:08 smithi139 ceph-mon[32999]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T20:15:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:08 smithi139 ceph-mon[32999]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:15:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:15:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:15:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:08 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:09.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:09.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:09.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:10.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:10 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi082 2024-04-26T20:15:10.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:10 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-26T20:15:10.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:10 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi082 2024-04-26T20:15:10.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:10 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-26T20:15:10.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:10 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi082 2024-04-26T20:15:10.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:10 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi082 to 8544M 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/1692515253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]: dispatch 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]: dispatch 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]': finished 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: osdmap e30: 5 total, 4 up, 5 in 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-26T20:15:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:11 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/3692471114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/1692515253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]: dispatch 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]: dispatch 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]': finished 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: osdmap e30: 5 total, 4 up, 5 in 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-26T20:15:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:11 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/3692471114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:15:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/1692515253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]: dispatch 2024-04-26T20:15:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]: dispatch 2024-04-26T20:15:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baa87007-045a-47a3-ada4-cb7a97da2a4b"}]': finished 2024-04-26T20:15:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: osdmap e30: 5 total, 4 up, 5 in 2024-04-26T20:15:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-26T20:15:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:11 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/3692471114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:15:13.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:13 smithi139 ceph-mon[32999]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-26T20:15:13.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:13 smithi135 ceph-mon[32816]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-26T20:15:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:13 smithi082 ceph-mon[28105]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-26T20:15:15.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:15 smithi139 ceph-mon[32999]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:15:15.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:15 smithi135 ceph-mon[32816]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:15:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:15 smithi082 ceph-mon[28105]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:15:17.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:17 smithi082 ceph-mon[28105]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-26T20:15:17.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T20:15:17.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:17.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:17 smithi139 ceph-mon[32999]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-26T20:15:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T20:15:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:17.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:17 smithi135 ceph-mon[32816]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-26T20:15:17.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T20:15:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:18.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:18 smithi135 ceph-mon[32816]: Deploying daemon osd.4 on smithi135 2024-04-26T20:15:18.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:18 smithi139 ceph-mon[32999]: Deploying daemon osd.4 on smithi135 2024-04-26T20:15:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:18 smithi082 ceph-mon[28105]: Deploying daemon osd.4 on smithi135 2024-04-26T20:15:19.782 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:19 smithi135 ceph-mon[32816]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:19.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:19 smithi139 ceph-mon[32999]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:19 smithi082 ceph-mon[28105]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:21 smithi139 ceph-mon[32999]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:21.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:21 smithi135 ceph-mon[32816]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:21 smithi082 ceph-mon[28105]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:23.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:23 smithi135 ceph-mon[32816]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:23.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:23.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:23.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:23.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:23 smithi139 ceph-mon[32999]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:23.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:23.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:23.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:23 smithi082 ceph-mon[28105]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:25.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:25 smithi135 ceph-mon[32816]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:25 smithi082 ceph-mon[28105]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:26.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:25 smithi139 ceph-mon[32999]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.757+0000 7f6fcd7fa700 1 -- 172.21.15.135:0/3495515148 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6fd006c2c0 con 0x7f6fb80a3c40 2024-04-26T20:15:26.759 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 4 on host 'smithi135' 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6fb80a3c40 msgr2=0x7f6fb80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6fb80a3c40 0x7f6fb80a6100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fd01033d0 tx=0x7f6fc0005f90 comp rx=0 tx=0).stop 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 msgr2=0x7f6fd01a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd01a0b00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009040 tx=0x7f6fc8004e00 comp rx=0 tx=0).stop 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 shutdown_connections 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6fb80a3c40 0x7f6fb80a6100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd0103f10 0x7f6fd01a0b00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd0102370 0x7f6fd0199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 --2- 172.21.15.135:0/3495515148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd0103570 0x7f6fd0199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 >> 172.21.15.135:0/3495515148 conn(0x7f6fd00fd910 msgr2=0x7f6fd006bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 shutdown_connections 2024-04-26T20:15:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:15:26.760+0000 7f6fd62e3700 1 -- 172.21.15.135:0/3495515148 wait complete. 2024-04-26T20:15:27.413 DEBUG:teuthology.orchestra.run.smithi135:osd.4> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T20:15:27.415 INFO:tasks.cephadm:Deploying osd.5 on smithi139 with /dev/vg_nvme/lv_3... 2024-04-26T20:15:27.416 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:15:27.661 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:15:27.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:27.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: from='osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:15:27.703 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:15:27.703 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.703 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.782 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:27.782 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.782 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.782 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: from='osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:15:27.782 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:15:27.783 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.783 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: from='osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:15:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T20:15:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:29.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-mon[32816]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T20:15:29.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-mon[32816]: from='osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:15:29.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-mon[32816]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T20:15:29.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:29.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-mon[32816]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:15:29.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-mon[32816]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:29.043 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:15:28.747+0000 7fbbb8539700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T20:15:29.043 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:15:28 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:15:28.754+0000 7fbbb432c700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:15:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:28 smithi139 ceph-mon[32999]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T20:15:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:28 smithi139 ceph-mon[32999]: from='osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:15:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:28 smithi139 ceph-mon[32999]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T20:15:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:28 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:28 smithi139 ceph-mon[32999]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:15:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:28 smithi139 ceph-mon[32999]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:28 smithi082 ceph-mon[28105]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T20:15:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:28 smithi082 ceph-mon[28105]: from='osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:15:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:28 smithi082 ceph-mon[28105]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T20:15:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:28 smithi082 ceph-mon[28105]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:15:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:28 smithi082 ceph-mon[28105]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:29.774 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:15:29.774 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:15:29.774 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-26T20:15:29.774 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-26T20:15:29.774 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0170065 s, 617 MB/s 2024-04-26T20:15:29.774 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-26T20:15:29.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:29 smithi135 ceph-mon[32816]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:15:29.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:29 smithi135 ceph-mon[32816]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T20:15:29.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:29.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:29 smithi139 ceph-mon[32999]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:15:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:29 smithi139 ceph-mon[32999]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T20:15:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:29 smithi082 ceph-mon[28105]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:15:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:29 smithi082 ceph-mon[28105]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T20:15:30.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.486 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_3 2024-04-26T20:15:30.743 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] boot 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: osdmap e33: 5 total, 5 up, 5 in 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi135 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:30.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.027 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:15:31.027 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] boot 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: osdmap e33: 5 total, 5 up, 5 in 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi135 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:31.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: osd.4 [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] boot 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: osdmap e33: 5 total, 5 up, 5 in 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi135 2024-04-26T20:15:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:31.931 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:31 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi135 to 8544M 2024-04-26T20:15:31.931 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:31 smithi139 ceph-mon[32999]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T20:15:31.932 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:31.932 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:31.932 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:31.932 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:32.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:31 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi135 to 8544M 2024-04-26T20:15:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:31 smithi135 ceph-mon[32816]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T20:15:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:31 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi135 to 8544M 2024-04-26T20:15:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:31 smithi082 ceph-mon[28105]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T20:15:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.463+0000 7f8d34397700 1 -- 172.21.15.139:0/52338707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c104670 msgr2=0x7f8d2c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.463+0000 7f8d34397700 1 --2- 172.21.15.139:0/52338707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c104670 0x7f8d2c104ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009990 tx=0x7f8d1c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- 172.21.15.139:0/52338707 shutdown_connections 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 --2- 172.21.15.139:0/52338707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c105010 0x7f8d2c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 --2- 172.21.15.139:0/52338707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d2c103470 0x7f8d2c103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 --2- 172.21.15.139:0/52338707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c104670 0x7f8d2c104ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- 172.21.15.139:0/52338707 >> 172.21.15.139:0/52338707 conn(0x7f8d2c0fea10 msgr2=0x7f8d2c100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- 172.21.15.139:0/52338707 shutdown_connections 2024-04-26T20:15:32.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- 172.21.15.139:0/52338707 wait complete. 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 Processor -- start 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- start start 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c103470 0x7f8d2c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d2c104670 0x7f8d2c199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 0x7f8d2c1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c10ef80 con 0x7f8d2c104670 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c10ee00 con 0x7f8d2c103470 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.464+0000 7f8d34397700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c10f100 con 0x7f8d2c105010 2024-04-26T20:15:32.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 0x7f8d2c1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 0x7f8d2c1a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36546/0 (socket says 172.21.15.139:36546) 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 -- 172.21.15.139:0/1166534233 learned_addr learned my addr 172.21.15.139:0/1166534233 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32133700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c103470 0x7f8d2c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 -- 172.21.15.139:0/1166534233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c103470 msgr2=0x7f8d2c1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c103470 0x7f8d2c1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 -- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d2c104670 msgr2=0x7f8d2c199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d2c104670 0x7f8d2c199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 -- 172.21.15.139:0/1166534233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c1a1220 con 0x7f8d2c105010 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32133700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c103470 0x7f8d2c1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d32934700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 0x7f8d2c1a0b80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d24007d40 tx=0x7f8d2400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24016020 con 0x7f8d2c105010 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2c1a1510 con 0x7f8d2c105010 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d2400ad60 con 0x7f8d2c105010 2024-04-26T20:15:32.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240116f0 con 0x7f8d2c105010 2024-04-26T20:15:32.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.465+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2c1a1a50 con 0x7f8d2c105010 2024-04-26T20:15:32.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.466+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2c06a110 con 0x7f8d2c105010 2024-04-26T20:15:32.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.467+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8d24019020 con 0x7f8d2c105010 2024-04-26T20:15:32.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.468+0000 7f8d237fe700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8d180a3c40 0x7f8d180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:32.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.468+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f8d240cf490 con 0x7f8d2c105010 2024-04-26T20:15:32.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.468+0000 7f8d32133700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8d180a3c40 0x7f8d180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:32.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.469+0000 7f8d32133700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8d180a3c40 0x7f8d180a6100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c1044d0 tx=0x7f8d28008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:32.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.473+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8d24020020 con 0x7f8d2c105010 2024-04-26T20:15:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:32.680+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8d2c063860 con 0x7f8d180a3c40 2024-04-26T20:15:33.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:32 smithi139 ceph-mon[32999]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:33.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:32 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:15:33.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:32 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:15:33.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:32 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:33.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:32 smithi135 ceph-mon[32816]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:33.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:32 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:15:33.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:32 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:15:33.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:32 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:33.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:32 smithi082 ceph-mon[28105]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:33.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:32 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:15:33.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:32 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:15:33.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:32 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:33.999 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:33 smithi139 ceph-mon[32999]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:15:34.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:33 smithi135 ceph-mon[32816]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:15:34.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:33 smithi082 ceph-mon[28105]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:15:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:34 smithi139 ceph-mon[32999]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:35.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:34 smithi135 ceph-mon[32816]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:35.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:34 smithi082 ceph-mon[28105]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:35 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/1584142109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]: dispatch 2024-04-26T20:15:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:35 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]: dispatch 2024-04-26T20:15:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:35 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]': finished 2024-04-26T20:15:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:35 smithi139 ceph-mon[32999]: osdmap e35: 6 total, 5 up, 6 in 2024-04-26T20:15:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:35 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/1584142109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]: dispatch 2024-04-26T20:15:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:35 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]: dispatch 2024-04-26T20:15:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:35 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]': finished 2024-04-26T20:15:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:35 smithi135 ceph-mon[32816]: osdmap e35: 6 total, 5 up, 6 in 2024-04-26T20:15:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:36.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/1584142109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]: dispatch 2024-04-26T20:15:36.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:35 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]: dispatch 2024-04-26T20:15:36.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:35 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77f7c06-0d03-476c-bdba-b28ef21c18af"}]': finished 2024-04-26T20:15:36.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:35 smithi082 ceph-mon[28105]: osdmap e35: 6 total, 5 up, 6 in 2024-04-26T20:15:36.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:37.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:36 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/2430698360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:15:37.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:36 smithi139 ceph-mon[32999]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:37.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:36 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/2430698360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:15:37.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:36 smithi082 ceph-mon[28105]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:37.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:36 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/2430698360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:15:37.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:36 smithi135 ceph-mon[32816]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:39.749 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:39 smithi139 ceph-mon[32999]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:39.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:39 smithi135 ceph-mon[32816]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:39 smithi082 ceph-mon[28105]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:41.693 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:41 smithi139 ceph-mon[32999]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:41.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:41 smithi135 ceph-mon[32816]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:41 smithi082 ceph-mon[28105]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:43.685 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:43 smithi139 ceph-mon[32999]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:43.685 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T20:15:43.685 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:43.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:43 smithi135 ceph-mon[32816]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:43.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T20:15:43.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:43 smithi082 ceph-mon[28105]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T20:15:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:44.798 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:44 smithi139 ceph-mon[32999]: Deploying daemon osd.5 on smithi139 2024-04-26T20:15:44.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:44 smithi135 ceph-mon[32816]: Deploying daemon osd.5 on smithi139 2024-04-26T20:15:44.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:44 smithi082 ceph-mon[28105]: Deploying daemon osd.5 on smithi139 2024-04-26T20:15:45.752 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:45 smithi139 ceph-mon[32999]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:45.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:45 smithi135 ceph-mon[32816]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:45 smithi082 ceph-mon[28105]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:47.611 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:47 smithi139 ceph-mon[32999]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:47.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:47 smithi135 ceph-mon[32816]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:47 smithi082 ceph-mon[28105]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:49 smithi135 ceph-mon[32816]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:49 smithi082 ceph-mon[28105]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:49.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:49.979 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:49 smithi139 ceph-mon[32999]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:49.979 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:49.979 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:49.979 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:51.801 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:51 smithi139 ceph-mon[32999]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:51.801 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:51.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:51 smithi135 ceph-mon[32816]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:51.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:51 smithi082 ceph-mon[28105]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.515 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 5 on host 'smithi139' 2024-04-26T20:15:52.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.513+0000 7f8d237fe700 1 -- 172.21.15.139:0/1166534233 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8d2c063860 con 0x7f8d180a3c40 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8d180a3c40 msgr2=0x7f8d180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8d180a3c40 0x7f8d180a6100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c1044d0 tx=0x7f8d28008040 comp rx=0 tx=0).stop 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 msgr2=0x7f8d2c1a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 0x7f8d2c1a0b80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d24007d40 tx=0x7f8d2400a340 comp rx=0 tx=0).stop 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 shutdown_connections 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d2c105010 0x7f8d2c1a0b80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8d180a3c40 0x7f8d180a6100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d2c103470 0x7f8d2c1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 --2- 172.21.15.139:0/1166534233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d2c104670 0x7f8d2c199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:52.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 >> 172.21.15.139:0/1166534233 conn(0x7f8d2c0fea10 msgr2=0x7f8d2c1079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:52.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 shutdown_connections 2024-04-26T20:15:52.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:15:52.516+0000 7f8d34397700 1 -- 172.21.15.139:0/1166534233 wait complete. 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:15:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:52.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:15:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:52.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T20:15:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:53.203 DEBUG:teuthology.orchestra.run.smithi139:osd.5> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T20:15:53.205 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2024-04-26T20:15:53.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:15:53.653 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:15:53.683 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:53 smithi139 ceph-mon[32999]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:53.683 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:53 smithi139 ceph-mon[32999]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T20:15:53.684 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:53 smithi139 ceph-mon[32999]: from='osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:15:53.684 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:53 smithi139 ceph-mon[32999]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T20:15:53.684 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:53.684 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:53 smithi139 ceph-mon[32999]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:15:53.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:53 smithi135 ceph-mon[32816]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:53 smithi135 ceph-mon[32816]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T20:15:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:53 smithi135 ceph-mon[32816]: from='osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:15:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:53 smithi135 ceph-mon[32816]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T20:15:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:53 smithi135 ceph-mon[32816]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:15:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:53 smithi082 ceph-mon[28105]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:53 smithi082 ceph-mon[28105]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T20:15:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:53 smithi082 ceph-mon[28105]: from='osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:15:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:53 smithi082 ceph-mon[28105]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T20:15:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:53 smithi082 ceph-mon[28105]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:15:54.781 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:15:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:15:54.484+0000 7fc14a0b1700 -1 osd.5 0 waiting for initial osdmap 2024-04-26T20:15:54.781 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:15:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:15:54.490+0000 7fc145ea4700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:55.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:55 smithi082 ceph-mon[28105]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:15:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:15:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:15:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T20:15:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:55.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:55 smithi139 ceph-mon[32999]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:55 smithi135 ceph-mon[32816]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-26T20:15:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] boot 2024-04-26T20:15:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: osdmap e38: 6 total, 6 up, 6 in 2024-04-26T20:15:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:15:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:15:56.821 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T20:15:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T20:15:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0325928 s, 322 MB/s 2024-04-26T20:15:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T20:15:56.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] boot 2024-04-26T20:15:56.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: osdmap e38: 6 total, 6 up, 6 in 2024-04-26T20:15:56.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:56.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:56.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:56.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:56.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:56.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: osd.5 [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] boot 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: osdmap e38: 6 total, 6 up, 6 in 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:15:57.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-04-26T20:15:57.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:57 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi139 2024-04-26T20:15:57.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:57 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi139 to 8544M 2024-04-26T20:15:57.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:57 smithi082 ceph-mon[28105]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:15:57.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:57 smithi082 ceph-mon[28105]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T20:15:57.793 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:57 smithi082 ceph-mon[28105]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T20:15:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:57 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi139 2024-04-26T20:15:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:57 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi139 to 8544M 2024-04-26T20:15:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:57 smithi139 ceph-mon[32999]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:15:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:57 smithi139 ceph-mon[32999]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T20:15:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:57 smithi139 ceph-mon[32999]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T20:15:57.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:57 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi139 2024-04-26T20:15:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:57 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi139 to 8544M 2024-04-26T20:15:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:57 smithi135 ceph-mon[32816]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:15:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:57 smithi135 ceph-mon[32816]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T20:15:57.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:57 smithi135 ceph-mon[32816]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T20:15:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:15:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:58 smithi139 ceph-mon[32999]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-26T20:15:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:58 smithi139 ceph-mon[32999]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T20:15:58.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:58 smithi135 ceph-mon[32816]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-26T20:15:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:58 smithi135 ceph-mon[32816]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T20:15:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:58 smithi082 ceph-mon[28105]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-26T20:15:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:58 smithi082 ceph-mon[28105]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T20:15:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:59 smithi139 ceph-mon[32999]: pgmap v156: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:15:59.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:15:59 smithi139 ceph-mon[32999]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T20:15:59.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:59 smithi135 ceph-mon[32816]: pgmap v156: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:15:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:15:59 smithi135 ceph-mon[32816]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T20:15:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:59 smithi082 ceph-mon[28105]: pgmap v156: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:15:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:15:59 smithi082 ceph-mon[28105]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T20:16:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 -- 172.21.15.82:0/3564860797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 msgr2=0x7fb4b4103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3564860797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b4103490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009f90 tx=0x7fb4ac00b330 comp rx=0 tx=0).stop 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 -- 172.21.15.82:0/3564860797 shutdown_connections 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3564860797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b4103490 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3564860797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 0x7fb4b4102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3564860797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4102650 0x7fb4b4102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 -- 172.21.15.82:0/3564860797 >> 172.21.15.82:0/3564860797 conn(0x7fb4b40fd910 msgr2=0x7fb4b40ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 -- 172.21.15.82:0/3564860797 shutdown_connections 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.508+0000 7fb4baa00700 1 -- 172.21.15.82:0/3564860797 wait complete. 2024-04-26T20:16:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.509+0000 7fb4baa00700 1 Processor -- start 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 -- start start 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 0x7fb4b419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4102650 0x7fb4b419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b41a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b4111120 con 0x7fb4b4101cf0 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b4110fa0 con 0x7fb4b4102650 2024-04-26T20:16:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4baa00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b41112a0 con 0x7fb4b4103010 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4b3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 0x7fb4b419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4b8a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b41a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4b3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 0x7fb4b419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46686/0 (socket says 172.21.15.82:46686) 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4b3e00700 1 -- 172.21.15.82:0/3262357152 learned_addr learned my addr 172.21.15.82:0/3262357152 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.510+0000 7fb4abe00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4102650 0x7fb4b419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b8a00700 1 -- 172.21.15.82:0/3262357152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4102650 msgr2=0x7fb4b419bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b8a00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4102650 0x7fb4b419bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b8a00700 1 -- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 msgr2=0x7fb4b419b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b8a00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 0x7fb4b419b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b8a00700 1 -- 172.21.15.82:0/3262357152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b41a33b0 con 0x7fb4b4103010 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b8a00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b41a2d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009550 tx=0x7fb4ac00cfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac021020 con 0x7fb4b4103010 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4ac0092e0 con 0x7fb4b4103010 2024-04-26T20:16:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0052a0 con 0x7fb4b4103010 2024-04-26T20:16:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.511+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b41a3640 con 0x7fb4b4103010 2024-04-26T20:16:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.512+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b41a3aa0 con 0x7fb4b4103010 2024-04-26T20:16:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.513+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b406a110 con 0x7fb4b4103010 2024-04-26T20:16:00.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.515+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb4ac024020 con 0x7fb4b4103010 2024-04-26T20:16:00.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.516+0000 7fb4b1600700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4980a3cc0 0x7fb4980a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:00.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.516+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7fb4ac00f020 con 0x7fb4b4103010 2024-04-26T20:16:00.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.516+0000 7fb4b3e00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4980a3cc0 0x7fb4980a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.517+0000 7fb4b3e00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4980a3cc0 0x7fb4980a6180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4005950 tx=0x7fb4a4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:00.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.518+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb4ac09e200 con 0x7fb4b4103010 2024-04-26T20:16:00.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:00.756+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb4b4063860 con 0x7fb4980a3cc0 2024-04-26T20:16:01.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:01 smithi139 ceph-mon[32999]: pgmap v159: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:16:01.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:16:01.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:16:01.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:01.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:01 smithi135 ceph-mon[32816]: pgmap v159: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:16:01.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:16:01.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:16:01.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:01.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:01 smithi082 ceph-mon[28105]: pgmap v159: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:16:01.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:16:01.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:16:01.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:02 smithi135 ceph-mon[32816]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:16:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:02 smithi082 ceph-mon[28105]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:16:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:02 smithi139 ceph-mon[32999]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:16:03.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:03 smithi082 ceph-mon[28105]: pgmap v160: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:16:03.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:03 smithi135 ceph-mon[32816]: pgmap v160: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:16:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:03 smithi139 ceph-mon[32999]: pgmap v160: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-04-26T20:16:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:04 smithi082 ceph-mon[28105]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-26T20:16:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:04 smithi082 ceph-mon[28105]: Cluster is now healthy 2024-04-26T20:16:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:04 smithi139 ceph-mon[32999]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-26T20:16:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:04 smithi139 ceph-mon[32999]: Cluster is now healthy 2024-04-26T20:16:05.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:04 smithi135 ceph-mon[32816]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-26T20:16:05.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:04 smithi135 ceph-mon[32816]: Cluster is now healthy 2024-04-26T20:16:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:05 smithi082 ceph-mon[28105]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-04-26T20:16:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:05 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1074708718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16b52ba7-1d31-42b1-8491-22423e769d87"}]: dispatch 2024-04-26T20:16:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:05 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1074708718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16b52ba7-1d31-42b1-8491-22423e769d87"}]': finished 2024-04-26T20:16:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:05 smithi082 ceph-mon[28105]: osdmap e43: 7 total, 6 up, 7 in 2024-04-26T20:16:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:05 smithi139 ceph-mon[32999]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-04-26T20:16:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:05 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1074708718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16b52ba7-1d31-42b1-8491-22423e769d87"}]: dispatch 2024-04-26T20:16:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:05 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1074708718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16b52ba7-1d31-42b1-8491-22423e769d87"}]': finished 2024-04-26T20:16:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:05 smithi139 ceph-mon[32999]: osdmap e43: 7 total, 6 up, 7 in 2024-04-26T20:16:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:06.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:05 smithi135 ceph-mon[32816]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-04-26T20:16:06.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:05 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1074708718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16b52ba7-1d31-42b1-8491-22423e769d87"}]: dispatch 2024-04-26T20:16:06.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:05 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1074708718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16b52ba7-1d31-42b1-8491-22423e769d87"}]': finished 2024-04-26T20:16:06.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:05 smithi135 ceph-mon[32816]: osdmap e43: 7 total, 6 up, 7 in 2024-04-26T20:16:06.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:06 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1803773714' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:16:07.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:06 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1803773714' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:16:07.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:06 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1803773714' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:16:07.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:07 smithi082 ceph-mon[28105]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:16:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:07 smithi139 ceph-mon[32999]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:16:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:07 smithi135 ceph-mon[32816]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:16:09.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:09 smithi082 ceph-mon[28105]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-26T20:16:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:09 smithi139 ceph-mon[32999]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-26T20:16:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:09 smithi135 ceph-mon[32816]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-26T20:16:11.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:11 smithi082 ceph-mon[28105]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:16:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:11 smithi139 ceph-mon[32999]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:16:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:11 smithi135 ceph-mon[32816]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:16:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:13 smithi082 ceph-mon[28105]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:16:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:13 smithi139 ceph-mon[32999]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:16:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:13 smithi135 ceph-mon[32816]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:16:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:15 smithi082 ceph-mon[28105]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T20:16:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:15 smithi139 ceph-mon[32999]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:15 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T20:16:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:15 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:15 smithi135 ceph-mon[32816]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:15 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T20:16:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:15 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:16.933 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:16 smithi082 ceph-mon[28105]: Deploying daemon osd.6 on smithi082 2024-04-26T20:16:17.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:16 smithi135 ceph-mon[32816]: Deploying daemon osd.6 on smithi082 2024-04-26T20:16:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:16 smithi139 ceph-mon[32999]: Deploying daemon osd.6 on smithi082 2024-04-26T20:16:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:17 smithi082 ceph-mon[28105]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:17 smithi139 ceph-mon[32999]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:18.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:17 smithi135 ceph-mon[32816]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:18 smithi082 ceph-mon[28105]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:18 smithi139 ceph-mon[32999]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:19.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:18 smithi135 ceph-mon[32816]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:21 smithi139 ceph-mon[32999]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:21.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:21 smithi135 ceph-mon[32816]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:21 smithi082 ceph-mon[28105]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:23.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:23 smithi082 ceph-mon[28105]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:23.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:23 smithi139 ceph-mon[32999]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:23.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:23 smithi135 ceph-mon[32816]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:25.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:24 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:25.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:24 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:25.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:24 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:25.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:24 smithi082 ceph-mon[28105]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:24 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:24 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:24 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:24 smithi139 ceph-mon[32999]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:24 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:24 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:24 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:25.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:24 smithi135 ceph-mon[32816]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:27.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:27 smithi082 ceph-mon[28105]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:27 smithi139 ceph-mon[32999]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:27.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:27 smithi135 ceph-mon[32816]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:29.161 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2024-04-26T20:16:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.159+0000 7fb4b1600700 1 -- 172.21.15.82:0/3262357152 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb4b4063860 con 0x7fb4980a3cc0 2024-04-26T20:16:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4980a3cc0 msgr2=0x7fb4980a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4980a3cc0 0x7fb4980a6180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4005950 tx=0x7fb4a4009310 comp rx=0 tx=0).stop 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 msgr2=0x7fb4b41a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b41a2d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009550 tx=0x7fb4ac00cfa0 comp rx=0 tx=0).stop 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 shutdown_connections 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4b4103010 0x7fb4b41a2d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4b4101cf0 0x7fb4b419b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4980a3cc0 0x7fb4980a6180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 --2- 172.21.15.82:0/3262357152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4102650 0x7fb4b419bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 >> 172.21.15.82:0/3262357152 conn(0x7fb4b40fd910 msgr2=0x7fb4b40ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 shutdown_connections 2024-04-26T20:16:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:16:29.162+0000 7fb4baa00700 1 -- 172.21.15.82:0/3262357152 wait complete. 2024-04-26T20:16:29.179 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:29.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:28 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:29.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:28 smithi082 ceph-mon[28105]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T20:16:29.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:28 smithi082 ceph-mon[28105]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:28 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:28 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:28 smithi139 ceph-mon[32999]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T20:16:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:28 smithi139 ceph-mon[32999]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:29.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:28 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:29.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:28 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:29.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:28 smithi135 ceph-mon[32816]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T20:16:29.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:28 smithi135 ceph-mon[32816]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:30.081 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.6.service 2024-04-26T20:16:30.087 INFO:tasks.cephadm:Deploying osd.7 on smithi135 with /dev/vg_nvme/lv_2... 2024-04-26T20:16:30.087 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:16:30.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T20:16:30.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:30.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T20:16:30.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T20:16:30.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:16:30.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:30.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:30.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:30.329 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.329 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.329 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.329 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:30.330 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:30.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:30 smithi135 ceph-mon[32816]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:30 smithi139 ceph-mon[32999]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:31.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:16:31.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:16:31.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: from='osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:16:31.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T20:16:31.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:31.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:31.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:30 smithi082 ceph-mon[28105]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-04-26T20:16:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:31 smithi135 ceph-mon[32816]: osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] boot 2024-04-26T20:16:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:31 smithi135 ceph-mon[32816]: osdmap e46: 7 total, 7 up, 7 in 2024-04-26T20:16:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:31 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:31 smithi082 ceph-mon[28105]: osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] boot 2024-04-26T20:16:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:31 smithi082 ceph-mon[28105]: osdmap e46: 7 total, 7 up, 7 in 2024-04-26T20:16:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:31 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:31 smithi139 ceph-mon[32999]: osd.6 [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] boot 2024-04-26T20:16:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:31 smithi139 ceph-mon[32999]: osdmap e46: 7 total, 7 up, 7 in 2024-04-26T20:16:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:31 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T20:16:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:16:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:16:32.337 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-26T20:16:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-26T20:16:32.337 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114195 s, 918 MB/s 2024-04-26T20:16:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-26T20:16:33.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:32 smithi135 ceph-mon[32816]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T20:16:33.035 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:32 smithi135 ceph-mon[32816]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:33.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-04-26T20:16:33.299 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:16:33.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:32 smithi139 ceph-mon[32999]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T20:16:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:32 smithi139 ceph-mon[32999]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:33.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:32 smithi082 ceph-mon[28105]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T20:16:33.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:32 smithi082 ceph-mon[28105]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:34.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 -- 172.21.15.135:0/389352702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c109170 msgr2=0x7fc58c10b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 --2- 172.21.15.135:0/389352702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c109170 0x7fc58c10b5e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc584009990 tx=0x7fc584009ca0 comp rx=0 tx=0).stop 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 -- 172.21.15.135:0/389352702 shutdown_connections 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 --2- 172.21.15.135:0/389352702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c109170 0x7fc58c10b5e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 --2- 172.21.15.135:0/389352702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c103f10 0x7fc58c106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 --2- 172.21.15.135:0/389352702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58c106840 0x7fc58c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 -- 172.21.15.135:0/389352702 >> 172.21.15.135:0/389352702 conn(0x7fc58c0fd920 msgr2=0x7fc58c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 -- 172.21.15.135:0/389352702 shutdown_connections 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.890+0000 7fc5946d7700 1 -- 172.21.15.135:0/389352702 wait complete. 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 Processor -- start 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 -- start start 2024-04-26T20:16:34.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 0x7fc58c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c106840 0x7fc58c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58c109170 0x7fc58c1a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c10efe0 con 0x7fc58c109170 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c10ee60 con 0x7fc58c103f10 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc5946d7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c10f160 con 0x7fc58c106840 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 0x7fc58c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 0x7fc58c199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52798/0 (socket says 172.21.15.135:52798) 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 -- 172.21.15.135:0/41548591 learned_addr learned my addr 172.21.15.135:0/41548591 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc591c72700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c106840 0x7fc58c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 -- 172.21.15.135:0/41548591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c106840 msgr2=0x7fc58c199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c106840 0x7fc58c199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:34.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 -- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58c109170 msgr2=0x7fc58c1a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58c109170 0x7fc58c1a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 -- 172.21.15.135:0/41548591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c1a1390 con 0x7fc58c103f10 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc591c72700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c106840 0x7fc58c199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.891+0000 7fc592473700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 0x7fc58c199730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc58800ba50 tx=0x7fc58800be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.892+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588019070 con 0x7fc58c103f10 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.892+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc588014440 con 0x7fc58c103f10 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.892+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58c1a1680 con 0x7fc58c103f10 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.892+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5880075d0 con 0x7fc58c103f10 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.892+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58c1a1bf0 con 0x7fc58c103f10 2024-04-26T20:16:34.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.893+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc58c06a110 con 0x7fc58c103f10 2024-04-26T20:16:34.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.894+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc58801c070 con 0x7fc58c103f10 2024-04-26T20:16:34.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.894+0000 7fc5837fe700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc5780a3c40 0x7fc5780a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:34.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.895+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7fc5880cf030 con 0x7fc58c103f10 2024-04-26T20:16:34.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.895+0000 7fc591c72700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc5780a3c40 0x7fc5780a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:34.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.896+0000 7fc591c72700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc5780a3c40 0x7fc5780a6100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc57c007900 tx=0x7fc57c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:34.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:34.898+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc58809c720 con 0x7fc58c103f10 2024-04-26T20:16:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:35.107+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc58c063860 con 0x7fc5780a3c40 2024-04-26T20:16:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:16:35.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:35.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:35.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:16:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:35.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:35.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:16:35.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:16:35.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:36.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:36 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi082 2024-04-26T20:16:36.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:36 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-26T20:16:36.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:36 smithi135 ceph-mon[32816]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:16:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:36 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi082 2024-04-26T20:16:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:36 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-26T20:16:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:36 smithi082 ceph-mon[28105]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:16:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:36 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi082 2024-04-26T20:16:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:36 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi082 to 5696M 2024-04-26T20:16:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:36 smithi139 ceph-mon[32999]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:16:37.839 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:37 smithi082 ceph-mon[28105]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:37.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:37 smithi135 ceph-mon[32816]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:38.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:37 smithi139 ceph-mon[32999]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/3166427095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]: dispatch 2024-04-26T20:16:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:38 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]: dispatch 2024-04-26T20:16:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:38 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]': finished 2024-04-26T20:16:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:38 smithi135 ceph-mon[32816]: osdmap e48: 8 total, 7 up, 8 in 2024-04-26T20:16:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:38 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/244646234' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:16:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/3166427095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]: dispatch 2024-04-26T20:16:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:38 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]: dispatch 2024-04-26T20:16:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:38 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]': finished 2024-04-26T20:16:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:38 smithi082 ceph-mon[28105]: osdmap e48: 8 total, 7 up, 8 in 2024-04-26T20:16:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:38 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/244646234' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:16:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/3166427095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]: dispatch 2024-04-26T20:16:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:38 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]: dispatch 2024-04-26T20:16:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:38 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9989e74-b2cd-47cd-9919-608a028380dd"}]': finished 2024-04-26T20:16:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:38 smithi139 ceph-mon[32999]: osdmap e48: 8 total, 7 up, 8 in 2024-04-26T20:16:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:38 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/244646234' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:16:39.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:39 smithi135 ceph-mon[32816]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:39 smithi082 ceph-mon[28105]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:39 smithi139 ceph-mon[32999]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:41.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:41 smithi135 ceph-mon[32816]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:41 smithi082 ceph-mon[28105]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:41 smithi139 ceph-mon[32999]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:43.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:43 smithi135 ceph-mon[32816]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:43 smithi082 ceph-mon[28105]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:44.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:43 smithi139 ceph-mon[32999]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:45.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:45 smithi135 ceph-mon[32816]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:45.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T20:16:45.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:45 smithi082 ceph-mon[28105]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T20:16:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:45 smithi139 ceph-mon[32999]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T20:16:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:46.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:46 smithi135 ceph-mon[32816]: Deploying daemon osd.7 on smithi135 2024-04-26T20:16:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:46 smithi082 ceph-mon[28105]: Deploying daemon osd.7 on smithi135 2024-04-26T20:16:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:46 smithi139 ceph-mon[32999]: Deploying daemon osd.7 on smithi135 2024-04-26T20:16:47.695 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:47 smithi135 ceph-mon[32816]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:47.908 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:47 smithi082 ceph-mon[28105]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:47 smithi139 ceph-mon[32999]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:49 smithi135 ceph-mon[32816]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:49 smithi082 ceph-mon[28105]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:49 smithi139 ceph-mon[32999]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:51.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:51 smithi135 ceph-mon[32816]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:51.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:51.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:51.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:51 smithi082 ceph-mon[28105]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:51 smithi139 ceph-mon[32999]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:53.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:53 smithi135 ceph-mon[32816]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:53 smithi082 ceph-mon[28105]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:53 smithi139 ceph-mon[32999]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.692+0000 7fc5837fe700 1 -- 172.21.15.135:0/41548591 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc58c063860 con 0x7fc5780a3c40 2024-04-26T20:16:55.694 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 7 on host 'smithi135' 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc5780a3c40 msgr2=0x7fc5780a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc5780a3c40 0x7fc5780a6100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc57c007900 tx=0x7fc57c008040 comp rx=0 tx=0).stop 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 msgr2=0x7fc58c199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 0x7fc58c199730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc58800ba50 tx=0x7fc58800be10 comp rx=0 tx=0).stop 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 shutdown_connections 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc58c109170 0x7fc58c1a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc5780a3c40 0x7fc5780a6100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c103f10 0x7fc58c199730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 --2- 172.21.15.135:0/41548591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc58c106840 0x7fc58c199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 >> 172.21.15.135:0/41548591 conn(0x7fc58c0fd920 msgr2=0x7fc58c1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:55.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 shutdown_connections 2024-04-26T20:16:55.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:16:55.695+0000 7fc5946d7700 1 -- 172.21.15.135:0/41548591 wait complete. 2024-04-26T20:16:55.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:16:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:55 smithi135 ceph-mon[32816]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:16:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:16:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:55 smithi082 ceph-mon[28105]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:16:56.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:55 smithi139 ceph-mon[32999]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T20:16:56.356 DEBUG:teuthology.orchestra.run.smithi135:osd.7> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.7.service 2024-04-26T20:16:56.358 INFO:tasks.cephadm:Deploying osd.8 on smithi139 with /dev/vg_nvme/lv_2... 2024-04-26T20:16:56.358 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:16:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:16:56.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:56.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:56 smithi135 ceph-mon[32816]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T20:16:56.903 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:56.904 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:56 smithi139 ceph-mon[32999]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:16:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T20:16:56.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:16:56.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T20:16:56.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:56.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:56 smithi082 ceph-mon[28105]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:16:57.740 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-mon[32816]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:57.740 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-mon[32816]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:16:57.740 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-mon[32816]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T20:16:57.740 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:57.740 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:57.740 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-mon[32816]: from='osd.7 ' entity='osd.7' 2024-04-26T20:16:57.740 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:16:57.441+0000 7f27c961e700 -1 osd.7 0 waiting for initial osdmap 2024-04-26T20:16:57.741 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:16:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:16:57.450+0000 7f27c1409700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:16:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:57 smithi139 ceph-mon[32999]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:57 smithi139 ceph-mon[32999]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:16:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:57 smithi139 ceph-mon[32999]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T20:16:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:57.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:57 smithi139 ceph-mon[32999]: from='osd.7 ' entity='osd.7' 2024-04-26T20:16:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:57 smithi082 ceph-mon[28105]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-04-26T20:16:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:57 smithi082 ceph-mon[28105]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:16:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:57 smithi082 ceph-mon[28105]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T20:16:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:57 smithi082 ceph-mon[28105]: from='osd.7 ' entity='osd.7' 2024-04-26T20:16:58.798 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:16:58.799 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:16:58.799 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-26T20:16:58.799 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-26T20:16:58.799 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113377 s, 925 MB/s 2024-04-26T20:16:58.799 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-26T20:16:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:58 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:16:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:58 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:16:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:58 smithi139 ceph-mon[32999]: osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] boot 2024-04-26T20:16:58.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:58 smithi139 ceph-mon[32999]: osdmap e51: 8 total, 8 up, 8 in 2024-04-26T20:16:58.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:58.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:58 smithi139 ceph-mon[32999]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:16:58.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:58 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:16:58.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:58 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:16:58.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:58 smithi135 ceph-mon[32816]: osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] boot 2024-04-26T20:16:58.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:58 smithi135 ceph-mon[32816]: osdmap e51: 8 total, 8 up, 8 in 2024-04-26T20:16:58.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:58.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:58 smithi135 ceph-mon[32816]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:16:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:58 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:16:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:58 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:16:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:58 smithi082 ceph-mon[28105]: osd.7 [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] boot 2024-04-26T20:16:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:58 smithi082 ceph-mon[28105]: osdmap e51: 8 total, 8 up, 8 in 2024-04-26T20:16:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T20:16:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:58 smithi082 ceph-mon[28105]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:16:59.520 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_2 2024-04-26T20:16:59.766 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:16:59.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi135 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi135 to 5696M 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:59.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:16:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi135 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:00.028 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi135 to 5696M 2024-04-26T20:17:00.029 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.029 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:00.029 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:00.029 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:16:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi135 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi135 to 5696M 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:16:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:00.934 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:00 smithi139 ceph-mon[32999]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T20:17:00.934 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:00 smithi139 ceph-mon[32999]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:00 smithi135 ceph-mon[32816]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T20:17:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:00 smithi135 ceph-mon[32816]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:00 smithi082 ceph-mon[28105]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T20:17:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:00 smithi082 ceph-mon[28105]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 -- 172.21.15.139:0/3635124527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 msgr2=0x7effc810ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 --2- 172.21.15.139:0/3635124527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc810ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effc000b0a0 tx=0x7effc000b3b0 comp rx=0 tx=0).stop 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 -- 172.21.15.139:0/3635124527 shutdown_connections 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 --2- 172.21.15.139:0/3635124527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc810ba40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 --2- 172.21.15.139:0/3635124527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effc8101770 0x7effc8101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 --2- 172.21.15.139:0/3635124527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc81047f0 0x7effc8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 -- 172.21.15.139:0/3635124527 >> 172.21.15.139:0/3635124527 conn(0x7effc80fd090 msgr2=0x7effc80ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 -- 172.21.15.139:0/3635124527 shutdown_connections 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 -- 172.21.15.139:0/3635124527 wait complete. 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 Processor -- start 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 -- start start 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.465+0000 7effcded5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effc8101770 0x7effc8104150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc81047f0 0x7effc81027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc8102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7effc810efd0 con 0x7effc8101770 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effc810ee50 con 0x7effc81047f0 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effc810f150 con 0x7effc8105190 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc8102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc8102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:50388/0 (socket says 172.21.15.139:50388) 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 -- 172.21.15.139:0/2793246228 learned_addr learned my addr 172.21.15.139:0/2793246228 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc6ffd700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc81047f0 0x7effc81027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 -- 172.21.15.139:0/2793246228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc81047f0 msgr2=0x7effc81027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc81047f0 0x7effc81027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 -- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effc8101770 msgr2=0x7effc8104150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effc8101770 0x7effc8104150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 -- 172.21.15.139:0/2793246228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc8103590 con 0x7effc8105190 2024-04-26T20:17:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc7fff700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc8102ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7effc000b070 tx=0x7effc0004e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0021030 con 0x7effc8105190 2024-04-26T20:17:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc0003a00 con 0x7effc8105190 2024-04-26T20:17:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc81a36e0 con 0x7effc8105190 2024-04-26T20:17:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0004600 con 0x7effc8105190 2024-04-26T20:17:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.466+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81a3bc0 con 0x7effc8105190 2024-04-26T20:17:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.468+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc806a110 con 0x7effc8105190 2024-04-26T20:17:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.468+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7effc0024070 con 0x7effc8105190 2024-04-26T20:17:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.469+0000 7effc4ff9700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7effb00a3cc0 0x7effb00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.469+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5397+0+0 (secure 0 0 0) 0x7effc00d0800 con 0x7effc8105190 2024-04-26T20:17:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.469+0000 7effc77fe700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7effb00a3cc0 0x7effb00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.470+0000 7effc77fe700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7effb00a3cc0 0x7effb00a6180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7effc806b910 tx=0x7effbc006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.474+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7effc009ddd0 con 0x7effc8105190 2024-04-26T20:17:01.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:01.683+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7effc8063860 con 0x7effb00a3cc0 2024-04-26T20:17:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:01 smithi139 ceph-mon[32999]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T20:17:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:17:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:17:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:01 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:02.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:01 smithi135 ceph-mon[32816]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T20:17:02.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:17:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:17:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:01 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:01 smithi082 ceph-mon[28105]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T20:17:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:17:02.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:17:02.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:01 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:03.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:02 smithi139 ceph-mon[32999]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:03.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:02 smithi139 ceph-mon[32999]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T20:17:03.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:02 smithi139 ceph-mon[32999]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:03.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:02 smithi135 ceph-mon[32816]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:03.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:02 smithi135 ceph-mon[32816]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T20:17:03.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:02 smithi135 ceph-mon[32816]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:02 smithi082 ceph-mon[28105]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:02 smithi082 ceph-mon[28105]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T20:17:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:02 smithi082 ceph-mon[28105]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:04 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/562667641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]: dispatch 2024-04-26T20:17:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:04 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]: dispatch 2024-04-26T20:17:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:04 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]': finished 2024-04-26T20:17:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:04 smithi135 ceph-mon[32816]: osdmap e56: 9 total, 8 up, 9 in 2024-04-26T20:17:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:04.919 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:04 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/562667641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]: dispatch 2024-04-26T20:17:04.920 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:04 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]: dispatch 2024-04-26T20:17:04.920 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:04 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]': finished 2024-04-26T20:17:04.920 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:04 smithi139 ceph-mon[32999]: osdmap e56: 9 total, 8 up, 9 in 2024-04-26T20:17:04.920 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:04 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/562667641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]: dispatch 2024-04-26T20:17:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:04 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]: dispatch 2024-04-26T20:17:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:04 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42d15fb2-bd22-4cd8-b05a-afea2784ddff"}]': finished 2024-04-26T20:17:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:04 smithi082 ceph-mon[28105]: osdmap e56: 9 total, 8 up, 9 in 2024-04-26T20:17:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:05 smithi135 ceph-mon[32816]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:05.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:05 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/116939914' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:17:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:05 smithi082 ceph-mon[28105]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:05 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/116939914' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:17:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:05 smithi139 ceph-mon[32999]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:05 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/116939914' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:17:07.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:07 smithi135 ceph-mon[32816]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:07 smithi082 ceph-mon[28105]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:07 smithi139 ceph-mon[32999]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:09.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:09 smithi135 ceph-mon[32816]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:09.873 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:09 smithi139 ceph-mon[32999]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:09 smithi082 ceph-mon[28105]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:11 smithi082 ceph-mon[28105]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:11 smithi139 ceph-mon[32999]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:11 smithi135 ceph-mon[32816]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:12.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T20:17:12.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:12 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:12.973 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T20:17:12.973 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:12 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T20:17:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:12 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:13 smithi082 ceph-mon[28105]: Deploying daemon osd.8 on smithi139 2024-04-26T20:17:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:13 smithi082 ceph-mon[28105]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:13 smithi139 ceph-mon[32999]: Deploying daemon osd.8 on smithi139 2024-04-26T20:17:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:13 smithi139 ceph-mon[32999]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:13 smithi135 ceph-mon[32816]: Deploying daemon osd.8 on smithi139 2024-04-26T20:17:14.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:13 smithi135 ceph-mon[32816]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:15 smithi082 ceph-mon[28105]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:16.020 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:15 smithi139 ceph-mon[32999]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:15 smithi135 ceph-mon[32816]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:17 smithi139 ceph-mon[32999]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:17.922 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:17 smithi135 ceph-mon[32816]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:17 smithi082 ceph-mon[28105]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:19.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:19 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:19.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:19 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:19.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:19 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:19.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:19 smithi135 ceph-mon[32816]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:19.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:19 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:19.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:19 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:19.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:19 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:19.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:19 smithi082 ceph-mon[28105]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:19.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:19 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:19.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:19 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:19.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:19 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:19.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:19 smithi139 ceph-mon[32999]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:21.763 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:21 smithi139 ceph-mon[32999]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:21.764 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.764 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.764 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:21.764 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:21.764 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:21 smithi135 ceph-mon[32816]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:21.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:21 smithi082 ceph-mon[28105]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.174 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 8 on host 'smithi139' 2024-04-26T20:17:22.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.173+0000 7effc4ff9700 1 -- 172.21.15.139:0/2793246228 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7effc8063860 con 0x7effb00a3cc0 2024-04-26T20:17:22.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.175+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7effb00a3cc0 msgr2=0x7effb00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.175+0000 7effcded5700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7effb00a3cc0 0x7effb00a6180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7effc806b910 tx=0x7effbc006d20 comp rx=0 tx=0).stop 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.175+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 msgr2=0x7effc8102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.175+0000 7effcded5700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc8102ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7effc000b070 tx=0x7effc0004e40 comp rx=0 tx=0).stop 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 shutdown_connections 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effc8105190 0x7effc8102ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effc8101770 0x7effc8104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7effb00a3cc0 0x7effb00a6180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 --2- 172.21.15.139:0/2793246228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc81047f0 0x7effc81027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 >> 172.21.15.139:0/2793246228 conn(0x7effc80fd090 msgr2=0x7effc8107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 shutdown_connections 2024-04-26T20:17:22.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:17:22.176+0000 7effcded5700 1 -- 172.21.15.139:0/2793246228 wait complete. 2024-04-26T20:17:22.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:22 smithi139 ceph-mon[32999]: from='osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:17:22.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:22 smithi139 ceph-mon[32999]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:17:22.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:22.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:22 smithi135 ceph-mon[32816]: from='osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:17:22.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:22 smithi135 ceph-mon[32816]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:17:22.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:22.933 DEBUG:teuthology.orchestra.run.smithi139:osd.8> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.8.service 2024-04-26T20:17:22.937 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2024-04-26T20:17:22.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T20:17:22.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:22 smithi082 ceph-mon[28105]: from='osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:17:22.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:22 smithi082 ceph-mon[28105]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T20:17:22.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:22.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:17:23.837 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:23 smithi082 ceph-mon[28105]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:23.837 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:23 smithi082 ceph-mon[28105]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T20:17:23.837 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:23 smithi082 ceph-mon[28105]: from='osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:17:23.837 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:23 smithi082 ceph-mon[28105]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T20:17:23.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:23.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:23 smithi082 ceph-mon[28105]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:17:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:23 smithi135 ceph-mon[32816]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:23 smithi135 ceph-mon[32816]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T20:17:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:23 smithi135 ceph-mon[32816]: from='osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:17:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:23 smithi135 ceph-mon[32816]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T20:17:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:23 smithi135 ceph-mon[32816]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:17:23.918 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-mon[32999]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:23.918 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-mon[32999]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T20:17:23.918 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-mon[32999]: from='osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:17:23.919 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-mon[32999]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T20:17:23.919 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:23.919 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-mon[32999]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:17:23.919 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:17:23.608+0000 7f54fad07700 -1 osd.8 0 waiting for initial osdmap 2024-04-26T20:17:23.920 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:17:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:17:23.617+0000 7f54f6afa700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:17:24.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:24 smithi082 ceph-mon[28105]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:17:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:24 smithi082 ceph-mon[28105]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T20:17:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:24 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:24 smithi082 ceph-mon[28105]: osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] boot 2024-04-26T20:17:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:24 smithi082 ceph-mon[28105]: osdmap e59: 9 total, 9 up, 9 in 2024-04-26T20:17:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:24 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:24.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:24 smithi139 ceph-mon[32999]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:17:24.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:24 smithi139 ceph-mon[32999]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T20:17:24.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:24 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:24.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:24 smithi139 ceph-mon[32999]: osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] boot 2024-04-26T20:17:24.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:24 smithi139 ceph-mon[32999]: osdmap e59: 9 total, 9 up, 9 in 2024-04-26T20:17:24.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:24 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:24.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:24 smithi135 ceph-mon[32816]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:17:24.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:24 smithi135 ceph-mon[32816]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T20:17:24.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:24 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:24.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:24 smithi135 ceph-mon[32816]: osd.8 [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] boot 2024-04-26T20:17:24.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:24 smithi135 ceph-mon[32816]: osdmap e59: 9 total, 9 up, 9 in 2024-04-26T20:17:24.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:24 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T20:17:25.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:25 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:17:25.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:25 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:17:25.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:25 smithi139 ceph-mon[32999]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:25.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:25 smithi139 ceph-mon[32999]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T20:17:25.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:25 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:17:25.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:25 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:17:25.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:25 smithi135 ceph-mon[32816]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:25.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:25 smithi135 ceph-mon[32816]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T20:17:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:25 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:17:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:25 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:17:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:25 smithi082 ceph-mon[28105]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-04-26T20:17:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:25 smithi082 ceph-mon[28105]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T20:17:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T20:17:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T20:17:26.382 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-26T20:17:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-26T20:17:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.035715 s, 294 MB/s 2024-04-26T20:17:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-26T20:17:27.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi139 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi139 to 5696M 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T20:17:27.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:26 smithi082 ceph-mon[28105]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:27.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-04-26T20:17:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi139 2024-04-26T20:17:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi139 to 5696M 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T20:17:27.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:26 smithi139 ceph-mon[32999]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi139 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi139 to 5696M 2024-04-26T20:17:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:27.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:27.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:27.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T20:17:27.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:26 smithi135 ceph-mon[32816]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:27.664 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:17:28.334 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:28 smithi082 ceph-mon[28105]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T20:17:28.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:28 smithi139 ceph-mon[32999]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T20:17:28.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:28 smithi135 ceph-mon[32816]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T20:17:29.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:29 smithi082 ceph-mon[28105]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T20:17:29.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:29 smithi082 ceph-mon[28105]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T20:17:29.472 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:29 smithi139 ceph-mon[32999]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T20:17:29.472 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:29 smithi139 ceph-mon[32999]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T20:17:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:29 smithi135 ceph-mon[32816]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T20:17:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:29 smithi135 ceph-mon[32816]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T20:17:30.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.094+0000 7f97bd000700 1 -- 172.21.15.82:0/1943065649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b8107160 msgr2=0x7f97b810da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.094+0000 7f97bd000700 1 --2- 172.21.15.82:0/1943065649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b8107160 0x7f97b810da10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97b000b0d0 tx=0x7f97b000b3e0 comp rx=0 tx=0).stop 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 -- 172.21.15.82:0/1943065649 shutdown_connections 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 --2- 172.21.15.82:0/1943065649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b8107160 0x7f97b810da10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 --2- 172.21.15.82:0/1943065649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f97b81055c0 0x7f97b81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 --2- 172.21.15.82:0/1943065649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81067c0 0x7f97b8106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 -- 172.21.15.82:0/1943065649 >> 172.21.15.82:0/1943065649 conn(0x7f97b8100b60 msgr2=0x7f97b8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 -- 172.21.15.82:0/1943065649 shutdown_connections 2024-04-26T20:17:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.095+0000 7f97bd000700 1 -- 172.21.15.82:0/1943065649 wait complete. 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 Processor -- start 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 -- start start 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 0x7f97b819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b81067c0 0x7f97b819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f97b8107160 0x7f97b81a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8111050 con 0x7f97b81055c0 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8110ed0 con 0x7f97b81067c0 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.096+0000 7f97bd000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f97b81111d0 con 0x7f97b8107160 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97b7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 0x7f97b819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:30.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97afe00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b81067c0 0x7f97b819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97b7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 0x7f97b819b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38708/0 (socket says 172.21.15.82:38708) 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97b7400700 1 -- 172.21.15.82:0/4159042560 learned_addr learned my addr 172.21.15.82:0/4159042560 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97b7e00700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f97b8107160 0x7f97b81a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97afe00700 1 -- 172.21.15.82:0/4159042560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f97b8107160 msgr2=0x7f97b81a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97afe00700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f97b8107160 0x7f97b81a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97afe00700 1 -- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 msgr2=0x7f97b819b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97afe00700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 0x7f97b819b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97afe00700 1 -- 172.21.15.82:0/4159042560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b81a3270 con 0x7f97b81067c0 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.097+0000 7f97b7400700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 0x7f97b819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:17:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.098+0000 7f97afe00700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b81067c0 0x7f97b819bb50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f97a000e9f0 tx=0x7f97a000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.098+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a000cb70 con 0x7f97b81067c0 2024-04-26T20:17:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.098+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a000ee90 con 0x7f97b81067c0 2024-04-26T20:17:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.098+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b81a3560 con 0x7f97b81067c0 2024-04-26T20:17:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.098+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0003d40 con 0x7f97b81067c0 2024-04-26T20:17:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.098+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b81a3aa0 con 0x7f97b81067c0 2024-04-26T20:17:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.099+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b806a110 con 0x7f97b81067c0 2024-04-26T20:17:30.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.101+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f97a0003ee0 con 0x7f97b81067c0 2024-04-26T20:17:30.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.103+0000 7f97b4c00700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f979c0a3c40 0x7f979c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:30.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.103+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7f97a00cfe20 con 0x7f97b81067c0 2024-04-26T20:17:30.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.103+0000 7f97b7400700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f979c0a3c40 0x7f979c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:30.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.104+0000 7f97b7400700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f979c0a3c40 0x7f979c0a6100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005950 tx=0x7f97a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.105+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f97a0054060 con 0x7f97b81067c0 2024-04-26T20:17:30.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:30.342+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f97b8063860 con 0x7f979c0a3c40 2024-04-26T20:17:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:17:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:17:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:30.742 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:17:30.743 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:17:30.743 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:30.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:17:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:17:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:31.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:31 smithi082 ceph-mon[28105]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:31.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:31 smithi082 ceph-mon[28105]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-04-26T20:17:31.669 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:31 smithi139 ceph-mon[32999]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:31.669 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:31 smithi139 ceph-mon[32999]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-04-26T20:17:31.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:31 smithi135 ceph-mon[32816]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:17:31.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:31 smithi135 ceph-mon[32816]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-04-26T20:17:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:33 smithi082 ceph-mon[28105]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-26T20:17:33.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:33 smithi135 ceph-mon[32816]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-26T20:17:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:33 smithi139 ceph-mon[32999]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-04-26T20:17:34.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:34 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3343273275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60f2ace-b710-46dc-b501-b76a51631621"}]: dispatch 2024-04-26T20:17:34.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:34 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3343273275' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f60f2ace-b710-46dc-b501-b76a51631621"}]': finished 2024-04-26T20:17:34.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:34 smithi135 ceph-mon[32816]: osdmap e64: 10 total, 9 up, 10 in 2024-04-26T20:17:34.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:34.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:34 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3343273275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60f2ace-b710-46dc-b501-b76a51631621"}]: dispatch 2024-04-26T20:17:34.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:34 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3343273275' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f60f2ace-b710-46dc-b501-b76a51631621"}]': finished 2024-04-26T20:17:34.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:34 smithi082 ceph-mon[28105]: osdmap e64: 10 total, 9 up, 10 in 2024-04-26T20:17:34.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:35.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:34 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3343273275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f60f2ace-b710-46dc-b501-b76a51631621"}]: dispatch 2024-04-26T20:17:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:34 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3343273275' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f60f2ace-b710-46dc-b501-b76a51631621"}]': finished 2024-04-26T20:17:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:34 smithi139 ceph-mon[32999]: osdmap e64: 10 total, 9 up, 10 in 2024-04-26T20:17:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:35.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:35 smithi135 ceph-mon[32816]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:17:35.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:35 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3848412546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:17:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:35 smithi082 ceph-mon[28105]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:17:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3848412546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:17:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:35 smithi139 ceph-mon[32999]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:17:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:35 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3848412546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:17:37.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:37 smithi135 ceph-mon[32816]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:37 smithi082 ceph-mon[28105]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:37 smithi139 ceph-mon[32999]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:39.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:39 smithi135 ceph-mon[32816]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:39 smithi082 ceph-mon[28105]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:39 smithi139 ceph-mon[32999]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:41.860 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:41 smithi082 ceph-mon[28105]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:41.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:41 smithi135 ceph-mon[32816]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:41 smithi139 ceph-mon[32999]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:43 smithi082 ceph-mon[28105]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:43.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:43 smithi135 ceph-mon[32816]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:43 smithi139 ceph-mon[32999]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:44.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:44 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T20:17:44.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:44 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:44.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:44 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T20:17:44.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:44 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:45.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:44 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T20:17:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:44 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:45.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:45 smithi135 ceph-mon[32816]: Deploying daemon osd.9 on smithi082 2024-04-26T20:17:45.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:45 smithi135 ceph-mon[32816]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:45 smithi082 ceph-mon[28105]: Deploying daemon osd.9 on smithi082 2024-04-26T20:17:45.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:45 smithi082 ceph-mon[28105]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:46.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:45 smithi139 ceph-mon[32999]: Deploying daemon osd.9 on smithi082 2024-04-26T20:17:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:45 smithi139 ceph-mon[32999]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:47 smithi082 ceph-mon[28105]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:47 smithi139 ceph-mon[32999]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:48.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:47 smithi135 ceph-mon[32816]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:49.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:49 smithi082 ceph-mon[28105]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:49 smithi139 ceph-mon[32999]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:50.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:49 smithi135 ceph-mon[32816]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:51 smithi082 ceph-mon[28105]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:51 smithi139 ceph-mon[32999]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:51 smithi135 ceph-mon[32816]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:53.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:53 smithi135 ceph-mon[32816]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:53.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:53 smithi082 ceph-mon[28105]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:53.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:53.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:53.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:54.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:53 smithi139 ceph-mon[32999]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:55.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:55 smithi135 ceph-mon[32816]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:55 smithi082 ceph-mon[28105]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:55 smithi139 ceph-mon[32999]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:57 smithi082 ceph-mon[28105]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:57 smithi082 ceph-mon[28105]: from='osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:17:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:57 smithi082 ceph-mon[28105]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:17:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:57 smithi139 ceph-mon[32999]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:57 smithi139 ceph-mon[32999]: from='osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:17:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:57 smithi139 ceph-mon[32999]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:17:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.089+0000 7f97b4c00700 1 -- 172.21.15.82:0/4159042560 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f97b8063860 con 0x7f979c0a3c40 2024-04-26T20:17:58.092 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2024-04-26T20:17:58.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.093+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f979c0a3c40 msgr2=0x7f979c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.093+0000 7f97bd000700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f979c0a3c40 0x7f979c0a6100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005950 tx=0x7f97a8009260 comp rx=0 tx=0).stop 2024-04-26T20:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.093+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b81067c0 msgr2=0x7f97b819bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.093+0000 7f97bd000700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b81067c0 0x7f97b819bb50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f97a000e9f0 tx=0x7f97a000ed00 comp rx=0 tx=0).stop 2024-04-26T20:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 shutdown_connections 2024-04-26T20:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f97b8107160 0x7f97b81a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97b81055c0 0x7f97b819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f979c0a3c40 0x7f979c0a6100 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 --2- 172.21.15.82:0/4159042560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b81067c0 0x7f97b819bb50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 >> 172.21.15.82:0/4159042560 conn(0x7f97b8100b60 msgr2=0x7f97b8109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 shutdown_connections 2024-04-26T20:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:17:58.094+0000 7f97bd000700 1 -- 172.21.15.82:0/4159042560 wait complete. 2024-04-26T20:17:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:57 smithi135 ceph-mon[32816]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:57 smithi135 ceph-mon[32816]: from='osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:17:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:57 smithi135 ceph-mon[32816]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T20:17:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T20:17:58.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:58.933 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.9.service 2024-04-26T20:17:58.942 INFO:tasks.cephadm:Deploying osd.10 on smithi135 with /dev/vg_nvme/lv_1... 2024-04-26T20:17:58.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T20:17:58.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T20:17:58.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T20:17:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:59.190 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:17:59.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:59 smithi082 ceph-mon[28105]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:59 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:59.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:17:59 smithi082 ceph-mon[28105]: from='osd.9 ' entity='osd.9' 2024-04-26T20:17:59.688 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:17:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:17:59.410+0000 7f0448400700 -1 osd.9 0 waiting for initial osdmap 2024-04-26T20:17:59.688 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:17:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:17:59.430+0000 7f043e200700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:17:59.972 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:59 smithi139 ceph-mon[32999]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:17:59.972 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:59 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:17:59.972 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:17:59 smithi139 ceph-mon[32999]: from='osd.9 ' entity='osd.9' 2024-04-26T20:18:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:59 smithi135 ceph-mon[32816]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:18:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:59 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:00.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:17:59 smithi135 ceph-mon[32816]: from='osd.9 ' entity='osd.9' 2024-04-26T20:18:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:00 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:18:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:00 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:18:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:00 smithi135 ceph-mon[32816]: osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] boot 2024-04-26T20:18:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:00 smithi135 ceph-mon[32816]: osdmap e67: 10 total, 10 up, 10 in 2024-04-26T20:18:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:00 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:18:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:00 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:18:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:00 smithi082 ceph-mon[28105]: osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] boot 2024-04-26T20:18:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:00 smithi082 ceph-mon[28105]: osdmap e67: 10 total, 10 up, 10 in 2024-04-26T20:18:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:01.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:00 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:18:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:00 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:18:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:00 smithi139 ceph-mon[32999]: osd.9 [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] boot 2024-04-26T20:18:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:00 smithi139 ceph-mon[32999]: osdmap e67: 10 total, 10 up, 10 in 2024-04-26T20:18:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T20:18:01.256 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T20:18:01.256 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T20:18:01.256 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-26T20:18:01.256 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-26T20:18:01.256 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113464 s, 924 MB/s 2024-04-26T20:18:01.256 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-26T20:18:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:01 smithi082 ceph-mon[28105]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:18:01.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:01 smithi135 ceph-mon[32816]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:18:01.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-04-26T20:18:02.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:01 smithi139 ceph-mon[32999]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-26T20:18:02.187 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:18:02.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:02 smithi082 ceph-mon[28105]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T20:18:03.012 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:02 smithi135 ceph-mon[32816]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T20:18:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:02 smithi139 ceph-mon[32999]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T20:18:03.739 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:03 smithi135 ceph-mon[32816]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:03.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:03 smithi082 ceph-mon[28105]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:03.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 -- 172.21.15.135:0/2140547041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc105020 msgr2=0x7f83cc10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:03.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 --2- 172.21.15.135:0/2140547041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc105020 0x7f83cc10b8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83c400b0d0 tx=0x7f83c400b3e0 comp rx=0 tx=0).stop 2024-04-26T20:18:03.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 -- 172.21.15.135:0/2140547041 shutdown_connections 2024-04-26T20:18:03.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 --2- 172.21.15.135:0/2140547041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc105020 0x7f83cc10b8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 --2- 172.21.15.135:0/2140547041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83cc103480 0x7f83cc1038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 --2- 172.21.15.135:0/2140547041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc104680 0x7f83cc104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.981+0000 7f83d135d700 1 -- 172.21.15.135:0/2140547041 >> 172.21.15.135:0/2140547041 conn(0x7f83cc0fea20 msgr2=0x7f83cc100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.982+0000 7f83d135d700 1 -- 172.21.15.135:0/2140547041 shutdown_connections 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.982+0000 7f83d135d700 1 -- 172.21.15.135:0/2140547041 wait complete. 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.982+0000 7f83d135d700 1 Processor -- start 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.982+0000 7f83d135d700 1 -- start start 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83cc103480 0x7f83cc1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 0x7f83cc199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc105020 0x7f83cc1a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10efa0 con 0x7f83cc103480 2024-04-26T20:18:03.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10ee20 con 0x7f83cc104680 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10f120 con 0x7f83cc105020 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 0x7f83cc199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 0x7f83cc199b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32892/0 (socket says 172.21.15.135:32892) 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 -- 172.21.15.135:0/2789995174 learned_addr learned my addr 172.21.15.135:0/2789995174 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83cb7fe700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc105020 0x7f83cc1a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 -- 172.21.15.135:0/2789995174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc105020 msgr2=0x7f83cc1a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc105020 0x7f83cc1a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 -- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83cc103480 msgr2=0x7f83cc1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83cc103480 0x7f83cc1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 -- 172.21.15.135:0/2789995174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc1a1240 con 0x7f83cc104680 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83cb7fe700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc105020 0x7f83cc1a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:18:03.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83ca7fc700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 0x7f83cc199b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83c000c920 tx=0x7f83c000cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:03.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0007b00 con 0x7f83cc104680 2024-04-26T20:18:03.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83c0004ce0 con 0x7f83cc104680 2024-04-26T20:18:03.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc1a1530 con 0x7f83cc104680 2024-04-26T20:18:03.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0005680 con 0x7f83cc104680 2024-04-26T20:18:03.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.983+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1a1af0 con 0x7f83cc104680 2024-04-26T20:18:03.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.984+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc06a110 con 0x7f83cc104680 2024-04-26T20:18:03.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.986+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f83c0004750 con 0x7f83cc104680 2024-04-26T20:18:03.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.987+0000 7f83b3fff700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f83b40a3c40 0x7f83b40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:03.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.987+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f83c00cfbf0 con 0x7f83cc104680 2024-04-26T20:18:03.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.987+0000 7f83caffd700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f83b40a3c40 0x7f83b40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:03.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.988+0000 7f83caffd700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f83b40a3c40 0x7f83b40a6100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83cc1044e0 tx=0x7f83bc006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:03.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:03.991+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f83c0014030 con 0x7f83cc104680 2024-04-26T20:18:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:03 smithi139 ceph-mon[32999]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:04.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:04.199+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f83cc063860 con 0x7f83b40a3c40 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:04.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:04.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:04 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:18:04.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:18:04.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:04.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:04.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:04 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:05.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:04 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:05.917 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:05.917 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi082 2024-04-26T20:18:05.917 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-26T20:18:05.917 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:05.917 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:05.918 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:05.918 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:05.918 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi082 2024-04-26T20:18:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-26T20:18:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi082 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi082 to 4272M 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/3609214947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]: dispatch 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]: dispatch 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]': finished 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: osdmap e69: 11 total, 10 up, 11 in 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:07 smithi082 ceph-mon[28105]: from='client.? 172.21.15.135:0/1147916974' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/3609214947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]: dispatch 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]: dispatch 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]': finished 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: osdmap e69: 11 total, 10 up, 11 in 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:07 smithi139 ceph-mon[32999]: from='client.? 172.21.15.135:0/1147916974' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/3609214947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]: dispatch 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]: dispatch 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1566c893-87e7-456b-8ef0-c9721c5e6a98"}]': finished 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: osdmap e69: 11 total, 10 up, 11 in 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:07 smithi135 ceph-mon[32816]: from='client.? 172.21.15.135:0/1147916974' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:18:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:09 smithi082 ceph-mon[28105]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:09 smithi139 ceph-mon[32999]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:09 smithi135 ceph-mon[32816]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:11 smithi082 ceph-mon[28105]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:12.009 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:11 smithi135 ceph-mon[32816]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:12.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:11 smithi139 ceph-mon[32999]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:13 smithi082 ceph-mon[28105]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:14.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:13 smithi139 ceph-mon[32999]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:14.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:13 smithi135 ceph-mon[32816]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:15.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:15 smithi135 ceph-mon[32816]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:15.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:15 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T20:18:15.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:15 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:15 smithi082 ceph-mon[28105]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T20:18:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:15 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:15 smithi139 ceph-mon[32999]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:15 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T20:18:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:15 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:16 smithi139 ceph-mon[32999]: Deploying daemon osd.10 on smithi135 2024-04-26T20:18:17.072 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:16 smithi135 ceph-mon[32816]: Deploying daemon osd.10 on smithi135 2024-04-26T20:18:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:16 smithi082 ceph-mon[28105]: Deploying daemon osd.10 on smithi135 2024-04-26T20:18:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:17 smithi082 ceph-mon[28105]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:17 smithi139 ceph-mon[32999]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:18.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:17 smithi135 ceph-mon[32816]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:18.805 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:18 smithi135 ceph-mon[32816]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:18 smithi139 ceph-mon[32999]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:18 smithi082 ceph-mon[28105]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:21 smithi135 ceph-mon[32816]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:21 smithi082 ceph-mon[28105]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:21 smithi139 ceph-mon[32999]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:23 smithi135 ceph-mon[32816]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:23 smithi082 ceph-mon[28105]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:23 smithi139 ceph-mon[32999]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:24.288 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 10 on host 'smithi135' 2024-04-26T20:18:24.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.287+0000 7f83b3fff700 1 -- 172.21.15.135:0/2789995174 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f83cc063860 con 0x7f83b40a3c40 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f83b40a3c40 msgr2=0x7f83b40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f83b40a3c40 0x7f83b40a6100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83cc1044e0 tx=0x7f83bc006d20 comp rx=0 tx=0).stop 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 msgr2=0x7f83cc199b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 0x7f83cc199b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83c000c920 tx=0x7f83c000cce0 comp rx=0 tx=0).stop 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 shutdown_connections 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83cc105020 0x7f83cc1a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83cc103480 0x7f83cc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f83b40a3c40 0x7f83b40a6100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 --2- 172.21.15.135:0/2789995174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83cc104680 0x7f83cc199b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.289+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 >> 172.21.15.135:0/2789995174 conn(0x7f83cc0fea20 msgr2=0x7f83cc107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.290+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 shutdown_connections 2024-04-26T20:18:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-26T20:18:24.290+0000 7f83d135d700 1 -- 172.21.15.135:0/2789995174 wait complete. 2024-04-26T20:18:25.000 DEBUG:teuthology.orchestra.run.smithi135:osd.10> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.10.service 2024-04-26T20:18:25.003 INFO:tasks.cephadm:Deploying osd.11 on smithi139 with /dev/vg_nvme/lv_1... 2024-04-26T20:18:25.004 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T20:18:25.259 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: from='osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:25 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: from='osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:18:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:18:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:25 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: from='osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:18:25.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T20:18:25.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:25.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:25.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:25 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:26 smithi139 ceph-mon[32999]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T20:18:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:26 smithi139 ceph-mon[32999]: from='osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:18:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:26 smithi139 ceph-mon[32999]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T20:18:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:26 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:26 smithi139 ceph-mon[32999]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:18:26.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-mon[32816]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T20:18:26.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-mon[32816]: from='osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:18:26.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-mon[32816]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T20:18:26.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:26.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-mon[32816]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:18:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:26 smithi082 ceph-mon[28105]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T20:18:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:26 smithi082 ceph-mon[28105]: from='osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:18:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:26 smithi082 ceph-mon[28105]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T20:18:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:26 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:26 smithi082 ceph-mon[28105]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-26T20:18:27.119 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:18:26.941+0000 7fd89576e700 -1 osd.10 0 waiting for initial osdmap 2024-04-26T20:18:27.119 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:18:26 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:18:26.954+0000 7fd88d559700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:18:27.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: from='osd.10 ' entity='osd.10' 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] boot 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: osdmap e72: 11 total, 11 up, 11 in 2024-04-26T20:18:27.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:27.339 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T20:18:27.339 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T20:18:27.339 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-26T20:18:27.340 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-26T20:18:27.340 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116874 s, 897 MB/s 2024-04-26T20:18:27.340 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: from='osd.10 ' entity='osd.10' 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] boot 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: osdmap e72: 11 total, 11 up, 11 in 2024-04-26T20:18:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:27.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: from='osd.10 ' entity='osd.10' 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: osd.10 [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] boot 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: osdmap e72: 11 total, 11 up, 11 in 2024-04-26T20:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T20:18:28.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_1 2024-04-26T20:18:28.299 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:28 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:18:28.299 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:28 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:18:28.300 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:28 smithi139 ceph-mon[32999]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T20:18:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:18:28.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:28 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:18:28.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:28 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:18:28.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:28 smithi135 ceph-mon[32816]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T20:18:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:28 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:18:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:28 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:18:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:28 smithi082 ceph-mon[28105]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T20:18:29.446 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: pgmap v264: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:29.446 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.446 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.446 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.446 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.446 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.447 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:29 smithi139 ceph-mon[32999]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: pgmap v264: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:29 smithi135 ceph-mon[32816]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: pgmap v264: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:29.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:29.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:29 smithi082 ceph-mon[28105]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 -- 172.21.15.139:0/1945580547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c105030 msgr2=0x7faf8c10b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 --2- 172.21.15.139:0/1945580547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c105030 0x7faf8c10b8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf8400b0a0 tx=0x7faf8400b3b0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 -- 172.21.15.139:0/1945580547 shutdown_connections 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 --2- 172.21.15.139:0/1945580547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c105030 0x7faf8c10b8e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 --2- 172.21.15.139:0/1945580547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf8c103490 0x7faf8c1038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 --2- 172.21.15.139:0/1945580547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c104690 0x7faf8c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 -- 172.21.15.139:0/1945580547 >> 172.21.15.139:0/1945580547 conn(0x7faf8c0fe9f0 msgr2=0x7faf8c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 -- 172.21.15.139:0/1945580547 shutdown_connections 2024-04-26T20:18:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.959+0000 7faf91006700 1 -- 172.21.15.139:0/1945580547 wait complete. 2024-04-26T20:18:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 Processor -- start 2024-04-26T20:18:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 -- start start 2024-04-26T20:18:29.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c103490 0x7faf8c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:29.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 0x7faf8c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:29.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf8c105030 0x7faf8c1a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:29.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c10f020 con 0x7faf8c105030 2024-04-26T20:18:29.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c10eea0 con 0x7faf8c103490 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf91006700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c10f1a0 con 0x7faf8c104690 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf8a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 0x7faf8c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf8a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 0x7faf8c199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36174/0 (socket says 172.21.15.139:36174) 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.960+0000 7faf8a59c700 1 -- 172.21.15.139:0/1729815311 learned_addr learned my addr 172.21.15.139:0/1729815311 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8ad9d700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c103490 0x7faf8c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8a59c700 1 -- 172.21.15.139:0/1729815311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c103490 msgr2=0x7faf8c1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8a59c700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c103490 0x7faf8c1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8a59c700 1 -- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf8c105030 msgr2=0x7faf8c1a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8a59c700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf8c105030 0x7faf8c1a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8a59c700 1 -- 172.21.15.139:0/1729815311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c1a1300 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8ad9d700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c103490 0x7faf8c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf8a59c700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 0x7faf8c199c30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf8000b560 tx=0x7faf8000b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80015020 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf80011ce0 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c1a15f0 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80010da0 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.961+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1a1b60 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.962+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c06a110 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.963+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7faf80018020 con 0x7faf8c104690 2024-04-26T20:18:29.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.964+0000 7faf73fff700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faf740a3c40 0x7faf740a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:29.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.964+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6723+0+0 (secure 0 0 0) 0x7faf800cfb60 con 0x7faf8c104690 2024-04-26T20:18:29.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.964+0000 7faf8ad9d700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faf740a3c40 0x7faf740a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:29.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.965+0000 7faf8ad9d700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faf740a3c40 0x7faf740a6100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf8c1044f0 tx=0x7faf7c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:29.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:29.967+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7faf8001f020 con 0x7faf8c104690 2024-04-26T20:18:30.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:30.178+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faf8c063860 con 0x7faf740a3c40 2024-04-26T20:18:30.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:30 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi135 2024-04-26T20:18:30.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:30 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi135 to 4272M 2024-04-26T20:18:30.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:18:30.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:18:30.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:30 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi135 2024-04-26T20:18:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:30 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi135 to 4272M 2024-04-26T20:18:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:18:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:18:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:30 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi135 2024-04-26T20:18:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:30 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi135 to 4272M 2024-04-26T20:18:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:18:30.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:18:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:31.515 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:31 smithi139 ceph-mon[32999]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:31.515 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:31 smithi139 ceph-mon[32999]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T20:18:31.516 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:31 smithi139 ceph-mon[32999]: pgmap v267: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:31.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:31 smithi135 ceph-mon[32816]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:31.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:31 smithi135 ceph-mon[32816]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T20:18:31.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:31 smithi135 ceph-mon[32816]: pgmap v267: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:31.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:31 smithi082 ceph-mon[28105]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:18:31.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:31 smithi082 ceph-mon[28105]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T20:18:31.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:31 smithi082 ceph-mon[28105]: pgmap v267: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:32.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:32 smithi139 ceph-mon[32999]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T20:18:32.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:32 smithi135 ceph-mon[32816]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T20:18:32.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:32 smithi082 ceph-mon[28105]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T20:18:33.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:33 smithi135 ceph-mon[32816]: pgmap v269: 1 pgs: 1 remapped+peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:33 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/554672205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]: dispatch 2024-04-26T20:18:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:33 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]: dispatch 2024-04-26T20:18:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:33 smithi135 ceph-mon[32816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]': finished 2024-04-26T20:18:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:33 smithi135 ceph-mon[32816]: osdmap e77: 12 total, 11 up, 12 in 2024-04-26T20:18:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:33.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:33 smithi082 ceph-mon[28105]: pgmap v269: 1 pgs: 1 remapped+peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:33.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:33 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/554672205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]: dispatch 2024-04-26T20:18:33.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:33 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]: dispatch 2024-04-26T20:18:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:33 smithi082 ceph-mon[28105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]': finished 2024-04-26T20:18:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:33 smithi082 ceph-mon[28105]: osdmap e77: 12 total, 11 up, 12 in 2024-04-26T20:18:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:33 smithi139 ceph-mon[32999]: pgmap v269: 1 pgs: 1 remapped+peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:33 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/554672205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]: dispatch 2024-04-26T20:18:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:33 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]: dispatch 2024-04-26T20:18:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:33 smithi139 ceph-mon[32999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df535157-a9a7-4de6-abb4-efe248039226"}]': finished 2024-04-26T20:18:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:33 smithi139 ceph-mon[32999]: osdmap e77: 12 total, 11 up, 12 in 2024-04-26T20:18:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:34.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:34 smithi135 ceph-mon[32816]: from='client.? 172.21.15.139:0/3267253138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:18:34.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:34 smithi082 ceph-mon[28105]: from='client.? 172.21.15.139:0/3267253138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:18:34.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:34 smithi139 ceph-mon[32999]: from='client.? 172.21.15.139:0/3267253138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:18:35.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:35 smithi135 ceph-mon[32816]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-26T20:18:35.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:35 smithi082 ceph-mon[28105]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-26T20:18:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:35 smithi139 ceph-mon[32999]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-26T20:18:37.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:37 smithi139 ceph-mon[32999]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-26T20:18:37.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:37 smithi135 ceph-mon[32816]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-26T20:18:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:37 smithi082 ceph-mon[28105]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-26T20:18:39.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:39 smithi139 ceph-mon[32999]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:18:39.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:39 smithi135 ceph-mon[32816]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:18:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:39 smithi082 ceph-mon[28105]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T20:18:41.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:41 smithi135 ceph-mon[32816]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-26T20:18:41.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T20:18:41.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:41.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:41 smithi135 ceph-mon[32816]: Deploying daemon osd.11 on smithi139 2024-04-26T20:18:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:41 smithi082 ceph-mon[28105]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-26T20:18:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T20:18:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:41 smithi082 ceph-mon[28105]: Deploying daemon osd.11 on smithi139 2024-04-26T20:18:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:41 smithi139 ceph-mon[32999]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-26T20:18:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T20:18:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:41 smithi139 ceph-mon[32999]: Deploying daemon osd.11 on smithi139 2024-04-26T20:18:43.699 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:43 smithi139 ceph-mon[32999]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:18:43.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:43 smithi135 ceph-mon[32816]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:18:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:43 smithi082 ceph-mon[28105]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T20:18:45.792 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:45 smithi139 ceph-mon[32999]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:45.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:45 smithi135 ceph-mon[32816]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:45 smithi082 ceph-mon[28105]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:47.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:47.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:47.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:47.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:47 smithi139 ceph-mon[32999]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:47.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:47.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:47.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:47.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:47 smithi135 ceph-mon[32816]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:47 smithi082 ceph-mon[28105]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:49.732 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:49 smithi139 ceph-mon[32999]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:49.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:49 smithi135 ceph-mon[32816]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:49 smithi082 ceph-mon[28105]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:50.466 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 11 on host 'smithi139' 2024-04-26T20:18:50.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.465+0000 7faf73fff700 1 -- 172.21.15.139:0/1729815311 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faf8c063860 con 0x7faf740a3c40 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faf740a3c40 msgr2=0x7faf740a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faf740a3c40 0x7faf740a6100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf8c1044f0 tx=0x7faf7c008040 comp rx=0 tx=0).stop 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 msgr2=0x7faf8c199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 0x7faf8c199c30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf8000b560 tx=0x7faf8000b920 comp rx=0 tx=0).stop 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 shutdown_connections 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf8c105030 0x7faf8c1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faf740a3c40 0x7faf740a6100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf8c103490 0x7faf8c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 --2- 172.21.15.139:0/1729815311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c104690 0x7faf8c199c30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:50.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 >> 172.21.15.139:0/1729815311 conn(0x7faf8c0fe9f0 msgr2=0x7faf8c107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:50.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 shutdown_connections 2024-04-26T20:18:50.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:18:50.468+0000 7faf91006700 1 -- 172.21.15.139:0/1729815311 wait complete. 2024-04-26T20:18:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:18:50.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:18:50.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:50.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:51.197 DEBUG:teuthology.orchestra.run.smithi139:osd.11> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.11.service 2024-04-26T20:18:51.199 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-26T20:18:51.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T20:18:51.641 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:51 smithi082 ceph-mon[28105]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:51 smithi082 ceph-mon[28105]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T20:18:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:51 smithi082 ceph-mon[28105]: from='osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:18:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:51 smithi082 ceph-mon[28105]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T20:18:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:51 smithi082 ceph-mon[28105]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:18:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:51 smithi139 ceph-mon[32999]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:51 smithi139 ceph-mon[32999]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T20:18:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:51 smithi139 ceph-mon[32999]: from='osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:18:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:51 smithi139 ceph-mon[32999]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T20:18:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:51 smithi139 ceph-mon[32999]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:18:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:51 smithi135 ceph-mon[32816]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:51 smithi135 ceph-mon[32816]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T20:18:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:51 smithi135 ceph-mon[32816]: from='osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:18:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:51 smithi135 ceph-mon[32816]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T20:18:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:51 smithi135 ceph-mon[32816]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-26T20:18:52.720 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:18:52.414+0000 7fd8350b9700 -1 osd.11 0 waiting for initial osdmap 2024-04-26T20:18:52.720 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:18:52.428+0000 7fd82cea4700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:18:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-mon[32999]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:18:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-mon[32999]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T20:18:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-mon[32999]: from='osd.11 ' entity='osd.11' 2024-04-26T20:18:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:52 smithi139 ceph-mon[32999]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:52 smithi135 ceph-mon[32816]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:18:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:52 smithi135 ceph-mon[32816]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T20:18:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:52 smithi135 ceph-mon[32816]: from='osd.11 ' entity='osd.11' 2024-04-26T20:18:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:52 smithi135 ceph-mon[32816]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:53.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:52 smithi082 ceph-mon[28105]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-26T20:18:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:52 smithi082 ceph-mon[28105]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T20:18:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:52 smithi082 ceph-mon[28105]: from='osd.11 ' entity='osd.11' 2024-04-26T20:18:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:52 smithi082 ceph-mon[28105]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-26T20:18:53.788 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:53 smithi082 ceph-mon[28105]: purged_snaps scrub starts 2024-04-26T20:18:53.788 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:53 smithi082 ceph-mon[28105]: purged_snaps scrub ok 2024-04-26T20:18:53.788 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:53.788 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:53 smithi082 ceph-mon[28105]: osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] boot 2024-04-26T20:18:53.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:53 smithi082 ceph-mon[28105]: osdmap e80: 12 total, 12 up, 12 in 2024-04-26T20:18:53.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:53 smithi139 ceph-mon[32999]: purged_snaps scrub starts 2024-04-26T20:18:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:53 smithi139 ceph-mon[32999]: purged_snaps scrub ok 2024-04-26T20:18:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:53 smithi139 ceph-mon[32999]: osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] boot 2024-04-26T20:18:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:53 smithi139 ceph-mon[32999]: osdmap e80: 12 total, 12 up, 12 in 2024-04-26T20:18:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 -- 172.21.15.82:0/1109191269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8079020 msgr2=0x7f9aa80794a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 --2- 172.21.15.82:0/1109191269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8079020 0x7f9aa80794a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009990 tx=0x7f9a94009ca0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 -- 172.21.15.82:0/1109191269 shutdown_connections 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 --2- 172.21.15.82:0/1109191269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80799e0 0x7f9aa807a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 --2- 172.21.15.82:0/1109191269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8077dd0 0x7f9aa80781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 --2- 172.21.15.82:0/1109191269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8079020 0x7f9aa80794a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 -- 172.21.15.82:0/1109191269 >> 172.21.15.82:0/1109191269 conn(0x7f9aa8100c70 msgr2=0x7f9aa81030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 -- 172.21.15.82:0/1109191269 shutdown_connections 2024-04-26T20:18:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.076+0000 7f9aaf800700 1 -- 172.21.15.82:0/1109191269 wait complete. 2024-04-26T20:18:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.077+0000 7f9aaf800700 1 Processor -- start 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.077+0000 7f9aaf800700 1 -- start start 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aaf800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 0x7f9aa819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aaf800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8079020 0x7f9aa81a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aaf800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80799e0 0x7f9aa81a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aaf800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8115600 con 0x7f9aa80799e0 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aaf800700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8115480 con 0x7f9aa8079020 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aaf800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8115780 con 0x7f9aa8077dd0 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aace00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 0x7f9aa819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aace00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 0x7f9aa819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48256/0 (socket says 172.21.15.82:48256) 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aace00700 1 -- 172.21.15.82:0/3602301017 learned_addr learned my addr 172.21.15.82:0/3602301017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aad800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80799e0 0x7f9aa81a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.078+0000 7f9aa7e00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8079020 0x7f9aa81a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aace00700 1 -- 172.21.15.82:0/3602301017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8079020 msgr2=0x7f9aa81a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aace00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8079020 0x7f9aa81a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aace00700 1 -- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80799e0 msgr2=0x7f9aa81a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aace00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80799e0 0x7f9aa81a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aace00700 1 -- 172.21.15.82:0/3602301017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa81a7880 con 0x7f9aa8077dd0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aa7e00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8079020 0x7f9aa81a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aace00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 0x7f9aa819fc30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e9c0 tx=0x7f9a9c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00cbd0 con 0x7f9aa8077dd0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a9c00cd70 con 0x7f9aa8077dd0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa81a7b70 con 0x7f9aa8077dd0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c005610 con 0x7f9aa8077dd0 2024-04-26T20:18:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.079+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa81a80b0 con 0x7f9aa8077dd0 2024-04-26T20:18:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.080+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa806a110 con 0x7f9aa8077dd0 2024-04-26T20:18:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.082+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9a9c004750 con 0x7f9aa8077dd0 2024-04-26T20:18:54.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.084+0000 7f9aa5600700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9a900a3cc0 0x7f9a900a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.084+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f9a9c0d0290 con 0x7f9aa8077dd0 2024-04-26T20:18:54.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.084+0000 7f9aa7e00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9a900a3cc0 0x7f9a900a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.084+0000 7f9aa7e00700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9a900a3cc0 0x7f9a900a6180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b2e0 tx=0x7f9a9401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:54.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.086+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9a9c09d070 con 0x7f9aa8077dd0 2024-04-26T20:18:54.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:53 smithi135 ceph-mon[32816]: purged_snaps scrub starts 2024-04-26T20:18:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:53 smithi135 ceph-mon[32816]: purged_snaps scrub ok 2024-04-26T20:18:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:53 smithi135 ceph-mon[32816]: osd.11 [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] boot 2024-04-26T20:18:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:53 smithi135 ceph-mon[32816]: osdmap e80: 12 total, 12 up, 12 in 2024-04-26T20:18:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T20:18:54.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.314+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9aa802e510 con 0x7f9aa8077dd0 2024-04-26T20:18:54.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.315+0000 7f9aa5600700 1 -- 172.21.15.82:0/3602301017 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7f9a9c09c970 con 0x7f9aa8077dd0 2024-04-26T20:18:54.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9a900a3cc0 msgr2=0x7f9a900a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9a900a3cc0 0x7f9a900a6180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b2e0 tx=0x7f9a9401a040 comp rx=0 tx=0).stop 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 msgr2=0x7f9aa819fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 0x7f9aa819fc30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e9c0 tx=0x7f9a9c00ecd0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 shutdown_connections 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80799e0 0x7f9aa81a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9aa8077dd0 0x7f9aa819fc30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9a900a3cc0 0x7f9a900a6180 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 --2- 172.21.15.82:0/3602301017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa8079020 0x7f9aa81a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 >> 172.21.15.82:0/3602301017 conn(0x7f9aa8100c70 msgr2=0x7f9aa8102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 shutdown_connections 2024-04-26T20:18:54.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:54.318+0000 7f9aaf800700 1 -- 172.21.15.82:0/3602301017 wait complete. 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3602301017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: Detected new or changed devices on smithi139 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi139 to 4272M 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:54.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:54.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3602301017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: Detected new or changed devices on smithi139 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi139 to 4272M 2024-04-26T20:18:55.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:55.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:55.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3602301017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: Detected new or changed devices on smithi139 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi139 to 4272M 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:55.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:18:55.261 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1714162733,"num_in_osds":12,"osd_in_since":1714162713,"num_remapped_pgs":0} 2024-04-26T20:18:55.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T20:18:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:56.060 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:55 smithi082 ceph-mon[28105]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T20:18:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:55 smithi139 ceph-mon[32999]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T20:18:56.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:55 smithi135 ceph-mon[32816]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T20:18:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:56 smithi139 ceph-mon[32999]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:57.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:56 smithi135 ceph-mon[32816]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:57.166 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:56 smithi082 ceph-mon[28105]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:58.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.002+0000 7f567b400700 1 -- 172.21.15.82:0/6012861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674009480 con 0x7f567c105f30 2024-04-26T20:18:58.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 -- 172.21.15.82:0/6012861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c105f30 msgr2=0x7f567c1123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 --2- 172.21.15.82:0/6012861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c105f30 0x7f567c1123f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f567400b0d0 tx=0x7f567400b3e0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 -- 172.21.15.82:0/6012861 shutdown_connections 2024-04-26T20:18:58.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 --2- 172.21.15.82:0/6012861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c105f30 0x7f567c1123f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 --2- 172.21.15.82:0/6012861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f567c10b620 0x7f567c10ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 --2- 172.21.15.82:0/6012861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c105570 0x7f567c1059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 -- 172.21.15.82:0/6012861 >> 172.21.15.82:0/6012861 conn(0x7f567c101040 msgr2=0x7f567c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:58.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 -- 172.21.15.82:0/6012861 shutdown_connections 2024-04-26T20:18:58.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.003+0000 7f5681e00700 1 -- 172.21.15.82:0/6012861 wait complete. 2024-04-26T20:18:58.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 Processor -- start 2024-04-26T20:18:58.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 -- start start 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f567c105570 0x7f567c1a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c105f30 0x7f567c1a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 0x7f567c19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f567c115720 con 0x7f567c10b620 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f567c1155a0 con 0x7f567c105f30 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f567c1158a0 con 0x7f567c105570 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 0x7f567c19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5680a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f567c105570 0x7f567c1a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 0x7f567c19b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41782/0 (socket says 172.21.15.82:41782) 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.005+0000 7f5681400700 1 -- 172.21.15.82:0/4188344222 learned_addr learned my addr 172.21.15.82:0/4188344222 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:18:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f567be00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c105f30 0x7f567c1a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5681400700 1 -- 172.21.15.82:0/4188344222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f567c105570 msgr2=0x7f567c1a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5681400700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f567c105570 0x7f567c1a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5681400700 1 -- 172.21.15.82:0/4188344222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c105f30 msgr2=0x7f567c1a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5681400700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c105f30 0x7f567c1a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5681400700 1 -- 172.21.15.82:0/4188344222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c19c0c0 con 0x7f567c10b620 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5681400700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 0x7f567c19b960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5674007a00 tx=0x7f5674007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567401f070 con 0x7f567c10b620 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5674004c50 con 0x7f567c10b620 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.006+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567401b690 con 0x7f567c10b620 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.007+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c19c350 con 0x7f567c10b620 2024-04-26T20:18:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.007+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c1a8670 con 0x7f567c10b620 2024-04-26T20:18:58.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.008+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c106c90 con 0x7f567c10b620 2024-04-26T20:18:58.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.011+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5674022070 con 0x7f567c10b620 2024-04-26T20:18:58.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.013+0000 7f5679600700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56640a3cc0 0x7f56640a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:58.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.013+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f567400f020 con 0x7f567c10b620 2024-04-26T20:18:58.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.013+0000 7f5680a00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56640a3cc0 0x7f56640a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:58.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.014+0000 7f5680a00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56640a3cc0 0x7f56640a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f567c19caa0 tx=0x7f5670009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:58.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.016+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5674029020 con 0x7f567c10b620 2024-04-26T20:18:58.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.245+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f567c02e490 con 0x7f567c10b620 2024-04-26T20:18:58.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.247+0000 7f5679600700 1 -- 172.21.15.82:0/4188344222 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18469 (secure 0 0 0) 0x7f567409e1e0 con 0x7f567c10b620 2024-04-26T20:18:58.249 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:18:58.249 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":81,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:18:54.722193+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.249+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56640a3cc0 msgr2=0x7f56640a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.249+0000 7f5681e00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56640a3cc0 0x7f56640a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f567c19caa0 tx=0x7f5670009260 comp rx=0 tx=0).stop 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.249+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 msgr2=0x7f567c19b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.249+0000 7f5681e00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 0x7f567c19b960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5674007a00 tx=0x7f5674007a30 comp rx=0 tx=0).stop 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 shutdown_connections 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567c10b620 0x7f567c19b960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f567c105570 0x7f567c1a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56640a3cc0 0x7f56640a6180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 --2- 172.21.15.82:0/4188344222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c105f30 0x7f567c1a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 >> 172.21.15.82:0/4188344222 conn(0x7f567c101040 msgr2=0x7f567c102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 shutdown_connections 2024-04-26T20:18:58.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:18:58.250+0000 7f5681e00700 1 -- 172.21.15.82:0/4188344222 wait complete. 2024-04-26T20:18:58.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4188344222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:18:58.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4188344222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:18:58.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4188344222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:18:59.145 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:18:59.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T20:18:59.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:18:59 smithi082 ceph-mon[28105]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:59.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:18:59 smithi139 ceph-mon[32999]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:18:59.579 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:18:59.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:18:59 smithi135 ceph-mon[32816]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:01.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 -- 172.21.15.82:0/3228133359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd330109a50 msgr2=0x7fd330109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:01.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 --2- 172.21.15.82:0/3228133359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd330109a50 0x7fd330109ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd318009990 tx=0x7fd318009ca0 comp rx=0 tx=0).stop 2024-04-26T20:19:01.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 -- 172.21.15.82:0/3228133359 shutdown_connections 2024-04-26T20:19:01.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 --2- 172.21.15.82:0/3228133359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010a410 0x7fd330116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:01.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 --2- 172.21.15.82:0/3228133359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd33010fa50 0x7fd33010fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:01.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 --2- 172.21.15.82:0/3228133359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd330109a50 0x7fd330109ed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:01.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 -- 172.21.15.82:0/3228133359 >> 172.21.15.82:0/3228133359 conn(0x7fd330076bf0 msgr2=0x7fd330108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:01.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 -- 172.21.15.82:0/3228133359 shutdown_connections 2024-04-26T20:19:01.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.850+0000 7fd335e00700 1 -- 172.21.15.82:0/3228133359 wait complete. 2024-04-26T20:19:01.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 Processor -- start 2024-04-26T20:19:01.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 -- start start 2024-04-26T20:19:01.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd330109a50 0x7fd3301a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:01.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 0x7fd3301a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010fa50 0x7fd3301a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd330119ce0 con 0x7fd33010a410 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd330119b60 con 0x7fd33010fa50 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.852+0000 7fd335e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd330119e60 con 0x7fd330109a50 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 0x7fd3301a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 0x7fd3301a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39498/0 (socket says 172.21.15.82:39498) 2024-04-26T20:19:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 -- 172.21.15.82:0/3609893668 learned_addr learned my addr 172.21.15.82:0/3609893668 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd32f400700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010fa50 0x7fd3301a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd32ea00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd330109a50 0x7fd3301a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 -- 172.21.15.82:0/3609893668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd330109a50 msgr2=0x7fd3301a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd330109a50 0x7fd3301a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 -- 172.21.15.82:0/3609893668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010fa50 msgr2=0x7fd3301a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010fa50 0x7fd3301a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd327e00700 1 -- 172.21.15.82:0/3609893668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3301a5280 con 0x7fd33010a410 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.853+0000 7fd32ea00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd330109a50 0x7fd3301a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.854+0000 7fd327e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 0x7fd3301a07b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd318005910 tx=0x7fd31800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.854+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318027070 con 0x7fd33010a410 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.854+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd318022470 con 0x7fd33010a410 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.854+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3301a5510 con 0x7fd33010a410 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.854+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318017650 con 0x7fd33010a410 2024-04-26T20:19:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.854+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3301acdf0 con 0x7fd33010a410 2024-04-26T20:19:01.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.855+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd330111fe0 con 0x7fd33010a410 2024-04-26T20:19:01.862 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:01 smithi082 ceph-mon[28105]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.857+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fd31802a070 con 0x7fd33010a410 2024-04-26T20:19:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.859+0000 7fd334a00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3140a3c40 0x7fd3140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.859+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd3180d0fb0 con 0x7fd33010a410 2024-04-26T20:19:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.859+0000 7fd32ea00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3140a3c40 0x7fd3140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.860+0000 7fd32ea00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3140a3c40 0x7fd3140a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd320009fd0 tx=0x7fd320009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:01.862+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd318013070 con 0x7fd33010a410 2024-04-26T20:19:01.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:01 smithi135 ceph-mon[32816]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:01 smithi139 ceph-mon[32999]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:02.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.085+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd3301a15d0 con 0x7fd33010a410 2024-04-26T20:19:02.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.086+0000 7fd334a00700 1 -- 172.21.15.82:0/3609893668 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fd31809de20 con 0x7fd33010a410 2024-04-26T20:19:02.087 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:19:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.088+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3140a3c40 msgr2=0x7fd3140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.088+0000 7fd335e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3140a3c40 0x7fd3140a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd320009fd0 tx=0x7fd320009260 comp rx=0 tx=0).stop 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.088+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 msgr2=0x7fd3301a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.088+0000 7fd335e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 0x7fd3301a07b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd318005910 tx=0x7fd31800b670 comp rx=0 tx=0).stop 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 shutdown_connections 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3140a3c40 0x7fd3140a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010fa50 0x7fd3301a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd330109a50 0x7fd3301a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 --2- 172.21.15.82:0/3609893668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd33010a410 0x7fd3301a07b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 >> 172.21.15.82:0/3609893668 conn(0x7fd330076bf0 msgr2=0x7fd3300772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 shutdown_connections 2024-04-26T20:19:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:02.089+0000 7fd335e00700 1 -- 172.21.15.82:0/3609893668 wait complete. 2024-04-26T20:19:02.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:02 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3609893668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:02.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:02 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3609893668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:02.948 INFO:tasks.cephadm:Adding mds.a on smithi082 2024-04-26T20:19:02.948 INFO:tasks.cephadm:Adding mds.d on smithi082 2024-04-26T20:19:02.948 INFO:tasks.cephadm:Adding mds.g on smithi082 2024-04-26T20:19:02.948 INFO:tasks.cephadm:Adding mds.j on smithi082 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.b on smithi135 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.e on smithi135 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.h on smithi135 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.k on smithi135 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.c on smithi139 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.f on smithi139 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.i on smithi139 2024-04-26T20:19:02.949 INFO:tasks.cephadm:Adding mds.l on smithi139 2024-04-26T20:19:02.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l' 2024-04-26T20:19:02.977 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:02 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3609893668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:03.200 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:19:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:03 smithi082 ceph-mon[28105]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:03 smithi139 ceph-mon[32999]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:04.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:03 smithi135 ceph-mon[32816]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:05.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 -- 172.21.15.139:0/1839726803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 msgr2=0x7f50901027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 --2- 172.21.15.139:0/1839726803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f50901027a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f508c009990 tx=0x7f508c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 -- 172.21.15.139:0/1839726803 shutdown_connections 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 --2- 172.21.15.139:0/1839726803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090103f20 0x7f509010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 --2- 172.21.15.139:0/1839726803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f50901027a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 --2- 172.21.15.139:0/1839726803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 0x7f50901039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 -- 172.21.15.139:0/1839726803 >> 172.21.15.139:0/1839726803 conn(0x7f50900fd940 msgr2=0x7f50900ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 -- 172.21.15.139:0/1839726803 shutdown_connections 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 -- 172.21.15.139:0/1839726803 wait complete. 2024-04-26T20:19:05.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 Processor -- start 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.047+0000 7f5097f2d700 1 -- start start 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f5090199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 0x7f5090199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090103f20 0x7f50901a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f509010def0 con 0x7f5090103f20 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f509010dd70 con 0x7f5090103580 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f509010e070 con 0x7f5090102380 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f5090199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f5090199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56512/0 (socket says 172.21.15.139:56512) 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 -- 172.21.15.139:0/377098559 learned_addr learned my addr 172.21.15.139:0/377098559 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f50954c8700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 0x7f5090199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 -- 172.21.15.139:0/377098559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 msgr2=0x7f5090199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 0x7f5090199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 -- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090103f20 msgr2=0x7f50901a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090103f20 0x7f50901a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 -- 172.21.15.139:0/377098559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50901a1360 con 0x7f5090102380 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f50954c8700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 0x7f5090199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5095cc9700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f5090199700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f508c0047b0 tx=0x7f508c003940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c027070 con 0x7f5090102380 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50901a15f0 con 0x7f5090102380 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f508c022470 con 0x7f5090102380 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c00f6c0 con 0x7f5090102380 2024-04-26T20:19:05.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.048+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50901a1b20 con 0x7f5090102380 2024-04-26T20:19:05.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.049+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509006a110 con 0x7f5090102380 2024-04-26T20:19:05.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.050+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f508c02a070 con 0x7f5090102380 2024-04-26T20:19:05.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.051+0000 7f5086ffd700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f507c0a3c40 0x7f507c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.051+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f508c0d0ea0 con 0x7f5090102380 2024-04-26T20:19:05.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.052+0000 7f50954c8700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f507c0a3c40 0x7f507c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.052+0000 7f50954c8700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f507c0a3c40 0x7f507c0a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5080007900 tx=0x7f5080008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:05.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.056+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f508c013070 con 0x7f5090102380 2024-04-26T20:19:05.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.263+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l", "target": ["mon-mgr", ""]}) -- 0x7f509006c300 con 0x7f507c0a3c40 2024-04-26T20:19:05.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.280+0000 7f5086ffd700 1 -- 172.21.15.139:0/377098559 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f509006c300 con 0x7f507c0a3c40 2024-04-26T20:19:05.281 INFO:teuthology.orchestra.run.smithi139.stdout:Scheduled mds.all update... 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f507c0a3c40 msgr2=0x7f507c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f507c0a3c40 0x7f507c0a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5080007900 tx=0x7f5080008040 comp rx=0 tx=0).stop 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 msgr2=0x7f5090199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f5090199700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f508c0047b0 tx=0x7f508c003940 comp rx=0 tx=0).stop 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 shutdown_connections 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090103f20 0x7f50901a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5090102380 0x7f5090199700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f507c0a3c40 0x7f507c0a6100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 --2- 172.21.15.139:0/377098559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5090103580 0x7f5090199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 >> 172.21.15.139:0/377098559 conn(0x7f50900fd940 msgr2=0x7f509006baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:05.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 shutdown_connections 2024-04-26T20:19:05.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T20:19:05.282+0000 7f5097f2d700 1 -- 172.21.15.139:0/377098559 wait complete. 2024-04-26T20:19:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:05 smithi082 ceph-mon[28105]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:05 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:05 smithi139 ceph-mon[32999]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:05 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:06.105 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.a.service 2024-04-26T20:19:06.112 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.d.service 2024-04-26T20:19:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:05 smithi135 ceph-mon[32816]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:05 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:06.158 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.g.service 2024-04-26T20:19:06.204 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.j.service 2024-04-26T20:19:06.249 DEBUG:teuthology.orchestra.run.smithi135:mds.b> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.b.service 2024-04-26T20:19:06.252 DEBUG:teuthology.orchestra.run.smithi135:mds.e> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.e.service 2024-04-26T20:19:06.295 DEBUG:teuthology.orchestra.run.smithi135:mds.h> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service 2024-04-26T20:19:06.338 DEBUG:teuthology.orchestra.run.smithi135:mds.k> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.k.service 2024-04-26T20:19:06.381 DEBUG:teuthology.orchestra.run.smithi139:mds.c> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.c.service 2024-04-26T20:19:06.383 DEBUG:teuthology.orchestra.run.smithi139:mds.f> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.f.service 2024-04-26T20:19:06.426 DEBUG:teuthology.orchestra.run.smithi139:mds.i> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.i.service 2024-04-26T20:19:06.469 DEBUG:teuthology.orchestra.run.smithi139:mds.l> sudo journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.l.service 2024-04-26T20:19:06.512 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-26T20:19:06.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:19:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.730+0000 7f70c2e00640 1 -- 172.21.15.82:0/3995228818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 msgr2=0x7f70bc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.730+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3995228818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc078990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009860 tx=0x7f70a402a340 comp rx=0 tx=0).stop 2024-04-26T20:19:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 -- 172.21.15.82:0/3995228818 shutdown_connections 2024-04-26T20:19:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3995228818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc078ed0 0x7f70bc079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3995228818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc078990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3995228818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70bc0772f0 0x7f70bc077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 -- 172.21.15.82:0/3995228818 >> 172.21.15.82:0/3995228818 conn(0x7f70bc100120 msgr2=0x7f70bc102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 -- 172.21.15.82:0/3995228818 shutdown_connections 2024-04-26T20:19:06.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.731+0000 7f70c2e00640 1 -- 172.21.15.82:0/3995228818 wait complete. 2024-04-26T20:19:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 Processor -- start 2024-04-26T20:19:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 -- start start 2024-04-26T20:19:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 0x7f70bc19f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70bc078ed0 0x7f70bc1a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc114ab0 con 0x7f70bc0772f0 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc114930 con 0x7f70bc078530 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.732+0000 7f70c2e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc114c30 con 0x7f70bc078ed0 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 0x7f70bc19f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70c0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70bc078ed0 0x7f70bc1a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70b3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 0x7f70bc19f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39518/0 (socket says 172.21.15.82:39518) 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 -- 172.21.15.82:0/3627738232 learned_addr learned my addr 172.21.15.82:0/3627738232 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 -- 172.21.15.82:0/3627738232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70bc078ed0 msgr2=0x7f70bc1a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70bc078ed0 0x7f70bc1a6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 -- 172.21.15.82:0/3627738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 msgr2=0x7f70bc19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 -- 172.21.15.82:0/3627738232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc1a6d90 con 0x7f70bc0772f0 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70b3400640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70bbe00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 0x7f70bc19f170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00e9f0 tx=0x7f70ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.733+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00ccc0 con 0x7f70bc0772f0 2024-04-26T20:19:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.734+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70ac00ce60 con 0x7f70bc0772f0 2024-04-26T20:19:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.734+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc1a7080 con 0x7f70bc0772f0 2024-04-26T20:19:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.734+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac010430 con 0x7f70bc0772f0 2024-04-26T20:19:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.734+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc1a7550 con 0x7f70bc0772f0 2024-04-26T20:19:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.735+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc1114e0 con 0x7f70bc0772f0 2024-04-26T20:19:06.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.737+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f70ac0046c0 con 0x7f70bc0772f0 2024-04-26T20:19:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.738+0000 7f70b9600640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f70a00a3bb0 0x7f70a00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.738+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f70ac0d03e0 con 0x7f70bc0772f0 2024-04-26T20:19:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.738+0000 7f70b3400640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f70a00a3bb0 0x7f70a00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.739+0000 7f70b3400640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f70a00a3bb0 0x7f70a00a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70a402a930 tx=0x7f70a4030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.743+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f70ac09d1c0 con 0x7f70bc0772f0 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l;count:12 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:06.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:06 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l;count:12 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:06 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:06.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.945+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70bc063530 con 0x7f70bc0772f0 2024-04-26T20:19:06.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.946+0000 7f70b9600640 1 -- 172.21.15.82:0/3627738232 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18469 (secure 0 0 0) 0x7f70ac09cac0 con 0x7f70bc0772f0 2024-04-26T20:19:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:06.947 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":81,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:18:54.722193+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f70a00a3bb0 msgr2=0x7f70a00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f70a00a3bb0 0x7f70a00a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f70a402a930 tx=0x7f70a4030450 comp rx=0 tx=0).stop 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 msgr2=0x7f70bc19f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 0x7f70bc19f170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00e9f0 tx=0x7f70ac00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 shutdown_connections 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f70a00a3bb0 0x7f70a00a6070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70bc078ed0 0x7f70bc1a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc078530 0x7f70bc19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 --2- 172.21.15.82:0/3627738232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70bc0772f0 0x7f70bc19f170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 >> 172.21.15.82:0/3627738232 conn(0x7f70bc100120 msgr2=0x7f70bc101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 shutdown_connections 2024-04-26T20:19:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:06.949+0000 7f70c2e00640 1 -- 172.21.15.82:0/3627738232 wait complete. 2024-04-26T20:19:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:19:06.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:19:07.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l;count:12 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:07.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:06 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.171+0000 7f7fbb400640 1 -- 172.21.15.82:0/322369900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4104b90 msgr2=0x7f7fb4104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.171+0000 7f7fbb400640 1 --2- 172.21.15.82:0/322369900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4104b90 0x7f7fb4104fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009900 tx=0x7f7fa802a410 comp rx=0 tx=0).stop 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 -- 172.21.15.82:0/322369900 shutdown_connections 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 --2- 172.21.15.82:0/322369900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4106740 0x7f7fb410cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 --2- 172.21.15.82:0/322369900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fb4105d80 0x7f7fb4106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 --2- 172.21.15.82:0/322369900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4104b90 0x7f7fb4104fb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 -- 172.21.15.82:0/322369900 >> 172.21.15.82:0/322369900 conn(0x7f7fb41000e0 msgr2=0x7f7fb4102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 -- 172.21.15.82:0/322369900 shutdown_connections 2024-04-26T20:19:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.172+0000 7f7fbb400640 1 -- 172.21.15.82:0/322369900 wait complete. 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.173+0000 7f7fbb400640 1 Processor -- start 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.173+0000 7f7fbb400640 1 -- start start 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fbb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 0x7f7fb419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fbb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fb4105d80 0x7f7fb419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fbb400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4106740 0x7f7fb41a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fbb400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41106e0 con 0x7f7fb4105d80 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fbb400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4110560 con 0x7f7fb4104b90 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fbb400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4110860 con 0x7f7fb4106740 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 0x7f7fb419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 0x7f7fb419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41018/0 (socket says 172.21.15.82:41018) 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 -- 172.21.15.82:0/824636018 learned_addr learned my addr 172.21.15.82:0/824636018 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb3e00640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fb4105d80 0x7f7fb419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb9400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4106740 0x7f7fb41a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 -- 172.21.15.82:0/824636018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4106740 msgr2=0x7f7fb41a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4106740 0x7f7fb41a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 -- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fb4105d80 msgr2=0x7f7fb419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fb4105d80 0x7f7fb419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.174+0000 7f7fb8a00640 1 -- 172.21.15.82:0/824636018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb41a2a30 con 0x7f7fb4104b90 2024-04-26T20:19:07.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.175+0000 7f7fb8a00640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 0x7f7fb419ae10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8031500 tx=0x7f7fa8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:07.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.175+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa803f070 con 0x7f7fb4104b90 2024-04-26T20:19:07.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.175+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa8031c50 con 0x7f7fb4104b90 2024-04-26T20:19:07.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.175+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8035030 con 0x7f7fb4104b90 2024-04-26T20:19:07.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.175+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb41a2cc0 con 0x7f7fb4104b90 2024-04-26T20:19:07.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.175+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb41a3160 con 0x7f7fb4104b90 2024-04-26T20:19:07.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.176+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb410bf30 con 0x7f7fb4104b90 2024-04-26T20:19:07.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.178+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7fa8042070 con 0x7f7fb4104b90 2024-04-26T20:19:07.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.180+0000 7f7fb1600640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f9c0a3c30 0x7f7f9c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.180+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7fa80f06e0 con 0x7f7fb4104b90 2024-04-26T20:19:07.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.180+0000 7f7fb3e00640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f9c0a3c30 0x7f7f9c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.181+0000 7f7fb3e00640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f9c0a3c30 0x7f7f9c0a60f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fb419c320 tx=0x7f7fa0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:07.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.184+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7fa80bce70 con 0x7f7fb4104b90 2024-04-26T20:19:07.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.384+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7fb40635d0 con 0x7f7fb4104b90 2024-04-26T20:19:07.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.385+0000 7f7fb1600640 1 -- 172.21.15.82:0/824636018 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f7fa80c1170 con 0x7f7fb4104b90 2024-04-26T20:19:07.386 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:19:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f9c0a3c30 msgr2=0x7f7f9c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f9c0a3c30 0x7f7f9c0a60f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fb419c320 tx=0x7f7fa0005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 msgr2=0x7f7fb419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 0x7f7fb419ae10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8031500 tx=0x7f7fa8003c10 comp rx=0 tx=0).stop 2024-04-26T20:19:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 shutdown_connections 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f9c0a3c30 0x7f7f9c0a60f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fb4106740 0x7f7fb41a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fb4105d80 0x7f7fb419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 --2- 172.21.15.82:0/824636018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4104b90 0x7f7fb419ae10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 >> 172.21.15.82:0/824636018 conn(0x7f7fb41000e0 msgr2=0x7f7fb4109100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 shutdown_connections 2024-04-26T20:19:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.388+0000 7f7fbb400640 1 -- 172.21.15.82:0/824636018 wait complete. 2024-04-26T20:19:07.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cef400640 1 -- 172.21.15.82:0/3703720926 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40318a0 con 0x7f2cf00772f0 2024-04-26T20:19:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 -- 172.21.15.82:0/3703720926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 msgr2=0x7f2cf0077710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 --2- 172.21.15.82:0/3703720926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf0077710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009900 tx=0x7f2ce402a410 comp rx=0 tx=0).stop 2024-04-26T20:19:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 -- 172.21.15.82:0/3703720926 shutdown_connections 2024-04-26T20:19:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 --2- 172.21.15.82:0/3703720926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0078ed0 0x7f2cf0079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 --2- 172.21.15.82:0/3703720926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cf0078530 0x7f2cf0078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 --2- 172.21.15.82:0/3703720926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf0077710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.608+0000 7f2cf7800640 1 -- 172.21.15.82:0/3703720926 >> 172.21.15.82:0/3703720926 conn(0x7f2cf0100120 msgr2=0x7f2cf0102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.609+0000 7f2cf7800640 1 -- 172.21.15.82:0/3703720926 shutdown_connections 2024-04-26T20:19:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.609+0000 7f2cf7800640 1 -- 172.21.15.82:0/3703720926 wait complete. 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 Processor -- start 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 -- start start 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf019f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cf0078530 0x7f2cf019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0078ed0 0x7f2cf01a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0114ac0 con 0x7f2cf00772f0 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0114940 con 0x7f2cf0078530 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf7800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0114c40 con 0x7f2cf0078ed0 2024-04-26T20:19:07.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf4e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf019f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cefe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cf0078530 0x7f2cf019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf4e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf019f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39568/0 (socket says 172.21.15.82:39568) 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf4e00640 1 -- 172.21.15.82:0/213687880 learned_addr learned my addr 172.21.15.82:0/213687880 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.610+0000 7f2cf5800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0078ed0 0x7f2cf01a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf4e00640 1 -- 172.21.15.82:0/213687880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0078ed0 msgr2=0x7f2cf01a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf4e00640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0078ed0 0x7f2cf01a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf4e00640 1 -- 172.21.15.82:0/213687880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cf0078530 msgr2=0x7f2cf019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf4e00640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cf0078530 0x7f2cf019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf4e00640 1 -- 172.21.15.82:0/213687880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf01a6da0 con 0x7f2cf00772f0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf4e00640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf019f180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4005940 tx=0x7f2ce40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce403f030 con 0x7f2cf00772f0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce4003cb0 con 0x7f2cf00772f0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf01a7030 con 0x7f2cf00772f0 2024-04-26T20:19:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.611+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4035070 con 0x7f2cf00772f0 2024-04-26T20:19:07.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.612+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf01a7570 con 0x7f2cf00772f0 2024-04-26T20:19:07.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.613+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf0111730 con 0x7f2cf00772f0 2024-04-26T20:19:07.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.616+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2ce4042030 con 0x7f2cf00772f0 2024-04-26T20:19:07.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.618+0000 7f2ced600640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cd80a3c30 0x7f2cd80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.618+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2ce40f0330 con 0x7f2cf00772f0 2024-04-26T20:19:07.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.618+0000 7f2cefe00640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cd80a3c30 0x7f2cd80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.619+0000 7f2cefe00640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cd80a3c30 0x7f2cd80a60f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2cf01a0690 tx=0x7f2cdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:07.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.623+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2ce4003e60 con 0x7f2cf00772f0 2024-04-26T20:19:07.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:07 smithi082 ceph-mon[28105]: Deploying daemon mds.l on smithi139 2024-04-26T20:19:07.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:07 smithi082 ceph-mon[28105]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:07.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:07 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3627738232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:07.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:07 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/824636018' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:07 smithi139 ceph-mon[32999]: Deploying daemon mds.l on smithi139 2024-04-26T20:19:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:07 smithi139 ceph-mon[32999]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:07 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3627738232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:07.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:07 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/824636018' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:07.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.869+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cf002dad0 con 0x7f2cf00772f0 2024-04-26T20:19:07.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.870+0000 7f2ced600640 1 -- 172.21.15.82:0/213687880 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f2ce40bcac0 con 0x7f2cf00772f0 2024-04-26T20:19:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:07.871 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-26T20:19:07.871 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 1 2024-04-26T20:19:07.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.872+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cd80a3c30 msgr2=0x7f2cd80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.872+0000 7f2cf7800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cd80a3c30 0x7f2cd80a60f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2cf01a0690 tx=0x7f2cdc005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:07.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.872+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 msgr2=0x7f2cf019f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.872+0000 7f2cf7800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf019f180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4005940 tx=0x7f2ce40042f0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 shutdown_connections 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cd80a3c30 0x7f2cd80a60f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cf0078ed0 0x7f2cf01a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cf0078530 0x7f2cf019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 --2- 172.21.15.82:0/213687880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf00772f0 0x7f2cf019f180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 >> 172.21.15.82:0/213687880 conn(0x7f2cf0100120 msgr2=0x7f2cf0101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 shutdown_connections 2024-04-26T20:19:07.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:07.873+0000 7f2cf7800640 1 -- 172.21.15.82:0/213687880 wait complete. 2024-04-26T20:19:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:07 smithi135 ceph-mon[32816]: Deploying daemon mds.l on smithi139 2024-04-26T20:19:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:07 smithi135 ceph-mon[32816]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:07 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3627738232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:07 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/824636018' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:08.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:08 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/213687880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:08.991 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:08 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/213687880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:08.991 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:08 smithi139 systemd[1]: Starting Ceph mds.l for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:09.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:08 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/213687880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:09.259 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:08 smithi139 podman[62788]: 2024-04-26 20:19:08.894324084 +0000 UTC m=+0.018042996 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:09.259 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 podman[62788]: 2024-04-26 20:19:09.006098064 +0000 UTC m=+0.129816974 container create 77f79c3cd69a18456d4c790ece6be70dcc5743c5fe90da04fc6c46a5bbbcc7d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:19:09.259 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 podman[62788]: 2024-04-26 20:19:09.258780052 +0000 UTC m=+0.382498959 container init 77f79c3cd69a18456d4c790ece6be70dcc5743c5fe90da04fc6c46a5bbbcc7d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T20:19:09.571 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 podman[62788]: 2024-04-26 20:19:09.261332615 +0000 UTC m=+0.385051531 container start 77f79c3cd69a18456d4c790ece6be70dcc5743c5fe90da04fc6c46a5bbbcc7d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T20:19:09.571 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mds[62807]: -- 172.21.15.139:0/2132087656 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55828310da40 con 0x5582830e0800 2024-04-26T20:19:09.571 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: starting mds.l at 2024-04-26T20:19:09.571 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 bash[62788]: 77f79c3cd69a18456d4c790ece6be70dcc5743c5fe90da04fc6c46a5bbbcc7d7 2024-04-26T20:19:09.571 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:19:09 smithi139 systemd[1]: Started Ceph mds.l for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:09.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] up:boot 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: fsmap 1 up:standby 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:09 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] up:boot 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: fsmap 1 up:standby 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:10.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:10.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:09 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 -- 172.21.15.82:0/3979193332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 msgr2=0x7febe0103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 --2- 172.21.15.82:0/3979193332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe0103fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7febd0009900 tx=0x7febd002a410 comp rx=0 tx=0).stop 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 -- 172.21.15.82:0/3979193332 shutdown_connections 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 --2- 172.21.15.82:0/3979193332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0104520 0x7febe010adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 --2- 172.21.15.82:0/3979193332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe0103fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 --2- 172.21.15.82:0/3979193332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe0102970 0x7febe0102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 -- 172.21.15.82:0/3979193332 >> 172.21.15.82:0/3979193332 conn(0x7febe00fdee0 msgr2=0x7febe0100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 -- 172.21.15.82:0/3979193332 shutdown_connections 2024-04-26T20:19:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.104+0000 7febe5200640 1 -- 172.21.15.82:0/3979193332 wait complete. 2024-04-26T20:19:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.105+0000 7febe5200640 1 Processor -- start 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.105+0000 7febe5200640 1 -- start start 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febe5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0102970 0x7febe019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febe5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febe5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe0104520 0x7febe01a2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febe5200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7febe010e4d0 con 0x7febe0103b60 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febe5200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febe010e350 con 0x7febe0102970 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febe5200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febe010e650 con 0x7febe0104520 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe019b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39584/0 (socket says 172.21.15.82:39584) 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 -- 172.21.15.82:0/3462823122 learned_addr learned my addr 172.21.15.82:0/3462823122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febdde00640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0102970 0x7febe019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febde800640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe0104520 0x7febe01a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 -- 172.21.15.82:0/3462823122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe0104520 msgr2=0x7febe01a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe0104520 0x7febe01a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 -- 172.21.15.82:0/3462823122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0102970 msgr2=0x7febe019adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0102970 0x7febe019adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febd5400640 1 -- 172.21.15.82:0/3462823122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe01a29d0 con 0x7febe0103b60 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.106+0000 7febdde00640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0102970 0x7febe019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.107+0000 7febd5400640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe019b2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febd0005ab0 tx=0x7febd0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.107+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd003f070 con 0x7febe0103b60 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.107+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febd0031c50 con 0x7febe0103b60 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.107+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0035030 con 0x7febe0103b60 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.107+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe01a2c60 con 0x7febe0103b60 2024-04-26T20:19:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.107+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe01a3100 con 0x7febe0103b60 2024-04-26T20:19:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.109+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe01a32d0 con 0x7febe0103b60 2024-04-26T20:19:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.111+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7febd0042070 con 0x7febe0103b60 2024-04-26T20:19:10.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.113+0000 7febd7400640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc40a3bb0 0x7febc40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.113+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7febd00f0e80 con 0x7febe0103b60 2024-04-26T20:19:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.113+0000 7febdde00640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc40a3bb0 0x7febc40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.114+0000 7febdde00640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc40a3bb0 0x7febc40a6070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febe01039c0 tx=0x7febc8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:10.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.116+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7febd00bdc60 con 0x7febe0103b60 2024-04-26T20:19:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] up:boot 2024-04-26T20:19:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: fsmap 1 up:standby 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:09 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.359+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febe01a35c0 con 0x7febe0103b60 2024-04-26T20:19:10.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.360+0000 7febd7400640 1 -- 172.21.15.82:0/3462823122 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7febd00bd560 con 0x7febe0103b60 2024-04-26T20:19:10.361 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:10.361 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:19:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.363+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc40a3bb0 msgr2=0x7febc40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.363+0000 7febe5200640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc40a3bb0 0x7febc40a6070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febe01039c0 tx=0x7febc8005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.363+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 msgr2=0x7febe019b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.363+0000 7febe5200640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe019b2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febd0005ab0 tx=0x7febd0003b90 comp rx=0 tx=0).stop 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 shutdown_connections 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc40a3bb0 0x7febc40a6070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe0104520 0x7febe01a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe0103b60 0x7febe019b2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 --2- 172.21.15.82:0/3462823122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe0102970 0x7febe019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 >> 172.21.15.82:0/3462823122 conn(0x7febe00fdee0 msgr2=0x7febe0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 shutdown_connections 2024-04-26T20:19:10.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:10.364+0000 7febe5200640 1 -- 172.21.15.82:0/3462823122 wait complete. 2024-04-26T20:19:10.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:10 smithi135 ceph-mon[32816]: Deploying daemon mds.k on smithi135 2024-04-26T20:19:10.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:10 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3462823122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:10 smithi082 ceph-mon[28105]: Deploying daemon mds.k on smithi135 2024-04-26T20:19:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:10 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3462823122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:11.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:10 smithi139 ceph-mon[32999]: Deploying daemon mds.k on smithi135 2024-04-26T20:19:11.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:10 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3462823122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:11.772 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:11 smithi135 ceph-mon[32816]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:11 smithi082 ceph-mon[28105]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:11 smithi139 ceph-mon[32999]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:12.119 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:11 smithi135 systemd[1]: Starting Ceph mds.k for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:12.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:12.437 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 podman[61374]: 2024-04-26 20:19:12.07636014 +0000 UTC m=+0.018228403 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:12.437 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 podman[61374]: 2024-04-26 20:19:12.200827558 +0000 UTC m=+0.142695821 container create f1e9e05b8c3b45d604247a5062921bc030c452f0d850131ca17cfcb659a620bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T20:19:12.437 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 podman[61374]: 2024-04-26 20:19:12.437465094 +0000 UTC m=+0.379333359 container init f1e9e05b8c3b45d604247a5062921bc030c452f0d850131ca17cfcb659a620bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 -- 172.21.15.82:0/2857424846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484103960 msgr2=0x7fb484103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 --2- 172.21.15.82:0/2857424846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484103960 0x7fb484103de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb470009900 tx=0x7fb47002a410 comp rx=0 tx=0).stop 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 -- 172.21.15.82:0/2857424846 shutdown_connections 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 --2- 172.21.15.82:0/2857424846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484104320 0x7fb48410abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 --2- 172.21.15.82:0/2857424846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484103960 0x7fb484103de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 --2- 172.21.15.82:0/2857424846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb484102770 0x7fb484102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 -- 172.21.15.82:0/2857424846 >> 172.21.15.82:0/2857424846 conn(0x7fb4840fdcc0 msgr2=0x7fb484100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 -- 172.21.15.82:0/2857424846 shutdown_connections 2024-04-26T20:19:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.597+0000 7fb48a600640 1 -- 172.21.15.82:0/2857424846 wait complete. 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.598+0000 7fb48a600640 1 Processor -- start 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.598+0000 7fb48a600640 1 -- start start 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb48a600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 0x7fb4841989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb48a600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb484103960 0x7fb484198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb48a600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484104320 0x7fb48419ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb48a600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb48410e2d0 con 0x7fb484104320 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb48a600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb48410e150 con 0x7fb484102770 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb48a600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb48410e450 con 0x7fb484103960 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 0x7fb4841989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb483e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb484103960 0x7fb484198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 0x7fb4841989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32888/0 (socket says 172.21.15.82:32888) 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 -- 172.21.15.82:0/1785522468 learned_addr learned my addr 172.21.15.82:0/1785522468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489c00640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484104320 0x7fb48419ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 -- 172.21.15.82:0/1785522468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb484103960 msgr2=0x7fb484198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb484103960 0x7fb484198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 -- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484104320 msgr2=0x7fb48419ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.599+0000 7fb489200640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484104320 0x7fb48419ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb489200640 1 -- 172.21.15.82:0/1785522468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4841a0570 con 0x7fb484102770 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb489200640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 0x7fb4841989a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb47800e9c0 tx=0x7fb47800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47800ccc0 con 0x7fb484102770 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4780035f0 con 0x7fb484102770 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47800ce60 con 0x7fb484102770 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4841a0860 con 0x7fb484102770 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.600+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4841a0dd0 con 0x7fb484102770 2024-04-26T20:19:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.602+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb484069670 con 0x7fb484102770 2024-04-26T20:19:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.603+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb478004020 con 0x7fb484102770 2024-04-26T20:19:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.604+0000 7fb481600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.605+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb4780d0320 con 0x7fb484102770 2024-04-26T20:19:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.605+0000 7fb483e00640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.605+0000 7fb483e00640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb470031500 tx=0x7fb470005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.610+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb47809d100 con 0x7fb484102770 2024-04-26T20:19:12.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.862+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb484109a90 con 0x7fb484102770 2024-04-26T20:19:12.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.863+0000 7fb481600640 1 -- 172.21.15.82:0/1785522468 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7fb484109a90 con 0x7fb484102770 2024-04-26T20:19:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:12.863 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:19:12.864 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-04-26T20:19:12.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 msgr2=0x7fb46c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb470031500 tx=0x7fb470005a20 comp rx=0 tx=0).stop 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 msgr2=0x7fb4841989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 0x7fb4841989a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb47800e9c0 tx=0x7fb47800edc0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 shutdown_connections 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb484104320 0x7fb48419ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb484103960 0x7fb484198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 --2- 172.21.15.82:0/1785522468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb484102770 0x7fb4841989a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 >> 172.21.15.82:0/1785522468 conn(0x7fb4840fdcc0 msgr2=0x7fb484106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 shutdown_connections 2024-04-26T20:19:12.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:12.866+0000 7fb48a600640 1 -- 172.21.15.82:0/1785522468 wait complete. 2024-04-26T20:19:12.868 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 podman[61374]: 2024-04-26 20:19:12.440047232 +0000 UTC m=+0.381915497 container start f1e9e05b8c3b45d604247a5062921bc030c452f0d850131ca17cfcb659a620bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T20:19:12.868 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 ceph-mds[61393]: -- 172.21.15.135:0/3179438530 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578458dda40 con 0x5578458b1000 2024-04-26T20:19:12.869 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: starting mds.k at 2024-04-26T20:19:12.869 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 bash[61374]: f1e9e05b8c3b45d604247a5062921bc030c452f0d850131ca17cfcb659a620bb 2024-04-26T20:19:12.869 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:19:12 smithi135 systemd[1]: Started Ceph mds.k for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: Deploying daemon mds.j on smithi082 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6832/3324936648,v1:172.21.15.135:6833/3324936648] up:boot 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: fsmap 2 up:standby 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:19:13.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:13 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1785522468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:13.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: Deploying daemon mds.j on smithi082 2024-04-26T20:19:13.865 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6832/3324936648,v1:172.21.15.135:6833/3324936648] up:boot 2024-04-26T20:19:13.865 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: fsmap 2 up:standby 2024-04-26T20:19:13.865 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:19:13.865 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:13 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1785522468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: Deploying daemon mds.j on smithi082 2024-04-26T20:19:14.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6832/3324936648,v1:172.21.15.135:6833/3324936648] up:boot 2024-04-26T20:19:14.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: fsmap 2 up:standby 2024-04-26T20:19:14.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:19:14.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:13 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1785522468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:14.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:15.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 -- 172.21.15.82:0/3208975613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60105d20 msgr2=0x7feb60108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 --2- 172.21.15.82:0/3208975613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60105d20 0x7feb60108110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009900 tx=0x7feb4c02a410 comp rx=0 tx=0).stop 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 -- 172.21.15.82:0/3208975613 shutdown_connections 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 --2- 172.21.15.82:0/3208975613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb60108650 0x7feb6010aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 --2- 172.21.15.82:0/3208975613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60105d20 0x7feb60108110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 --2- 172.21.15.82:0/3208975613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb601057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 -- 172.21.15.82:0/3208975613 >> 172.21.15.82:0/3208975613 conn(0x7feb600fcde0 msgr2=0x7feb600ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 -- 172.21.15.82:0/3208975613 shutdown_connections 2024-04-26T20:19:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.117+0000 7feb67600640 1 -- 172.21.15.82:0/3208975613 wait complete. 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 Processor -- start 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 -- start start 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb6019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb60105d20 0x7feb6019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60108650 0x7feb601a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feb6010e4f0 con 0x7feb60108650 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb6010e370 con 0x7feb601033f0 2024-04-26T20:19:15.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb67600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feb6010e670 con 0x7feb60105d20 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.118+0000 7feb64c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb6019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb6019adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32906/0 (socket says 172.21.15.82:32906) 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 -- 172.21.15.82:0/3003029850 learned_addr learned my addr 172.21.15.82:0/3003029850 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb65600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60108650 0x7feb601a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb5fe00640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb60105d20 0x7feb6019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 -- 172.21.15.82:0/3003029850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb60105d20 msgr2=0x7feb6019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb60105d20 0x7feb6019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 -- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60108650 msgr2=0x7feb601a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60108650 0x7feb601a2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 -- 172.21.15.82:0/3003029850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb601a29e0 con 0x7feb601033f0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb64c00640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb6019adc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb5400ea60 tx=0x7feb5400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5400cde0 con 0x7feb601033f0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.119+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb540035f0 con 0x7feb601033f0 2024-04-26T20:19:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.120+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb601a2cd0 con 0x7feb601033f0 2024-04-26T20:19:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.120+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54010690 con 0x7feb601033f0 2024-04-26T20:19:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.120+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb601a31a0 con 0x7feb601033f0 2024-04-26T20:19:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.121+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6010a1a0 con 0x7feb601033f0 2024-04-26T20:19:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.122+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7feb540037a0 con 0x7feb601033f0 2024-04-26T20:19:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.124+0000 7feb5d600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb480a3bb0 0x7feb480a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.124+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7feb540d0340 con 0x7feb601033f0 2024-04-26T20:19:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.124+0000 7feb5fe00640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb480a3bb0 0x7feb480a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.125+0000 7feb5fe00640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb480a3bb0 0x7feb480a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb4c006010 tx=0x7feb4c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.128+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7feb5409d120 con 0x7feb601033f0 2024-04-26T20:19:15.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.391+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb6002dad0 con 0x7feb601033f0 2024-04-26T20:19:15.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.392+0000 7feb5d600640 1 -- 172.21.15.82:0/3003029850 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7feb5409ca20 con 0x7feb601033f0 2024-04-26T20:19:15.393 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:15.393 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:19:15.393 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb480a3bb0 msgr2=0x7feb480a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb480a3bb0 0x7feb480a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb4c006010 tx=0x7feb4c0314a0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 msgr2=0x7feb6019adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb6019adc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb5400ea60 tx=0x7feb5400ef20 comp rx=0 tx=0).stop 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 shutdown_connections 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb480a3bb0 0x7feb480a6070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb60108650 0x7feb601a2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb60105d20 0x7feb6019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 --2- 172.21.15.82:0/3003029850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb601033f0 0x7feb6019adc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 >> 172.21.15.82:0/3003029850 conn(0x7feb600fcde0 msgr2=0x7feb60102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:15.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.395+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 shutdown_connections 2024-04-26T20:19:15.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:15.396+0000 7feb67600640 1 -- 172.21.15.82:0/3003029850 wait complete. 2024-04-26T20:19:15.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:15 smithi139 ceph-mon[32999]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:15.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:15 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3003029850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:15.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:15 smithi135 ceph-mon[32816]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:15.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:15 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3003029850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:15 smithi082 ceph-mon[28105]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:15 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3003029850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:16.276 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 podman[68800]: 2024-04-26 20:19:16.004827389 +0000 UTC m=+0.168133769 container create 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T20:19:16.277 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 podman[68800]: 2024-04-26 20:19:16.275341819 +0000 UTC m=+0.438648206 container init 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T20:19:16.687 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 podman[68800]: 2024-04-26 20:19:16.285157011 +0000 UTC m=+0.448463368 container start 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:19:16.687 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 ceph-mds[68819]: -- 172.21.15.82:0/921748096 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c760971a40 con 0x55c760944c00 2024-04-26T20:19:16.687 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j[68815]: starting mds.j at 2024-04-26T20:19:16.687 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 bash[68800]: 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 2024-04-26T20:19:16.687 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:19:16 smithi082 systemd[1]: Started Ceph mds.j for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:17.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:17.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 -- 172.21.15.82:0/4042879063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb810a180 msgr2=0x7febb810a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 --2- 172.21.15.82:0/4042879063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb810a180 0x7febb810a600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feba0009900 tx=0x7feba002a410 comp rx=0 tx=0).stop 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 -- 172.21.15.82:0/4042879063 shutdown_connections 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 --2- 172.21.15.82:0/4042879063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb810ab40 0x7febb81113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 --2- 172.21.15.82:0/4042879063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb810a180 0x7febb810a600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 --2- 172.21.15.82:0/4042879063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb8108f90 0x7febb81093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 -- 172.21.15.82:0/4042879063 >> 172.21.15.82:0/4042879063 conn(0x7febb8077f40 msgr2=0x7febb807a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 -- 172.21.15.82:0/4042879063 shutdown_connections 2024-04-26T20:19:17.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.606+0000 7febbd200640 1 -- 172.21.15.82:0/4042879063 wait complete. 2024-04-26T20:19:17.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 Processor -- start 2024-04-26T20:19:17.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 -- start start 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 0x7febb819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb810a180 0x7febb819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb810ab40 0x7febb81a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7febb8114b20 con 0x7febb8108f90 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febb81149a0 con 0x7febb810ab40 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.607+0000 7febbd200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febb8114ca0 con 0x7febb810a180 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 0x7febb819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 0x7febb819f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49116/0 (socket says 172.21.15.82:49116) 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 -- 172.21.15.82:0/4088774261 learned_addr learned my addr 172.21.15.82:0/4088774261 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb6800640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb810ab40 0x7febb81a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5400640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb810a180 0x7febb819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 -- 172.21.15.82:0/4088774261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb810a180 msgr2=0x7febb819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb810a180 0x7febb819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 -- 172.21.15.82:0/4088774261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb810ab40 msgr2=0x7febb81a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb810ab40 0x7febb81a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 -- 172.21.15.82:0/4088774261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb81a6d60 con 0x7febb8108f90 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb6800640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb810ab40 0x7febb81a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febb5e00640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 0x7febb819f140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feba800ebc0 tx=0x7feba800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8003b70 con 0x7febb8108f90 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.608+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba8003d10 con 0x7febb8108f90 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.609+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb81a6ff0 con 0x7febb8108f90 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.609+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8019800 con 0x7febb8108f90 2024-04-26T20:19:17.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.609+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb81a74b0 con 0x7febb8108f90 2024-04-26T20:19:17.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.610+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb81102b0 con 0x7febb8108f90 2024-04-26T20:19:17.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.612+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7feba80199a0 con 0x7febb8108f90 2024-04-26T20:19:17.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.613+0000 7febaea00640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb9c0a3bb0 0x7feb9c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.613+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7feba80d0930 con 0x7febb8108f90 2024-04-26T20:19:17.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.613+0000 7febb5400640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb9c0a3bb0 0x7feb9c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.614+0000 7febb5400640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb9c0a3bb0 0x7feb9c0a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feba0000c00 tx=0x7feba00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:17.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.618+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7feba809d7b0 con 0x7febb8108f90 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: Deploying daemon mds.d on smithi082 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6834/3327585570,v1:172.21.15.82:6835/3327585570] up:boot 2024-04-26T20:19:17.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: fsmap 3 up:standby 2024-04-26T20:19:17.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:17 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:19:17.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:17.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:17.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:17.848 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: Deploying daemon mds.d on smithi082 2024-04-26T20:19:17.848 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:17.848 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6834/3327585570,v1:172.21.15.82:6835/3327585570] up:boot 2024-04-26T20:19:17.848 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: fsmap 3 up:standby 2024-04-26T20:19:17.848 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:17 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:19:17.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: Deploying daemon mds.d on smithi082 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6834/3327585570,v1:172.21.15.82:6835/3327585570] up:boot 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: fsmap 3 up:standby 2024-04-26T20:19:17.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:17 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:19:17.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.868+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febb802dad0 con 0x7febb8108f90 2024-04-26T20:19:17.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.870+0000 7febaea00640 1 -- 172.21.15.82:0/4088774261 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7feba809d0b0 con 0x7febb8108f90 2024-04-26T20:19:17.870 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:17.870 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-26T20:19:17.871 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 4 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb9c0a3bb0 msgr2=0x7feb9c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb9c0a3bb0 0x7feb9c0a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feba0000c00 tx=0x7feba00314a0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 msgr2=0x7febb819f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 0x7febb819f140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feba800ebc0 tx=0x7feba800c6a0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 shutdown_connections 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7feb9c0a3bb0 0x7feb9c0a6070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb810ab40 0x7febb81a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb810a180 0x7febb819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 --2- 172.21.15.82:0/4088774261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febb8108f90 0x7febb819f140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.872+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 >> 172.21.15.82:0/4088774261 conn(0x7febb8077f40 msgr2=0x7febb810d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.873+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 shutdown_connections 2024-04-26T20:19:17.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:17.873+0000 7febbd200640 1 -- 172.21.15.82:0/4088774261 wait complete. 2024-04-26T20:19:18.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:18 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4088774261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:18.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:18 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4088774261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:18.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:18 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4088774261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:19.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:19 smithi139 ceph-mon[32999]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:19.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:19 smithi135 ceph-mon[32816]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:19.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:19.928 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:19 smithi082 ceph-mon[28105]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:19.929 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:19 smithi082 systemd[1]: Starting Ceph mds.d for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:20.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 -- 172.21.15.82:0/835062173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948102860 msgr2=0x7fd948102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 --2- 172.21.15.82:0/835062173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948102860 0x7fd948102ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd934009900 tx=0x7fd93402a410 comp rx=0 tx=0).stop 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 -- 172.21.15.82:0/835062173 shutdown_connections 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 --2- 172.21.15.82:0/835062173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd948103220 0x7fd948109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 --2- 172.21.15.82:0/835062173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948102860 0x7fd948102ce0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 --2- 172.21.15.82:0/835062173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948101670 0x7fd948101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 -- 172.21.15.82:0/835062173 >> 172.21.15.82:0/835062173 conn(0x7fd9480fcbc0 msgr2=0x7fd9480ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 -- 172.21.15.82:0/835062173 shutdown_connections 2024-04-26T20:19:20.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.093+0000 7fd94de00640 1 -- 172.21.15.82:0/835062173 wait complete. 2024-04-26T20:19:20.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.094+0000 7fd94de00640 1 Processor -- start 2024-04-26T20:19:20.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.094+0000 7fd94de00640 1 -- start start 2024-04-26T20:19:20.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948101670 0x7fd94819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd948102860 0x7fd94819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948103220 0x7fd9481a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94de00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd94810d190 con 0x7fd948101670 2024-04-26T20:19:20.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94de00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd94810d010 con 0x7fd948102860 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94de00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd94810d310 con 0x7fd948103220 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948101670 0x7fd94819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948103220 0x7fd9481a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948101670 0x7fd94819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49144/0 (socket says 172.21.15.82:49144) 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd94ca00640 1 -- 172.21.15.82:0/246332496 learned_addr learned my addr 172.21.15.82:0/246332496 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.095+0000 7fd947e00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd948102860 0x7fd94819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94d400640 1 -- 172.21.15.82:0/246332496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd948102860 msgr2=0x7fd94819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94d400640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd948102860 0x7fd94819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94d400640 1 -- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948101670 msgr2=0x7fd94819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94d400640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948101670 0x7fd94819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94d400640 1 -- 172.21.15.82:0/246332496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9481a2770 con 0x7fd948103220 2024-04-26T20:19:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94d400640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948103220 0x7fd9481a2100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd940009fd0 tx=0x7fd94000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94000ce20 con 0x7fd948103220 2024-04-26T20:19:20.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd940005020 con 0x7fd948103220 2024-04-26T20:19:20.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940010690 con 0x7fd948103220 2024-04-26T20:19:20.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.096+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9481a2a60 con 0x7fd948103220 2024-04-26T20:19:20.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.097+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9481a2f30 con 0x7fd948103220 2024-04-26T20:19:20.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.098+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9481a3220 con 0x7fd948103220 2024-04-26T20:19:20.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.101+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fd9400054d0 con 0x7fd948103220 2024-04-26T20:19:20.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.103+0000 7fd945600640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9300a3bb0 0x7fd9300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.103+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd9400d0b00 con 0x7fd948103220 2024-04-26T20:19:20.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.103+0000 7fd94ca00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9300a3bb0 0x7fd9300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.104+0000 7fd94ca00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9300a3bb0 0x7fd9300a6070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0058c0 tx=0x7fd93c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.104+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd94009d8e0 con 0x7fd948103220 2024-04-26T20:19:20.188 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:19 smithi082 podman[69145]: 2024-04-26 20:19:19.832872022 +0000 UTC m=+0.034089472 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:20.188 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:19 smithi082 podman[69145]: 2024-04-26 20:19:19.944290094 +0000 UTC m=+0.145507545 container create f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:19:20.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.354+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9481a38e0 con 0x7fd948103220 2024-04-26T20:19:20.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.355+0000 7fd945600640 1 -- 172.21.15.82:0/246332496 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7fd9400cee20 con 0x7fd948103220 2024-04-26T20:19:20.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:20.356 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-26T20:19:20.356 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 4 2024-04-26T20:19:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9300a3bb0 msgr2=0x7fd9300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9300a3bb0 0x7fd9300a6070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0058c0 tx=0x7fd93c005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948103220 msgr2=0x7fd9481a2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948103220 0x7fd9481a2100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd940009fd0 tx=0x7fd94000ef10 comp rx=0 tx=0).stop 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 shutdown_connections 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9300a3bb0 0x7fd9300a6070 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd948103220 0x7fd9481a2100 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd948102860 0x7fd94819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 --2- 172.21.15.82:0/246332496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd948101670 0x7fd94819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 >> 172.21.15.82:0/246332496 conn(0x7fd9480fcbc0 msgr2=0x7fd948069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 shutdown_connections 2024-04-26T20:19:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:20.358+0000 7fd94de00640 1 -- 172.21.15.82:0/246332496 wait complete. 2024-04-26T20:19:20.533 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:20 smithi082 podman[69145]: 2024-04-26 20:19:20.223859948 +0000 UTC m=+0.425077445 container init f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True) 2024-04-26T20:19:20.533 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:20 smithi082 podman[69145]: 2024-04-26 20:19:20.234857753 +0000 UTC m=+0.436075246 container start f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:19:20.534 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:20 smithi082 ceph-mds[69203]: -- 172.21.15.82:0/2970337777 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556098901a40 con 0x5560988d4c00 2024-04-26T20:19:20.534 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d[69190]: starting mds.d at 2024-04-26T20:19:20.534 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:20 smithi082 bash[69145]: f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 2024-04-26T20:19:20.534 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:19:20 smithi082 systemd[1]: Started Ceph mds.d for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:20.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:20 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/246332496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:20.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:20.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:20.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:20 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/246332496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:20.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:20.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:20 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/246332496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6836/4285824325,v1:172.21.15.82:6837/4285824325] up:boot 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: fsmap 4 up:standby 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:21.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:21.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:21 smithi139 ceph-mon[32999]: Deploying daemon mds.e on smithi135 2024-04-26T20:19:21.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6836/4285824325,v1:172.21.15.82:6837/4285824325] up:boot 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: fsmap 4 up:standby 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:21.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:21 smithi135 ceph-mon[32816]: Deploying daemon mds.e on smithi135 2024-04-26T20:19:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6836/4285824325,v1:172.21.15.82:6837/4285824325] up:boot 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: fsmap 4 up:standby 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:21 smithi082 ceph-mon[28105]: Deploying daemon mds.e on smithi135 2024-04-26T20:19:22.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:22.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.589+0000 7f4a1c400640 1 -- 172.21.15.82:0/836073168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 msgr2=0x7f4a141113d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.589+0000 7f4a1c400640 1 --2- 172.21.15.82:0/836073168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 0x7f4a141113d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009ca0 tx=0x7f4a0c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 -- 172.21.15.82:0/836073168 shutdown_connections 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 --2- 172.21.15.82:0/836073168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 0x7f4a141113d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 --2- 172.21.15.82:0/836073168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a1410a180 0x7f4a1410a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 --2- 172.21.15.82:0/836073168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a14108f90 0x7f4a141093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 -- 172.21.15.82:0/836073168 >> 172.21.15.82:0/836073168 conn(0x7f4a14077f40 msgr2=0x7f4a1407a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 -- 172.21.15.82:0/836073168 shutdown_connections 2024-04-26T20:19:22.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.590+0000 7f4a1c400640 1 -- 172.21.15.82:0/836073168 wait complete. 2024-04-26T20:19:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.591+0000 7f4a1c400640 1 Processor -- start 2024-04-26T20:19:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.591+0000 7f4a1c400640 1 -- start start 2024-04-26T20:19:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1c400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 0x7f4a1419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1c400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1410a180 0x7f4a1419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1c400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 0x7f4a141a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1c400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14114ad0 con 0x7f4a14108f90 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1c400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14114950 con 0x7f4a1410ab40 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1c400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14114c50 con 0x7f4a1410a180 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 0x7f4a1419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 0x7f4a1419f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57692/0 (socket says 172.21.15.82:57692) 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 -- 172.21.15.82:0/840737134 learned_addr learned my addr 172.21.15.82:0/840737134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a1a400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 0x7f4a141a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19000640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1410a180 0x7f4a1419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 -- 172.21.15.82:0/840737134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1410a180 msgr2=0x7f4a1419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1410a180 0x7f4a1419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 -- 172.21.15.82:0/840737134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 msgr2=0x7f4a141a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 0x7f4a141a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.592+0000 7f4a19a00640 1 -- 172.21.15.82:0/840737134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a141a6d40 con 0x7f4a14108f90 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.593+0000 7f4a19a00640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 0x7f4a1419f120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800e9c0 tx=0x7f4a0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.593+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800cd80 con 0x7f4a14108f90 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.593+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a080035f0 con 0x7f4a14108f90 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.593+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a141a6fd0 con 0x7f4a14108f90 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.593+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08010690 con 0x7f4a14108f90 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.593+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a141a7490 con 0x7f4a14108f90 2024-04-26T20:19:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.594+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a141102b0 con 0x7f4a14108f90 2024-04-26T20:19:22.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.596+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4a08004000 con 0x7f4a14108f90 2024-04-26T20:19:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.597+0000 7f4a12000640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49fc0a3c30 0x7f49fc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.598+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f4a080d04a0 con 0x7f4a14108f90 2024-04-26T20:19:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.598+0000 7f4a19000640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49fc0a3c30 0x7f49fc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.599+0000 7f4a19000640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49fc0a3c30 0x7f49fc0a60f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a000095f0 tx=0x7f4a00005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.602+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4a0809d280 con 0x7f4a14108f90 2024-04-26T20:19:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.845+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a1402dad0 con 0x7f4a14108f90 2024-04-26T20:19:22.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.846+0000 7f4a12000640 1 -- 172.21.15.82:0/840737134 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f4a0809cb80 con 0x7f4a14108f90 2024-04-26T20:19:22.847 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:22.847 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-26T20:19:22.847 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.848+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49fc0a3c30 msgr2=0x7f49fc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.848+0000 7f4a1c400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49fc0a3c30 0x7f49fc0a60f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a000095f0 tx=0x7f4a00005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.848+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 msgr2=0x7f4a1419f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.848+0000 7f4a1c400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 0x7f4a1419f120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800e9c0 tx=0x7f4a0800ee80 comp rx=0 tx=0).stop 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.848+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 shutdown_connections 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49fc0a3c30 0x7f49fc0a60f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1410ab40 0x7f4a141a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a1410a180 0x7f4a1419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 --2- 172.21.15.82:0/840737134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a14108f90 0x7f4a1419f120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 >> 172.21.15.82:0/840737134 conn(0x7f4a14077f40 msgr2=0x7f4a1410d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:22.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 shutdown_connections 2024-04-26T20:19:22.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:22.849+0000 7f4a1c400640 1 -- 172.21.15.82:0/840737134 wait complete. 2024-04-26T20:19:23.044 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:22 smithi135 systemd[1]: Starting Ceph mds.e for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:23.369 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 podman[61692]: 2024-04-26 20:19:22.94635026 +0000 UTC m=+0.018064506 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:23.369 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 podman[61692]: 2024-04-26 20:19:23.143708381 +0000 UTC m=+0.215422663 container create c276d3a6c065c8b1c1398edeff684ccbbeca2ce0bfbc6c3dcc4389d6f7c01cd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T20:19:23.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/840737134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 podman[61692]: 2024-04-26 20:19:23.393310791 +0000 UTC m=+0.465025027 container init c276d3a6c065c8b1c1398edeff684ccbbeca2ce0bfbc6c3dcc4389d6f7c01cd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-26T20:19:23.870 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 podman[61692]: 2024-04-26 20:19:23.396024377 +0000 UTC m=+0.467738621 container start c276d3a6c065c8b1c1398edeff684ccbbeca2ce0bfbc6c3dcc4389d6f7c01cd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T20:19:23.871 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-mds[61711]: -- 172.21.15.135:0/2700159405 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561325cd7a40 con 0x561325caa800 2024-04-26T20:19:23.871 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e[61707]: starting mds.e at 2024-04-26T20:19:23.871 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 bash[61692]: c276d3a6c065c8b1c1398edeff684ccbbeca2ce0bfbc6c3dcc4389d6f7c01cd2 2024-04-26T20:19:23.871 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:19:23 smithi135 systemd[1]: Started Ceph mds.e for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/840737134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:23.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:23 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/840737134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:23 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:24.868 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:24 smithi082 ceph-mon[28105]: Deploying daemon mds.f on smithi139 2024-04-26T20:19:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:24 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6834/1988909695,v1:172.21.15.135:6835/1988909695] up:boot 2024-04-26T20:19:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:24 smithi082 ceph-mon[28105]: fsmap 5 up:standby 2024-04-26T20:19:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:24 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:19:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:24 smithi139 ceph-mon[32999]: Deploying daemon mds.f on smithi139 2024-04-26T20:19:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:24 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6834/1988909695,v1:172.21.15.135:6835/1988909695] up:boot 2024-04-26T20:19:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:24 smithi139 ceph-mon[32999]: fsmap 5 up:standby 2024-04-26T20:19:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:24 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:19:25.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 -- 172.21.15.82:0/1305014763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 msgr2=0x7f0998106000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:25.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 --2- 172.21.15.82:0/1305014763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 0x7f0998106000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0984009900 tx=0x7f098402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 -- 172.21.15.82:0/1305014763 shutdown_connections 2024-04-26T20:19:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 --2- 172.21.15.82:0/1305014763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998106540 0x7f099810cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 --2- 172.21.15.82:0/1305014763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 0x7f0998106000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 --2- 172.21.15.82:0/1305014763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0998104990 0x7f0998104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 -- 172.21.15.82:0/1305014763 >> 172.21.15.82:0/1305014763 conn(0x7f09980fff00 msgr2=0x7f0998102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 -- 172.21.15.82:0/1305014763 shutdown_connections 2024-04-26T20:19:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.072+0000 7f0997200640 1 -- 172.21.15.82:0/1305014763 wait complete. 2024-04-26T20:19:25.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.073+0000 7f0997200640 1 Processor -- start 2024-04-26T20:19:25.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.073+0000 7f0997200640 1 -- start start 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0997200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 0x7f099819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0997200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 0x7f099819b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0997200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0998106540 0x7f09981a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0997200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09981104a0 con 0x7f0998104990 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0997200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0998110320 con 0x7f0998106540 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0997200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0998110620 con 0x7f0998105b80 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 0x7f099819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 0x7f099819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57710/0 (socket says 172.21.15.82:57710) 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 -- 172.21.15.82:0/2588076734 learned_addr learned my addr 172.21.15.82:0/2588076734 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995400640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 0x7f099819b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0996800640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0998106540 0x7f09981a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:25.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 -- 172.21.15.82:0/2588076734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 msgr2=0x7f099819b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 0x7f099819b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 -- 172.21.15.82:0/2588076734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0998106540 msgr2=0x7f09981a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0998106540 0x7f09981a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.074+0000 7f0995e00640 1 -- 172.21.15.82:0/2588076734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09981a2760 con 0x7f0998104990 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.075+0000 7f0995e00640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 0x7f099819ab40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f098800d770 tx=0x7f098800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.075+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988017070 con 0x7f0998104990 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.075+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0988009c30 con 0x7f0998104990 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.075+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988003c90 con 0x7f0998104990 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.075+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09981a2a50 con 0x7f0998104990 2024-04-26T20:19:25.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.075+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09981a2f70 con 0x7f0998104990 2024-04-26T20:19:25.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.077+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099810bd30 con 0x7f0998104990 2024-04-26T20:19:25.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.080+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0988003e30 con 0x7f0998104990 2024-04-26T20:19:25.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.082+0000 7f098ea00640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f097c0a3bb0 0x7f097c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:25.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.082+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f09880cfcc0 con 0x7f0998104990 2024-04-26T20:19:25.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.082+0000 7f0995400640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f097c0a3bb0 0x7f097c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:25.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.083+0000 7f0995400640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f097c0a3bb0 0x7f097c0a6070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0984000c00 tx=0x7f09840314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:25.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.085+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0988009de0 con 0x7f0998104990 2024-04-26T20:19:25.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:24 smithi135 ceph-mon[32816]: Deploying daemon mds.f on smithi139 2024-04-26T20:19:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:24 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6834/1988909695,v1:172.21.15.135:6835/1988909695] up:boot 2024-04-26T20:19:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:24 smithi135 ceph-mon[32816]: fsmap 5 up:standby 2024-04-26T20:19:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:24 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:19:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.326+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f099802dad0 con 0x7f0998104990 2024-04-26T20:19:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.327+0000 7f098ea00640 1 -- 172.21.15.82:0/2588076734 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7f098809c450 con 0x7f0998104990 2024-04-26T20:19:25.328 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:25.328 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-26T20:19:25.328 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2024-04-26T20:19:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.329+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f097c0a3bb0 msgr2=0x7f097c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.329+0000 7f0997200640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f097c0a3bb0 0x7f097c0a6070 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0984000c00 tx=0x7f09840314a0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.329+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 msgr2=0x7f099819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.329+0000 7f0997200640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 0x7f099819ab40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f098800d770 tx=0x7f098800dc30 comp rx=0 tx=0).stop 2024-04-26T20:19:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 shutdown_connections 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f097c0a3bb0 0x7f097c0a6070 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0998106540 0x7f09981a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0998105b80 0x7f099819b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 --2- 172.21.15.82:0/2588076734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0998104990 0x7f099819ab40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 >> 172.21.15.82:0/2588076734 conn(0x7f09980fff00 msgr2=0x7f0998108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 shutdown_connections 2024-04-26T20:19:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:25.330+0000 7f0997200640 1 -- 172.21.15.82:0/2588076734 wait complete. 2024-04-26T20:19:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:25 smithi082 ceph-mon[28105]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:25 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2588076734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:26.052 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:25 smithi139 ceph-mon[32999]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:26.052 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:25 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2588076734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:26.053 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:25 smithi139 systemd[1]: Starting Ceph mds.f for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:26.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:25 smithi135 ceph-mon[32816]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:26.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:25 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2588076734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:26.322 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 podman[63104]: 2024-04-26 20:19:25.955458391 +0000 UTC m=+0.018151664 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:26.322 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 podman[63104]: 2024-04-26 20:19:26.093222355 +0000 UTC m=+0.155915614 container create 5d0aaa22b1a820b06dd47516035a004c05ea5a31d9e74a1175fd8e2f00256a43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:19:26.821 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 podman[63104]: 2024-04-26 20:19:26.346294387 +0000 UTC m=+0.408987649 container init 5d0aaa22b1a820b06dd47516035a004c05ea5a31d9e74a1175fd8e2f00256a43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T20:19:26.821 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 podman[63104]: 2024-04-26 20:19:26.348861822 +0000 UTC m=+0.411555082 container start 5d0aaa22b1a820b06dd47516035a004c05ea5a31d9e74a1175fd8e2f00256a43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-04-26T20:19:26.821 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 ceph-mds[63123]: -- 172.21.15.139:0/551178073 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f6926da40 con 0x559f69240800 2024-04-26T20:19:26.821 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f[63119]: starting mds.f at 2024-04-26T20:19:26.821 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 bash[63104]: 5d0aaa22b1a820b06dd47516035a004c05ea5a31d9e74a1175fd8e2f00256a43 2024-04-26T20:19:26.821 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:19:26 smithi139 systemd[1]: Started Ceph mds.f for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:27.350 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.559+0000 7f33e4400640 1 -- 172.21.15.82:0/3615666218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc1011d0 msgr2=0x7f33dc1015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.559+0000 7f33e4400640 1 --2- 172.21.15.82:0/3615666218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc1011d0 0x7f33dc1015f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009900 tx=0x7f33d002a410 comp rx=0 tx=0).stop 2024-04-26T20:19:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 -- 172.21.15.82:0/3615666218 shutdown_connections 2024-04-26T20:19:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 --2- 172.21.15.82:0/3615666218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 0x7f33dc102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 --2- 172.21.15.82:0/3615666218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc101b30 0x7f33dc101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 --2- 172.21.15.82:0/3615666218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc1011d0 0x7f33dc1015f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 -- 172.21.15.82:0/3615666218 >> 172.21.15.82:0/3615666218 conn(0x7f33dc0fcdd0 msgr2=0x7f33dc0ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 -- 172.21.15.82:0/3615666218 shutdown_connections 2024-04-26T20:19:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.560+0000 7f33e4400640 1 -- 172.21.15.82:0/3615666218 wait complete. 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 Processor -- start 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 -- start start 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc1011d0 0x7f33dc19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc101b30 0x7f33dc19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 0x7f33dc1a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc110650 con 0x7f33dc1011d0 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc1104d0 con 0x7f33dc1024d0 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e4400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc1107d0 con 0x7f33dc101b30 2024-04-26T20:19:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.561+0000 7f33e1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc1011d0 0x7f33dc19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 0x7f33dc1a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e1000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc101b30 0x7f33dc19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc1011d0 0x7f33dc19ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57730/0 (socket says 172.21.15.82:57730) 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e1a00640 1 -- 172.21.15.82:0/574467803 learned_addr learned my addr 172.21.15.82:0/574467803 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 -- 172.21.15.82:0/574467803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc101b30 msgr2=0x7f33dc19b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc101b30 0x7f33dc19b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 -- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc1011d0 msgr2=0x7f33dc19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc1011d0 0x7f33dc19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 -- 172.21.15.82:0/574467803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc1a2960 con 0x7f33dc1024d0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33e2400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 0x7f33dc1a22c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009fd0 tx=0x7f33d400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.562+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d400ce20 con 0x7f33dc1024d0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.563+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33d4005020 con 0x7f33dc1024d0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.563+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc1a2c50 con 0x7f33dc1024d0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.563+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4010690 con 0x7f33dc1024d0 2024-04-26T20:19:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.563+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc1a31a0 con 0x7f33dc1024d0 2024-04-26T20:19:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.564+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33dc10c160 con 0x7f33dc1024d0 2024-04-26T20:19:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.565+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f33d40054d0 con 0x7f33dc1024d0 2024-04-26T20:19:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.567+0000 7f33da000640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33c40a3c30 0x7f33c40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.567+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f33d40d0700 con 0x7f33dc1024d0 2024-04-26T20:19:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.567+0000 7f33e1a00640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33c40a3c30 0x7f33c40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:27.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.568+0000 7f33e1a00640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33c40a3c30 0x7f33c40a60f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33dc19c220 tx=0x7f33d00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.571+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f33d409d4e0 con 0x7f33dc1024d0 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: Deploying daemon mds.c on smithi139 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6834/2462659708,v1:172.21.15.139:6835/2462659708] up:boot 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: fsmap 6 up:standby 2024-04-26T20:19:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:27 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:19:27.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.814+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33dc063530 con 0x7f33dc1024d0 2024-04-26T20:19:27.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.815+0000 7f33da000640 1 -- 172.21.15.82:0/574467803 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7f33d409cde0 con 0x7f33dc1024d0 2024-04-26T20:19:27.816 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:27.816 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-26T20:19:27.817 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33c40a3c30 msgr2=0x7f33c40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33c40a3c30 0x7f33c40a60f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33dc19c220 tx=0x7f33d00058d0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 msgr2=0x7f33dc1a22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 0x7f33dc1a22c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009fd0 tx=0x7f33d400ef10 comp rx=0 tx=0).stop 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 shutdown_connections 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33c40a3c30 0x7f33c40a60f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33dc1024d0 0x7f33dc1a22c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33dc101b30 0x7f33dc19b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 --2- 172.21.15.82:0/574467803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc1011d0 0x7f33dc19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 >> 172.21.15.82:0/574467803 conn(0x7f33dc0fcdd0 msgr2=0x7f33dc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 shutdown_connections 2024-04-26T20:19:27.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:27.818+0000 7f33e4400640 1 -- 172.21.15.82:0/574467803 wait complete. 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: Deploying daemon mds.c on smithi139 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6834/2462659708,v1:172.21.15.139:6835/2462659708] up:boot 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: fsmap 6 up:standby 2024-04-26T20:19:27.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:27 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:19:27.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: Deploying daemon mds.c on smithi139 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6834/2462659708,v1:172.21.15.139:6835/2462659708] up:boot 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: fsmap 6 up:standby 2024-04-26T20:19:27.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:27 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:19:28.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:28 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/574467803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:28.821 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:28 smithi139 systemd[1]: Starting Ceph mds.c for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:28.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:28 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/574467803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:28.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:28 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/574467803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:29.241 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:28 smithi139 podman[63415]: 2024-04-26 20:19:28.956804763 +0000 UTC m=+0.110330491 container create fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T20:19:29.241 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:28 smithi139 podman[63415]: 2024-04-26 20:19:28.864709423 +0000 UTC m=+0.018235110 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:29.241 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:29 smithi139 podman[63415]: 2024-04-26 20:19:29.240771483 +0000 UTC m=+0.394297169 container init fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T20:19:29.562 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:29 smithi139 podman[63415]: 2024-04-26 20:19:29.243472348 +0000 UTC m=+0.396998045 container start fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T20:19:29.562 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mds[63434]: -- 172.21.15.139:0/1677625474 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5642370f5a40 con 0x5642370c8800 2024-04-26T20:19:29.562 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: starting mds.c at 2024-04-26T20:19:29.563 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:29 smithi139 bash[63415]: fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 2024-04-26T20:19:29.563 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:19:29 smithi139 systemd[1]: Started Ceph mds.c for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:29.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:29 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:29.839 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:29.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:29.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:29.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:29.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:29 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:29.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:29.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:29.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:29.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:29.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:29 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:30.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.052+0000 7fa457200640 1 -- 172.21.15.82:0/3556783240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458108d90 msgr2=0x7fa4581091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:30.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.052+0000 7fa457200640 1 --2- 172.21.15.82:0/3556783240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458108d90 0x7fa4581091b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa448009900 tx=0x7fa44802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.052+0000 7fa457200640 1 -- 172.21.15.82:0/3556783240 shutdown_connections 2024-04-26T20:19:30.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.052+0000 7fa457200640 1 --2- 172.21.15.82:0/3556783240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45810a940 0x7fa4581111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.053+0000 7fa457200640 1 --2- 172.21.15.82:0/3556783240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa458109f80 0x7fa45810a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.053+0000 7fa457200640 1 --2- 172.21.15.82:0/3556783240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458108d90 0x7fa4581091b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.053+0000 7fa457200640 1 -- 172.21.15.82:0/3556783240 >> 172.21.15.82:0/3556783240 conn(0x7fa458077d30 msgr2=0x7fa45807a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:30.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.053+0000 7fa457200640 1 -- 172.21.15.82:0/3556783240 shutdown_connections 2024-04-26T20:19:30.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.053+0000 7fa457200640 1 -- 172.21.15.82:0/3556783240 wait complete. 2024-04-26T20:19:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 Processor -- start 2024-04-26T20:19:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 -- start start 2024-04-26T20:19:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 0x7fa45819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458109f80 0x7fa45819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45810a940 0x7fa4581a6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa458114910 con 0x7fa458109f80 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa458114790 con 0x7fa45810a940 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa457200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa458114a90 con 0x7fa458108d90 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa455e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 0x7fa45819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa455400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458109f80 0x7fa45819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa455e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 0x7fa45819efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60930/0 (socket says 172.21.15.82:60930) 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa455e00640 1 -- 172.21.15.82:0/1541110516 learned_addr learned my addr 172.21.15.82:0/1541110516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.054+0000 7fa456800640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45810a940 0x7fa4581a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455e00640 1 -- 172.21.15.82:0/1541110516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45810a940 msgr2=0x7fa4581a6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455e00640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45810a940 0x7fa4581a6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455e00640 1 -- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458109f80 msgr2=0x7fa45819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455e00640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458109f80 0x7fa45819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455e00640 1 -- 172.21.15.82:0/1541110516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4581a6bc0 con 0x7fa458108d90 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455400640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458109f80 0x7fa45819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa455e00640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 0x7fa45819efa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa448031500 tx=0x7fa448003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44803f070 con 0x7fa458108d90 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581a6e50 con 0x7fa458108d90 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa448031c50 con 0x7fa458108d90 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.055+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448035030 con 0x7fa458108d90 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.056+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4581a72b0 con 0x7fa458108d90 2024-04-26T20:19:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.057+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa458110180 con 0x7fa458108d90 2024-04-26T20:19:30.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.059+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa448042070 con 0x7fa458108d90 2024-04-26T20:19:30.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.060+0000 7fa44ea00640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa43c0a3bb0 0x7fa43c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:30.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.060+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa4480f0d70 con 0x7fa458108d90 2024-04-26T20:19:30.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.060+0000 7fa455400640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa43c0a3bb0 0x7fa43c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:30.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.061+0000 7fa455400640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa43c0a3bb0 0x7fa43c0a6070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa4581a04b0 tx=0x7fa444005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:30.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.062+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa4480bd500 con 0x7fa458108d90 2024-04-26T20:19:30.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.306+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa45802dad0 con 0x7fa458108d90 2024-04-26T20:19:30.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.307+0000 7fa44ea00640 1 -- 172.21.15.82:0/1541110516 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7fa4480c1800 con 0x7fa458108d90 2024-04-26T20:19:30.308 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:30.308 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T20:19:30.309 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-04-26T20:19:30.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa43c0a3bb0 msgr2=0x7fa43c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:30.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa43c0a3bb0 0x7fa43c0a6070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa4581a04b0 tx=0x7fa444005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:30.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 msgr2=0x7fa45819efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:30.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 0x7fa45819efa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa448031500 tx=0x7fa448003c10 comp rx=0 tx=0).stop 2024-04-26T20:19:30.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 shutdown_connections 2024-04-26T20:19:30.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa43c0a3bb0 0x7fa43c0a6070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45810a940 0x7fa4581a6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa458109f80 0x7fa45819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 --2- 172.21.15.82:0/1541110516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa458108d90 0x7fa45819efa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 >> 172.21.15.82:0/1541110516 conn(0x7fa458077d30 msgr2=0x7fa45810d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 shutdown_connections 2024-04-26T20:19:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:30.310+0000 7fa457200640 1 -- 172.21.15.82:0/1541110516 wait complete. 2024-04-26T20:19:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:30 smithi135 ceph-mon[32816]: Deploying daemon mds.h on smithi135 2024-04-26T20:19:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:boot 2024-04-26T20:19:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:30 smithi135 ceph-mon[32816]: fsmap 7 up:standby 2024-04-26T20:19:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:19:30.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:30 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1541110516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:30.650 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:30 smithi139 ceph-mon[32999]: Deploying daemon mds.h on smithi135 2024-04-26T20:19:30.650 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:boot 2024-04-26T20:19:30.650 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:30 smithi139 ceph-mon[32999]: fsmap 7 up:standby 2024-04-26T20:19:30.650 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:19:30.650 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:30 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1541110516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:30 smithi082 ceph-mon[28105]: Deploying daemon mds.h on smithi135 2024-04-26T20:19:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:boot 2024-04-26T20:19:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:30 smithi082 ceph-mon[28105]: fsmap 7 up:standby 2024-04-26T20:19:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:19:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:30 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1541110516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:31.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:31 smithi135 ceph-mon[32816]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:31 smithi082 ceph-mon[28105]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:31 smithi139 ceph-mon[32999]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:32.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:32.368 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:19:32 smithi135 systemd[1]: Started Ceph mds.h for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:32.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 -- 172.21.15.82:0/592875156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 msgr2=0x7f022c1157a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:32.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 --2- 172.21.15.82:0/592875156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 0x7f022c1157a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0224009ca0 tx=0x7f022402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 -- 172.21.15.82:0/592875156 shutdown_connections 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 --2- 172.21.15.82:0/592875156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 0x7f022c1157a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 --2- 172.21.15.82:0/592875156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 --2- 172.21.15.82:0/592875156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10d360 0x7f022c10d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 -- 172.21.15.82:0/592875156 >> 172.21.15.82:0/592875156 conn(0x7f022c073b90 msgr2=0x7f022c073fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 -- 172.21.15.82:0/592875156 shutdown_connections 2024-04-26T20:19:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.531+0000 7f0233600640 1 -- 172.21.15.82:0/592875156 wait complete. 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.532+0000 7f0233600640 1 Processor -- start 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 -- start start 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10d360 0x7f022c1a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c1a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 0x7f022c1aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f022c118ef0 con 0x7f022c10d360 2024-04-26T20:19:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f022c118d70 con 0x7f022c10e550 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0233600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f022c119070 con 0x7f022c10ef10 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0230c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10d360 0x7f022c1a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f022be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c1a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f022be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c1a3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57048/0 (socket says 172.21.15.82:57048) 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f0231600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 0x7f022c1aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.533+0000 7f022be00640 1 -- 172.21.15.82:0/2011613978 learned_addr learned my addr 172.21.15.82:0/2011613978 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f022be00640 1 -- 172.21.15.82:0/2011613978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 msgr2=0x7f022c1aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f022be00640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 0x7f022c1aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f022be00640 1 -- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10d360 msgr2=0x7f022c1a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f022be00640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10d360 0x7f022c1a3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f022be00640 1 -- 172.21.15.82:0/2011613978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c1ab190 con 0x7f022c10e550 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f022be00640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c1a3ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f021800e9f0 tx=0x7f021800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021800cd80 con 0x7f022c10e550 2024-04-26T20:19:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02180054d0 con 0x7f022c10e550 2024-04-26T20:19:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c1ab480 con 0x7f022c10e550 2024-04-26T20:19:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218010690 con 0x7f022c10e550 2024-04-26T20:19:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.534+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c1ab9d0 con 0x7f022c10e550 2024-04-26T20:19:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.536+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c114700 con 0x7f022c10e550 2024-04-26T20:19:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.537+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0218004e90 con 0x7f022c10e550 2024-04-26T20:19:32.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.539+0000 7f0229600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02140a3c30 0x7f02140a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:32.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.539+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f02180d0310 con 0x7f022c10e550 2024-04-26T20:19:32.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.539+0000 7f0230c00640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02140a3c30 0x7f02140a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.539+0000 7f0230c00640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02140a3c30 0x7f02140a60f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f022c10e3b0 tx=0x7f0220005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.543+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f021809d170 con 0x7f022c10e550 2024-04-26T20:19:32.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.787+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f022c02dad0 con 0x7f022c10e550 2024-04-26T20:19:32.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.789+0000 7f0229600640 1 -- 172.21.15.82:0/2011613978 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7186 (secure 0 0 0) 0x7f021809ca70 con 0x7f022c10e550 2024-04-26T20:19:32.789 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:32.789 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T20:19:32.790 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-04-26T20:19:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02140a3c30 msgr2=0x7f02140a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02140a3c30 0x7f02140a60f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f022c10e3b0 tx=0x7f0220005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 msgr2=0x7f022c1a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c1a3ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f021800e9f0 tx=0x7f021800edf0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 shutdown_connections 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02140a3c30 0x7f02140a60f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f022c10ef10 0x7f022c1aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f022c10e550 0x7f022c1a3ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 --2- 172.21.15.82:0/2011613978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f022c10d360 0x7f022c1a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.791+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 >> 172.21.15.82:0/2011613978 conn(0x7f022c073b90 msgr2=0x7f022c1118d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.792+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 shutdown_connections 2024-04-26T20:19:32.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:32.792+0000 7f0233600640 1 -- 172.21.15.82:0/2011613978 wait complete. 2024-04-26T20:19:33.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:33.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:33.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:33.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: Deploying daemon mds.i on smithi139 2024-04-26T20:19:33.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:33.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6836/1503486498,v1:172.21.15.135:6837/1503486498] up:boot 2024-04-26T20:19:33.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: fsmap 8 up:standby 2024-04-26T20:19:33.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:19:33.572 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:33 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2011613978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: Deploying daemon mds.i on smithi139 2024-04-26T20:19:33.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:33.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6836/1503486498,v1:172.21.15.135:6837/1503486498] up:boot 2024-04-26T20:19:33.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: fsmap 8 up:standby 2024-04-26T20:19:33.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:19:33.620 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:33 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2011613978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: Deploying daemon mds.i on smithi139 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6836/1503486498,v1:172.21.15.135:6837/1503486498] up:boot 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: fsmap 8 up:standby 2024-04-26T20:19:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:19:33.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:33 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2011613978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:34.571 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 systemd[1]: Starting Ceph mds.i for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:34.812 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:34.967 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 podman[63733]: 2024-04-26 20:19:34.597524694 +0000 UTC m=+0.017744481 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:34.968 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 podman[63733]: 2024-04-26 20:19:34.721027559 +0000 UTC m=+0.141247341 container create 44a0369f22ab43c61b1f6d5c200dbcabb7899df1e4252d8bb1f41c644c30983e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T20:19:34.968 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 podman[63733]: 2024-04-26 20:19:34.967576895 +0000 UTC m=+0.387796666 container init 44a0369f22ab43c61b1f6d5c200dbcabb7899df1e4252d8bb1f41c644c30983e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-26T20:19:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.016+0000 7fba76400640 1 -- 172.21.15.82:0/2806964480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 msgr2=0x7fba701111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.016+0000 7fba76400640 1 --2- 172.21.15.82:0/2806964480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 0x7fba701111d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba68009be0 tx=0x7fba6802a6c0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.016+0000 7fba76400640 1 -- 172.21.15.82:0/2806964480 shutdown_connections 2024-04-26T20:19:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.016+0000 7fba76400640 1 --2- 172.21.15.82:0/2806964480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 0x7fba701111d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.016+0000 7fba76400640 1 --2- 172.21.15.82:0/2806964480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7010a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.017+0000 7fba76400640 1 --2- 172.21.15.82:0/2806964480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 0x7fba701091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.017+0000 7fba76400640 1 -- 172.21.15.82:0/2806964480 >> 172.21.15.82:0/2806964480 conn(0x7fba70077d30 msgr2=0x7fba7007a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.017+0000 7fba76400640 1 -- 172.21.15.82:0/2806964480 shutdown_connections 2024-04-26T20:19:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.017+0000 7fba76400640 1 -- 172.21.15.82:0/2806964480 wait complete. 2024-04-26T20:19:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.017+0000 7fba76400640 1 Processor -- start 2024-04-26T20:19:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 -- start start 2024-04-26T20:19:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 0x7fba7019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 0x7fba701a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba701148a0 con 0x7fba70108d90 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba70114720 con 0x7fba7010a940 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba76400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fba70114a20 con 0x7fba70109f80 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba75000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 0x7fba7019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba6fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba75000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 0x7fba7019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40062/0 (socket says 172.21.15.82:40062) 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba6fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60786/0 (socket says 172.21.15.82:60786) 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba75000640 1 -- 172.21.15.82:0/3842284742 learned_addr learned my addr 172.21.15.82:0/3842284742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.018+0000 7fba75a00640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 0x7fba701a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6fe00640 1 -- 172.21.15.82:0/3842284742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 msgr2=0x7fba701a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6fe00640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 0x7fba701a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6fe00640 1 -- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 msgr2=0x7fba7019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6fe00640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 0x7fba7019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6fe00640 1 -- 172.21.15.82:0/3842284742 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba701a6b60 con 0x7fba70109f80 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6fe00640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7019f480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00e9f0 tx=0x7fba5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00ccc0 con 0x7fba70109f80 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba5c0108e0 con 0x7fba70109f80 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba701a6e50 con 0x7fba70109f80 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c018880 con 0x7fba70109f80 2024-04-26T20:19:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.019+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701a7310 con 0x7fba70109f80 2024-04-26T20:19:35.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.020+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba701101a0 con 0x7fba70109f80 2024-04-26T20:19:35.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.022+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fba5c010430 con 0x7fba70109f80 2024-04-26T20:19:35.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.023+0000 7fba6d600640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba580a3bb0 0x7fba580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:35.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.024+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fba5c0d02d0 con 0x7fba70109f80 2024-04-26T20:19:35.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.024+0000 7fba75000640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba580a3bb0 0x7fba580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:35.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.024+0000 7fba75000640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba580a3bb0 0x7fba580a6070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba640096c0 tx=0x7fba64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:35.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.028+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fba5c09ca60 con 0x7fba70109f80 2024-04-26T20:19:35.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.279+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba700635d0 con 0x7fba70109f80 2024-04-26T20:19:35.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.280+0000 7fba6d600640 1 -- 172.21.15.82:0/3842284742 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7186 (secure 0 0 0) 0x7fba5c0a0d60 con 0x7fba70109f80 2024-04-26T20:19:35.282 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:35.282 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T20:19:35.282 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.282+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba580a3bb0 msgr2=0x7fba580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.282+0000 7fba76400640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba580a3bb0 0x7fba580a6070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba640096c0 tx=0x7fba64009260 comp rx=0 tx=0).stop 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 msgr2=0x7fba7019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7019f480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00e9f0 tx=0x7fba5c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 shutdown_connections 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba580a3bb0 0x7fba580a6070 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7010a940 0x7fba701a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba70109f80 0x7fba7019f480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 --2- 172.21.15.82:0/3842284742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba70108d90 0x7fba7019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:35.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 >> 172.21.15.82:0/3842284742 conn(0x7fba70077d30 msgr2=0x7fba7010d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:35.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 shutdown_connections 2024-04-26T20:19:35.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:35.283+0000 7fba76400640 1 -- 172.21.15.82:0/3842284742 wait complete. 2024-04-26T20:19:35.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 podman[63733]: 2024-04-26 20:19:34.970496413 +0000 UTC m=+0.390716193 container start 44a0369f22ab43c61b1f6d5c200dbcabb7899df1e4252d8bb1f41c644c30983e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T20:19:35.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 ceph-mds[63752]: -- 172.21.15.139:0/375300484 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc8c2f7a40 con 0x55fc8c2cb000 2024-04-26T20:19:35.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:34 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: starting mds.i at 2024-04-26T20:19:35.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:35 smithi139 bash[63733]: 44a0369f22ab43c61b1f6d5c200dbcabb7899df1e4252d8bb1f41c644c30983e 2024-04-26T20:19:35.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:19:35 smithi139 systemd[1]: Started Ceph mds.i for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3842284742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:35 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3842284742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:35 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3842284742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:36 smithi082 ceph-mon[28105]: Deploying daemon mds.g on smithi082 2024-04-26T20:19:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:36 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:boot 2024-04-26T20:19:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:36 smithi082 ceph-mon[28105]: fsmap 9 up:standby 2024-04-26T20:19:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:36 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:19:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:36 smithi139 ceph-mon[32999]: Deploying daemon mds.g on smithi082 2024-04-26T20:19:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:36 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:boot 2024-04-26T20:19:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:36 smithi139 ceph-mon[32999]: fsmap 9 up:standby 2024-04-26T20:19:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:36 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:19:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:36 smithi135 ceph-mon[32816]: Deploying daemon mds.g on smithi082 2024-04-26T20:19:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:36 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:boot 2024-04-26T20:19:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:36 smithi135 ceph-mon[32816]: fsmap 9 up:standby 2024-04-26T20:19:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:36 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:19:37.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 -- 172.21.15.82:0/2508415194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14410a180 msgr2=0x7ff14410a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:37.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 --2- 172.21.15.82:0/2508415194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14410a180 0x7ff14410a600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff130009900 tx=0x7ff13002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 -- 172.21.15.82:0/2508415194 shutdown_connections 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 --2- 172.21.15.82:0/2508415194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff14410ab40 0x7ff1441113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 --2- 172.21.15.82:0/2508415194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14410a180 0x7ff14410a600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 --2- 172.21.15.82:0/2508415194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff144108f90 0x7ff1441093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 -- 172.21.15.82:0/2508415194 >> 172.21.15.82:0/2508415194 conn(0x7ff144077f40 msgr2=0x7ff14407a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 -- 172.21.15.82:0/2508415194 shutdown_connections 2024-04-26T20:19:37.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.518+0000 7ff14ae00640 1 -- 172.21.15.82:0/2508415194 wait complete. 2024-04-26T20:19:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.519+0000 7ff14ae00640 1 Processor -- start 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.519+0000 7ff14ae00640 1 -- start start 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.519+0000 7ff14ae00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 0x7ff14419f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.519+0000 7ff14ae00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff14410a180 0x7ff14419f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff14ae00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 0x7ff1441a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff14ae00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff144114ad0 con 0x7ff14410ab40 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff14ae00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff144114950 con 0x7ff144108f90 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff14ae00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff144114c50 con 0x7ff14410a180 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 0x7ff1441a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff143e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 0x7ff14419f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 0x7ff1441a6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40078/0 (socket says 172.21.15.82:40078) 2024-04-26T20:19:37.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 -- 172.21.15.82:0/3327801294 learned_addr learned my addr 172.21.15.82:0/3327801294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff143e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 0x7ff14419f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57086/0 (socket says 172.21.15.82:57086) 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff143400640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff14410a180 0x7ff14419f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 -- 172.21.15.82:0/3327801294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff14410a180 msgr2=0x7ff14419f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff14410a180 0x7ff14419f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 -- 172.21.15.82:0/3327801294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 msgr2=0x7ff14419f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 0x7ff14419f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff148e00640 1 -- 172.21.15.82:0/3327801294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1441a6d70 con 0x7ff14410ab40 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.520+0000 7ff143e00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 0x7ff14419f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.521+0000 7ff148e00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 0x7ff1441a6700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00eb10 tx=0x7ff13c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.521+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c004b20 con 0x7ff14410ab40 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.521+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1441a7060 con 0x7ff14410ab40 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.521+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff13c004cc0 con 0x7ff14410ab40 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.521+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1441a75d0 con 0x7ff14410ab40 2024-04-26T20:19:37.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.521+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c018630 con 0x7ff14410ab40 2024-04-26T20:19:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.522+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1441102b0 con 0x7ff14410ab40 2024-04-26T20:19:37.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.524+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff13c005000 con 0x7ff14410ab40 2024-04-26T20:19:37.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.526+0000 7ff140c00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff1280a3bb0 0x7ff1280a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:37.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.526+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff13c0d06d0 con 0x7ff14410ab40 2024-04-26T20:19:37.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.526+0000 7ff143e00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff1280a3bb0 0x7ff1280a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:37.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.527+0000 7ff143e00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff1280a3bb0 0x7ff1280a6070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff144109fe0 tx=0x7ff134005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:37.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.530+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff13c09d4b0 con 0x7ff14410ab40 2024-04-26T20:19:37.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.786+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff14402dad0 con 0x7ff14410ab40 2024-04-26T20:19:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.788+0000 7ff140c00640 1 -- 172.21.15.82:0/3327801294 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8016 (secure 0 0 0) 0x7ff13c09cdb0 con 0x7ff14410ab40 2024-04-26T20:19:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:37.792 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T20:19:37.792 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2024-04-26T20:19:37.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff1280a3bb0 msgr2=0x7ff1280a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:37.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff1280a3bb0 0x7ff1280a6070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff144109fe0 tx=0x7ff134005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:37.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 msgr2=0x7ff1441a6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:37.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 0x7ff1441a6700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00eb10 tx=0x7ff13c00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 shutdown_connections 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff1280a3bb0 0x7ff1280a6070 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff14410ab40 0x7ff1441a6700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff14410a180 0x7ff14419f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 --2- 172.21.15.82:0/3327801294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144108f90 0x7ff14419f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 >> 172.21.15.82:0/3327801294 conn(0x7ff144077f40 msgr2=0x7ff14410d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 shutdown_connections 2024-04-26T20:19:37.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:37.793+0000 7ff14ae00640 1 -- 172.21.15.82:0/3327801294 wait complete. 2024-04-26T20:19:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:37 smithi082 ceph-mon[28105]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:37 smithi139 ceph-mon[32999]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:38.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:37 smithi135 ceph-mon[32816]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:38.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3327801294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:39.041 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:38 smithi082 podman[69781]: 2024-04-26 20:19:38.883921421 +0000 UTC m=+0.190681049 container create 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T20:19:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3327801294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:39.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3327801294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:39.635 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:39 smithi082 podman[69781]: 2024-04-26 20:19:39.187014288 +0000 UTC m=+0.493773878 container init 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5) 2024-04-26T20:19:39.635 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:39 smithi082 podman[69781]: 2024-04-26 20:19:39.197010624 +0000 UTC m=+0.503770220 container start 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T20:19:39.635 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mds[69807]: -- 172.21.15.82:0/3845391366 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5642a6aa9a40 con 0x5642a6a7d000 2024-04-26T20:19:39.635 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: starting mds.g at 2024-04-26T20:19:39.636 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:39 smithi082 bash[69781]: 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 2024-04-26T20:19:39.636 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:19:39 smithi082 systemd[1]: Started Ceph mds.g for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:39.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:39.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:39.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:39.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:39.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:39.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:39.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:39.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:40.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 -- 172.21.15.82:0/1936168032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668102770 msgr2=0x7f7668102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 --2- 172.21.15.82:0/1936168032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668102770 0x7f7668102b90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7658009860 tx=0x7f765802a340 comp rx=0 tx=0).stop 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 -- 172.21.15.82:0/1936168032 shutdown_connections 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 --2- 172.21.15.82:0/1936168032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668104320 0x7f766810abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 --2- 172.21.15.82:0/1936168032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668103960 0x7f7668103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 --2- 172.21.15.82:0/1936168032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668102770 0x7f7668102b90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 -- 172.21.15.82:0/1936168032 >> 172.21.15.82:0/1936168032 conn(0x7f76680fdcc0 msgr2=0x7f7668100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 -- 172.21.15.82:0/1936168032 shutdown_connections 2024-04-26T20:19:40.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.012+0000 7f7667e00640 1 -- 172.21.15.82:0/1936168032 wait complete. 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 Processor -- start 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 -- start start 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 0x7f766819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668103960 0x7f766819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668104320 0x7f76681a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f766810e2a0 con 0x7f7668102770 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f766810e120 con 0x7f7668103960 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.013+0000 7f7667e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f766810e420 con 0x7f7668104320 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f7666a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 0x7f766819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f7666a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 0x7f766819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40120/0 (socket says 172.21.15.82:40120) 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f765fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668103960 0x7f766819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:40.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f7666a00640 1 -- 172.21.15.82:0/2907362479 learned_addr learned my addr 172.21.15.82:0/2907362479 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f7667400640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668104320 0x7f76681a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f765fe00640 1 -- 172.21.15.82:0/2907362479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668104320 msgr2=0x7f76681a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f765fe00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668104320 0x7f76681a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f765fe00640 1 -- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 msgr2=0x7f766819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f765fe00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 0x7f766819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f765fe00640 1 -- 172.21.15.82:0/2907362479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76681a27d0 con 0x7f7668103960 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.014+0000 7f7666a00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 0x7f766819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.015+0000 7f765fe00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668103960 0x7f766819b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7650005fd0 tx=0x7f765000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.015+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000cd00 con 0x7f7668103960 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.015+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76681a2ac0 con 0x7f7668103960 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.015+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76500035f0 con 0x7f7668103960 2024-04-26T20:19:40.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.015+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650010690 con 0x7f7668103960 2024-04-26T20:19:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.015+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681a3010 con 0x7f7668103960 2024-04-26T20:19:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.016+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76681a3240 con 0x7f7668103960 2024-04-26T20:19:40.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.018+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7650003a80 con 0x7f7668103960 2024-04-26T20:19:40.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.019+0000 7f765f400640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f764c0a3bb0 0x7f764c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:40.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.020+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f76500d0360 con 0x7f7668103960 2024-04-26T20:19:40.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.020+0000 7f7666a00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f764c0a3bb0 0x7f764c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:40.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.020+0000 7f7666a00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f764c0a3bb0 0x7f764c0a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76580095f0 tx=0x7f7658030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:40.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.022+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7650009510 con 0x7f7668103960 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:40.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.275+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76681a3410 con 0x7f7668103960 2024-04-26T20:19:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.276+0000 7f765f400640 1 -- 172.21.15.82:0/2907362479 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8842 (secure 0 0 0) 0x7f765009d140 con 0x7f7668103960 2024-04-26T20:19:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:40.278 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24554,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-04-26T20:19:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2024-04-26T20:19:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f764c0a3bb0 msgr2=0x7f764c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f764c0a3bb0 0x7f764c0a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76580095f0 tx=0x7f7658030450 comp rx=0 tx=0).stop 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668103960 msgr2=0x7f766819b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668103960 0x7f766819b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7650005fd0 tx=0x7f765000ee50 comp rx=0 tx=0).stop 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 shutdown_connections 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f764c0a3bb0 0x7f764c0a6070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7668104320 0x7f76681a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7668103960 0x7f766819b0f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 --2- 172.21.15.82:0/2907362479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7668102770 0x7f766819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 >> 172.21.15.82:0/2907362479 conn(0x7f76680fdcc0 msgr2=0x7f7668074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 shutdown_connections 2024-04-26T20:19:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:40.279+0000 7f7667e00640 1 -- 172.21.15.82:0/2907362479 wait complete. 2024-04-26T20:19:40.902 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:40 smithi082 ceph-mon[28105]: Deploying daemon mds.a on smithi082 2024-04-26T20:19:40.902 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:40 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:boot 2024-04-26T20:19:40.902 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:40 smithi082 ceph-mon[28105]: fsmap 10 up:standby 2024-04-26T20:19:40.902 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:19:40.902 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:40 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2907362479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:40 smithi139 ceph-mon[32999]: Deploying daemon mds.a on smithi082 2024-04-26T20:19:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:40 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:boot 2024-04-26T20:19:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:40 smithi139 ceph-mon[32999]: fsmap 10 up:standby 2024-04-26T20:19:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:19:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:40 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2907362479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:40 smithi135 ceph-mon[32816]: Deploying daemon mds.a on smithi082 2024-04-26T20:19:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:40 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:boot 2024-04-26T20:19:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:40 smithi135 ceph-mon[32816]: fsmap 10 up:standby 2024-04-26T20:19:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:19:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:40 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2907362479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.822 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:41 smithi082 ceph-mon[28105]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:41 smithi139 ceph-mon[32999]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:41 smithi135 ceph-mon[32816]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:42.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:42.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 -- 172.21.15.82:0/1972054014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc105d60 msgr2=0x7fc6dc1061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:42.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 --2- 172.21.15.82:0/1972054014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc105d60 0x7fc6dc1061e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009900 tx=0x7fc6c802a410 comp rx=0 tx=0).stop 2024-04-26T20:19:42.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 -- 172.21.15.82:0/1972054014 shutdown_connections 2024-04-26T20:19:42.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 --2- 172.21.15.82:0/1972054014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6dc106720 0x7fc6dc10cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:42.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 --2- 172.21.15.82:0/1972054014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc105d60 0x7fc6dc1061e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:42.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 --2- 172.21.15.82:0/1972054014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc104b70 0x7fc6dc104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:42.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 -- 172.21.15.82:0/1972054014 >> 172.21.15.82:0/1972054014 conn(0x7fc6dc100120 msgr2=0x7fc6dc102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:42.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 -- 172.21.15.82:0/1972054014 shutdown_connections 2024-04-26T20:19:42.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.756+0000 7fc6e4400640 1 -- 172.21.15.82:0/1972054014 wait complete. 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.757+0000 7fc6e4400640 1 Processor -- start 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.757+0000 7fc6e4400640 1 -- start start 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e4400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 0x7fc6dc19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e4400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6dc105d60 0x7fc6dc19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e4400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc106720 0x7fc6dc1a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e4400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1106f0 con 0x7fc6dc104b70 2024-04-26T20:19:42.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e4400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc110570 con 0x7fc6dc105d60 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e4400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc110870 con 0x7fc6dc106720 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 0x7fc6dc19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 0x7fc6dc19adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59086/0 (socket says 172.21.15.82:59086) 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e1a00640 1 -- 172.21.15.82:0/741400081 learned_addr learned my addr 172.21.15.82:0/741400081 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e2400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc106720 0x7fc6dc1a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.758+0000 7fc6e1000640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6dc105d60 0x7fc6dc19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e2400640 1 -- 172.21.15.82:0/741400081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6dc105d60 msgr2=0x7fc6dc19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e2400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6dc105d60 0x7fc6dc19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e2400640 1 -- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 msgr2=0x7fc6dc19adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e2400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 0x7fc6dc19adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:42.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e2400640 1 -- 172.21.15.82:0/741400081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc1a29e0 con 0x7fc6dc106720 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e1a00640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 0x7fc6dc19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e2400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc106720 0x7fc6dc1a2370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400ec50 tx=0x7fc6d400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4003b70 con 0x7fc6dc106720 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6d4003d10 con 0x7fc6dc106720 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc1a2cd0 con 0x7fc6dc106720 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4010830 con 0x7fc6dc106720 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.759+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1a31a0 con 0x7fc6dc106720 2024-04-26T20:19:42.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.761+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc10bf60 con 0x7fc6dc106720 2024-04-26T20:19:42.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.763+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc6d4003ec0 con 0x7fc6dc106720 2024-04-26T20:19:42.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.764+0000 7fc6da000640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6c40a3bb0 0x7fc6c40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:42.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.764+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc6d40d0550 con 0x7fc6dc106720 2024-04-26T20:19:42.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.764+0000 7fc6e1a00640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6c40a3bb0 0x7fc6c40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:42.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.765+0000 7fc6e1a00640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6c40a3bb0 0x7fc6c40a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00058c0 tx=0x7fc6d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:42.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:42.768+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc6d409d330 con 0x7fc6dc106720 2024-04-26T20:19:42.937 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:42 smithi082 systemd[1]: Starting Ceph mds.a for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:43.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.018+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6dc02dad0 con 0x7fc6dc106720 2024-04-26T20:19:43.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.019+0000 7fc6da000640 1 -- 172.21.15.82:0/741400081 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8842 (secure 0 0 0) 0x7fc6d409cc30 con 0x7fc6dc106720 2024-04-26T20:19:43.021 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:43.021 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24554,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-04-26T20:19:43.021 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2024-04-26T20:19:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.021+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6c40a3bb0 msgr2=0x7fc6c40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.021+0000 7fc6e4400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6c40a3bb0 0x7fc6c40a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00058c0 tx=0x7fc6d0005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.021+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc106720 msgr2=0x7fc6dc1a2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.021+0000 7fc6e4400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc106720 0x7fc6dc1a2370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400ec50 tx=0x7fc6d400c6a0 comp rx=0 tx=0).stop 2024-04-26T20:19:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 shutdown_connections 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6c40a3bb0 0x7fc6c40a6070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6dc106720 0x7fc6dc1a2370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6dc105d60 0x7fc6dc19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 --2- 172.21.15.82:0/741400081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6dc104b70 0x7fc6dc19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 >> 172.21.15.82:0/741400081 conn(0x7fc6dc100120 msgr2=0x7fc6dc109130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 shutdown_connections 2024-04-26T20:19:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:43.022+0000 7fc6e4400640 1 -- 172.21.15.82:0/741400081 wait complete. 2024-04-26T20:19:43.304 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 podman[70169]: 2024-04-26 20:19:42.924605155 +0000 UTC m=+0.031871335 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:43.304 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 podman[70169]: 2024-04-26 20:19:43.049207111 +0000 UTC m=+0.156473348 container create 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T20:19:43.304 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 podman[70169]: 2024-04-26 20:19:43.303297887 +0000 UTC m=+0.410564106 container init 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5) 2024-04-26T20:19:43.685 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 podman[70169]: 2024-04-26 20:19:43.312054391 +0000 UTC m=+0.419320567 container start 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:19:43.685 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mds[70190]: -- 172.21.15.82:0/3141995370 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56364ca59a40 con 0x56364ca2c800 2024-04-26T20:19:43.685 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a[70186]: starting mds.a at 2024-04-26T20:19:43.686 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 bash[70169]: 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c 2024-04-26T20:19:43.686 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:19:43 smithi082 systemd[1]: Started Ceph mds.a for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/741400081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:43 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/741400081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:43 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:44.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/741400081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T20:19:44.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:43 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:44.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:44 smithi135 ceph-mon[32816]: Deploying daemon mds.b on smithi135 2024-04-26T20:19:44.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:44 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6840/1325720417,v1:172.21.15.82:6841/1325720417] up:boot 2024-04-26T20:19:44.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:44 smithi135 ceph-mon[32816]: fsmap 11 up:standby 2024-04-26T20:19:44.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:44 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:19:45.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:45.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:44 smithi139 ceph-mon[32999]: Deploying daemon mds.b on smithi135 2024-04-26T20:19:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:44 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6840/1325720417,v1:172.21.15.82:6841/1325720417] up:boot 2024-04-26T20:19:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:44 smithi139 ceph-mon[32999]: fsmap 11 up:standby 2024-04-26T20:19:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:44 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:19:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:44 smithi082 ceph-mon[28105]: Deploying daemon mds.b on smithi135 2024-04-26T20:19:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:44 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6840/1325720417,v1:172.21.15.82:6841/1325720417] up:boot 2024-04-26T20:19:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:44 smithi082 ceph-mon[28105]: fsmap 11 up:standby 2024-04-26T20:19:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:44 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T20:19:45.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 -- 172.21.15.82:0/2529598165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8103b70 msgr2=0x7f79e8103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 --2- 172.21.15.82:0/2529598165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8103b70 0x7f79e8103ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009900 tx=0x7f79d002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 -- 172.21.15.82:0/2529598165 shutdown_connections 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 --2- 172.21.15.82:0/2529598165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8104530 0x7f79e810adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 --2- 172.21.15.82:0/2529598165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8103b70 0x7f79e8103ff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 --2- 172.21.15.82:0/2529598165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79e8102980 0x7f79e8102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 -- 172.21.15.82:0/2529598165 >> 172.21.15.82:0/2529598165 conn(0x7f79e80fdf10 msgr2=0x7f79e8100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 -- 172.21.15.82:0/2529598165 shutdown_connections 2024-04-26T20:19:45.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.256+0000 7f79ef800640 1 -- 172.21.15.82:0/2529598165 wait complete. 2024-04-26T20:19:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 Processor -- start 2024-04-26T20:19:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 -- start start 2024-04-26T20:19:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8102980 0x7f79e819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 0x7f79e819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79e8104530 0x7f79e81a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79e810e4b0 con 0x7f79e8103b70 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79e810e330 con 0x7f79e8102980 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79ef800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f79e810e630 con 0x7f79e8104530 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 0x7f79e819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 0x7f79e819b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59140/0 (socket says 172.21.15.82:59140) 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.257+0000 7f79e7e00640 1 -- 172.21.15.82:0/2003036609 learned_addr learned my addr 172.21.15.82:0/2003036609 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79ece00640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8102980 0x7f79e819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79ed800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79e8104530 0x7f79e81a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e7e00640 1 -- 172.21.15.82:0/2003036609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79e8104530 msgr2=0x7f79e81a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e7e00640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79e8104530 0x7f79e81a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e7e00640 1 -- 172.21.15.82:0/2003036609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8102980 msgr2=0x7f79e819ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e7e00640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8102980 0x7f79e819ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e7e00640 1 -- 172.21.15.82:0/2003036609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e81a2a30 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e7e00640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 0x7f79e819b350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005940 tx=0x7f79d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.258+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d003f030 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.259+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d0003cb0 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.259+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e81a2cc0 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.259+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0035070 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.259+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81a31b0 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.260+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e81a33e0 con 0x7f79e8103b70 2024-04-26T20:19:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.262+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f79d0042030 con 0x7f79e8103b70 2024-04-26T20:19:45.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.263+0000 7f79e5600640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79cc0a3c30 0x7f79cc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:45.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.263+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f79d00f0330 con 0x7f79e8103b70 2024-04-26T20:19:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.263+0000 7f79ece00640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79cc0a3c30 0x7f79cc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.264+0000 7f79ece00640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79cc0a3c30 0x7f79cc0a60f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79e81039d0 tx=0x7f79d8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:45.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.268+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f79d0003e60 con 0x7f79e8103b70 2024-04-26T20:19:45.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.506+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79e81a35b0 con 0x7f79e8103b70 2024-04-26T20:19:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.508+0000 7f79e5600640 1 -- 172.21.15.82:0/2003036609 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7f79d00bcac0 con 0x7f79e8103b70 2024-04-26T20:19:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:45.510 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24554,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-04-26T20:19:45.510 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2024-04-26T20:19:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79cc0a3c30 msgr2=0x7f79cc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79cc0a3c30 0x7f79cc0a60f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79e81039d0 tx=0x7f79d8009500 comp rx=0 tx=0).stop 2024-04-26T20:19:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 msgr2=0x7f79e819b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 0x7f79e819b350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005940 tx=0x7f79d00042f0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 shutdown_connections 2024-04-26T20:19:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79cc0a3c30 0x7f79cc0a60f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79e8104530 0x7f79e81a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79e8103b70 0x7f79e819b350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 --2- 172.21.15.82:0/2003036609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e8102980 0x7f79e819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 >> 172.21.15.82:0/2003036609 conn(0x7f79e80fdf10 msgr2=0x7f79e81093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 shutdown_connections 2024-04-26T20:19:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:45.511+0000 7f79ef800640 1 -- 172.21.15.82:0/2003036609 wait complete. 2024-04-26T20:19:45.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:45 smithi135 ceph-mon[32816]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:45.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:45 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2003036609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:45.869 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:45 smithi135 systemd[1]: Starting Ceph mds.b for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:19:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:45 smithi082 ceph-mon[28105]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:45 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2003036609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:45 smithi139 ceph-mon[32999]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:45 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2003036609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:46.194 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:45 smithi135 podman[62308]: 2024-04-26 20:19:45.825079295 +0000 UTC m=+0.018136605 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:19:46.194 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:45 smithi135 podman[62308]: 2024-04-26 20:19:45.930169188 +0000 UTC m=+0.123226485 container create 0e309e07d15698f6a8873c0e7665c0e49e00c8102d5e30a81d857c690edb0203 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:19:46.194 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:46 smithi135 podman[62308]: 2024-04-26 20:19:46.166823843 +0000 UTC m=+0.359881140 container init 0e309e07d15698f6a8873c0e7665c0e49e00c8102d5e30a81d857c690edb0203 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=) 2024-04-26T20:19:46.194 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:46 smithi135 podman[62308]: 2024-04-26 20:19:46.169344121 +0000 UTC m=+0.362401419 container start 0e309e07d15698f6a8873c0e7665c0e49e00c8102d5e30a81d857c690edb0203 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T20:19:46.618 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:46 smithi135 ceph-mds[62327]: -- 172.21.15.135:0/263222175 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577fc213a40 con 0x5577fc1e6c00 2024-04-26T20:19:46.619 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: starting mds.b at 2024-04-26T20:19:46.619 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:46 smithi135 bash[62308]: 0e309e07d15698f6a8873c0e7665c0e49e00c8102d5e30a81d857c690edb0203 2024-04-26T20:19:46.619 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:46 smithi135 systemd[1]: Started Ceph mds.b for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:19:47.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:47.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] up:boot 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: fsmap 12 up:standby 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:19:47.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] up:boot 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: fsmap 12 up:standby 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:19:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:47.716 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.716 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] up:boot 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: fsmap 12 up:standby 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:19:47.717 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 -- 172.21.15.82:0/1013663211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 msgr2=0x7fa4bc108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/1013663211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 0x7fa4bc108160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009900 tx=0x7fa4a802a410 comp rx=0 tx=0).stop 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 -- 172.21.15.82:0/1013663211 shutdown_connections 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/1013663211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/1013663211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 0x7fa4bc108160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/1013663211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 0x7fa4bc105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 -- 172.21.15.82:0/1013663211 >> 172.21.15.82:0/1013663211 conn(0x7fa4bc0fcdf0 msgr2=0x7fa4bc0ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 -- 172.21.15.82:0/1013663211 shutdown_connections 2024-04-26T20:19:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.729+0000 7fa4c3c00640 1 -- 172.21.15.82:0/1013663211 wait complete. 2024-04-26T20:19:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.730+0000 7fa4c3c00640 1 Processor -- start 2024-04-26T20:19:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.730+0000 7fa4c3c00640 1 -- start start 2024-04-26T20:19:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c3c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 0x7fa4bc198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c3c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 0x7fa4bc1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c3c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc1a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c3c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc10e4b0 con 0x7fa4bc103440 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c3c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc10e330 con 0x7fa4bc105d70 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c3c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc10e630 con 0x7fa4bc1086a0 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c1c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc1a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c1c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc1a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50842/0 (socket says 172.21.15.82:50842) 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c1c00640 1 -- 172.21.15.82:0/2431117837 learned_addr learned my addr 172.21.15.82:0/2431117837 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4bbe00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 0x7fa4bc1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c1200640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 0x7fa4bc198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.731+0000 7fa4c1c00640 1 -- 172.21.15.82:0/2431117837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 msgr2=0x7fa4bc1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c1c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 0x7fa4bc1990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c1c00640 1 -- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 msgr2=0x7fa4bc198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c1c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 0x7fa4bc198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c1c00640 1 -- 172.21.15.82:0/2431117837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc1a07d0 con 0x7fa4bc1086a0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c1200640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 0x7fa4bc198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c1c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc1a0160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400efd0 tx=0x7fa4b400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4003b70 con 0x7fa4bc1086a0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc1a0ac0 con 0x7fa4bc1086a0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b4003d10 con 0x7fa4bc1086a0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40108a0 con 0x7fa4bc1086a0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.732+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc1a0fe0 con 0x7fa4bc1086a0 2024-04-26T20:19:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.734+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc0fe8e0 con 0x7fa4bc1086a0 2024-04-26T20:19:47.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.737+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa4b4004020 con 0x7fa4bc1086a0 2024-04-26T20:19:47.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.738+0000 7fa4b9600640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4a40a3c30 0x7fa4a40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:47.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.738+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa4b40d0430 con 0x7fa4bc1086a0 2024-04-26T20:19:47.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.738+0000 7fa4c1200640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4a40a3c30 0x7fa4a40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:47.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.739+0000 7fa4c1200640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4a40a3c30 0x7fa4a40a60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009c20 tx=0x7fa4b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:47.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.742+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa4b409d210 con 0x7fa4bc1086a0 2024-04-26T20:19:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.990+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4bc063530 con 0x7fa4bc1086a0 2024-04-26T20:19:47.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.991+0000 7fa4b9600640 1 -- 172.21.15.82:0/2431117837 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10497 (secure 0 0 0) 0x7fa4b409cb10 con 0x7fa4bc1086a0 2024-04-26T20:19:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:47.993 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24554,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24584,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-26T20:19:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-04-26T20:19:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.993+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4a40a3c30 msgr2=0x7fa4a40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.993+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4a40a3c30 0x7fa4a40a60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009c20 tx=0x7fa4b0005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.993+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 msgr2=0x7fa4bc1a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.993+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc1a0160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400efd0 tx=0x7fa4b400c6a0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 shutdown_connections 2024-04-26T20:19:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4a40a3c30 0x7fa4a40a60f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc1086a0 0x7fa4bc1a0160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4bc105d70 0x7fa4bc1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 --2- 172.21.15.82:0/2431117837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4bc103440 0x7fa4bc198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 >> 172.21.15.82:0/2431117837 conn(0x7fa4bc0fcdf0 msgr2=0x7fa4bc103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 shutdown_connections 2024-04-26T20:19:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:47.994+0000 7fa4c3c00640 1 -- 172.21.15.82:0/2431117837 wait complete. 2024-04-26T20:19:48.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.211+0000 7f91c6800640 1 -- 172.21.15.82:0/325349357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c01032f0 msgr2=0x7f91c01056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.211+0000 7f91c6800640 1 --2- 172.21.15.82:0/325349357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c01032f0 0x7f91c01056e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009be0 tx=0x7f91b402a6c0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.211+0000 7f91c6800640 1 -- 172.21.15.82:0/325349357 shutdown_connections 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.211+0000 7f91c6800640 1 --2- 172.21.15.82:0/325349357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91c0108550 0x7f91c010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.211+0000 7f91c6800640 1 --2- 172.21.15.82:0/325349357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91c0105c20 0x7f91c0108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.211+0000 7f91c6800640 1 --2- 172.21.15.82:0/325349357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c01032f0 0x7f91c01056e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.212+0000 7f91c6800640 1 -- 172.21.15.82:0/325349357 >> 172.21.15.82:0/325349357 conn(0x7f91c00fcc40 msgr2=0x7f91c00ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:48.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.212+0000 7f91c6800640 1 -- 172.21.15.82:0/325349357 shutdown_connections 2024-04-26T20:19:48.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.212+0000 7f91c6800640 1 -- 172.21.15.82:0/325349357 wait complete. 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 Processor -- start 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 -- start start 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91c01032f0 0x7f91c019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 0x7f91c019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91c0108550 0x7f91c01a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010e310 con 0x7f91c0105c20 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010e190 con 0x7f91c0108550 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c6800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010e490 con 0x7f91c01032f0 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 0x7f91c019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 0x7f91c019b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59168/0 (socket says 172.21.15.82:59168) 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c4a00640 1 -- 172.21.15.82:0/1930722461 learned_addr learned my addr 172.21.15.82:0/1930722461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c5400640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91c01032f0 0x7f91c019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.213+0000 7f91c5e00640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91c0108550 0x7f91c01a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c4a00640 1 -- 172.21.15.82:0/1930722461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91c01032f0 msgr2=0x7f91c019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c4a00640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91c01032f0 0x7f91c019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c4a00640 1 -- 172.21.15.82:0/1930722461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91c0108550 msgr2=0x7f91c01a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c4a00640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91c0108550 0x7f91c01a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c4a00640 1 -- 172.21.15.82:0/1930722461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c01a27e0 con 0x7f91c0105c20 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c4a00640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 0x7f91c019b100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e9f0 tx=0x7f91ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00ccc0 con 0x7f91c0105c20 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91ac0108e0 con 0x7f91c0105c20 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac018880 con 0x7f91c0105c20 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.214+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c01a2ad0 con 0x7f91c0105c20 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.215+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c01a2fd0 con 0x7f91c0105c20 2024-04-26T20:19:48.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.216+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c010a040 con 0x7f91c0105c20 2024-04-26T20:19:48.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.218+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f91ac010430 con 0x7f91c0105c20 2024-04-26T20:19:48.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.219+0000 7f91be000640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91a80a3c30 0x7f91a80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.219+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f91ac0d01b0 con 0x7f91c0105c20 2024-04-26T20:19:48.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.219+0000 7f91c5400640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91a80a3c30 0x7f91a80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.220+0000 7f91c5400640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91a80a3c30 0x7f91a80a60f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91b402acb0 tx=0x7f91b4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:48.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.223+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f91ac09c940 con 0x7f91c0105c20 2024-04-26T20:19:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.430+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c00635d0 con 0x7f91c0105c20 2024-04-26T20:19:48.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.433+0000 7f91be000640 1 -- 172.21.15.82:0/1930722461 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18469 (secure 0 0 0) 0x7f91ac0a0c40 con 0x7f91c0105c20 2024-04-26T20:19:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:48.435 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":81,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:18:54.722193+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:19:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.435+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91a80a3c30 msgr2=0x7f91a80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.435+0000 7f91c6800640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91a80a3c30 0x7f91a80a60f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91b402acb0 tx=0x7f91b4005fd0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.435+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 msgr2=0x7f91c019b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.435+0000 7f91c6800640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 0x7f91c019b100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e9f0 tx=0x7f91ac00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 shutdown_connections 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91a80a3c30 0x7f91a80a60f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91c0108550 0x7f91c01a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91c0105c20 0x7f91c019b100 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 --2- 172.21.15.82:0/1930722461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91c01032f0 0x7f91c019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 >> 172.21.15.82:0/1930722461 conn(0x7f91c00fcc40 msgr2=0x7f91c0102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 shutdown_connections 2024-04-26T20:19:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.436+0000 7f91c6800640 1 -- 172.21.15.82:0/1930722461 wait complete. 2024-04-26T20:19:48.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:19:48.458 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:19:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.661+0000 7f62e1000640 1 -- 172.21.15.82:0/172493758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1010c0 msgr2=0x7f62dc1014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.661+0000 7f62e1000640 1 --2- 172.21.15.82:0/172493758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1010c0 0x7f62dc1014e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009900 tx=0x7f62cc02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 -- 172.21.15.82:0/172493758 shutdown_connections 2024-04-26T20:19:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 --2- 172.21.15.82:0/172493758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1023c0 0x7f62dc102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 --2- 172.21.15.82:0/172493758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 0x7f62dc101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 --2- 172.21.15.82:0/172493758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1010c0 0x7f62dc1014e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 -- 172.21.15.82:0/172493758 >> 172.21.15.82:0/172493758 conn(0x7f62dc0fcce0 msgr2=0x7f62dc0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 -- 172.21.15.82:0/172493758 shutdown_connections 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.662+0000 7f62e1000640 1 -- 172.21.15.82:0/172493758 wait complete. 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.663+0000 7f62e1000640 1 Processor -- start 2024-04-26T20:19:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.663+0000 7f62e1000640 1 -- start start 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62e1000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1010c0 0x7f62dc19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62e1000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 0x7f62dc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62e1000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1023c0 0x7f62dc1a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62e1000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1105b0 con 0x7f62dc1010c0 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62e1000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc110430 con 0x7f62dc1023c0 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62e1000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc110730 con 0x7f62dc101a20 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1010c0 0x7f62dc19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62daa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 0x7f62dc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62dbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1023c0 0x7f62dc1a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1010c0 0x7f62dc19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59176/0 (socket says 172.21.15.82:59176) 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62db400640 1 -- 172.21.15.82:0/2220860748 learned_addr learned my addr 172.21.15.82:0/2220860748 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62daa00640 1 -- 172.21.15.82:0/2220860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1023c0 msgr2=0x7f62dc1a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62daa00640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1023c0 0x7f62dc1a21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62daa00640 1 -- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1010c0 msgr2=0x7f62dc19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62daa00640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1010c0 0x7f62dc19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.664+0000 7f62daa00640 1 -- 172.21.15.82:0/2220860748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc1a2880 con 0x7f62dc101a20 2024-04-26T20:19:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.665+0000 7f62dbe00640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1023c0 0x7f62dc1a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.665+0000 7f62daa00640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 0x7f62dc19b1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62c800e9f0 tx=0x7f62c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.665+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c800ccc0 con 0x7f62dc101a20 2024-04-26T20:19:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.665+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c8005020 con 0x7f62dc101a20 2024-04-26T20:19:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.665+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8004a00 con 0x7f62dc101a20 2024-04-26T20:19:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.666+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62dc1a2b70 con 0x7f62dc101a20 2024-04-26T20:19:48.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.666+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62dc1a3070 con 0x7f62dc101a20 2024-04-26T20:19:48.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.667+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62dc10c000 con 0x7f62dc101a20 2024-04-26T20:19:48.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.670+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f62c8004ba0 con 0x7f62dc101a20 2024-04-26T20:19:48.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.671+0000 7f62d3e00640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f62c00a3d00 0x7f62c00a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:48.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.671+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f62c80cfe50 con 0x7f62dc101a20 2024-04-26T20:19:48.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.672+0000 7f62db400640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f62c00a3d00 0x7f62c00a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:48.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.672+0000 7f62db400640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f62c00a3d00 0x7f62c00a61c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62cc000c00 tx=0x7f62cc005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:48.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.675+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f62c809ccd0 con 0x7f62dc101a20 2024-04-26T20:19:48.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:48 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2431117837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:48.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:48 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1930722461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:48.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:48 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:48 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:48 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2431117837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:48 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1930722461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:48 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:48 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:48.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.889+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62dc02dc80 con 0x7f62dc101a20 2024-04-26T20:19:48.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.890+0000 7f62d3e00640 1 -- 172.21.15.82:0/2220860748 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f62c809c5d0 con 0x7f62dc101a20 2024-04-26T20:19:48.891 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f62c00a3d00 msgr2=0x7f62c00a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f62c00a3d00 0x7f62c00a61c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62cc000c00 tx=0x7f62cc005a20 comp rx=0 tx=0).stop 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 msgr2=0x7f62dc19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 0x7f62dc19b1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62c800e9f0 tx=0x7f62c800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 shutdown_connections 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f62c00a3d00 0x7f62c00a61c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62dc1023c0 0x7f62dc1a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62dc101a20 0x7f62dc19b1b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 --2- 172.21.15.82:0/2220860748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62dc1010c0 0x7f62dc19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:48.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 >> 172.21.15.82:0/2220860748 conn(0x7f62dc0fcce0 msgr2=0x7f62dc0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 shutdown_connections 2024-04-26T20:19:48.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:48.892+0000 7f62e1000640 1 -- 172.21.15.82:0/2220860748 wait complete. 2024-04-26T20:19:48.909 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:48 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2431117837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:48.909 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:48 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1930722461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:48.910 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:48 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:48.910 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:48 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:48.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 -- 172.21.15.82:0/1322024793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904106760 msgr2=0x7f890410cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 --2- 172.21.15.82:0/1322024793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904106760 0x7f890410cff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009ca0 tx=0x7f88fc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 -- 172.21.15.82:0/1322024793 shutdown_connections 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 --2- 172.21.15.82:0/1322024793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904106760 0x7f890410cff0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 --2- 172.21.15.82:0/1322024793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f8904106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 --2- 172.21.15.82:0/1322024793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8904104bb0 0x7f8904104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 -- 172.21.15.82:0/1322024793 >> 172.21.15.82:0/1322024793 conn(0x7f8904100120 msgr2=0x7f8904102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.087+0000 7f8908a00640 1 -- 172.21.15.82:0/1322024793 shutdown_connections 2024-04-26T20:19:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.088+0000 7f8908a00640 1 -- 172.21.15.82:0/1322024793 wait complete. 2024-04-26T20:19:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 Processor -- start 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 -- start start 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904104bb0 0x7f890419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f890419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8904106760 0x7f89041a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89041106e0 con 0x7f8904104bb0 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8904110560 con 0x7f8904105da0 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.089+0000 7f8908a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8904110860 con 0x7f8904106760 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904104bb0 0x7f890419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f890419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f890419b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55344/0 (socket says 172.21.15.82:55344) 2024-04-26T20:19:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8902800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8904106760 0x7f89041a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 -- 172.21.15.82:0/1643890805 learned_addr learned my addr 172.21.15.82:0/1643890805 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 -- 172.21.15.82:0/1643890805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8904106760 msgr2=0x7f89041a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8904106760 0x7f89041a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 -- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904104bb0 msgr2=0x7f890419ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904104bb0 0x7f890419ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 -- 172.21.15.82:0/1643890805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89041a29b0 con 0x7f8904105da0 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.090+0000 7f8901400640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f890419b2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f88f000ea60 tx=0x7f88f000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.091+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f000cde0 con 0x7f8904105da0 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.091+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89041a2ca0 con 0x7f8904105da0 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.091+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f00035f0 con 0x7f8904105da0 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.091+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0018690 con 0x7f8904105da0 2024-04-26T20:19:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.091+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89041a3190 con 0x7f8904105da0 2024-04-26T20:19:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.092+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890410bed0 con 0x7f8904105da0 2024-04-26T20:19:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.095+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f88f0003a10 con 0x7f8904105da0 2024-04-26T20:19:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.096+0000 7f88faa00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e80a3c30 0x7f88e80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.097+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f88f00d0490 con 0x7f8904105da0 2024-04-26T20:19:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.097+0000 7f8901e00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e80a3c30 0x7f88e80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.097+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f88f009d270 con 0x7f8904105da0 2024-04-26T20:19:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.098+0000 7f8901e00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e80a3c30 0x7f88e80a60f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f890419c270 tx=0x7f88f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:49.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.308+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f890402dcd0 con 0x7f8904105da0 2024-04-26T20:19:49.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.309+0000 7f88faa00640 1 -- 172.21.15.82:0/1643890805 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f88f009cb70 con 0x7f8904105da0 2024-04-26T20:19:49.310 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:49.310 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-04-26T20:19:49.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:19:49.311 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-04-26T20:19:49.311 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-04-26T20:19:49.311 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:19:49.311 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e80a3c30 msgr2=0x7f88e80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e80a3c30 0x7f88e80a60f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f890419c270 tx=0x7f88f4005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 msgr2=0x7f890419b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f890419b2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f88f000ea60 tx=0x7f88f000ef20 comp rx=0 tx=0).stop 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 shutdown_connections 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e80a3c30 0x7f88e80a60f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8904106760 0x7f89041a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8904105da0 0x7f890419b2e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 --2- 172.21.15.82:0/1643890805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8904104bb0 0x7f890419ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.311+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 >> 172.21.15.82:0/1643890805 conn(0x7f8904100120 msgr2=0x7f89041090a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:49.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.312+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 shutdown_connections 2024-04-26T20:19:49.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.312+0000 7f8908a00640 1 -- 172.21.15.82:0/1643890805 wait complete. 2024-04-26T20:19:49.330 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T20:19:49.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 -- 172.21.15.82:0/2052352469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 msgr2=0x7fd52010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 --2- 172.21.15.82:0/2052352469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 0x7fd52010aab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd518009900 tx=0x7fd51802a410 comp rx=0 tx=0).stop 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 -- 172.21.15.82:0/2052352469 shutdown_connections 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 --2- 172.21.15.82:0/2052352469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 0x7fd52010aab0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 --2- 172.21.15.82:0/2052352469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd520108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 --2- 172.21.15.82:0/2052352469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 0x7fd5201057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 -- 172.21.15.82:0/2052352469 >> 172.21.15.82:0/2052352469 conn(0x7fd5200fcdf0 msgr2=0x7fd5200ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 -- 172.21.15.82:0/2052352469 shutdown_connections 2024-04-26T20:19:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.512+0000 7fd524a00640 1 -- 172.21.15.82:0/2052352469 wait complete. 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.513+0000 7fd524a00640 1 Processor -- start 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.513+0000 7fd524a00640 1 -- start start 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd524a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 0x7fd52019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd524a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd52019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd524a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 0x7fd5201a2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd524a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010e4b0 con 0x7fd520105d30 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd524a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010e330 con 0x7fd520103400 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd524a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010e630 con 0x7fd520108660 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd51d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd52019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd51d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd52019b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59212/0 (socket says 172.21.15.82:59212) 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd51d400640 1 -- 172.21.15.82:0/3817157122 learned_addr learned my addr 172.21.15.82:0/3817157122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd51e800640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 0x7fd5201a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.514+0000 7fd51de00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 0x7fd52019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51d400640 1 -- 172.21.15.82:0/3817157122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 msgr2=0x7fd5201a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51d400640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 0x7fd5201a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51d400640 1 -- 172.21.15.82:0/3817157122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 msgr2=0x7fd52019adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51d400640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 0x7fd52019adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51d400640 1 -- 172.21.15.82:0/3817157122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5201a29d0 con 0x7fd520105d30 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51de00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 0x7fd52019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd51d400640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd52019b2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd50800e9c0 tx=0x7fd50800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50800cd80 con 0x7fd520105d30 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5080054d0 con 0x7fd520105d30 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508010430 con 0x7fd520105d30 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5201a2cc0 con 0x7fd520105d30 2024-04-26T20:19:49.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.515+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5201a31c0 con 0x7fd520105d30 2024-04-26T20:19:49.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.516+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52010a150 con 0x7fd520105d30 2024-04-26T20:19:49.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.519+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fd508005020 con 0x7fd520105d30 2024-04-26T20:19:49.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.521+0000 7fd516a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5040a3c30 0x7fd5040a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:49.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.521+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd5080d0400 con 0x7fd520105d30 2024-04-26T20:19:49.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.522+0000 7fd51de00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5040a3c30 0x7fd5040a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:49.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.522+0000 7fd51de00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5040a3c30 0x7fd5040a60f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd510005fd0 tx=0x7fd510009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:49.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.526+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd50809d1e0 con 0x7fd520105d30 2024-04-26T20:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:49 smithi082 ceph-mon[28105]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:49 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2220860748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:49 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1643890805' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T20:19:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:49.734+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd52002dad0 con 0x7fd520105d30 2024-04-26T20:19:49.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:49 smithi139 ceph-mon[32999]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:49 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2220860748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:49.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:49 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1643890805' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T20:19:49.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:49 smithi135 ceph-mon[32816]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:49 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2220860748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:19:49.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:49 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1643890805' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T20:19:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.607+0000 7fd516a00640 1 -- 172.21.15.82:0/3817157122 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7fd50809cae0 con 0x7fd520105d30 2024-04-26T20:19:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-04-26T20:19:50.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.611+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5040a3c30 msgr2=0x7fd5040a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:50.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.611+0000 7fd524a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5040a3c30 0x7fd5040a60f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd510005fd0 tx=0x7fd510009500 comp rx=0 tx=0).stop 2024-04-26T20:19:50.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.611+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 msgr2=0x7fd52019b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:50.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.611+0000 7fd524a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd52019b2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd50800e9c0 tx=0x7fd50800ee80 comp rx=0 tx=0).stop 2024-04-26T20:19:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 shutdown_connections 2024-04-26T20:19:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5040a3c30 0x7fd5040a60f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd520108660 0x7fd5201a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd520105d30 0x7fd52019b2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 --2- 172.21.15.82:0/3817157122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd520103400 0x7fd52019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 >> 172.21.15.82:0/3817157122 conn(0x7fd5200fcdf0 msgr2=0x7fd520102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.613+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 shutdown_connections 2024-04-26T20:19:50.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.614+0000 7fd524a00640 1 -- 172.21.15.82:0/3817157122 wait complete. 2024-04-26T20:19:50.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T20:19:50.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 -- 172.21.15.82:0/1651738892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0105c60 msgr2=0x7f4bb01060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:50.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 --2- 172.21.15.82:0/1651738892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0105c60 0x7f4bb01060e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009900 tx=0x7f4b9802a410 comp rx=0 tx=0).stop 2024-04-26T20:19:50.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 -- 172.21.15.82:0/1651738892 shutdown_connections 2024-04-26T20:19:50.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 --2- 172.21.15.82:0/1651738892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 0x7f4bb010ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 --2- 172.21.15.82:0/1651738892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0105c60 0x7f4bb01060e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 --2- 172.21.15.82:0/1651738892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0104a70 0x7f4bb0104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 -- 172.21.15.82:0/1651738892 >> 172.21.15.82:0/1651738892 conn(0x7f4bb00fffe0 msgr2=0x7f4bb0102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:50.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.833+0000 7f4bb5400640 1 -- 172.21.15.82:0/1651738892 shutdown_connections 2024-04-26T20:19:50.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.834+0000 7f4bb5400640 1 -- 172.21.15.82:0/1651738892 wait complete. 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.834+0000 7f4bb5400640 1 Processor -- start 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 -- start start 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0104a70 0x7f4bb019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 0x7f4bb019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 0x7f4bb01a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01105d0 con 0x7f4bb0104a70 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb0110450 con 0x7f4bb0106620 2024-04-26T20:19:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb5400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb0110750 con 0x7f4bb0105c60 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4ba7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 0x7f4bb019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bafe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0104a70 0x7f4bb019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4ba7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 0x7f4bb019b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47114/0 (socket says 172.21.15.82:47114) 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4bb4a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 0x7f4bb01a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4ba7e00640 1 -- 172.21.15.82:0/773241536 learned_addr learned my addr 172.21.15.82:0/773241536 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4ba7e00640 1 -- 172.21.15.82:0/773241536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 msgr2=0x7f4bb01a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.835+0000 7f4ba7e00640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 0x7f4bb01a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4ba7e00640 1 -- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0104a70 msgr2=0x7f4bb019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4ba7e00640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0104a70 0x7f4bb019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4ba7e00640 1 -- 172.21.15.82:0/773241536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb01a28e0 con 0x7f4bb0105c60 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4bb4a00640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 0x7f4bb01a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4ba7e00640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 0x7f4bb019b1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b98005ab0 tx=0x7f4b98003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:50.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9803f070 con 0x7f4bb0105c60 2024-04-26T20:19:50.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b98031c50 con 0x7f4bb0105c60 2024-04-26T20:19:50.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb01a2b70 con 0x7f4bb0105c60 2024-04-26T20:19:50.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98035030 con 0x7f4bb0105c60 2024-04-26T20:19:50.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.836+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb01a30b0 con 0x7f4bb0105c60 2024-04-26T20:19:50.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.838+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb010beb0 con 0x7f4bb0105c60 2024-04-26T20:19:50.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.839+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4b98042070 con 0x7f4bb0105c60 2024-04-26T20:19:50.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.841+0000 7f4bad600640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4b940a3c30 0x7f4b940a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:50.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.841+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f4b980f07a0 con 0x7f4bb0105c60 2024-04-26T20:19:50.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.841+0000 7f4bafe00640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4b940a3c30 0x7f4b940a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:50.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.842+0000 7f4bafe00640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4b940a3c30 0x7f4b940a60f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4bb019bb70 tx=0x7f4ba0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:50.845+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f4b980bcdc0 con 0x7f4bb0105c60 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3817157122' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T20:19:50.864 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3817157122' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T20:19:50.865 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3817157122' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T20:19:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:51.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.070+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4bb002dad0 con 0x7f4bb0105c60 2024-04-26T20:19:51.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.637+0000 7f4bad600640 1 -- 172.21.15.82:0/773241536 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7f4b980c10c0 con 0x7f4bb0105c60 2024-04-26T20:19:51.639 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-04-26T20:19:51.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.643+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4b940a3c30 msgr2=0x7f4b940a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:51.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.643+0000 7f4bb5400640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4b940a3c30 0x7f4b940a60f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4bb019bb70 tx=0x7f4ba0005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:51.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.643+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 msgr2=0x7f4bb019b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.643+0000 7f4bb5400640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 0x7f4bb019b1e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b98005ab0 tx=0x7f4b98003b90 comp rx=0 tx=0).stop 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 shutdown_connections 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4b940a3c30 0x7f4b940a60f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb0106620 0x7f4bb01a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bb0105c60 0x7f4bb019b1e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 --2- 172.21.15.82:0/773241536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb0104a70 0x7f4bb019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 >> 172.21.15.82:0/773241536 conn(0x7f4bb00fffe0 msgr2=0x7f4bb0109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:51.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 shutdown_connections 2024-04-26T20:19:51.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.644+0000 7f4bb5400640 1 -- 172.21.15.82:0/773241536 wait complete. 2024-04-26T20:19:51.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T20:19:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 -- 172.21.15.82:0/1870302847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58105da0 msgr2=0x7f2c58106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 --2- 172.21.15.82:0/1870302847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58105da0 0x7f2c58106220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009900 tx=0x7f2c4402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 -- 172.21.15.82:0/1870302847 shutdown_connections 2024-04-26T20:19:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 --2- 172.21.15.82:0/1870302847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58106760 0x7f2c5810cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 --2- 172.21.15.82:0/1870302847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58105da0 0x7f2c58106220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 --2- 172.21.15.82:0/1870302847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58104bb0 0x7f2c58104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 -- 172.21.15.82:0/1870302847 >> 172.21.15.82:0/1870302847 conn(0x7f2c58100120 msgr2=0x7f2c58102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.868+0000 7f2c5d000640 1 -- 172.21.15.82:0/1870302847 shutdown_connections 2024-04-26T20:19:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.869+0000 7f2c5d000640 1 -- 172.21.15.82:0/1870302847 wait complete. 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 Processor -- start 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 -- start start 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58104bb0 0x7f2c5819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58105da0 0x7f2c5819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 0x7f2c581a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58110710 con 0x7f2c58104bb0 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58110590 con 0x7f2c58106760 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c5d000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58110890 con 0x7f2c58105da0 2024-04-26T20:19:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c55400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58105da0 0x7f2c5819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c55e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58104bb0 0x7f2c5819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c56800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 0x7f2c581a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c56800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 0x7f2c581a23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52784/0 (socket says 172.21.15.82:52784) 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c56800640 1 -- 172.21.15.82:0/3765977032 learned_addr learned my addr 172.21.15.82:0/3765977032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.870+0000 7f2c55400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58105da0 0x7f2c5819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47132/0 (socket says 172.21.15.82:47132) 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c56800640 1 -- 172.21.15.82:0/3765977032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58105da0 msgr2=0x7f2c5819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c56800640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58105da0 0x7f2c5819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c56800640 1 -- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58104bb0 msgr2=0x7f2c5819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c56800640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58104bb0 0x7f2c5819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c56800640 1 -- 172.21.15.82:0/3765977032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c581a2a50 con 0x7f2c58106760 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c56800640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 0x7f2c581a23e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000efd0 tx=0x7f2c5000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50003b70 con 0x7f2c58106760 2024-04-26T20:19:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c50003d10 con 0x7f2c58106760 2024-04-26T20:19:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c581a2d40 con 0x7f2c58106760 2024-04-26T20:19:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c500108a0 con 0x7f2c58106760 2024-04-26T20:19:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.871+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c581a3200 con 0x7f2c58106760 2024-04-26T20:19:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.873+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5810bfa0 con 0x7f2c58106760 2024-04-26T20:19:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.874+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2c50004020 con 0x7f2c58106760 2024-04-26T20:19:51.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.875+0000 7f2c4ea00640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2c3c0a3c30 0x7f2c3c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:51.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.876+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f2c500d0640 con 0x7f2c58106760 2024-04-26T20:19:51.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.876+0000 7f2c55e00640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2c3c0a3c30 0x7f2c3c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:51.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.876+0000 7f2c55e00640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2c3c0a3c30 0x7f2c3c0a60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c58105c00 tx=0x7f2c48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:51.880+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2c5009d130 con 0x7f2c58106760 2024-04-26T20:19:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:51 smithi082 ceph-mon[28105]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:51 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3817157122' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T20:19:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:51 smithi082 ceph-mon[28105]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T20:19:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:51 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/773241536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-26T20:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:51 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-26T20:19:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:51 smithi139 ceph-mon[32999]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:51 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3817157122' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T20:19:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:51 smithi139 ceph-mon[32999]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T20:19:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:51 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/773241536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-26T20:19:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:51 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-26T20:19:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:51 smithi135 ceph-mon[32816]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:51 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3817157122' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T20:19:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:51 smithi135 ceph-mon[32816]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T20:19:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:51 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/773241536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-26T20:19:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:51 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-26T20:19:52.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.132+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2c5802dad0 con 0x7f2c58106760 2024-04-26T20:19:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.686+0000 7f2c4ea00640 1 -- 172.21.15.82:0/3765977032 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f2c5009ca30 con 0x7f2c58106760 2024-04-26T20:19:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T20:19:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2c3c0a3c30 msgr2=0x7f2c3c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2c3c0a3c30 0x7f2c3c0a60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c58105c00 tx=0x7f2c48005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 msgr2=0x7f2c581a23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 0x7f2c581a23e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000efd0 tx=0x7f2c5000c6a0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 shutdown_connections 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2c3c0a3c30 0x7f2c3c0a60f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58106760 0x7f2c581a23e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c58105da0 0x7f2c5819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 --2- 172.21.15.82:0/3765977032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58104bb0 0x7f2c5819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 >> 172.21.15.82:0/3765977032 conn(0x7f2c58100120 msgr2=0x7f2c58109170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.689+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 shutdown_connections 2024-04-26T20:19:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.690+0000 7f2c5d000640 1 -- 172.21.15.82:0/3765977032 wait complete. 2024-04-26T20:19:52.714 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T20:19:52.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T20:19:52.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 -- 172.21.15.82:0/4157025563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101280 msgr2=0x7fa6e81016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 --2- 172.21.15.82:0/4157025563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101280 0x7fa6e81016a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009900 tx=0x7fa6d802a480 comp rx=0 tx=0).stop 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 -- 172.21.15.82:0/4157025563 shutdown_connections 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 --2- 172.21.15.82:0/4157025563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e8102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 --2- 172.21.15.82:0/4157025563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e8101be0 0x7fa6e8102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 --2- 172.21.15.82:0/4157025563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101280 0x7fa6e81016a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 -- 172.21.15.82:0/4157025563 >> 172.21.15.82:0/4157025563 conn(0x7fa6e80fce40 msgr2=0x7fa6e80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 -- 172.21.15.82:0/4157025563 shutdown_connections 2024-04-26T20:19:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.896+0000 7fa6ef000640 1 -- 172.21.15.82:0/4157025563 wait complete. 2024-04-26T20:19:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.897+0000 7fa6ef000640 1 Processor -- start 2024-04-26T20:19:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.897+0000 7fa6ef000640 1 -- start start 2024-04-26T20:19:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.897+0000 7fa6ef000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e8101280 0x7fa6e819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.897+0000 7fa6ef000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101be0 0x7fa6e819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.897+0000 7fa6ef000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e81a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ef000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e8110710 con 0x7fa6e8102580 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ef000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e8110590 con 0x7fa6e8101280 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ef000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e8110890 con 0x7fa6e8101be0 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e81a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6e7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101be0 0x7fa6e819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e81a2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40244/0 (socket says 172.21.15.82:40244) 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 -- 172.21.15.82:0/1319343401 learned_addr learned my addr 172.21.15.82:0/1319343401 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6e7e00640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e8101280 0x7fa6e819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 -- 172.21.15.82:0/1319343401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101be0 msgr2=0x7fa6e819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101be0 0x7fa6e819b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 -- 172.21.15.82:0/1319343401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e8101280 msgr2=0x7fa6e819adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e8101280 0x7fa6e819adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 -- 172.21.15.82:0/1319343401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e81a29e0 con 0x7fa6e8102580 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.898+0000 7fa6ed000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e81a2370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000eb10 tx=0x7fa6e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.899+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0004b20 con 0x7fa6e8102580 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.899+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6e0004cc0 con 0x7fa6e8102580 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.899+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e81a2cd0 con 0x7fa6e8102580 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.899+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0010670 con 0x7fa6e8102580 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.899+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e81a31d0 con 0x7fa6e8102580 2024-04-26T20:19:52.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.900+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e8069bd0 con 0x7fa6e8102580 2024-04-26T20:19:52.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.902+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa6e0005020 con 0x7fa6e8102580 2024-04-26T20:19:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.904+0000 7fa6e4c00640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6cc0a3c30 0x7fa6cc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.904+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fa6e00d0880 con 0x7fa6e8102580 2024-04-26T20:19:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.904+0000 7fa6e7e00640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6cc0a3c30 0x7fa6cc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:52.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.904+0000 7fa6e7e00640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6cc0a3c30 0x7fa6cc0a60f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8031500 tx=0x7fa6d8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:52.909+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa6e8069bd0 con 0x7fa6e8102580 2024-04-26T20:19:52.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:52.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-26T20:19:52.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T20:19:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3765977032' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:19:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:19:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:52 smithi082 ceph-mon[28105]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3765977032' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:19:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:52 smithi139 ceph-mon[32999]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T20:19:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3765977032' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T20:19:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:52 smithi135 ceph-mon[32816]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T20:19:53.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.120+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fa6e8063560 con 0x7fa6e8102580 2024-04-26T20:19:53.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.629+0000 7fa6e4c00640 1 -- 172.21.15.82:0/1319343401 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7fa6e009d310 con 0x7fa6e8102580 2024-04-26T20:19:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6cc0a3c30 msgr2=0x7fa6cc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6cc0a3c30 0x7fa6cc0a60f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8031500 tx=0x7fa6d8005a20 comp rx=0 tx=0).stop 2024-04-26T20:19:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 msgr2=0x7fa6e81a2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e81a2370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000eb10 tx=0x7fa6e000c2d0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 shutdown_connections 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6cc0a3c30 0x7fa6cc0a60f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e8102580 0x7fa6e81a2370 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e8101be0 0x7fa6e819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 --2- 172.21.15.82:0/1319343401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e8101280 0x7fa6e819adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.633+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 >> 172.21.15.82:0/1319343401 conn(0x7fa6e80fce40 msgr2=0x7fa6e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.634+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 shutdown_connections 2024-04-26T20:19:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.634+0000 7fa6ef000640 1 -- 172.21.15.82:0/1319343401 wait complete. 2024-04-26T20:19:53.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T20:19:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.869+0000 7fd6a2000640 1 -- 172.21.15.82:0/1550715041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104b90 msgr2=0x7fd69c104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.869+0000 7fd6a2000640 1 --2- 172.21.15.82:0/1550715041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104b90 0x7fd69c104fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009900 tx=0x7fd68c02a410 comp rx=0 tx=0).stop 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 -- 172.21.15.82:0/1550715041 shutdown_connections 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 --2- 172.21.15.82:0/1550715041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c106740 0x7fd69c10cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 --2- 172.21.15.82:0/1550715041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd69c105d80 0x7fd69c106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 --2- 172.21.15.82:0/1550715041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c104b90 0x7fd69c104fb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 -- 172.21.15.82:0/1550715041 >> 172.21.15.82:0/1550715041 conn(0x7fd69c100120 msgr2=0x7fd69c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 -- 172.21.15.82:0/1550715041 shutdown_connections 2024-04-26T20:19:53.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.870+0000 7fd6a2000640 1 -- 172.21.15.82:0/1550715041 wait complete. 2024-04-26T20:19:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 Processor -- start 2024-04-26T20:19:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 -- start start 2024-04-26T20:19:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd69c104b90 0x7fd69c19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:53.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c105d80 0x7fd69c19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 0x7fd69c1a2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c1106e0 con 0x7fd69c106740 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c110560 con 0x7fd69c104b90 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd6a2000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c110860 con 0x7fd69c105d80 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd69be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 0x7fd69c1a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd69be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 0x7fd69c1a2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40264/0 (socket says 172.21.15.82:40264) 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd69be00640 1 -- 172.21.15.82:0/892408674 learned_addr learned my addr 172.21.15.82:0/892408674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd69aa00640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c105d80 0x7fd69c19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.871+0000 7fd69b400640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd69c104b90 0x7fd69c19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69aa00640 1 -- 172.21.15.82:0/892408674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd69c104b90 msgr2=0x7fd69c19ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69aa00640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd69c104b90 0x7fd69c19ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69aa00640 1 -- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 msgr2=0x7fd69c1a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:53.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69aa00640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 0x7fd69c1a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69aa00640 1 -- 172.21.15.82:0/892408674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c1a2a00 con 0x7fd69c105d80 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69be00640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 0x7fd69c1a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd69aa00640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c105d80 0x7fd69c19b320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd68800e9f0 tx=0x7fd68800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.872+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68800ccc0 con 0x7fd69c105d80 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.873+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6880108e0 con 0x7fd69c105d80 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.873+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c1a2cf0 con 0x7fd69c105d80 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.873+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688018880 con 0x7fd69c105d80 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.873+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c1a3230 con 0x7fd69c105d80 2024-04-26T20:19:53.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.874+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c10bf30 con 0x7fd69c105d80 2024-04-26T20:19:53.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.876+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fd688010430 con 0x7fd69c105d80 2024-04-26T20:19:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.878+0000 7fd693e00640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd6800a3c30 0x7fd6800a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.878+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fd6880d06e0 con 0x7fd69c105d80 2024-04-26T20:19:53.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.878+0000 7fd69b400640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd6800a3c30 0x7fd6800a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.879+0000 7fd69b400640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd6800a3c30 0x7fd6800a60f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd68c005ab0 tx=0x7fd68c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:53.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:53.880+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd68809c9e0 con 0x7fd69c105d80 2024-04-26T20:19:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: pgmap v316: 97 pgs: 29 creating+peering, 7 active+clean, 61 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T20:19:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:53 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1319343401' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: pgmap v316: 97 pgs: 29 creating+peering, 7 active+clean, 61 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T20:19:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T20:19:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T20:19:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:53 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1319343401' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-26T20:19:54.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:54.083+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd69c02dad0 con 0x7fd69c105d80 2024-04-26T20:19:54.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: pgmap v316: 97 pgs: 29 creating+peering, 7 active+clean, 61 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T20:19:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:53 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1319343401' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-26T20:19:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1319343401' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-26T20:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T20:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] up:active 2024-04-26T20:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/892408674' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:54 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1319343401' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] up:active 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/892408674' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:19:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:54 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:19:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1319343401' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-26T20:19:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T20:19:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] up:active 2024-04-26T20:19:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/892408674' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:19:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:54 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T20:19:55.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.714+0000 7fd693e00640 1 -- 172.21.15.82:0/892408674 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7fd6880a0ce0 con 0x7fd69c105d80 2024-04-26T20:19:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' created 2024-04-26T20:19:55.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.720+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd6800a3c30 msgr2=0x7fd6800a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:55.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.720+0000 7fd6a2000640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd6800a3c30 0x7fd6800a60f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd68c005ab0 tx=0x7fd68c005a20 comp rx=0 tx=0).stop 2024-04-26T20:19:55.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.720+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c105d80 msgr2=0x7fd69c19b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:55.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.720+0000 7fd6a2000640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c105d80 0x7fd69c19b320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd68800e9f0 tx=0x7fd68800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.721+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 shutdown_connections 2024-04-26T20:19:55.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.722+0000 7fd6a2000640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd6800a3c30 0x7fd6800a60f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.722+0000 7fd6a2000640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd69c106740 0x7fd69c1a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.722+0000 7fd6a2000640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd69c105d80 0x7fd69c19b320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.722+0000 7fd6a2000640 1 --2- 172.21.15.82:0/892408674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd69c104b90 0x7fd69c19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.722+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 >> 172.21.15.82:0/892408674 conn(0x7fd69c100120 msgr2=0x7fd69c109100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.722+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 shutdown_connections 2024-04-26T20:19:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.723+0000 7fd6a2000640 1 -- 172.21.15.82:0/892408674 wait complete. 2024-04-26T20:19:55.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 -- 172.21.15.82:0/3699891680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 msgr2=0x7f1e78102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 --2- 172.21.15.82:0/3699891680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 0x7f1e78102040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009ca0 tx=0x7f1e6002a950 comp rx=0 tx=0).stop 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 -- 172.21.15.82:0/3699891680 shutdown_connections 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 --2- 172.21.15.82:0/3699891680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78102580 0x7f1e78102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 --2- 172.21.15.82:0/3699891680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 0x7f1e78102040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 --2- 172.21.15.82:0/3699891680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e78101280 0x7f1e781016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 -- 172.21.15.82:0/3699891680 >> 172.21.15.82:0/3699891680 conn(0x7f1e780fce20 msgr2=0x7f1e780ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:55.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 -- 172.21.15.82:0/3699891680 shutdown_connections 2024-04-26T20:19:55.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.933+0000 7f1e7d800640 1 -- 172.21.15.82:0/3699891680 wait complete. 2024-04-26T20:19:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.934+0000 7f1e7d800640 1 Processor -- start 2024-04-26T20:19:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.934+0000 7f1e7d800640 1 -- start start 2024-04-26T20:19:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e7d800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 0x7f1e7819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e7d800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 0x7f1e7819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e7d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e78102580 0x7f1e781a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:55.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e7d800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78110710 con 0x7f1e78101280 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e7d800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78110590 con 0x7f1e78102580 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e7d800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78110890 con 0x7f1e78101be0 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 0x7f1e7819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 0x7f1e7819adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40280/0 (socket says 172.21.15.82:40280) 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 -- 172.21.15.82:0/2952034682 learned_addr learned my addr 172.21.15.82:0/2952034682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76000640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 0x7f1e7819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e77400640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e78102580 0x7f1e781a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 -- 172.21.15.82:0/2952034682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 msgr2=0x7f1e7819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 0x7f1e7819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 -- 172.21.15.82:0/2952034682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e78102580 msgr2=0x7f1e781a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e78102580 0x7f1e781a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.935+0000 7f1e76a00640 1 -- 172.21.15.82:0/2952034682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e781a2a10 con 0x7f1e78101280 2024-04-26T20:19:55.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.936+0000 7f1e76a00640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 0x7f1e7819adf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000e9f0 tx=0x7f1e7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.936+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000cd80 con 0x7f1e78101280 2024-04-26T20:19:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.936+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e781a2d00 con 0x7f1e78101280 2024-04-26T20:19:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.936+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e700054d0 con 0x7f1e78101280 2024-04-26T20:19:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.936+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70010690 con 0x7f1e78101280 2024-04-26T20:19:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.936+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e781a31d0 con 0x7f1e78101280 2024-04-26T20:19:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.937+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e7810bfd0 con 0x7f1e78101280 2024-04-26T20:19:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.939+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1e70004e30 con 0x7f1e78101280 2024-04-26T20:19:55.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.941+0000 7f1e6f400640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1e5c0a3bb0 0x7f1e5c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.941+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7f1e700d0d40 con 0x7f1e78101280 2024-04-26T20:19:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.941+0000 7f1e76000640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1e5c0a3bb0 0x7f1e5c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.942+0000 7f1e76000640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1e5c0a3bb0 0x7f1e5c0a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e60000f80 tx=0x7f1e6002f870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:55.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:55.944+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1e70054060 con 0x7f1e78101280 2024-04-26T20:19:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:55 smithi139 ceph-mon[32999]: pgmap v319: 97 pgs: 35 creating+peering, 43 active+clean, 19 unknown; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-04-26T20:19:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:55 smithi139 ceph-mon[32999]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T20:19:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:55 smithi139 ceph-mon[32999]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T20:19:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:55 smithi139 ceph-mon[32999]: Cluster is now healthy 2024-04-26T20:19:56.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:55 smithi135 ceph-mon[32816]: pgmap v319: 97 pgs: 35 creating+peering, 43 active+clean, 19 unknown; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-04-26T20:19:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:55 smithi135 ceph-mon[32816]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T20:19:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:55 smithi135 ceph-mon[32816]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T20:19:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:55 smithi135 ceph-mon[32816]: Cluster is now healthy 2024-04-26T20:19:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.145+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1e7802dad0 con 0x7f1e78101280 2024-04-26T20:19:56.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:55 smithi082 ceph-mon[28105]: pgmap v319: 97 pgs: 35 creating+peering, 43 active+clean, 19 unknown; 578 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-04-26T20:19:56.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:55 smithi082 ceph-mon[28105]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T20:19:56.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:55 smithi082 ceph-mon[28105]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T20:19:56.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:55 smithi082 ceph-mon[28105]: Cluster is now healthy 2024-04-26T20:19:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.713+0000 7f1e6f400640 1 -- 172.21.15.82:0/2952034682 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7f1e7009d4a0 con 0x7f1e78101280 2024-04-26T20:19:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T20:19:56.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.718+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1e5c0a3bb0 msgr2=0x7f1e5c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:56.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.718+0000 7f1e7d800640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1e5c0a3bb0 0x7f1e5c0a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e60000f80 tx=0x7f1e6002f870 comp rx=0 tx=0).stop 2024-04-26T20:19:56.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.718+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 msgr2=0x7f1e7819adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:56.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.718+0000 7f1e7d800640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 0x7f1e7819adf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000e9f0 tx=0x7f1e7000edf0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 shutdown_connections 2024-04-26T20:19:56.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1e5c0a3bb0 0x7f1e5c0a6070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e78102580 0x7f1e781a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e78101be0 0x7f1e7819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 --2- 172.21.15.82:0/2952034682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e78101280 0x7f1e7819adf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 >> 172.21.15.82:0/2952034682 conn(0x7f1e780fce20 msgr2=0x7f1e780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:56.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 shutdown_connections 2024-04-26T20:19:56.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.719+0000 7f1e7d800640 1 -- 172.21.15.82:0/2952034682 wait complete. 2024-04-26T20:19:56.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T20:19:56.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 -- 172.21.15.82:0/3611743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 msgr2=0x7f6038104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 --2- 172.21.15.82:0/3611743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f6038104fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6028009900 tx=0x7f602802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 -- 172.21.15.82:0/3611743637 shutdown_connections 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 --2- 172.21.15.82:0/3611743637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 0x7f603810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 --2- 172.21.15.82:0/3611743637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f6038106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 --2- 172.21.15.82:0/3611743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f6038104fb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 -- 172.21.15.82:0/3611743637 >> 172.21.15.82:0/3611743637 conn(0x7f6038100120 msgr2=0x7f6038102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 -- 172.21.15.82:0/3611743637 shutdown_connections 2024-04-26T20:19:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.935+0000 7f603ce00640 1 -- 172.21.15.82:0/3611743637 wait complete. 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 Processor -- start 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 -- start start 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f603819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f603819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 0x7f60381a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6038110710 con 0x7f6038104b90 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6038110590 con 0x7f6038105d80 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.936+0000 7f603ce00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6038110890 con 0x7f6038106740 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f603819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f602fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f603819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f603819adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40306/0 (socket says 172.21.15.82:40306) 2024-04-26T20:19:56.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 -- 172.21.15.82:0/2645718929 learned_addr learned my addr 172.21.15.82:0/2645718929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f602fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f603819b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52852/0 (socket says 172.21.15.82:52852) 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6036800640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 0x7f60381a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 -- 172.21.15.82:0/2645718929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 msgr2=0x7f60381a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 0x7f60381a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 -- 172.21.15.82:0/2645718929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 msgr2=0x7f603819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f603819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 -- 172.21.15.82:0/2645718929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60381a2a10 con 0x7f6038104b90 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6036800640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 0x7f60381a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f602fe00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f603819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.937+0000 7f6035e00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f603819adf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6028031500 tx=0x7f6028003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.938+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602803f070 con 0x7f6038104b90 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.938+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6028031c50 con 0x7f6038104b90 2024-04-26T20:19:56.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.938+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60381a2ca0 con 0x7f6038104b90 2024-04-26T20:19:56.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.938+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028035030 con 0x7f6038104b90 2024-04-26T20:19:56.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.938+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60381a3190 con 0x7f6038104b90 2024-04-26T20:19:56.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.939+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603810bf30 con 0x7f6038104b90 2024-04-26T20:19:56.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.941+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6028042070 con 0x7f6038104b90 2024-04-26T20:19:56.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.942+0000 7f602ea00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f601c0a3bb0 0x7f601c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.943+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f60280f0e30 con 0x7f6038104b90 2024-04-26T20:19:56.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.943+0000 7f602fe00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f601c0a3bb0 0x7f601c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:56.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.943+0000 7f602fe00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f601c0a3bb0 0x7f601c0a6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60200095f0 tx=0x7f6020005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:56.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:56.947+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f60280bd590 con 0x7f6038104b90 2024-04-26T20:19:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:56 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T20:19:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:56 smithi139 ceph-mon[32999]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T20:19:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:56 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2952034682' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-26T20:19:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:56 smithi139 ceph-mon[32999]: pgmap v322: 129 pgs: 35 creating+peering, 73 active+clean, 21 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 9 op/s 2024-04-26T20:19:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:56 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2952034682' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-26T20:19:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:56 smithi139 ceph-mon[32999]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T20:19:57.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:56 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T20:19:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:56 smithi135 ceph-mon[32816]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T20:19:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:56 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2952034682' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-26T20:19:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:56 smithi135 ceph-mon[32816]: pgmap v322: 129 pgs: 35 creating+peering, 73 active+clean, 21 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 9 op/s 2024-04-26T20:19:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:56 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2952034682' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-26T20:19:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:56 smithi135 ceph-mon[32816]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T20:19:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:56 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T20:19:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:56 smithi082 ceph-mon[28105]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T20:19:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:56 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2952034682' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-26T20:19:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:56 smithi082 ceph-mon[28105]: pgmap v322: 129 pgs: 35 creating+peering, 73 active+clean, 21 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 9 op/s 2024-04-26T20:19:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:56 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2952034682' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-26T20:19:57.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:56 smithi082 ceph-mon[28105]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T20:19:57.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.192+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6038063530 con 0x7f6038104b90 2024-04-26T20:19:57.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.758+0000 7f602ea00640 1 -- 172.21.15.82:0/2645718929 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f60280bce90 con 0x7f6038104b90 2024-04-26T20:19:57.759 INFO:teuthology.orchestra.run.smithi082.stderr:added data pool 4 to fsmap 2024-04-26T20:19:57.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.761+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f601c0a3bb0 msgr2=0x7f601c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.761+0000 7f603ce00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f601c0a3bb0 0x7f601c0a6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60200095f0 tx=0x7f6020005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.761+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 msgr2=0x7f603819adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.761+0000 7f603ce00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f603819adf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6028031500 tx=0x7f6028003c10 comp rx=0 tx=0).stop 2024-04-26T20:19:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 shutdown_connections 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f601c0a3bb0 0x7f601c0a6070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6038106740 0x7f60381a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6038105d80 0x7f603819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 --2- 172.21.15.82:0/2645718929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6038104b90 0x7f603819adf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 >> 172.21.15.82:0/2645718929 conn(0x7f6038100120 msgr2=0x7f6038109100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 shutdown_connections 2024-04-26T20:19:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.762+0000 7f603ce00640 1 -- 172.21.15.82:0/2645718929 wait complete. 2024-04-26T20:19:57.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 -- 172.21.15.82:0/1199498452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094106740 msgr2=0x7fe09410cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 --2- 172.21.15.82:0/1199498452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094106740 0x7fe09410cfd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009ca0 tx=0x7fe08c02a8b0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 -- 172.21.15.82:0/1199498452 shutdown_connections 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 --2- 172.21.15.82:0/1199498452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094106740 0x7fe09410cfd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 --2- 172.21.15.82:0/1199498452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094105d80 0x7fe094106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 --2- 172.21.15.82:0/1199498452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094104b90 0x7fe094104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.969+0000 7fe099200640 1 -- 172.21.15.82:0/1199498452 >> 172.21.15.82:0/1199498452 conn(0x7fe094100120 msgr2=0x7fe094102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.970+0000 7fe099200640 1 -- 172.21.15.82:0/1199498452 shutdown_connections 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.970+0000 7fe099200640 1 -- 172.21.15.82:0/1199498452 wait complete. 2024-04-26T20:19:57.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.970+0000 7fe099200640 1 Processor -- start 2024-04-26T20:19:57.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 -- start start 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094104b90 0x7fe09419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 0x7fe09419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094106740 0x7fe0941a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe094110710 con 0x7fe094105d80 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe094110590 con 0x7fe094104b90 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe099200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe094110890 con 0x7fe094106740 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 0x7fe09419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 0x7fe09419b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40332/0 (socket says 172.21.15.82:40332) 2024-04-26T20:19:57.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 -- 172.21.15.82:0/1063983021 learned_addr learned my addr 172.21.15.82:0/1063983021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe092800640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094106740 0x7fe0941a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe091e00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094104b90 0x7fe09419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 -- 172.21.15.82:0/1063983021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094106740 msgr2=0x7fe0941a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094106740 0x7fe0941a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 -- 172.21.15.82:0/1063983021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094104b90 msgr2=0x7fe09419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094104b90 0x7fe09419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe08be00640 1 -- 172.21.15.82:0/1063983021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0941a2960 con 0x7fe094105d80 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.971+0000 7fe091e00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094104b90 0x7fe09419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.972+0000 7fe08be00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 0x7fe09419b290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00d950 tx=0x7fe07c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.972+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c017030 con 0x7fe094105d80 2024-04-26T20:19:57.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.972+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe07c004020 con 0x7fe094105d80 2024-04-26T20:19:57.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.972+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0941a2c50 con 0x7fe094105d80 2024-04-26T20:19:57.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.972+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0047a0 con 0x7fe094105d80 2024-04-26T20:19:57.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.972+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0941a31a0 con 0x7fe094105d80 2024-04-26T20:19:57.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.973+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09410beb0 con 0x7fe094105d80 2024-04-26T20:19:57.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.976+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe07c009a30 con 0x7fe094105d80 2024-04-26T20:19:57.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.977+0000 7fe08aa00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe0740a3bb0 0x7fe0740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:57.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.977+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fe07c0d01a0 con 0x7fe094105d80 2024-04-26T20:19:57.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.977+0000 7fe091e00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe0740a3bb0 0x7fe0740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:57.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.978+0000 7fe091e00640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe0740a3bb0 0x7fe0740a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe09419c220 tx=0x7fe084005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:57.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:57.982+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe07c09c8e0 con 0x7fe094105d80 2024-04-26T20:19:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:57 smithi139 ceph-mon[32999]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:19:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:57 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2645718929' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-26T20:19:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:57 smithi135 ceph-mon[32816]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:19:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:57 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2645718929' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-26T20:19:58.119 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:19:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:19:57.707+0000 7fd343189700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:19:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:57 smithi082 ceph-mon[28105]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T20:19:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:57 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2645718929' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-26T20:19:58.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.210+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe094063530 con 0x7fe094105d80 2024-04-26T20:19:58.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.212+0000 7fe08aa00640 1 -- 172.21.15.82:0/1063983021 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11815 (secure 0 0 0) 0x7fe07c09c1e0 con 0x7fe094105d80 2024-04-26T20:19:58.213 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:58.213 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24554,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:19:57.194309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24584},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24584,"qdb_cluster":[24584]},"id":1}]} 2024-04-26T20:19:58.213 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-26T20:19:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe0740a3bb0 msgr2=0x7fe0740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe0740a3bb0 0x7fe0740a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe09419c220 tx=0x7fe084005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 msgr2=0x7fe09419b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 0x7fe09419b290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00d950 tx=0x7fe07c00de10 comp rx=0 tx=0).stop 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 shutdown_connections 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe0740a3bb0 0x7fe0740a6070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094106740 0x7fe0941a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094105d80 0x7fe09419b290 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 --2- 172.21.15.82:0/1063983021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe094104b90 0x7fe09419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 >> 172.21.15.82:0/1063983021 conn(0x7fe094100120 msgr2=0x7fe094109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 shutdown_connections 2024-04-26T20:19:58.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.215+0000 7fe099200640 1 -- 172.21.15.82:0/1063983021 wait complete. 2024-04-26T20:19:58.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:19:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 -- 172.21.15.82:0/2996501631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1011b0 msgr2=0x7f825c10ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 --2- 172.21.15.82:0/2996501631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1011b0 0x7f825c10ad60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8254009ca0 tx=0x7f825402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 -- 172.21.15.82:0/2996501631 shutdown_connections 2024-04-26T20:19:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 --2- 172.21.15.82:0/2996501631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1011b0 0x7f825c10ad60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 --2- 172.21.15.82:0/2996501631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f825c1007f0 0x7f825c100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 --2- 172.21.15.82:0/2996501631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c103d80 0x7f825c1041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 -- 172.21.15.82:0/2996501631 >> 172.21.15.82:0/2996501631 conn(0x7f825c0fc390 msgr2=0x7f825c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.418+0000 7f8261a00640 1 -- 172.21.15.82:0/2996501631 shutdown_connections 2024-04-26T20:19:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.419+0000 7f8261a00640 1 -- 172.21.15.82:0/2996501631 wait complete. 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.419+0000 7f8261a00640 1 Processor -- start 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.419+0000 7f8261a00640 1 -- start start 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 0x7f825c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c1011b0 0x7f825c19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f825c103d80 0x7f825c1a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f825c10e2b0 con 0x7f825c1007f0 2024-04-26T20:19:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f825c10e130 con 0x7f825c103d80 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f825c10e430 con 0x7f825c1011b0 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 0x7f825c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 0x7f825c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40350/0 (socket says 172.21.15.82:40350) 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 -- 172.21.15.82:0/654671103 learned_addr learned my addr 172.21.15.82:0/654671103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8261000640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f825c103d80 0x7f825c1a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8253e00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c1011b0 0x7f825c19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 -- 172.21.15.82:0/654671103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c1011b0 msgr2=0x7f825c19b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c1011b0 0x7f825c19b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 -- 172.21.15.82:0/654671103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f825c103d80 msgr2=0x7f825c1a20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f825c103d80 0x7f825c1a20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f825be00640 1 -- 172.21.15.82:0/654671103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c1a2750 con 0x7f825c1007f0 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.420+0000 7f8253e00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c1011b0 0x7f825c19b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.421+0000 7f825be00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 0x7f825c19ab30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f824c00d770 tx=0x7f824c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.421+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c017070 con 0x7f825c1007f0 2024-04-26T20:19:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.421+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825c1a2a40 con 0x7f825c1007f0 2024-04-26T20:19:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.421+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f824c009c30 con 0x7f825c1007f0 2024-04-26T20:19:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.421+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c003cc0 con 0x7f825c1007f0 2024-04-26T20:19:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.421+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825c1a2f90 con 0x7f825c1007f0 2024-04-26T20:19:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.422+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825c068de0 con 0x7f825c1007f0 2024-04-26T20:19:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.425+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f824c003e60 con 0x7f825c1007f0 2024-04-26T20:19:58.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.426+0000 7f8259600640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82400a3bb0 0x7f82400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.426+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f824c0cffb0 con 0x7f825c1007f0 2024-04-26T20:19:58.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.426+0000 7f8253e00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82400a3bb0 0x7f82400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.427+0000 7f8253e00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82400a3bb0 0x7f82400a6070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8244005d00 tx=0x7f8244005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:58.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.431+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f824c009de0 con 0x7f825c1007f0 2024-04-26T20:19:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.632+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f825c1a31c0 con 0x7f825c1007f0 2024-04-26T20:19:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.636+0000 7f8259600640 1 -- 172.21.15.82:0/654671103 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7f824c0bc070 con 0x7f825c1007f0 2024-04-26T20:19:58.637 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:58.637 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:19:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82400a3bb0 msgr2=0x7f82400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82400a3bb0 0x7f82400a6070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8244005d00 tx=0x7f8244005c70 comp rx=0 tx=0).stop 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 msgr2=0x7f825c19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 0x7f825c19ab30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f824c00d770 tx=0x7f824c00dc30 comp rx=0 tx=0).stop 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 shutdown_connections 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f82400a3bb0 0x7f82400a6070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f825c103d80 0x7f825c1a20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c1011b0 0x7f825c19b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 --2- 172.21.15.82:0/654671103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c1007f0 0x7f825c19ab30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 >> 172.21.15.82:0/654671103 conn(0x7f825c0fc390 msgr2=0x7f825c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 shutdown_connections 2024-04-26T20:19:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.639+0000 7f8261a00640 1 -- 172.21.15.82:0/654671103 wait complete. 2024-04-26T20:19:58.658 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:19:58.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 -- 172.21.15.82:0/168323992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25010a940 msgr2=0x7fe2501111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 --2- 172.21.15.82:0/168323992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25010a940 0x7fe2501111d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe248009ca0 tx=0x7fe24802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 -- 172.21.15.82:0/168323992 shutdown_connections 2024-04-26T20:19:58.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 --2- 172.21.15.82:0/168323992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25010a940 0x7fe2501111d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 --2- 172.21.15.82:0/168323992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25010a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 --2- 172.21.15.82:0/168323992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe250108d90 0x7fe2501091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 -- 172.21.15.82:0/168323992 >> 172.21.15.82:0/168323992 conn(0x7fe250077d30 msgr2=0x7fe25007a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:58.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 -- 172.21.15.82:0/168323992 shutdown_connections 2024-04-26T20:19:58.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.853+0000 7fe24f200640 1 -- 172.21.15.82:0/168323992 wait complete. 2024-04-26T20:19:58.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.854+0000 7fe24f200640 1 Processor -- start 2024-04-26T20:19:58.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.854+0000 7fe24f200640 1 -- start start 2024-04-26T20:19:58.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe250108d90 0x7fe25019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe25010a940 0x7fe2501a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe250114910 con 0x7fe250109f80 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe250114790 con 0x7fe250108d90 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe250114a90 con 0x7fe25010a940 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe247e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe247e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25019f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40356/0 (socket says 172.21.15.82:40356) 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe250108d90 0x7fe25019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe247e00640 1 -- 172.21.15.82:0/4169335705 learned_addr learned my addr 172.21.15.82:0/4169335705 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24e800640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe25010a940 0x7fe2501a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24de00640 1 -- 172.21.15.82:0/4169335705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe25010a940 msgr2=0x7fe2501a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24de00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe25010a940 0x7fe2501a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24de00640 1 -- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 msgr2=0x7fe25019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24de00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe24de00640 1 -- 172.21.15.82:0/4169335705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2501a6b10 con 0x7fe250108d90 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.855+0000 7fe247e00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.856+0000 7fe24de00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe250108d90 0x7fe25019eef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e9c0 tx=0x7fe24000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.856+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24000ccc0 con 0x7fe250108d90 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.856+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2400035f0 con 0x7fe250108d90 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.856+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2501a6e00 con 0x7fe250108d90 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.856+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24000ce60 con 0x7fe250108d90 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.856+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2501a7210 con 0x7fe250108d90 2024-04-26T20:19:58.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.857+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2501100b0 con 0x7fe250108d90 2024-04-26T20:19:58.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.859+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe240004000 con 0x7fe250108d90 2024-04-26T20:19:58.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.861+0000 7fe246a00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2340a3bb0 0x7fe2340a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:58.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.861+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fe2400d0a10 con 0x7fe250108d90 2024-04-26T20:19:58.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.861+0000 7fe247e00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2340a3bb0 0x7fe2340a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:58.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.861+0000 7fe247e00640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2340a3bb0 0x7fe2340a6070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2380095f0 tx=0x7fe238005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:58.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:58.865+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe24009d150 con 0x7fe250108d90 2024-04-26T20:19:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:58 smithi082 ceph-mon[28105]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T20:19:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2645718929' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-26T20:19:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:58 smithi082 ceph-mon[28105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1063983021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:58 smithi082 ceph-mon[28105]: pgmap v325: 129 pgs: 11 creating+peering, 108 active+clean, 10 unknown; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 9 op/s 2024-04-26T20:19:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/654671103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.070+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe250063630 con 0x7fe250108d90 2024-04-26T20:19:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:58 smithi139 ceph-mon[32999]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T20:19:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2645718929' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-26T20:19:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:58 smithi139 ceph-mon[32999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1063983021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:58 smithi139 ceph-mon[32999]: pgmap v325: 129 pgs: 11 creating+peering, 108 active+clean, 10 unknown; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 9 op/s 2024-04-26T20:19:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/654671103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.072+0000 7fe246a00640 1 -- 172.21.15.82:0/4169335705 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7fe24009ca50 con 0x7fe250108d90 2024-04-26T20:19:59.073 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:59.073 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:19:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.074+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2340a3bb0 msgr2=0x7fe2340a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.074+0000 7fe24f200640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2340a3bb0 0x7fe2340a6070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2380095f0 tx=0x7fe238005f90 comp rx=0 tx=0).stop 2024-04-26T20:19:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe250108d90 msgr2=0x7fe25019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe250108d90 0x7fe25019eef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e9c0 tx=0x7fe24000ee80 comp rx=0 tx=0).stop 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 shutdown_connections 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2340a3bb0 0x7fe2340a6070 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe25010a940 0x7fe2501a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe250109f80 0x7fe25019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 --2- 172.21.15.82:0/4169335705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe250108d90 0x7fe25019eef0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 >> 172.21.15.82:0/4169335705 conn(0x7fe250077d30 msgr2=0x7fe25010d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 shutdown_connections 2024-04-26T20:19:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.075+0000 7fe24f200640 1 -- 172.21.15.82:0/4169335705 wait complete. 2024-04-26T20:19:59.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:59.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:58 smithi135 ceph-mon[32816]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T20:19:59.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2645718929' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-26T20:19:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:58 smithi135 ceph-mon[32816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:19:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1063983021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:19:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:58 smithi135 ceph-mon[32816]: pgmap v325: 129 pgs: 11 creating+peering, 108 active+clean, 10 unknown; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 9 op/s 2024-04-26T20:19:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/654671103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 -- 172.21.15.82:0/3605725929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 msgr2=0x7f5e14104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/3605725929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 0x7f5e14104fb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009900 tx=0x7f5e0402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 -- 172.21.15.82:0/3605725929 shutdown_connections 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/3605725929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e1410cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/3605725929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e14106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/3605725929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 0x7f5e14104fb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 -- 172.21.15.82:0/3605725929 >> 172.21.15.82:0/3605725929 conn(0x7f5e14100120 msgr2=0x7f5e14102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 -- 172.21.15.82:0/3605725929 shutdown_connections 2024-04-26T20:19:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.307+0000 7f5e1aa00640 1 -- 172.21.15.82:0/3605725929 wait complete. 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 Processor -- start 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 -- start start 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 0x7f5e1419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e1419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e141a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14110700 con 0x7f5e14106740 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14110580 con 0x7f5e14105d80 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.308+0000 7f5e1aa00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14110880 con 0x7f5e14104b90 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e141a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e1419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e141a23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40378/0 (socket says 172.21.15.82:40378) 2024-04-26T20:19:59.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 -- 172.21.15.82:0/2136640302 learned_addr learned my addr 172.21.15.82:0/2136640302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e1419b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52930/0 (socket says 172.21.15.82:52930) 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e13e00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 0x7f5e1419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 -- 172.21.15.82:0/2136640302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 msgr2=0x7f5e1419adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 0x7f5e1419adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 -- 172.21.15.82:0/2136640302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 msgr2=0x7f5e1419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e1419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 -- 172.21.15.82:0/2136640302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e141a2a10 con 0x7f5e14106740 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e0be00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e1419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.309+0000 7f5e18a00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e141a23a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00efd0 tx=0x7f5e0c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.310+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c003b70 con 0x7f5e14106740 2024-04-26T20:19:59.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.310+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e0c003d10 con 0x7f5e14106740 2024-04-26T20:19:59.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.310+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e141a2d00 con 0x7f5e14106740 2024-04-26T20:19:59.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.310+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c0108a0 con 0x7f5e14106740 2024-04-26T20:19:59.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.310+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e141a31a0 con 0x7f5e14106740 2024-04-26T20:19:59.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.311+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e1410beb0 con 0x7f5e14106740 2024-04-26T20:19:59.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.313+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5e0c004020 con 0x7f5e14106740 2024-04-26T20:19:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.314+0000 7f5e11600640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5df80a3bb0 0x7f5df80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.315+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f5e0c0d0a70 con 0x7f5e14106740 2024-04-26T20:19:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.315+0000 7f5e13e00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5df80a3bb0 0x7f5df80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.316+0000 7f5e13e00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5df80a3bb0 0x7f5df80a6070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005ab0 tx=0x7f5e04005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.319+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5e0c09d1b0 con 0x7f5e14106740 2024-04-26T20:19:59.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.562+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e1402dad0 con 0x7f5e14106740 2024-04-26T20:19:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.563+0000 7f5e11600640 1 -- 172.21.15.82:0/2136640302 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11815 (secure 0 0 0) 0x7f5e0c09cab0 con 0x7f5e14106740 2024-04-26T20:19:59.564 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:19:59.564 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24467,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24554,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:19:57.194309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24584},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24584,"qdb_cluster":[24584]},"id":1}]} 2024-04-26T20:19:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.566+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5df80a3bb0 msgr2=0x7f5df80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.566+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5df80a3bb0 0x7f5df80a6070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005ab0 tx=0x7f5e04005a20 comp rx=0 tx=0).stop 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.566+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 msgr2=0x7f5e141a23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.566+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e141a23a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00efd0 tx=0x7f5e0c00c6a0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 shutdown_connections 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5df80a3bb0 0x7f5df80a6070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e14106740 0x7f5e141a23a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e14105d80 0x7f5e1419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 --2- 172.21.15.82:0/2136640302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5e14104b90 0x7f5e1419adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 >> 172.21.15.82:0/2136640302 conn(0x7f5e14100120 msgr2=0x7f5e14109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 shutdown_connections 2024-04-26T20:19:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.567+0000 7f5e1aa00640 1 -- 172.21.15.82:0/2136640302 wait complete. 2024-04-26T20:19:59.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 -- 172.21.15.82:0/884630931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 msgr2=0x7f833c104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 --2- 172.21.15.82:0/884630931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c104f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f832c009860 tx=0x7f832c02a340 comp rx=0 tx=0).stop 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 -- 172.21.15.82:0/884630931 shutdown_connections 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 --2- 172.21.15.82:0/884630931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c106720 0x7f833c10cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 --2- 172.21.15.82:0/884630931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c105d60 0x7f833c1061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 --2- 172.21.15.82:0/884630931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c104f90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 -- 172.21.15.82:0/884630931 >> 172.21.15.82:0/884630931 conn(0x7f833c100120 msgr2=0x7f833c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 -- 172.21.15.82:0/884630931 shutdown_connections 2024-04-26T20:19:59.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.788+0000 7f8343600640 1 -- 172.21.15.82:0/884630931 wait complete. 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.789+0000 7f8343600640 1 Processor -- start 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.789+0000 7f8343600640 1 -- start start 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8343600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8343600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c105d60 0x7f833c19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8343600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 0x7f833c1a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8343600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f833c110670 con 0x7f833c106720 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8343600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f833c1104f0 con 0x7f833c104b70 2024-04-26T20:19:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8343600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f833c1107f0 con 0x7f833c105d60 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8341600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 0x7f833c1a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8341600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 0x7f833c1a23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40398/0 (socket says 172.21.15.82:40398) 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c19ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52952/0 (socket says 172.21.15.82:52952) 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8341600640 1 -- 172.21.15.82:0/3821412717 learned_addr learned my addr 172.21.15.82:0/3821412717 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f833be00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c105d60 0x7f833c19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 -- 172.21.15.82:0/3821412717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c105d60 msgr2=0x7f833c19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c105d60 0x7f833c19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 -- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 msgr2=0x7f833c1a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 0x7f833c1a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8340c00640 1 -- 172.21.15.82:0/3821412717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c1a2a20 con 0x7f833c104b70 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f833be00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c105d60 0x7f833c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.790+0000 7f8341600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 0x7f833c1a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:19:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.791+0000 7f8340c00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c19ae00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f832c02a860 tx=0x7f832c032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.791+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c040020 con 0x7f833c104b70 2024-04-26T20:19:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.791+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c1a2cb0 con 0x7f833c104b70 2024-04-26T20:19:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.791+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f832c030d50 con 0x7f833c104b70 2024-04-26T20:19:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.791+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c037040 con 0x7f833c104b70 2024-04-26T20:19:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.791+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c1a31a0 con 0x7f833c104b70 2024-04-26T20:19:59.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.792+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c10bfb0 con 0x7f833c104b70 2024-04-26T20:19:59.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.794+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f832c043020 con 0x7f833c104b70 2024-04-26T20:19:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.796+0000 7f8339600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f831c0a3bb0 0x7f831c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.796+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f832c0f05a0 con 0x7f833c104b70 2024-04-26T20:19:59.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.796+0000 7f833be00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f831c0a3bb0 0x7f831c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.797+0000 7f833be00640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f831c0a3bb0 0x7f831c0a6070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f833c19c310 tx=0x7f83240095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:19:59.798+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f832c04a020 con 0x7f833c104b70 2024-04-26T20:19:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:59 smithi082 ceph-mon[28105]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T20:19:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:59 smithi082 ceph-mon[28105]: Cluster is now healthy 2024-04-26T20:19:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:59 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4169335705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:19:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:19:59 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2136640302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:20:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.001+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f833c02dca0 con 0x7f833c104b70 2024-04-26T20:20:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.003+0000 7f8339600640 1 -- 172.21.15.82:0/3821412717 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7f832c0b8020 con 0x7f833c104b70 2024-04-26T20:20:00.004 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:00.004 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.005+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f831c0a3bb0 msgr2=0x7f831c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.005+0000 7f8343600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f831c0a3bb0 0x7f831c0a6070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f833c19c310 tx=0x7f83240095c0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.005+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 msgr2=0x7f833c19ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.005+0000 7f8343600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c19ae00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f832c02a860 tx=0x7f832c032d50 comp rx=0 tx=0).stop 2024-04-26T20:20:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 shutdown_connections 2024-04-26T20:20:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f831c0a3bb0 0x7f831c0a6070 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f833c106720 0x7f833c1a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f833c105d60 0x7f833c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 --2- 172.21.15.82:0/3821412717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f833c104b70 0x7f833c19ae00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 >> 172.21.15.82:0/3821412717 conn(0x7f833c100120 msgr2=0x7f833c109180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 shutdown_connections 2024-04-26T20:20:00.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.006+0000 7f8343600640 1 -- 172.21.15.82:0/3821412717 wait complete. 2024-04-26T20:20:00.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:19:52.134957+0000', 'modified': '2024-04-26T20:19:57.194309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24584}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24584': {'gid': 24584, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6839/1800754758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1800754758}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1800754758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24584, 'qdb_cluster': [24584]} 2024-04-26T20:20:00.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T20:20:00.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:20:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:59 smithi139 ceph-mon[32999]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T20:20:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:59 smithi139 ceph-mon[32999]: Cluster is now healthy 2024-04-26T20:20:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:59 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4169335705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:19:59 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2136640302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:20:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:59 smithi135 ceph-mon[32816]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T20:20:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:59 smithi135 ceph-mon[32816]: Cluster is now healthy 2024-04-26T20:20:00.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:59 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4169335705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:00.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:19:59 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2136640302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:20:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 -- 172.21.15.82:0/331516277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4880772f0 msgr2=0x7fb488077710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 --2- 172.21.15.82:0/331516277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4880772f0 0x7fb488077710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb478009900 tx=0x7fb47802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 -- 172.21.15.82:0/331516277 shutdown_connections 2024-04-26T20:20:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 --2- 172.21.15.82:0/331516277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb488078ed0 0x7fb488079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 --2- 172.21.15.82:0/331516277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078530 0x7fb488078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 --2- 172.21.15.82:0/331516277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4880772f0 0x7fb488077710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 -- 172.21.15.82:0/331516277 >> 172.21.15.82:0/331516277 conn(0x7fb488100120 msgr2=0x7fb488102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 -- 172.21.15.82:0/331516277 shutdown_connections 2024-04-26T20:20:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.236+0000 7fb48fc00640 1 -- 172.21.15.82:0/331516277 wait complete. 2024-04-26T20:20:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 Processor -- start 2024-04-26T20:20:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 -- start start 2024-04-26T20:20:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880772f0 0x7fb48819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 0x7fb48819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078ed0 0x7fb4881a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb488114a90 con 0x7fb488078ed0 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb488114910 con 0x7fb4880772f0 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48fc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb488114c10 con 0x7fb488078530 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb487e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 0x7fb48819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb487e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 0x7fb48819f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47320/0 (socket says 172.21.15.82:47320) 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb48dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078ed0 0x7fb4881a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.237+0000 7fb487e00640 1 -- 172.21.15.82:0/3687247405 learned_addr learned my addr 172.21.15.82:0/3687247405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb48d200640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880772f0 0x7fb48819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb487e00640 1 -- 172.21.15.82:0/3687247405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880772f0 msgr2=0x7fb48819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb487e00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880772f0 0x7fb48819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb487e00640 1 -- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078ed0 msgr2=0x7fb4881a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb487e00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078ed0 0x7fb4881a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb487e00640 1 -- 172.21.15.82:0/3687247405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4881a6d80 con 0x7fb488078530 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb48dc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078ed0 0x7fb4881a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb487e00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 0x7fb48819f6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb47400e9f0 tx=0x7fb47400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.238+0000 7fb485600640 1 -- 172.21.15.82:0/3687247405 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47400cd80 con 0x7fb488078530 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.239+0000 7fb485600640 1 -- 172.21.15.82:0/3687247405 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4740108e0 con 0x7fb488078530 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.239+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4881a7070 con 0x7fb488078530 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.239+0000 7fb485600640 1 -- 172.21.15.82:0/3687247405 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474018980 con 0x7fb488078530 2024-04-26T20:20:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.239+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4881a7610 con 0x7fb488078530 2024-04-26T20:20:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 Processor -- start 2024-04-26T20:20:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 -- start start 2024-04-26T20:20:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb485600640 1 -- 172.21.15.82:0/3687247405 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb474010430 con 0x7fb488078530 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c750600 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c6ed100 con 0x55bc2c7ecae0 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.242+0000 7fb492bef740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c74c5c0 con 0x55bc2c7f1c50 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb487e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb487e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47322/0 (socket says 172.21.15.82:47322) 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb487e00640 1 -- 172.21.15.82:0/1651040855 learned_addr learned my addr 172.21.15.82:0/1651040855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7ec510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40420/0 (socket says 172.21.15.82:40420) 2024-04-26T20:20:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 -- 172.21.15.82:0/1651040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 msgr2=0x55bc2c7f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 -- 172.21.15.82:0/1651040855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ecae0 msgr2=0x55bc2c7f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb48dc00640 1 -- 172.21.15.82:0/1651040855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2c4622d0 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.243+0000 7fb487e00640 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.244+0000 7fb48dc00640 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7ec510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb480005fd0 tx=0x7fb480011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32425c7d7c83aba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.244+0000 7fb47e000640 1 -- 172.21.15.82:0/1651040855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480004d20 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.244+0000 7fb47e000640 1 -- 172.21.15.82:0/1651040855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48000f9a0 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.244+0000 7fb47e000640 1 -- 172.21.15.82:0/1651040855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480004410 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.244+0000 7fb485600640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb485600640 1 -- 172.21.15.82:0/3687247405 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb4740d0900 con 0x7fb488078530 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb48d200640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 -- 172.21.15.82:0/1651040855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 msgr2=0x55bc2c7ec510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7ec510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb480005fd0 tx=0x7fb480011bf0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 -- 172.21.15.82:0/1651040855 shutdown_connections 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 --2- 172.21.15.82:0/1651040855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7ec510 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 -- 172.21.15.82:0/1651040855 >> 172.21.15.82:0/1651040855 conn(0x55bc2c780d10 msgr2=0x55bc2c7e7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 -- 172.21.15.82:0/1651040855 shutdown_connections 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb492bef740 1 -- 172.21.15.82:0/1651040855 wait complete. 2024-04-26T20:20:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.245+0000 7fb48d200640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb4780314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 -- start start 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 Processor -- start 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7fda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c7f4c00 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c6d7f70 con 0x55bc2c7f1c50 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c7f4d80 con 0x55bc2c7ecae0 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb492bef740 10 client.0 _ll_register_callbacks cb 0x55bc2c746480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb48d200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.246+0000 7fb487e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47334/0 (socket says 172.21.15.82:47334) 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 -- 172.21.15.82:0/1858342814 learned_addr learned my addr 172.21.15.82:0/1858342814 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb48dc00640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 -- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 msgr2=0x55bc2c7fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 -- 172.21.15.82:0/1858342814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 msgr2=0x55bc2c7f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 -- 172.21.15.82:0/1858342814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc2c52c6b0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb48dc00640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb487e00640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f6a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb474000c00 tx=0x7fb474009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b24b7eba2cd80d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb472a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb472a00640 1 -- 172.21.15.82:0/1858342814 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47409c590 con 0x55bc2c7ecae0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb48000f9a0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.247+0000 7fb472a00640 1 -- 172.21.15.82:0/1858342814 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb4740bbb60 con 0x55bc2c7ecae0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb472a00640 1 -- 172.21.15.82:0/1858342814 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb47409c3b0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 10 client.24706 fetch_fsmap learned FSMap version 17 2024-04-26T20:20:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55bc2c800ae0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb472a00640 1 -- 172.21.15.82:0/1858342814 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48000f9a0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb472a00640 1 -- 172.21.15.82:0/1858342814 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb4740987a0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 10 client.24706 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 10 client.24706 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 20 client.24706 populate_metadata read hostname 'smithi082' 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c803120 0x55bc2c804590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 4 client.24706 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.248+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc2c75e210 con 0x55bc2c803120 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.249+0000 7fb48d200640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c803120 0x55bc2c804590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.249+0000 7fb48d200640 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c803120 0x55bc2c804590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cec751a144666021 server_cookie=40ad941784f61e3c in_seq=0 out_seq=0 2024-04-26T20:20:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.249+0000 7fb472a00640 10 client.24706 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:20:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb472a00640 1 -- 172.21.15.82:0/1858342814 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bc2c75e210 con 0x55bc2c803120 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb472a00640 10 client.24706 handle_command_reply: tid=0 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 client.24706 shutdown 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 msgr2=0x55bc2c7f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f6a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb474000c00 tx=0x7fb474009310 comp rx=0 tx=0).stop 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 shutdown_connections 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c803120 0x55bc2c804590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb472a00640 0 client.24706 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7f6a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.250+0000 7fb492bef740 1 --2- 172.21.15.82:0/1858342814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.251+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 >> 172.21.15.82:0/1858342814 conn(0x55bc2c780d10 msgr2=0x55bc2c7e6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.251+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 shutdown_connections 2024-04-26T20:20:00.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.251+0000 7fb492bef740 1 -- 172.21.15.82:0/1858342814 wait complete. 2024-04-26T20:20:00.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.251+0000 7fb492bef740 20 client.24706 trim_cache size 0 max 16384 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.270+0000 7fb492bef740 1 Processor -- start 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 -- start start 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c8028d0 con 0x55bc2c7ecae0 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c802fa0 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb492bef740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c803670 con 0x55bc2c7f1c50 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb48dc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb487e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb48dc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47344/0 (socket says 172.21.15.82:47344) 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb48dc00640 1 -- 172.21.15.82:0/4124987104 learned_addr learned my addr 172.21.15.82:0/4124987104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.271+0000 7fb48d200640 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb48dc00640 1 -- 172.21.15.82:0/4124987104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ec0f0 msgr2=0x55bc2c7e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb48dc00640 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb48dc00640 1 -- 172.21.15.82:0/4124987104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 msgr2=0x55bc2c7fda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb48dc00640 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb48dc00640 1 -- 172.21.15.82:0/4124987104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2c7e8820 con 0x55bc2c7f1c50 2024-04-26T20:20:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb487e00640 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb48dc00640 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f5ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55bc2c7ed340 tx=0x7fb480003c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9294310f33f33d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb47d600640 1 -- 172.21.15.82:0/4124987104 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48001e040 con 0x55bc2c7f1c50 2024-04-26T20:20:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb47d600640 1 -- 172.21.15.82:0/4124987104 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48001f040 con 0x55bc2c7f1c50 2024-04-26T20:20:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.272+0000 7fb47d600640 1 -- 172.21.15.82:0/4124987104 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4800055d0 con 0x55bc2c7f1c50 2024-04-26T20:20:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 -- 172.21.15.82:0/4124987104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 msgr2=0x55bc2c7f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f5ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55bc2c7ed340 tx=0x7fb480003c40 comp rx=0 tx=0).stop 2024-04-26T20:20:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 -- 172.21.15.82:0/4124987104 shutdown_connections 2024-04-26T20:20:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f5ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 --2- 172.21.15.82:0/4124987104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 -- 172.21.15.82:0/4124987104 >> 172.21.15.82:0/4124987104 conn(0x55bc2c780d10 msgr2=0x55bc2c7e6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 -- 172.21.15.82:0/4124987104 shutdown_connections 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.273+0000 7fb492bef740 1 -- 172.21.15.82:0/4124987104 wait complete. 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 -- start start 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 Processor -- start 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c804410 con 0x55bc2c7ecae0 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c803d40 con 0x55bc2c7f1c50 2024-04-26T20:20:00.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc2c804ae0 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.274+0000 7fb492bef740 10 client.0 _ll_register_callbacks cb 0x7fb47400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb487e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7fd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47350/0 (socket says 172.21.15.82:47350) 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 -- 172.21.15.82:0/1076879449 learned_addr learned my addr 172.21.15.82:0/1076879449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48dc00640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 -- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 msgr2=0x55bc2c7f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 -- 172.21.15.82:0/1076879449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 msgr2=0x55bc2c7fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 -- 172.21.15.82:0/1076879449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc2c7fa760 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb487e00640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb48d200640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7fd440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb47802a910 tx=0x7fb478009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7309e0c74ee5e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:00.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb472a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb472a00640 1 -- 172.21.15.82:0/1076879449 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478035040 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb48001f040 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.275+0000 7fb472a00640 1 -- 172.21.15.82:0/1076879449 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fb4780538c0 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb472a00640 1 -- 172.21.15.82:0/1076879449 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb4780035f0 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 10 client.24712 fetch_fsmap learned FSMap version 17 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55bc2c869e90 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb472a00640 1 -- 172.21.15.82:0/1076879449 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48001f040 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb472a00640 1 -- 172.21.15.82:0/1076879449 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb478044040 con 0x55bc2c7ec0f0 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 10 client.24712 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 10 client.24712 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 20 client.24712 populate_metadata read hostname 'smithi082' 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c86eb20 0x55bc2c86d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:00.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 4 client.24712 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.276+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "status"}) -- 0x55bc2c758080 con 0x55bc2c86eb20 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb487e00640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c86eb20 0x55bc2c86d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb487e00640 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c86eb20 0x55bc2c86d830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70207596058f7a9e server_cookie=91bd2a2ced45990b in_seq=0 out_seq=0 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb472a00640 10 client.24712 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb472a00640 1 -- 172.21.15.82:0/1076879449 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55bc2c758080 con 0x55bc2c86eb20 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb472a00640 10 client.24712 handle_command_reply: tid=0 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 client.24712 shutdown 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 msgr2=0x55bc2c7fd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7fd440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb47802a910 tx=0x7fb478009260 comp rx=0 tx=0).stop 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 shutdown_connections 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bc2c86eb20 0x55bc2c86d830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc2c7f1c50 0x55bc2c7f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb472a00640 0 client.24712 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:20:00.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc2c7ecae0 0x55bc2c7fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 --2- 172.21.15.82:0/1076879449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc2c7ec0f0 0x55bc2c7fd440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.277+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 >> 172.21.15.82:0/1076879449 conn(0x55bc2c780d10 msgr2=0x55bc2c7e6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 shutdown_connections 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb492bef740 1 -- 172.21.15.82:0/1076879449 wait complete. 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb492bef740 20 client.24712 trim_cache size 0 max 16384 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24584, 2024-04-26T20:20:00.283 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 7.5917189020000002, 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 17, 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 89, 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 14.081373313 2024-04-26T20:20:00.284 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 msgr2=0x7fb46c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb4780314a0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 msgr2=0x7fb48819f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 0x7fb48819f6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb47400e9f0 tx=0x7fb47400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 shutdown_connections 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb46c0a3c30 0x7fb46c0a60f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb488078ed0 0x7fb4881a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb488078530 0x7fb48819f6a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 --2- 172.21.15.82:0/3687247405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880772f0 0x7fb48819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.278+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 >> 172.21.15.82:0/3687247405 conn(0x7fb488100120 msgr2=0x7fb488103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.279+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 shutdown_connections 2024-04-26T20:20:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:00.279+0000 7fb48fc00640 1 -- 172.21.15.82:0/3687247405 wait complete. 2024-04-26T20:20:00.296 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:20:00.296 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:00.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T20:20:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:01.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:00 smithi139 ceph-mon[32999]: overall HEALTH_OK 2024-04-26T20:20:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:00 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3821412717' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:00 smithi139 ceph-mon[32999]: pgmap v326: 129 pgs: 11 creating+peering, 114 active+clean, 4 unknown; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-04-26T20:20:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:00 smithi135 ceph-mon[32816]: overall HEALTH_OK 2024-04-26T20:20:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:00 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3821412717' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:00 smithi135 ceph-mon[32816]: pgmap v326: 129 pgs: 11 creating+peering, 114 active+clean, 4 unknown; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-04-26T20:20:01.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:00 smithi082 ceph-mon[28105]: overall HEALTH_OK 2024-04-26T20:20:01.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:00 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3821412717' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:01.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:00 smithi082 ceph-mon[28105]: pgmap v326: 129 pgs: 11 creating+peering, 114 active+clean, 4 unknown; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-04-26T20:20:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 -- 172.21.15.82:0/2582636642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 msgr2=0x7fa2d81038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:03.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 --2- 172.21.15.82:0/2582636642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81038f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009990 tx=0x7fa2c4009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 -- 172.21.15.82:0/2582636642 shutdown_connections 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 --2- 172.21.15.82:0/2582636642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d8103e30 0x7fa2d8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 --2- 172.21.15.82:0/2582636642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d81094c0 0x7fa2d81098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 --2- 172.21.15.82:0/2582636642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81038f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.198+0000 7fa2dd200700 1 -- 172.21.15.82:0/2582636642 >> 172.21.15.82:0/2582636642 conn(0x7fa2d807a580 msgr2=0x7fa2d807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.199+0000 7fa2dd200700 1 -- 172.21.15.82:0/2582636642 shutdown_connections 2024-04-26T20:20:03.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.199+0000 7fa2dd200700 1 -- 172.21.15.82:0/2582636642 wait complete. 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 Processor -- start 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 -- start start 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d8103e30 0x7fa2d81a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d81094c0 0x7fa2d819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81135c0 con 0x7fa2d8103470 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113440 con 0x7fa2d81094c0 2024-04-26T20:20:03.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2dd200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113740 con 0x7fa2d8103e30 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.200+0000 7fa2d5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47254/0 (socket says 172.21.15.82:47254) 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d6800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d81094c0 0x7fa2d819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 -- 172.21.15.82:0/886125143 learned_addr learned my addr 172.21.15.82:0/886125143 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5400700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d8103e30 0x7fa2d81a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 -- 172.21.15.82:0/886125143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d8103e30 msgr2=0x7fa2d81a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d8103e30 0x7fa2d81a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 -- 172.21.15.82:0/886125143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d81094c0 msgr2=0x7fa2d819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d81094c0 0x7fa2d819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 -- 172.21.15.82:0/886125143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d819c400 con 0x7fa2d8103470 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5400700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d8103e30 0x7fa2d81a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d6800700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d81094c0 0x7fa2d819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.201+0000 7fa2d5e00700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81a1a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800e9a0 tx=0x7fa2c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:03.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.202+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800cbd0 con 0x7fa2d8103470 2024-04-26T20:20:03.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.202+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2c800cd70 con 0x7fa2d8103470 2024-04-26T20:20:03.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.202+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8018680 con 0x7fa2d8103470 2024-04-26T20:20:03.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.202+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d819c6f0 con 0x7fa2d8103470 2024-04-26T20:20:03.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.202+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81a89d0 con 0x7fa2d8103470 2024-04-26T20:20:03.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.203+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d8104b60 con 0x7fa2d8103470 2024-04-26T20:20:03.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.205+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa2c8010430 con 0x7fa2d8103470 2024-04-26T20:20:03.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.206+0000 7fa2cea00700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2bc0a3cc0 0x7fa2bc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:03.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.207+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa2c80d07d0 con 0x7fa2d8103470 2024-04-26T20:20:03.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.207+0000 7fa2d5400700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2bc0a3cc0 0x7fa2bc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:03.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.208+0000 7fa2d5400700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2bc0a3cc0 0x7fa2bc0a6180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006010 tx=0x7fa2c401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:03.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.211+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa2c809cf10 con 0x7fa2d8103470 2024-04-26T20:20:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.488+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa2d81a8ba0 con 0x7fa2d8103470 2024-04-26T20:20:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.489+0000 7fa2cea00700 1 -- 172.21.15.82:0/886125143 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fa2c809c810 con 0x7fa2d8103470 2024-04-26T20:20:03.490 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:20:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2bc0a3cc0 msgr2=0x7fa2bc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2bc0a3cc0 0x7fa2bc0a6180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006010 tx=0x7fa2c401a040 comp rx=0 tx=0).stop 2024-04-26T20:20:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 msgr2=0x7fa2d81a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81a1a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800e9a0 tx=0x7fa2c800ecb0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 shutdown_connections 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2bc0a3cc0 0x7fa2bc0a6180 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d81094c0 0x7fa2d819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d8103470 0x7fa2d81a1a50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 --2- 172.21.15.82:0/886125143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d8103e30 0x7fa2d81a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.491+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 >> 172.21.15.82:0/886125143 conn(0x7fa2d807a580 msgr2=0x7fa2d810e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.492+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 shutdown_connections 2024-04-26T20:20:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:03.492+0000 7fa2dd200700 1 -- 172.21.15.82:0/886125143 wait complete. 2024-04-26T20:20:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:03 smithi082 ceph-mon[28105]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 2 op/s 2024-04-26T20:20:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:03 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/886125143' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:20:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:03 smithi139 ceph-mon[32999]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 2 op/s 2024-04-26T20:20:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:03 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/886125143' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:20:04.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:03 smithi135 ceph-mon[32816]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 2 op/s 2024-04-26T20:20:04.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:03 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/886125143' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:20:04.521 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T20:20:04.521 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:20:04.522 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T20:20:04.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:04.522 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-04-26T20:20:04.578 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:20:04.579 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42058sec preferred_lft 42058sec 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-04-26T20:20:04.580 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:20:04.581 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:20:04.582 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:20:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:20:05.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:05.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:05.052 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:20:05.127 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-04-26T20:20:05.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:05.132 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-04-26T20:20:05.193 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-04-26T20:20:05.194 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:20:05.194 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:20:05.194 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:20:05.194 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:20:05.195 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:20:05.195 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:20:05.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:20:05.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:20:05.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:20:05.195 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:20:05.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:20:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:05 smithi082 ceph-mon[28105]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 0 op/s 2024-04-26T20:20:05.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:05.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:05.967 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-26T20:20:06.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:06.024 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-04-26T20:20:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:05 smithi139 ceph-mon[32999]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 0 op/s 2024-04-26T20:20:06.079 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:20:06.079 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:20:06.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:20:06.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T20:20:06.079 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:20:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:05 smithi135 ceph-mon[32816]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 0 op/s 2024-04-26T20:20:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:20:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:06.264 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T20:20:06.265 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:20:06.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:20:06.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:06.561 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:20:06.561 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:20:06.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-04-26T20:20:06.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:20:06.561 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:20:06.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:20:06.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:06.760 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T20:20:06.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:20:06.761 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T20:20:06.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:20:06.805 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:06.897 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-04-26T20:20:06.963 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-04-26T20:20:07.010 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T20:20:07.011 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/535ef2d527d8c155dde781bd2b751b4895f06b42f92789e038f92efdafa58f25/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a6cd82b73606dd307c0282bfb6d26c42431855244d91ba2a709afc40e862d2b4/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/3fd64d2c009313cf61db1bd8e6f5af711b0b2988e74fa06e2195c405085eceb3/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/edc4968fb680edfc650e77699fe2ba9f0537b9f93d63016157616afd29771fb7/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5b662e8c6235edc7c4dc116bd27af11af06b73544d86d20f4646dfcdf5ec2c40/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/7a61d9dc10cf87dfd060f0b7f5ce6b288c4fc82e099fb17ae145927cfba6bc1f/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/9ee4e24421f4aac7e3252c5d6ff72c4d7f11a390cf1e3f9e3868a2ddf28d66be/merged 2024-04-26T20:20:07.012 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bd6b9cb0ce0b961f96169cca40758bf55a7d08d16492e5772274c96b4bf6d401/merged 2024-04-26T20:20:07.013 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/82594c233ba4b6f105afb40be6ecaebf7f0b258ce6dcb4cb5265d0a963890f4d/merged 2024-04-26T20:20:07.013 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/0cd0b067c7055f3c00af709001e4bdc8ad359646b0331392653dbae27ff9fd58/merged 2024-04-26T20:20:07.013 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-04-26T20:20:07.013 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:20:07.013 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:20:07.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:07.014 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-04-26T20:20:07.063 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T20:20:07.063 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T20:20:07.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-04-26T20:20:07.162 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-04-26T20:20:07.203 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-04-26T20:20:07.204 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/535ef2d527d8c155dde781bd2b751b4895f06b42f92789e038f92efdafa58f25/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a6cd82b73606dd307c0282bfb6d26c42431855244d91ba2a709afc40e862d2b4/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/3fd64d2c009313cf61db1bd8e6f5af711b0b2988e74fa06e2195c405085eceb3/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/edc4968fb680edfc650e77699fe2ba9f0537b9f93d63016157616afd29771fb7/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5b662e8c6235edc7c4dc116bd27af11af06b73544d86d20f4646dfcdf5ec2c40/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/7a61d9dc10cf87dfd060f0b7f5ce6b288c4fc82e099fb17ae145927cfba6bc1f/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/9ee4e24421f4aac7e3252c5d6ff72c4d7f11a390cf1e3f9e3868a2ddf28d66be/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bd6b9cb0ce0b961f96169cca40758bf55a7d08d16492e5772274c96b4bf6d401/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/82594c233ba4b6f105afb40be6ecaebf7f0b258ce6dcb4cb5265d0a963890f4d/merged 2024-04-26T20:20:07.205 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/0cd0b067c7055f3c00af709001e4bdc8ad359646b0331392653dbae27ff9fd58/merged 2024-04-26T20:20:07.206 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-04-26T20:20:07.206 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:20:07.206 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:20:07.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:07.207 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-04-26T20:20:07.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:2024-04-26T20:20:07.262+0000 7f811f4d0480 -1 init, newargv = 0x557cca84b270 newargc=15 2024-04-26T20:20:07.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[72313]: starting ceph client 2024-04-26T20:20:07.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[72313]: starting fuse 2024-04-26T20:20:07.292 INFO:teuthology.orchestra.run.smithi082.stdout:114 2024-04-26T20:20:07.292 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-04-26T20:20:07.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-04-26T20:20:07.293 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.admin")) 2024-04-26T20:20:07.294 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-04-26T20:20:07.492 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.admin.72313.asok 2024-04-26T20:20:07.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:07.509 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72313.asok 2024-04-26T20:20:07.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:07.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72313.asok status 2024-04-26T20:20:07.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:07 smithi082 ceph-mon[28105]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 727 B/s wr, 0 op/s 2024-04-26T20:20:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:20:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-04-26T20:20:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T20:20:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "admin", 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "72313", 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24710, 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-04-26T20:20:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 24710 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3932498506 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3932498506 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:20:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.24710 172.21.15.82:0/3932498506", 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "172.21.15.82:0/3932498506", 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 17, 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 89, 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-04-26T20:20:07.747 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:20:07.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:07.761 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-04-26T20:20:07.762 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:07.810 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-04-26T20:20:07.810 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:07.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:07.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:07.929 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T20:20:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:20:08.059 INFO:teuthology.orchestra.run.smithi082.stdout:# file: . 2024-04-26T20:20:08.060 INFO:teuthology.orchestra.run.smithi082.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T20:20:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:08.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:20:08.070 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:20:08.070 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:20:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:07 smithi139 ceph-mon[32999]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 727 B/s wr, 0 op/s 2024-04-26T20:20:08.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:20:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:07 smithi135 ceph-mon[32816]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 727 B/s wr, 0 op/s 2024-04-26T20:20:08.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.338+0000 7ff060a00640 1 -- 172.21.15.82:0/3096388800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c102770 msgr2=0x7ff05c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.338+0000 7ff060a00640 1 --2- 172.21.15.82:0/3096388800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c102770 0x7ff05c102b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009900 tx=0x7ff04c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 -- 172.21.15.82:0/3096388800 shutdown_connections 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 --2- 172.21.15.82:0/3096388800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 0x7ff05c10abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 --2- 172.21.15.82:0/3096388800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c103960 0x7ff05c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 --2- 172.21.15.82:0/3096388800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c102770 0x7ff05c102b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 -- 172.21.15.82:0/3096388800 >> 172.21.15.82:0/3096388800 conn(0x7ff05c0fdcc0 msgr2=0x7ff05c100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 -- 172.21.15.82:0/3096388800 shutdown_connections 2024-04-26T20:20:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.339+0000 7ff060a00640 1 -- 172.21.15.82:0/3096388800 wait complete. 2024-04-26T20:20:08.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 Processor -- start 2024-04-26T20:20:08.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 -- start start 2024-04-26T20:20:08.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c102770 0x7ff05c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 0x7ff05c19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 0x7ff05c1a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c10e2f0 con 0x7ff05c103960 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c10e170 con 0x7ff05c102770 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff060a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c10e470 con 0x7ff05c104320 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff05aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 0x7ff05c19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff05be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 0x7ff05c1a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff05aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 0x7ff05c19b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47272/0 (socket says 172.21.15.82:47272) 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff05aa00640 1 -- 172.21.15.82:0/3432272294 learned_addr learned my addr 172.21.15.82:0/3432272294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff05be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 0x7ff05c1a2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37046/0 (socket says 172.21.15.82:37046) 2024-04-26T20:20:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.340+0000 7ff05b400640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c102770 0x7ff05c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05aa00640 1 -- 172.21.15.82:0/3432272294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 msgr2=0x7ff05c1a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05aa00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 0x7ff05c1a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05aa00640 1 -- 172.21.15.82:0/3432272294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c102770 msgr2=0x7ff05c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05aa00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c102770 0x7ff05c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05aa00640 1 -- 172.21.15.82:0/3432272294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c1a2780 con 0x7ff05c103960 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05b400640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c102770 0x7ff05c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.341+0000 7ff05aa00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 0x7ff05c19b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff04800e9f0 tx=0x7ff04800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.342+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04800cd80 con 0x7ff05c103960 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.342+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0480108e0 con 0x7ff05c103960 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.342+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048018980 con 0x7ff05c103960 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.342+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c1a2a70 con 0x7ff05c103960 2024-04-26T20:20:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.342+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c1a2fc0 con 0x7ff05c103960 2024-04-26T20:20:08.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.343+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c1a3190 con 0x7ff05c103960 2024-04-26T20:20:08.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.347+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff048010430 con 0x7ff05c103960 2024-04-26T20:20:08.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.349+0000 7ff053e00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0400a3bb0 0x7ff0400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.350+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff0480d0970 con 0x7ff05c103960 2024-04-26T20:20:08.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.350+0000 7ff05b400640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0400a3bb0 0x7ff0400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.351+0000 7ff05b400640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0400a3bb0 0x7ff0400a6070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff04c005ab0 tx=0x7ff04c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.356+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff04809ca60 con 0x7ff05c103960 2024-04-26T20:20:08.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.564+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff05c1a3520 con 0x7ff05c103960 2024-04-26T20:20:08.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.566+0000 7ff053e00640 1 -- 172.21.15.82:0/3432272294 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7ff0480a0d60 con 0x7ff05c103960 2024-04-26T20:20:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:08.566 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0400a3bb0 msgr2=0x7ff0400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0400a3bb0 0x7ff0400a6070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff04c005ab0 tx=0x7ff04c005a20 comp rx=0 tx=0).stop 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 msgr2=0x7ff05c19b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 0x7ff05c19b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff04800e9f0 tx=0x7ff04800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 shutdown_connections 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0400a3bb0 0x7ff0400a6070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c104320 0x7ff05c1a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c103960 0x7ff05c19b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 --2- 172.21.15.82:0/3432272294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c102770 0x7ff05c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.568+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 >> 172.21.15.82:0/3432272294 conn(0x7ff05c0fdcc0 msgr2=0x7ff05c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.569+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 shutdown_connections 2024-04-26T20:20:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.569+0000 7ff060a00640 1 -- 172.21.15.82:0/3432272294 wait complete. 2024-04-26T20:20:08.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:20:08.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 -- 172.21.15.82:0/1336842702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 msgr2=0x7f515410cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 --2- 172.21.15.82:0/1336842702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f515410cfd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f514c009ca0 tx=0x7f514c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 -- 172.21.15.82:0/1336842702 shutdown_connections 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 --2- 172.21.15.82:0/1336842702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f515410cfd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 --2- 172.21.15.82:0/1336842702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5154105d80 0x7f5154106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 --2- 172.21.15.82:0/1336842702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154104b90 0x7f5154104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 -- 172.21.15.82:0/1336842702 >> 172.21.15.82:0/1336842702 conn(0x7f5154100120 msgr2=0x7f5154102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:08.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 -- 172.21.15.82:0/1336842702 shutdown_connections 2024-04-26T20:20:08.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.775+0000 7f5159e00640 1 -- 172.21.15.82:0/1336842702 wait complete. 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.776+0000 7f5159e00640 1 Processor -- start 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.776+0000 7f5159e00640 1 -- start start 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.776+0000 7f5159e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5154104b90 0x7f515419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.776+0000 7f5159e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154105d80 0x7f515419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5159e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f51541a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5159e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5154110710 con 0x7f5154106740 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5159e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5154110590 con 0x7f5154105d80 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5159e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5154110890 con 0x7f5154104b90 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f51541a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f51541a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47294/0 (socket says 172.21.15.82:47294) 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 -- 172.21.15.82:0/552183012 learned_addr learned my addr 172.21.15.82:0/552183012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5152000640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154105d80 0x7f515419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5152a00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5154104b90 0x7f515419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 -- 172.21.15.82:0/552183012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5154104b90 msgr2=0x7f515419ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5154104b90 0x7f515419ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 -- 172.21.15.82:0/552183012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154105d80 msgr2=0x7f515419b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154105d80 0x7f515419b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5153400640 1 -- 172.21.15.82:0/552183012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541a29b0 con 0x7f5154106740 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.777+0000 7f5152000640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154105d80 0x7f515419b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.778+0000 7f5153400640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f51541a2310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f514c033040 tx=0x7f514c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.778+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c003b70 con 0x7f5154106740 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.778+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f514c003d10 con 0x7f5154106740 2024-04-26T20:20:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.778+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c02fb40 con 0x7f5154106740 2024-04-26T20:20:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.778+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51541a2c40 con 0x7f5154106740 2024-04-26T20:20:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.778+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541a3140 con 0x7f5154106740 2024-04-26T20:20:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.779+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515410bf00 con 0x7f5154106740 2024-04-26T20:20:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.781+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f514c004610 con 0x7f5154106740 2024-04-26T20:20:08.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.783+0000 7f5158a00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51380a3c30 0x7f51380a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:08.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.783+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f514c0f1a60 con 0x7f5154106740 2024-04-26T20:20:08.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.784+0000 7f5152a00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51380a3c30 0x7f51380a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:08.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.784+0000 7f5152a00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51380a3c30 0x7f51380a60f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f515419c270 tx=0x7f5144005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:08.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.788+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f514c0be1a0 con 0x7f5154106740 2024-04-26T20:20:08.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:08 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3432272294' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:08.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.977+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51540635d0 con 0x7f5154106740 2024-04-26T20:20:08.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.978+0000 7f5158a00640 1 -- 172.21.15.82:0/552183012 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f514c0bdaa0 con 0x7f5154106740 2024-04-26T20:20:08.979 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:20:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51380a3c30 msgr2=0x7f51380a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51380a3c30 0x7f51380a60f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f515419c270 tx=0x7f5144005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 msgr2=0x7f51541a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:08.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f51541a2310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f514c033040 tx=0x7f514c0316f0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 shutdown_connections 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51380a3c30 0x7f51380a60f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154106740 0x7f51541a2310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5154105d80 0x7f515419b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 --2- 172.21.15.82:0/552183012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5154104b90 0x7f515419ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 >> 172.21.15.82:0/552183012 conn(0x7f5154100120 msgr2=0x7f51541090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 shutdown_connections 2024-04-26T20:20:08.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:08.981+0000 7f5159e00640 1 -- 172.21.15.82:0/552183012 wait complete. 2024-04-26T20:20:08.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:20:09.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:08 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3432272294' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:09.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:08 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3432272294' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:09.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 -- 172.21.15.82:0/3645251920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900768f0 msgr2=0x7fcc90074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 --2- 172.21.15.82:0/3645251920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900768f0 0x7fcc90074d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009900 tx=0x7fcc8002a480 comp rx=0 tx=0).stop 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 -- 172.21.15.82:0/3645251920 shutdown_connections 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 --2- 172.21.15.82:0/3645251920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc9010a830 0x7fcc9010ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 --2- 172.21.15.82:0/3645251920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc90075310 0x7fcc90075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 --2- 172.21.15.82:0/3645251920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc900768f0 0x7fcc90074d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 -- 172.21.15.82:0/3645251920 >> 172.21.15.82:0/3645251920 conn(0x7fcc900fdf10 msgr2=0x7fcc90100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 -- 172.21.15.82:0/3645251920 shutdown_connections 2024-04-26T20:20:09.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.188+0000 7fcc96200640 1 -- 172.21.15.82:0/3645251920 wait complete. 2024-04-26T20:20:09.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 Processor -- start 2024-04-26T20:20:09.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 -- start start 2024-04-26T20:20:09.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc90075310 0x7fcc9019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc900768f0 0x7fcc9019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 0x7fcc901a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc901106e0 con 0x7fcc9010a830 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90110560 con 0x7fcc900768f0 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc96200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90110860 con 0x7fcc90075310 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc8fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 0x7fcc901a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc8fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 0x7fcc901a23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47302/0 (socket says 172.21.15.82:47302) 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.189+0000 7fcc8fe00640 1 -- 172.21.15.82:0/1636668827 learned_addr learned my addr 172.21.15.82:0/1636668827 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8f400640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc90075310 0x7fcc9019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc86a00640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc900768f0 0x7fcc9019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8fe00640 1 -- 172.21.15.82:0/1636668827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc90075310 msgr2=0x7fcc9019ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8fe00640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc90075310 0x7fcc9019ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8fe00640 1 -- 172.21.15.82:0/1636668827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc900768f0 msgr2=0x7fcc9019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8fe00640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc900768f0 0x7fcc9019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8fe00640 1 -- 172.21.15.82:0/1636668827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc901a2a30 con 0x7fcc9010a830 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc86a00640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc900768f0 0x7fcc9019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8fe00640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 0x7fcc901a23c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800eb10 tx=0x7fcc8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.190+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88004b20 con 0x7fcc9010a830 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.191+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc88004cc0 con 0x7fcc9010a830 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.191+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc901a2d20 con 0x7fcc9010a830 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.191+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88010670 con 0x7fcc9010a830 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.191+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc901a31c0 con 0x7fcc9010a830 2024-04-26T20:20:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.192+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc901095f0 con 0x7fcc9010a830 2024-04-26T20:20:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.194+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fcc88005020 con 0x7fcc9010a830 2024-04-26T20:20:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.195+0000 7fcc8cc00640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcc740a3bb0 0x7fcc740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.195+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fcc880d0c00 con 0x7fcc9010a830 2024-04-26T20:20:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.195+0000 7fcc8f400640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcc740a3bb0 0x7fcc740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.196+0000 7fcc8f400640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcc740a3bb0 0x7fcc740a6070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc80031500 tx=0x7fcc80005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:09.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.200+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcc8809d340 con 0x7fcc9010a830 2024-04-26T20:20:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.401+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcc900635d0 con 0x7fcc9010a830 2024-04-26T20:20:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.402+0000 7fcc8cc00640 1 -- 172.21.15.82:0/1636668827 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fcc8809cc40 con 0x7fcc9010a830 2024-04-26T20:20:09.403 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:20:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.405+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcc740a3bb0 msgr2=0x7fcc740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.405+0000 7fcc96200640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcc740a3bb0 0x7fcc740a6070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc80031500 tx=0x7fcc80005a20 comp rx=0 tx=0).stop 2024-04-26T20:20:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.405+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 msgr2=0x7fcc901a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.405+0000 7fcc96200640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 0x7fcc901a23c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800eb10 tx=0x7fcc8800c2d0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 shutdown_connections 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcc740a3bb0 0x7fcc740a6070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9010a830 0x7fcc901a23c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc900768f0 0x7fcc9019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 --2- 172.21.15.82:0/1636668827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc90075310 0x7fcc9019ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 >> 172.21.15.82:0/1636668827 conn(0x7fcc900fdf10 msgr2=0x7fcc901067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 shutdown_connections 2024-04-26T20:20:09.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.406+0000 7fcc96200640 1 -- 172.21.15.82:0/1636668827 wait complete. 2024-04-26T20:20:09.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:20:09.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.626+0000 7fbe3ac00640 1 -- 172.21.15.82:0/345124473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 msgr2=0x7fbe34105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.626+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/345124473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe34105da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009900 tx=0x7fbe2002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 -- 172.21.15.82:0/345124473 shutdown_connections 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/345124473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 0x7fbe34106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/345124473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe34105da0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/345124473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe34100fc0 0x7fbe341033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 -- 172.21.15.82:0/345124473 >> 172.21.15.82:0/345124473 conn(0x7fbe340fcc00 msgr2=0x7fbe340ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 -- 172.21.15.82:0/345124473 shutdown_connections 2024-04-26T20:20:09.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.627+0000 7fbe3ac00640 1 -- 172.21.15.82:0/345124473 wait complete. 2024-04-26T20:20:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 Processor -- start 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 -- start start 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe34100fc0 0x7fbe3419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe3419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 0x7fbe341a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe34114850 con 0x7fbe34103930 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe341146d0 con 0x7fbe341062e0 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3ac00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbe341149d0 con 0x7fbe34100fc0 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe38e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe3419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe38e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe3419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47330/0 (socket says 172.21.15.82:47330) 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe38e00640 1 -- 172.21.15.82:0/1255847287 learned_addr learned my addr 172.21.15.82:0/1255847287 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe39800640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe34100fc0 0x7fbe3419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.628+0000 7fbe3a200640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 0x7fbe341a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe38e00640 1 -- 172.21.15.82:0/1255847287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe34100fc0 msgr2=0x7fbe3419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe38e00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe34100fc0 0x7fbe3419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe38e00640 1 -- 172.21.15.82:0/1255847287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 msgr2=0x7fbe341a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe38e00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 0x7fbe341a64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe38e00640 1 -- 172.21.15.82:0/1255847287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe341a6b20 con 0x7fbe34103930 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe3a200640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 0x7fbe341a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe38e00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe3419f440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005940 tx=0x7fbe200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:09.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.629+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2003f030 con 0x7fbe34103930 2024-04-26T20:20:09.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.630+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe20003cb0 con 0x7fbe34103930 2024-04-26T20:20:09.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.630+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20035070 con 0x7fbe34103930 2024-04-26T20:20:09.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.630+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe341a6db0 con 0x7fbe34103930 2024-04-26T20:20:09.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.630+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe341a7260 con 0x7fbe34103930 2024-04-26T20:20:09.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.631+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe340fe6f0 con 0x7fbe34103930 2024-04-26T20:20:09.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.633+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbe20042030 con 0x7fbe34103930 2024-04-26T20:20:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.635+0000 7fbe32000640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbe180a3c30 0x7fbe180a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:09.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.635+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fbe200f09b0 con 0x7fbe34103930 2024-04-26T20:20:09.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.635+0000 7fbe39800640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbe180a3c30 0x7fbe180a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:09.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.636+0000 7fbe39800640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbe180a3c30 0x7fbe180a60f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c005fd0 tx=0x7fbe2c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.639+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fbe20003e60 con 0x7fbe34103930 2024-04-26T20:20:09.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:09 smithi082 ceph-mon[28105]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 378 B/s wr, 0 op/s 2024-04-26T20:20:09.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:09 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/552183012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:20:09.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:09 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1636668827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:20:09.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.842+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe3402dcf0 con 0x7fbe34103930 2024-04-26T20:20:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.843+0000 7fbe32000640 1 -- 172.21.15.82:0/1255847287 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fbe200bcaa0 con 0x7fbe34103930 2024-04-26T20:20:09.843 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbe180a3c30 msgr2=0x7fbe180a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbe180a3c30 0x7fbe180a60f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c005fd0 tx=0x7fbe2c009500 comp rx=0 tx=0).stop 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 msgr2=0x7fbe3419f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe3419f440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005940 tx=0x7fbe200042f0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 shutdown_connections 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbe180a3c30 0x7fbe180a60f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe341062e0 0x7fbe341a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34103930 0x7fbe3419f440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 --2- 172.21.15.82:0/1255847287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe34100fc0 0x7fbe3419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 >> 172.21.15.82:0/1255847287 conn(0x7fbe340fcc00 msgr2=0x7fbe34101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 shutdown_connections 2024-04-26T20:20:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:09.846+0000 7fbe3ac00640 1 -- 172.21.15.82:0/1255847287 wait complete. 2024-04-26T20:20:09.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 -- 172.21.15.82:0/1859258096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e810a980 msgr2=0x7f57e81112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 --2- 172.21.15.82:0/1859258096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e810a980 0x7f57e81112a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009ca0 tx=0x7f57e002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 -- 172.21.15.82:0/1859258096 shutdown_connections 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 --2- 172.21.15.82:0/1859258096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e810a980 0x7f57e81112a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 --2- 172.21.15.82:0/1859258096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8109fc0 0x7f57e810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 --2- 172.21.15.82:0/1859258096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e8108e70 0x7f57e8109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 -- 172.21.15.82:0/1859258096 >> 172.21.15.82:0/1859258096 conn(0x7f57e8077e00 msgr2=0x7f57e807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 -- 172.21.15.82:0/1859258096 shutdown_connections 2024-04-26T20:20:10.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.069+0000 7f57ee800640 1 -- 172.21.15.82:0/1859258096 wait complete. 2024-04-26T20:20:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:09 smithi139 ceph-mon[32999]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 378 B/s wr, 0 op/s 2024-04-26T20:20:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:09 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/552183012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:20:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:09 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1636668827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.070+0000 7f57ee800640 1 Processor -- start 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.070+0000 7f57ee800640 1 -- start start 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.070+0000 7f57ee800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 0x7f57e819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.070+0000 7f57ee800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8109fc0 0x7f57e819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ee800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e810a980 0x7f57e81a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ee800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8114a20 con 0x7f57e8109fc0 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ee800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57e81148a0 con 0x7f57e810a980 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ee800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8114ba0 con 0x7f57e8108e70 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 0x7f57e819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57eca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8109fc0 0x7f57e819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 0x7f57e819efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37126/0 (socket says 172.21.15.82:37126) 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 -- 172.21.15.82:0/3970557319 learned_addr learned my addr 172.21.15.82:0/3970557319 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 -- 172.21.15.82:0/3970557319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e810a980 msgr2=0x7f57e81a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e810a980 0x7f57e81a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 -- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8109fc0 msgr2=0x7f57e819f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8109fc0 0x7f57e819f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57ed400640 1 -- 172.21.15.82:0/3970557319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e81a6c00 con 0x7f57e8108e70 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.071+0000 7f57eca00640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8109fc0 0x7f57e819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.072+0000 7f57ed400640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 0x7f57e819efe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00d950 tx=0x7f57dc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.072+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc017030 con 0x7f57e8108e70 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.072+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57dc004020 con 0x7f57e8108e70 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.072+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0047a0 con 0x7f57e8108e70 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.072+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e81a6ef0 con 0x7f57e8108e70 2024-04-26T20:20:10.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.072+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e81a7360 con 0x7f57e8108e70 2024-04-26T20:20:10.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.073+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e81100b0 con 0x7f57e8108e70 2024-04-26T20:20:10.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.075+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f57dc009a30 con 0x7f57e8108e70 2024-04-26T20:20:10.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.076+0000 7f57e6000640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57d00a3bb0 0x7f57d00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.077+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f57dc0d0160 con 0x7f57e8108e70 2024-04-26T20:20:10.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.077+0000 7f57eca00640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57d00a3bb0 0x7f57d00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.077+0000 7f57eca00640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57d00a3bb0 0x7f57d00a6070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57e81a04f0 tx=0x7f57d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.081+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f57dc09c8a0 con 0x7f57e8108e70 2024-04-26T20:20:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:09 smithi135 ceph-mon[32816]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 378 B/s wr, 0 op/s 2024-04-26T20:20:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:09 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/552183012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:20:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:09 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1636668827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:20:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.269+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f57e802dad0 con 0x7f57e8108e70 2024-04-26T20:20:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.270+0000 7f57e6000640 1 -- 172.21.15.82:0/3970557319 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f57e802dad0 con 0x7f57e8108e70 2024-04-26T20:20:10.271 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:20:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57d00a3bb0 msgr2=0x7f57d00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57d00a3bb0 0x7f57d00a6070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57e81a04f0 tx=0x7f57d8005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 msgr2=0x7f57e819efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 0x7f57e819efe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00d950 tx=0x7f57dc00de10 comp rx=0 tx=0).stop 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 shutdown_connections 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57d00a3bb0 0x7f57d00a6070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57e810a980 0x7f57e81a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57e8109fc0 0x7f57e819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 --2- 172.21.15.82:0/3970557319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e8108e70 0x7f57e819efe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 >> 172.21.15.82:0/3970557319 conn(0x7f57e8077e00 msgr2=0x7f57e810d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 shutdown_connections 2024-04-26T20:20:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.273+0000 7f57ee800640 1 -- 172.21.15.82:0/3970557319 wait complete. 2024-04-26T20:20:10.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 -- 172.21.15.82:0/1286562876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4104990 msgr2=0x7f2bf4104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/1286562876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4104990 0x7f2bf4104db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009860 tx=0x7f2be402a340 comp rx=0 tx=0).stop 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 -- 172.21.15.82:0/1286562876 shutdown_connections 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/1286562876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4106540 0x7f2bf410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/1286562876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4105b80 0x7f2bf4106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/1286562876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4104990 0x7f2bf4104db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 -- 172.21.15.82:0/1286562876 >> 172.21.15.82:0/1286562876 conn(0x7f2bf40fff00 msgr2=0x7f2bf4102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 -- 172.21.15.82:0/1286562876 shutdown_connections 2024-04-26T20:20:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.487+0000 7f2bf9a00640 1 -- 172.21.15.82:0/1286562876 wait complete. 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 Processor -- start 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 -- start start 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 0x7f2bf419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4105b80 0x7f2bf419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4106540 0x7f2bf41a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf41104c0 con 0x7f2bf4104990 2024-04-26T20:20:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4110340 con 0x7f2bf4105b80 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf9a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4110640 con 0x7f2bf4106540 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 0x7f2bf419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2beb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4105b80 0x7f2bf419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 0x7f2bf419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47362/0 (socket says 172.21.15.82:47362) 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.489+0000 7f2bf3e00640 1 -- 172.21.15.82:0/2480153190 learned_addr learned my addr 172.21.15.82:0/2480153190 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf9000640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4106540 0x7f2bf41a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf3e00640 1 -- 172.21.15.82:0/2480153190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4106540 msgr2=0x7f2bf41a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf3e00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4106540 0x7f2bf41a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf3e00640 1 -- 172.21.15.82:0/2480153190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4105b80 msgr2=0x7f2bf419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf3e00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4105b80 0x7f2bf419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf3e00640 1 -- 172.21.15.82:0/2480153190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41a27b0 con 0x7f2bf4104990 2024-04-26T20:20:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2beb400640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4105b80 0x7f2bf419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf3e00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 0x7f2bf419ab90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2be40057c0 tx=0x7f2be4032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.490+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4037040 con 0x7f2bf4104990 2024-04-26T20:20:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.491+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf41a2a40 con 0x7f2bf4104990 2024-04-26T20:20:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.491+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2be4030bd0 con 0x7f2bf4104990 2024-04-26T20:20:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.491+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4005280 con 0x7f2bf4104990 2024-04-26T20:20:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.491+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41a2f20 con 0x7f2bf4104990 2024-04-26T20:20:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.492+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf410bd50 con 0x7f2bf4104990 2024-04-26T20:20:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.494+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2be4043020 con 0x7f2bf4104990 2024-04-26T20:20:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.496+0000 7f2bf1600640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2bd80a3c30 0x7f2bd80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.496+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f2be40efc00 con 0x7f2bf4104990 2024-04-26T20:20:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.496+0000 7f2beb400640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2bd80a3c30 0x7f2bd80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.497+0000 7f2beb400640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2bd80a3c30 0x7f2bd80a60f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0096c0 tx=0x7f2bdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.501+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2be40bc340 con 0x7f2bf4104990 2024-04-26T20:20:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.726+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2bf402dad0 con 0x7f2bf4104990 2024-04-26T20:20:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.726+0000 7f2bf1600640 1 -- 172.21.15.82:0/2480153190 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+591 (secure 0 0 0) 0x7f2be40bbc40 con 0x7f2bf4104990 2024-04-26T20:20:10.727 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3159671154 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3236939866 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2488160347 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3159671154 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1183753623 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1310193659 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3095457796 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2488160347 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/539922460 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1137290075 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-04-26T20:20:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2bd80a3c30 msgr2=0x7f2bd80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2bd80a3c30 0x7f2bd80a60f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0096c0 tx=0x7f2bdc009260 comp rx=0 tx=0).stop 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 msgr2=0x7f2bf419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 0x7f2bf419ab90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2be40057c0 tx=0x7f2be4032da0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 shutdown_connections 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2bd80a3c30 0x7f2bd80a60f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4106540 0x7f2bf41a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf4105b80 0x7f2bf419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 --2- 172.21.15.82:0/2480153190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bf4104990 0x7f2bf419ab90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 >> 172.21.15.82:0/2480153190 conn(0x7f2bf40fff00 msgr2=0x7f2bf4108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 shutdown_connections 2024-04-26T20:20:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:10.730+0000 7f2bf9a00640 1 -- 172.21.15.82:0/2480153190 wait complete. 2024-04-26T20:20:10.749 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:20:10.749 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:20:10.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:20:10.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:10 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1255847287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:20:10.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:10 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3970557319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 -- 172.21.15.82:0/2656623582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c0772f0 msgr2=0x7fa00c077710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 --2- 172.21.15.82:0/2656623582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c0772f0 0x7fa00c077710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ca0 tx=0x7fa00402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 -- 172.21.15.82:0/2656623582 shutdown_connections 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 --2- 172.21.15.82:0/2656623582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078ed0 0x7fa00c079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 --2- 172.21.15.82:0/2656623582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c078530 0x7fa00c078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 --2- 172.21.15.82:0/2656623582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c0772f0 0x7fa00c077710 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 -- 172.21.15.82:0/2656623582 >> 172.21.15.82:0/2656623582 conn(0x7fa00c100120 msgr2=0x7fa00c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 -- 172.21.15.82:0/2656623582 shutdown_connections 2024-04-26T20:20:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.050+0000 7fa012400640 1 -- 172.21.15.82:0/2656623582 wait complete. 2024-04-26T20:20:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.051+0000 7fa012400640 1 Processor -- start 2024-04-26T20:20:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.051+0000 7fa012400640 1 -- start start 2024-04-26T20:20:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.051+0000 7fa012400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c0772f0 0x7fa00c19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa012400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078530 0x7fa00c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa012400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 0x7fa00c1a6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa012400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c114ad0 con 0x7fa00c078ed0 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa012400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c114950 con 0x7fa00c0772f0 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa012400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c114c50 con 0x7fa00c078530 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 0x7fa00c1a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c0772f0 0x7fa00c19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 0x7fa00c1a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42692/0 (socket says 172.21.15.82:42692) 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00be00640 1 -- 172.21.15.82:0/106426641 learned_addr learned my addr 172.21.15.82:0/106426641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00aa00640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078530 0x7fa00c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00b400640 1 -- 172.21.15.82:0/106426641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078530 msgr2=0x7fa00c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00b400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078530 0x7fa00c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00b400640 1 -- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 msgr2=0x7fa00c1a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00b400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 0x7fa00c1a6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00b400640 1 -- 172.21.15.82:0/106426641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c1a6db0 con 0x7fa00c0772f0 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00be00640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 0x7fa00c1a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.052+0000 7fa00aa00640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078530 0x7fa00c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.053+0000 7fa00b400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c0772f0 0x7fa00c19f190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ca0 tx=0x7fa0040316e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.053+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004003b70 con 0x7fa00c0772f0 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.053+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c1a7040 con 0x7fa00c0772f0 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.053+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa004003d10 con 0x7fa00c0772f0 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.053+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00402fb30 con 0x7fa00c0772f0 2024-04-26T20:20:11.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.053+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c1a75e0 con 0x7fa00c0772f0 2024-04-26T20:20:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.054+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00c111740 con 0x7fa00c0772f0 2024-04-26T20:20:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.056+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa004004610 con 0x7fa00c0772f0 2024-04-26T20:20:11.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.057+0000 7fa003e00640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ff00a3c30 0x7f9ff00a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.058+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa0040f1be0 con 0x7fa00c0772f0 2024-04-26T20:20:11.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.058+0000 7fa00aa00640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ff00a3c30 0x7f9ff00a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.058+0000 7fa00aa00640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ff00a3c30 0x7f9ff00a60f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa00c1a06a0 tx=0x7f9ff4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:11.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.060+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa0040be320 con 0x7fa00c0772f0 2024-04-26T20:20:11.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:10 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1255847287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:20:11.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:10 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3970557319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:20:11.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:10 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1255847287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:20:11.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:10 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3970557319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:20:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.264+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa00c063530 con 0x7fa00c0772f0 2024-04-26T20:20:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.266+0000 7fa003e00640 1 -- 172.21.15.82:0/106426641 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7fa0040bdc20 con 0x7fa00c0772f0 2024-04-26T20:20:11.267 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:11.267 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ff00a3c30 msgr2=0x7f9ff00a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ff00a3c30 0x7f9ff00a60f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa00c1a06a0 tx=0x7f9ff4005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c0772f0 msgr2=0x7fa00c19f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c0772f0 0x7fa00c19f190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ca0 tx=0x7fa0040316e0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 shutdown_connections 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ff00a3c30 0x7f9ff00a60f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa00c078ed0 0x7fa00c1a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa00c078530 0x7fa00c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 --2- 172.21.15.82:0/106426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa00c0772f0 0x7fa00c19f190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 >> 172.21.15.82:0/106426641 conn(0x7fa00c100120 msgr2=0x7fa00c1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 shutdown_connections 2024-04-26T20:20:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.269+0000 7fa012400640 1 -- 172.21.15.82:0/106426641 wait complete. 2024-04-26T20:20:11.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:20:11.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 -- 172.21.15.82:0/1299475324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8106620 msgr2=0x7f43a810ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 --2- 172.21.15.82:0/1299475324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8106620 0x7f43a810ceb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f439802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 -- 172.21.15.82:0/1299475324 shutdown_connections 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 --2- 172.21.15.82:0/1299475324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8106620 0x7f43a810ceb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 --2- 172.21.15.82:0/1299475324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a8105c60 0x7f43a81060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 --2- 172.21.15.82:0/1299475324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43a8104a70 0x7f43a8104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 -- 172.21.15.82:0/1299475324 >> 172.21.15.82:0/1299475324 conn(0x7f43a80fffe0 msgr2=0x7f43a8102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:11.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 -- 172.21.15.82:0/1299475324 shutdown_connections 2024-04-26T20:20:11.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.503+0000 7f43a7200640 1 -- 172.21.15.82:0/1299475324 wait complete. 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 Processor -- start 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 -- start start 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 0x7f43a819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43a8105c60 0x7f43a819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a8106620 0x7f43a81a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81105f0 con 0x7f43a8104a70 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8110470 con 0x7f43a8106620 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a7200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8110770 con 0x7f43a8105c60 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 0x7f43a819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 0x7f43a819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42718/0 (socket says 172.21.15.82:42718) 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.505+0000 7f43a5e00640 1 -- 172.21.15.82:0/637890016 learned_addr learned my addr 172.21.15.82:0/637890016 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5400640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43a8105c60 0x7f43a819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a6800640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a8106620 0x7f43a81a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5e00640 1 -- 172.21.15.82:0/637890016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43a8105c60 msgr2=0x7f43a819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5e00640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43a8105c60 0x7f43a819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5e00640 1 -- 172.21.15.82:0/637890016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a8106620 msgr2=0x7f43a81a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5e00640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a8106620 0x7f43a81a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5e00640 1 -- 172.21.15.82:0/637890016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a81a2840 con 0x7f43a8104a70 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a5e00640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 0x7f43a819ac30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f43a000e9c0 tx=0x7f43a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a000cd80 con 0x7f43a8104a70 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a00035f0 con 0x7f43a8104a70 2024-04-26T20:20:11.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0010690 con 0x7f43a8104a70 2024-04-26T20:20:11.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.506+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a81a2b30 con 0x7f43a8104a70 2024-04-26T20:20:11.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.507+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a3030 con 0x7f43a8104a70 2024-04-26T20:20:11.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.508+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a810bd90 con 0x7f43a8104a70 2024-04-26T20:20:11.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.510+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f43a0004000 con 0x7f43a8104a70 2024-04-26T20:20:11.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.511+0000 7f439ea00640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f438c0a3bb0 0x7f438c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.511+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f43a00d0cd0 con 0x7f43a8104a70 2024-04-26T20:20:11.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.512+0000 7f43a5400640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f438c0a3bb0 0x7f438c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.512+0000 7f43a5400640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f438c0a3bb0 0x7f438c0a6070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4390005fd0 tx=0x7f4390009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:11.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.516+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f43a009d410 con 0x7f43a8104a70 2024-04-26T20:20:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.719+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f43a8063530 con 0x7f43a8104a70 2024-04-26T20:20:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.720+0000 7f439ea00640 1 -- 172.21.15.82:0/637890016 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f43a009cd10 con 0x7f43a8104a70 2024-04-26T20:20:11.720 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:20:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.722+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f438c0a3bb0 msgr2=0x7f438c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.722+0000 7f43a7200640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f438c0a3bb0 0x7f438c0a6070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4390005fd0 tx=0x7f4390009500 comp rx=0 tx=0).stop 2024-04-26T20:20:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.722+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 msgr2=0x7f43a819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.722+0000 7f43a7200640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 0x7f43a819ac30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f43a000e9c0 tx=0x7f43a000ee80 comp rx=0 tx=0).stop 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 shutdown_connections 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f438c0a3bb0 0x7f438c0a6070 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a8106620 0x7f43a81a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43a8105c60 0x7f43a819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 --2- 172.21.15.82:0/637890016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a8104a70 0x7f43a819ac30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 >> 172.21.15.82:0/637890016 conn(0x7f43a80fffe0 msgr2=0x7f43a8108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 shutdown_connections 2024-04-26T20:20:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.723+0000 7f43a7200640 1 -- 172.21.15.82:0/637890016 wait complete. 2024-04-26T20:20:11.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:20:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:11 smithi082 ceph-mon[28105]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:11 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2480153190' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:20:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:11 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/106426641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:11.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 -- 172.21.15.82:0/2460584577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c104410 msgr2=0x7fba4c10aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 --2- 172.21.15.82:0/2460584577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c104410 0x7fba4c10aca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fba44009ca0 tx=0x7fba4402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 -- 172.21.15.82:0/2460584577 shutdown_connections 2024-04-26T20:20:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 --2- 172.21.15.82:0/2460584577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c104410 0x7fba4c10aca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 --2- 172.21.15.82:0/2460584577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c103a50 0x7fba4c103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 --2- 172.21.15.82:0/2460584577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c102860 0x7fba4c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 -- 172.21.15.82:0/2460584577 >> 172.21.15.82:0/2460584577 conn(0x7fba4c0fddd0 msgr2=0x7fba4c100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:11.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 -- 172.21.15.82:0/2460584577 shutdown_connections 2024-04-26T20:20:11.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.953+0000 7fba4be00640 1 -- 172.21.15.82:0/2460584577 wait complete. 2024-04-26T20:20:11.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 Processor -- start 2024-04-26T20:20:11.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 -- start start 2024-04-26T20:20:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c102860 0x7fba4c0766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 0x7fba4c074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c104410 0x7fba4c075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10e370 con 0x7fba4c103a50 2024-04-26T20:20:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10e1f0 con 0x7fba4c102860 2024-04-26T20:20:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.954+0000 7fba4be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10e4f0 con 0x7fba4c104410 2024-04-26T20:20:11.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 0x7fba4c074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 0x7fba4c074d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42734/0 (socket says 172.21.15.82:42734) 2024-04-26T20:20:11.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 -- 172.21.15.82:0/2201064836 learned_addr learned my addr 172.21.15.82:0/2201064836 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:11.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4aa00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c102860 0x7fba4c0766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4b400640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c104410 0x7fba4c075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 -- 172.21.15.82:0/2201064836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c104410 msgr2=0x7fba4c075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c104410 0x7fba4c075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 -- 172.21.15.82:0/2201064836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c102860 msgr2=0x7fba4c0766e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:11.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c102860 0x7fba4c0766e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:11.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 -- 172.21.15.82:0/2201064836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c075af0 con 0x7fba4c103a50 2024-04-26T20:20:11.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba4a000640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 0x7fba4c074d20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9f0 tx=0x7fba3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:11.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.955+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3800cd80 con 0x7fba4c103a50 2024-04-26T20:20:11.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.956+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1a2b20 con 0x7fba4c103a50 2024-04-26T20:20:11.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.956+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba380108e0 con 0x7fba4c103a50 2024-04-26T20:20:11.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.956+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38018980 con 0x7fba4c103a50 2024-04-26T20:20:11.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.956+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c1a3070 con 0x7fba4c103a50 2024-04-26T20:20:11.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.957+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c109c50 con 0x7fba4c103a50 2024-04-26T20:20:11.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.959+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fba38010430 con 0x7fba4c103a50 2024-04-26T20:20:11.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.960+0000 7fba43400640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba300a3bb0 0x7fba300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:11.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.961+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fba380d0e50 con 0x7fba4c103a50 2024-04-26T20:20:11.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.961+0000 7fba4aa00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba300a3bb0 0x7fba300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:11.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.962+0000 7fba4aa00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba300a3bb0 0x7fba300a6070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba4c1038b0 tx=0x7fba3c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:11.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:11.963+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fba3809cf40 con 0x7fba4c103a50 2024-04-26T20:20:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:11 smithi139 ceph-mon[32999]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:11 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2480153190' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:20:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:11 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/106426641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:11 smithi135 ceph-mon[32816]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:11 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2480153190' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:20:12.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:11 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/106426641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:12.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.163+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fba4c02dc60 con 0x7fba4c103a50 2024-04-26T20:20:12.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.164+0000 7fba43400640 1 -- 172.21.15.82:0/2201064836 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fba380a1240 con 0x7fba4c103a50 2024-04-26T20:20:12.164 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:20:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba300a3bb0 msgr2=0x7fba300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba300a3bb0 0x7fba300a6070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba4c1038b0 tx=0x7fba3c00b390 comp rx=0 tx=0).stop 2024-04-26T20:20:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 msgr2=0x7fba4c074d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 0x7fba4c074d20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9f0 tx=0x7fba3800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 shutdown_connections 2024-04-26T20:20:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fba300a3bb0 0x7fba300a6070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba4c104410 0x7fba4c075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c103a50 0x7fba4c074d20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 --2- 172.21.15.82:0/2201064836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba4c102860 0x7fba4c0766e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.166+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 >> 172.21.15.82:0/2201064836 conn(0x7fba4c0fddd0 msgr2=0x7fba4c106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.167+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 shutdown_connections 2024-04-26T20:20:12.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.167+0000 7fba4be00640 1 -- 172.21.15.82:0/2201064836 wait complete. 2024-04-26T20:20:12.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:20:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.390+0000 7f912dc00640 1 -- 172.21.15.82:0/1249983213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 msgr2=0x7f9128106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.390+0000 7f912dc00640 1 --2- 172.21.15.82:0/1249983213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 0x7f9128106200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9114009be0 tx=0x7f911402a6c0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.390+0000 7f912dc00640 1 -- 172.21.15.82:0/1249983213 shutdown_connections 2024-04-26T20:20:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.390+0000 7f912dc00640 1 --2- 172.21.15.82:0/1249983213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9128106740 0x7f912810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.390+0000 7f912dc00640 1 --2- 172.21.15.82:0/1249983213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 0x7f9128106200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.390+0000 7f912dc00640 1 --2- 172.21.15.82:0/1249983213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128104b90 0x7f9128104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.391+0000 7f912dc00640 1 -- 172.21.15.82:0/1249983213 >> 172.21.15.82:0/1249983213 conn(0x7f9128100120 msgr2=0x7f9128102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.391+0000 7f912dc00640 1 -- 172.21.15.82:0/1249983213 shutdown_connections 2024-04-26T20:20:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.391+0000 7f912dc00640 1 -- 172.21.15.82:0/1249983213 wait complete. 2024-04-26T20:20:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 Processor -- start 2024-04-26T20:20:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 -- start start 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9128104b90 0x7f912819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 0x7f912819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 0x7f91281a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91281106a0 con 0x7f9128106740 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9128110520 con 0x7f9128105d80 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.392+0000 7f912dc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9128110820 con 0x7f9128104b90 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 0x7f91281a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 0x7f91281a2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42762/0 (socket says 172.21.15.82:42762) 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 -- 172.21.15.82:0/3525400477 learned_addr learned my addr 172.21.15.82:0/3525400477 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9126a00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9128104b90 0x7f912819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9126000640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 0x7f912819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 -- 172.21.15.82:0/3525400477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9128104b90 msgr2=0x7f912819ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9128104b90 0x7f912819ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 -- 172.21.15.82:0/3525400477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 msgr2=0x7f912819b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 0x7f912819b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 -- 172.21.15.82:0/3525400477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91281a2990 con 0x7f9128106740 2024-04-26T20:20:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.393+0000 7f9127400640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 0x7f91281a2320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f912000e970 tx=0x7f912000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.394+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912000ccc0 con 0x7f9128106740 2024-04-26T20:20:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.394+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f912000ce60 con 0x7f9128106740 2024-04-26T20:20:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.394+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281a2c80 con 0x7f9128106740 2024-04-26T20:20:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.394+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120010430 con 0x7f9128106740 2024-04-26T20:20:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.394+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91281a3150 con 0x7f9128106740 2024-04-26T20:20:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.395+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912810bf00 con 0x7f9128106740 2024-04-26T20:20:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.397+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9120004f20 con 0x7f9128106740 2024-04-26T20:20:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.398+0000 7f911f400640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f910c0a3bb0 0x7f910c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.399+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f91200d0900 con 0x7f9128106740 2024-04-26T20:20:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.399+0000 7f9126a00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f910c0a3bb0 0x7f910c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.400+0000 7f9126a00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f910c0a3bb0 0x7f910c0a6070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9128105be0 tx=0x7f9118009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.403+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f912009d0a0 con 0x7f9128106740 2024-04-26T20:20:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.604+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91280635d0 con 0x7f9128106740 2024-04-26T20:20:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.605+0000 7f911f400640 1 -- 172.21.15.82:0/3525400477 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f912009c9a0 con 0x7f9128106740 2024-04-26T20:20:12.605 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:20:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f910c0a3bb0 msgr2=0x7f910c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f910c0a3bb0 0x7f910c0a6070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9128105be0 tx=0x7f9118009260 comp rx=0 tx=0).stop 2024-04-26T20:20:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 msgr2=0x7f91281a2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 0x7f91281a2320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f912000e970 tx=0x7f912000ed70 comp rx=0 tx=0).stop 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 shutdown_connections 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f910c0a3bb0 0x7f910c0a6070 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128106740 0x7f91281a2320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9128105d80 0x7f912819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 --2- 172.21.15.82:0/3525400477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9128104b90 0x7f912819ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 >> 172.21.15.82:0/3525400477 conn(0x7f9128100120 msgr2=0x7f91281090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 shutdown_connections 2024-04-26T20:20:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.608+0000 7f912dc00640 1 -- 172.21.15.82:0/3525400477 wait complete. 2024-04-26T20:20:12.628 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 -- 172.21.15.82:0/185985575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc105d80 msgr2=0x7ff9fc106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 --2- 172.21.15.82:0/185985575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc105d80 0x7ff9fc106200 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009900 tx=0x7ff9e402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 -- 172.21.15.82:0/185985575 shutdown_connections 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 --2- 172.21.15.82:0/185985575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9fc106740 0x7ff9fc10cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 --2- 172.21.15.82:0/185985575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc105d80 0x7ff9fc106200 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 --2- 172.21.15.82:0/185985575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc104b90 0x7ff9fc104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 -- 172.21.15.82:0/185985575 >> 172.21.15.82:0/185985575 conn(0x7ff9fc100120 msgr2=0x7ff9fc102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:12.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 -- 172.21.15.82:0/185985575 shutdown_connections 2024-04-26T20:20:12.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.833+0000 7ffa03600640 1 -- 172.21.15.82:0/185985575 wait complete. 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.834+0000 7ffa03600640 1 Processor -- start 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 -- start start 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9fc104b90 0x7ff9fc19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc105d80 0x7ff9fc19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 0x7ff9fc1a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc1106f0 con 0x7ff9fc105d80 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc110570 con 0x7ff9fc104b90 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa03600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc110870 con 0x7ff9fc106740 2024-04-26T20:20:12.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa01600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 0x7ff9fc1a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc105d80 0x7ff9fc19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa01600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 0x7ff9fc1a2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47682/0 (socket says 172.21.15.82:47682) 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa01600640 1 -- 172.21.15.82:0/1167107770 learned_addr learned my addr 172.21.15.82:0/1167107770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.835+0000 7ffa00c00640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9fc104b90 0x7ff9fc19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa01600640 1 -- 172.21.15.82:0/1167107770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9fc104b90 msgr2=0x7ff9fc19adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa01600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9fc104b90 0x7ff9fc19adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa01600640 1 -- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc105d80 msgr2=0x7ff9fc19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa01600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc105d80 0x7ff9fc19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa01600640 1 -- 172.21.15.82:0/1167107770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc1a29e0 con 0x7ff9fc106740 2024-04-26T20:20:12.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa01600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 0x7ff9fc1a2370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400e970 tx=0x7ff9f400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:12.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400ccc0 con 0x7ff9fc106740 2024-04-26T20:20:12.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9f400ce60 con 0x7ff9fc106740 2024-04-26T20:20:12.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9fc1a2cd0 con 0x7ff9fc106740 2024-04-26T20:20:12.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.836+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4010430 con 0x7ff9fc106740 2024-04-26T20:20:12.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.837+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9fc1a31a0 con 0x7ff9fc106740 2024-04-26T20:20:12.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.838+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9fc10bf50 con 0x7ff9fc106740 2024-04-26T20:20:12.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.840+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff9f4004ff0 con 0x7ff9fc106740 2024-04-26T20:20:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.842+0000 7ff9fa000640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3bb0 0x7ff9e00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.842+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7ff9f40d0a20 con 0x7ff9fc106740 2024-04-26T20:20:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.842+0000 7ffa00c00640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3bb0 0x7ff9e00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:12.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.842+0000 7ffa00c00640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3bb0 0x7ff9e00a6070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0099a0 tx=0x7ff9ec009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:12.844+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff9f409d160 con 0x7ff9fc106740 2024-04-26T20:20:12.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:12 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/637890016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:20:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:12 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2201064836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:20:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:12 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3525400477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.045+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff9fc02dc60 con 0x7ff9fc106740 2024-04-26T20:20:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.046+0000 7ff9fa000640 1 -- 172.21.15.82:0/1167107770 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7ff9f409ca60 con 0x7ff9fc106740 2024-04-26T20:20:13.047 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:20:13.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.048+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3bb0 msgr2=0x7ff9e00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.048+0000 7ffa03600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3bb0 0x7ff9e00a6070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0099a0 tx=0x7ff9ec009500 comp rx=0 tx=0).stop 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.048+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 msgr2=0x7ff9fc1a2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.048+0000 7ffa03600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 0x7ff9fc1a2370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400e970 tx=0x7ff9f400ed70 comp rx=0 tx=0).stop 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 shutdown_connections 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3bb0 0x7ff9e00a6070 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9fc106740 0x7ff9fc1a2370 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc105d80 0x7ff9fc19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 --2- 172.21.15.82:0/1167107770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9fc104b90 0x7ff9fc19adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 >> 172.21.15.82:0/1167107770 conn(0x7ff9fc100120 msgr2=0x7ff9fc109120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 shutdown_connections 2024-04-26T20:20:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.049+0000 7ffa03600640 1 -- 172.21.15.82:0/1167107770 wait complete. 2024-04-26T20:20:13.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:20:13.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:12 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/637890016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:12 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2201064836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:12 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3525400477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:12 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/637890016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:12 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2201064836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:12 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3525400477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 -- 172.21.15.82:0/3086565439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994104990 msgr2=0x7f7994104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 --2- 172.21.15.82:0/3086565439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994104990 0x7f7994104db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7984009900 tx=0x7f798402a400 comp rx=0 tx=0).stop 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 -- 172.21.15.82:0/3086565439 shutdown_connections 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 --2- 172.21.15.82:0/3086565439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7994106540 0x7f799410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 --2- 172.21.15.82:0/3086565439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7994105b80 0x7f7994106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 --2- 172.21.15.82:0/3086565439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994104990 0x7f7994104db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 -- 172.21.15.82:0/3086565439 >> 172.21.15.82:0/3086565439 conn(0x7f79940fff00 msgr2=0x7f7994102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 -- 172.21.15.82:0/3086565439 shutdown_connections 2024-04-26T20:20:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.266+0000 7f7993200640 1 -- 172.21.15.82:0/3086565439 wait complete. 2024-04-26T20:20:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 Processor -- start 2024-04-26T20:20:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 -- start start 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7994104990 0x7f799419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7994105b80 0x7f799419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 0x7f79941a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79941104e0 con 0x7f7994106540 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7994110360 con 0x7f7994105b80 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.267+0000 7f7993200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7994110660 con 0x7f7994104990 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 0x7f79941a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 0x7f79941a2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42798/0 (socket says 172.21.15.82:42798) 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 -- 172.21.15.82:0/3698851449 learned_addr learned my addr 172.21.15.82:0/3698851449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7991e00640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7994104990 0x7f799419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f798be00640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7994105b80 0x7f799419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 -- 172.21.15.82:0/3698851449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7994104990 msgr2=0x7f799419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7994104990 0x7f799419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 -- 172.21.15.82:0/3698851449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7994105b80 msgr2=0x7f799419b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7994105b80 0x7f799419b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.268+0000 7f7992800640 1 -- 172.21.15.82:0/3698851449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79941a27a0 con 0x7f7994106540 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.269+0000 7f7992800640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 0x7f79941a2130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f798c00eb10 tx=0x7f798c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.269+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c004b20 con 0x7f7994106540 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.269+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f798c004cc0 con 0x7f7994106540 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.269+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79941a2a90 con 0x7f7994106540 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.269+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c010670 con 0x7f7994106540 2024-04-26T20:20:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.269+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79941a2f90 con 0x7f7994106540 2024-04-26T20:20:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.270+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799410bd30 con 0x7f7994106540 2024-04-26T20:20:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.272+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f798c005020 con 0x7f7994106540 2024-04-26T20:20:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.273+0000 7f798aa00640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79780a3bb0 0x7f79780a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.274+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f798c0d0c50 con 0x7f7994106540 2024-04-26T20:20:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.274+0000 7f7991e00640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79780a3bb0 0x7f79780a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.274+0000 7f7991e00640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79780a3bb0 0x7f79780a6070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7984005ab0 tx=0x7f7984005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.278+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f798c09d390 con 0x7f7994106540 2024-04-26T20:20:13.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.493+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f799402dad0 con 0x7f7994106540 2024-04-26T20:20:13.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.493+0000 7f798aa00640 1 -- 172.21.15.82:0/3698851449 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+591 (secure 0 0 0) 0x7f798c09cc90 con 0x7f7994106540 2024-04-26T20:20:13.494 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3159671154 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:13.494 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3236939866 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:13.494 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2488160347 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:13.494 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3159671154 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:13.494 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1183753623 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:13.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1310193659 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:13.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3095457796 2024-04-27T20:11:46.422113+0000 2024-04-26T20:20:13.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2488160347 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:13.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/539922460 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:13.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1137290075 2024-04-27T20:11:11.001209+0000 2024-04-26T20:20:13.495 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79780a3bb0 msgr2=0x7f79780a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79780a3bb0 0x7f79780a6070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7984005ab0 tx=0x7f7984005a20 comp rx=0 tx=0).stop 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 msgr2=0x7f79941a2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 0x7f79941a2130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f798c00eb10 tx=0x7f798c00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 shutdown_connections 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79780a3bb0 0x7f79780a6070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7994106540 0x7f79941a2130 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7994105b80 0x7f799419b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 --2- 172.21.15.82:0/3698851449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7994104990 0x7f799419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 >> 172.21.15.82:0/3698851449 conn(0x7f79940fff00 msgr2=0x7f7994108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:13.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.496+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 shutdown_connections 2024-04-26T20:20:13.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.497+0000 7f7993200640 1 -- 172.21.15.82:0/3698851449 wait complete. 2024-04-26T20:20:13.515 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-04-26T20:20:13.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:13.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:20:13.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[72313]: fuse finished with error 0 and tester_r 0 2024-04-26T20:20:13.586 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:20:13.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:20:13.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:20:13.650 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T20:20:13.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:20:13.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:13 smithi082 ceph-mon[28105]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:13.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:13 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1167107770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:20:13.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:13 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3698851449' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 -- 172.21.15.82:0/3920216206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8104990 msgr2=0x7fc6f8104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 --2- 172.21.15.82:0/3920216206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8104990 0x7fc6f8104db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009900 tx=0x7fc6e002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 -- 172.21.15.82:0/3920216206 shutdown_connections 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 --2- 172.21.15.82:0/3920216206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6f8106540 0x7fc6f810cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 --2- 172.21.15.82:0/3920216206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6f8105b80 0x7fc6f8106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 --2- 172.21.15.82:0/3920216206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8104990 0x7fc6f8104db0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 -- 172.21.15.82:0/3920216206 >> 172.21.15.82:0/3920216206 conn(0x7fc6f80fff00 msgr2=0x7fc6f8102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 -- 172.21.15.82:0/3920216206 shutdown_connections 2024-04-26T20:20:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.939+0000 7fc6fe200640 1 -- 172.21.15.82:0/3920216206 wait complete. 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.940+0000 7fc6fe200640 1 Processor -- start 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.940+0000 7fc6fe200640 1 -- start start 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fe200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6f8104990 0x7fc6f819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fe200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6f8105b80 0x7fc6f819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fe200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 0x7fc6f81a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fe200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8110500 con 0x7fc6f8106540 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fe200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8110380 con 0x7fc6f8104990 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fe200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8110680 con 0x7fc6f8105b80 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 0x7fc6f81a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 0x7fc6f81a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42814/0 (socket says 172.21.15.82:42814) 2024-04-26T20:20:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 -- 172.21.15.82:0/829786530 learned_addr learned my addr 172.21.15.82:0/829786530 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6efe00640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6f8105b80 0x7fc6f819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fce00640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6f8104990 0x7fc6f819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 -- 172.21.15.82:0/829786530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6f8105b80 msgr2=0x7fc6f819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6f8105b80 0x7fc6f819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 -- 172.21.15.82:0/829786530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6f8104990 msgr2=0x7fc6f819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6f8104990 0x7fc6f819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.941+0000 7fc6fd800640 1 -- 172.21.15.82:0/829786530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f81a27c0 con 0x7fc6f8106540 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.942+0000 7fc6fd800640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 0x7fc6f81a2150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000eb10 tx=0x7fc6f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.942+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0004b20 con 0x7fc6f8106540 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.942+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6f0004cc0 con 0x7fc6f8106540 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.942+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f81a2ab0 con 0x7fc6f8106540 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.942+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0010670 con 0x7fc6f8106540 2024-04-26T20:20:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.942+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f81a3000 con 0x7fc6f8106540 2024-04-26T20:20:13.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.943+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f810bdd0 con 0x7fc6f8106540 2024-04-26T20:20:13.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.945+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc6f0005020 con 0x7fc6f8106540 2024-04-26T20:20:13.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.946+0000 7fc6f6000640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6d80a3c30 0x7fc6d80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.947+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fc6f00d0b80 con 0x7fc6f8106540 2024-04-26T20:20:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.947+0000 7fc6fce00640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6d80a3c30 0x7fc6d80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:13.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.948+0000 7fc6fce00640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6d80a3c30 0x7fc6d80a60f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0005ab0 tx=0x7fc6e0005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:13.951+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc6f009d2c0 con 0x7fc6f8106540 2024-04-26T20:20:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:13 smithi139 ceph-mon[32999]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:13 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1167107770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:20:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:13 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3698851449' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:20:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:13 smithi135 ceph-mon[32816]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:14.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:13 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1167107770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:20:14.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:13 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3698851449' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:20:14.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.139+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6f80635d0 con 0x7fc6f8106540 2024-04-26T20:20:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.142+0000 7fc6f6000640 1 -- 172.21.15.82:0/829786530 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7fc6f009cbc0 con 0x7fc6f8106540 2024-04-26T20:20:14.142 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:14.143 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.144+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6d80a3c30 msgr2=0x7fc6d80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.144+0000 7fc6fe200640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6d80a3c30 0x7fc6d80a60f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0005ab0 tx=0x7fc6e0005a20 comp rx=0 tx=0).stop 2024-04-26T20:20:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.144+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 msgr2=0x7fc6f81a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.144+0000 7fc6fe200640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 0x7fc6f81a2150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000eb10 tx=0x7fc6f000c2d0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 shutdown_connections 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc6d80a3c30 0x7fc6d80a60f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8106540 0x7fc6f81a2150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6f8105b80 0x7fc6f819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 --2- 172.21.15.82:0/829786530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6f8104990 0x7fc6f819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 >> 172.21.15.82:0/829786530 conn(0x7fc6f80fff00 msgr2=0x7fc6f8108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 shutdown_connections 2024-04-26T20:20:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.145+0000 7fc6fe200640 1 -- 172.21.15.82:0/829786530 wait complete. 2024-04-26T20:20:14.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 -- 172.21.15.82:0/2691197233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c10a940 msgr2=0x7f7f7c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2691197233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c10a940 0x7f7f7c1111d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009ca0 tx=0x7f7f7402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 -- 172.21.15.82:0/2691197233 shutdown_connections 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2691197233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c10a940 0x7f7f7c1111d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2691197233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f7c109f80 0x7f7f7c10a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2691197233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 0x7f7f7c1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 -- 172.21.15.82:0/2691197233 >> 172.21.15.82:0/2691197233 conn(0x7f7f7c077d30 msgr2=0x7f7f7c07a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 -- 172.21.15.82:0/2691197233 shutdown_connections 2024-04-26T20:20:14.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.363+0000 7f7f7b200640 1 -- 172.21.15.82:0/2691197233 wait complete. 2024-04-26T20:20:14.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.364+0000 7f7f7b200640 1 Processor -- start 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.364+0000 7f7f7b200640 1 -- start start 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 0x7f7f7c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 0x7f7f7c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f7c10a940 0x7f7f7c1a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c114910 con 0x7f7f7c10a940 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c114790 con 0x7f7f7c108d90 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c114a90 con 0x7f7f7c109f80 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f79e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 0x7f7f7c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 0x7f7f7c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f7a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f7c10a940 0x7f7f7c1a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 0x7f7f7c19f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47724/0 (socket says 172.21.15.82:47724) 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 -- 172.21.15.82:0/2237913450 learned_addr learned my addr 172.21.15.82:0/2237913450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:14.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 -- 172.21.15.82:0/2237913450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 msgr2=0x7f7f7c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 0x7f7f7c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 -- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f7c10a940 msgr2=0x7f7f7c1a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.365+0000 7f7f73e00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f7c10a940 0x7f7f7c1a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f73e00640 1 -- 172.21.15.82:0/2237913450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c1a6b10 con 0x7f7f7c109f80 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f79e00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 0x7f7f7c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f73e00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 0x7f7f7c19f430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400e9f0 tx=0x7f7f6400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400cd80 con 0x7f7f7c109f80 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c1a6e00 con 0x7f7f7c109f80 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f640108e0 con 0x7f7f7c109f80 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64018980 con 0x7f7f7c109f80 2024-04-26T20:20:14.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.366+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c1a7310 con 0x7f7f7c109f80 2024-04-26T20:20:14.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.367+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c110130 con 0x7f7f7c109f80 2024-04-26T20:20:14.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.370+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7f64010430 con 0x7f7f7c109f80 2024-04-26T20:20:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.371+0000 7f7f72a00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f600a3c30 0x7f7f600a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.371+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f7f640d0900 con 0x7f7f7c109f80 2024-04-26T20:20:14.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.371+0000 7f7f79e00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f600a3c30 0x7f7f600a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.372+0000 7f7f79e00640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f600a3c30 0x7f7f600a60f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c109de0 tx=0x7f7f6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:14.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.375+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7f6409c9f0 con 0x7f7f7c109f80 2024-04-26T20:20:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.581+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f7c0635d0 con 0x7f7f7c109f80 2024-04-26T20:20:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.583+0000 7f7f72a00640 1 -- 172.21.15.82:0/2237913450 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7f7f640a0cf0 con 0x7f7f7c109f80 2024-04-26T20:20:14.584 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:14.585 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:14.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.586+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f600a3c30 msgr2=0x7f7f600a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.586+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f600a3c30 0x7f7f600a60f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c109de0 tx=0x7f7f6c005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.586+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 msgr2=0x7f7f7c19f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.586+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 0x7f7f7c19f430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400e9f0 tx=0x7f7f6400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 shutdown_connections 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f600a3c30 0x7f7f600a60f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f7c10a940 0x7f7f7c1a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f7c109f80 0x7f7f7c19f430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 --2- 172.21.15.82:0/2237913450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f7c108d90 0x7f7f7c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 >> 172.21.15.82:0/2237913450 conn(0x7f7f7c077d30 msgr2=0x7f7f7c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 shutdown_connections 2024-04-26T20:20:14.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.587+0000 7f7f7b200640 1 -- 172.21.15.82:0/2237913450 wait complete. 2024-04-26T20:20:14.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T20:20:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.818+0000 7fbb45e00640 1 -- 172.21.15.82:0/548382501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb40103a30 msgr2=0x7fbb40103eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.818+0000 7fbb45e00640 1 --2- 172.21.15.82:0/548382501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb40103a30 0x7fbb40103eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009860 tx=0x7fbb2c02a340 comp rx=0 tx=0).stop 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 -- 172.21.15.82:0/548382501 shutdown_connections 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 --2- 172.21.15.82:0/548382501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb401043f0 0x7fbb4010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 --2- 172.21.15.82:0/548382501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb40103a30 0x7fbb40103eb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 --2- 172.21.15.82:0/548382501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb40102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 -- 172.21.15.82:0/548382501 >> 172.21.15.82:0/548382501 conn(0x7fbb400fddd0 msgr2=0x7fbb401001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 -- 172.21.15.82:0/548382501 shutdown_connections 2024-04-26T20:20:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.819+0000 7fbb45e00640 1 -- 172.21.15.82:0/548382501 wait complete. 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 Processor -- start 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 -- start start 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb4019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb40103a30 0x7fbb4019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb401043f0 0x7fbb401a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010e370 con 0x7fbb40102840 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010e1f0 con 0x7fbb401043f0 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010e4f0 con 0x7fbb40103a30 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb44a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb4019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb44a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb4019ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42846/0 (socket says 172.21.15.82:42846) 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb44a00640 1 -- 172.21.15.82:0/3813391134 learned_addr learned my addr 172.21.15.82:0/3813391134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb3fe00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb40103a30 0x7fbb4019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.820+0000 7fbb45400640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb401043f0 0x7fbb401a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb44a00640 1 -- 172.21.15.82:0/3813391134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb40103a30 msgr2=0x7fbb4019b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb44a00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb40103a30 0x7fbb4019b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb44a00640 1 -- 172.21.15.82:0/3813391134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb401043f0 msgr2=0x7fbb401a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb44a00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb401043f0 0x7fbb401a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb44a00640 1 -- 172.21.15.82:0/3813391134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb401a28c0 con 0x7fbb40102840 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb3fe00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb40103a30 0x7fbb4019b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb44a00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb4019ac80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e9f0 tx=0x7fbb3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400ccc0 con 0x7fbb40102840 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.821+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340035f0 con 0x7fbb40102840 2024-04-26T20:20:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.822+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb401a2bb0 con 0x7fbb40102840 2024-04-26T20:20:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.822+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400ce60 con 0x7fbb40102840 2024-04-26T20:20:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.822+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401a30d0 con 0x7fbb40102840 2024-04-26T20:20:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.823+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb401a32a0 con 0x7fbb40102840 2024-04-26T20:20:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.825+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbb34004000 con 0x7fbb40102840 2024-04-26T20:20:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.826+0000 7fbb3d600640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbb280a3bb0 0x7fbb280a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.826+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fbb340d0880 con 0x7fbb40102840 2024-04-26T20:20:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.827+0000 7fbb3fe00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbb280a3bb0 0x7fbb280a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.827+0000 7fbb3fe00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbb280a3bb0 0x7fbb280a6070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c02a930 tx=0x7fbb2c030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:14.831+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fbb3409cfc0 con 0x7fbb40102840 2024-04-26T20:20:14.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:14 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/829786530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:14.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:14 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2237913450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:15.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:14 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/829786530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:15.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:14 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2237913450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:15.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.073+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbb401a3470 con 0x7fbb40102840 2024-04-26T20:20:15.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:14 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/829786530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:15.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:14 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2237913450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:15.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.690+0000 7fbb3d600640 1 -- 172.21.15.82:0/3813391134 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fbb3409c8c0 con 0x7fbb40102840 2024-04-26T20:20:15.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbb280a3bb0 msgr2=0x7fbb280a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbb280a3bb0 0x7fbb280a6070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c02a930 tx=0x7fbb2c030450 comp rx=0 tx=0).stop 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 msgr2=0x7fbb4019ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb4019ac80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e9f0 tx=0x7fbb3400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 shutdown_connections 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbb280a3bb0 0x7fbb280a6070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb401043f0 0x7fbb401a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb40103a30 0x7fbb4019b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 --2- 172.21.15.82:0/3813391134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb40102840 0x7fbb4019ac80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 >> 172.21.15.82:0/3813391134 conn(0x7fbb400fddd0 msgr2=0x7fbb40074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:15.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 shutdown_connections 2024-04-26T20:20:15.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.694+0000 7fbb45e00640 1 -- 172.21.15.82:0/3813391134 wait complete. 2024-04-26T20:20:15.720 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-04-26T20:20:15.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-26T20:20:15.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 -- 172.21.15.82:0/3537394467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b5010a700 msgr2=0x7f1b5010cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 --2- 172.21.15.82:0/3537394467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b5010a700 0x7f1b5010cb90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009ca0 tx=0x7f1b4802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 -- 172.21.15.82:0/3537394467 shutdown_connections 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 --2- 172.21.15.82:0/3537394467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b5010a700 0x7f1b5010cb90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 --2- 172.21.15.82:0/3537394467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b50075390 0x7f1b50075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 --2- 172.21.15.82:0/3537394467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 0x7f1b50074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 -- 172.21.15.82:0/3537394467 >> 172.21.15.82:0/3537394467 conn(0x7f1b500fddd0 msgr2=0x7f1b501001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 -- 172.21.15.82:0/3537394467 shutdown_connections 2024-04-26T20:20:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.922+0000 7f1b56600640 1 -- 172.21.15.82:0/3537394467 wait complete. 2024-04-26T20:20:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.923+0000 7f1b56600640 1 Processor -- start 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.923+0000 7f1b56600640 1 -- start start 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b56600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 0x7f1b5019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b56600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 0x7f1b5019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b56600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5010a700 0x7f1b501a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b56600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50110530 con 0x7f1b50075390 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b56600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b501103b0 con 0x7f1b5010a700 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b56600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b501106b0 con 0x7f1b50076970 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b55200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 0x7f1b5019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b55200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 0x7f1b5019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42866/0 (socket says 172.21.15.82:42866) 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b55200640 1 -- 172.21.15.82:0/2062106549 learned_addr learned my addr 172.21.15.82:0/2062106549 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b4fe00640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 0x7f1b5019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b55c00640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5010a700 0x7f1b501a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b55200640 1 -- 172.21.15.82:0/2062106549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 msgr2=0x7f1b5019b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.924+0000 7f1b55200640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 0x7f1b5019b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b55200640 1 -- 172.21.15.82:0/2062106549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5010a700 msgr2=0x7f1b501a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b55200640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5010a700 0x7f1b501a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b55200640 1 -- 172.21.15.82:0/2062106549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b501a27a0 con 0x7f1b50075390 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b4fe00640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 0x7f1b5019b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b55200640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 0x7f1b5019ab80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e9f0 tx=0x7f1b4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400cd80 con 0x7f1b50075390 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b440108e0 con 0x7f1b50075390 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44018980 con 0x7f1b50075390 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b501a2a90 con 0x7f1b50075390 2024-04-26T20:20:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.925+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b501a2f90 con 0x7f1b50075390 2024-04-26T20:20:15.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.926+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b50109430 con 0x7f1b50075390 2024-04-26T20:20:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.928+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1b44010430 con 0x7f1b50075390 2024-04-26T20:20:15.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.930+0000 7f1b4d600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b380a3bb0 0x7f1b380a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:15.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.930+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f1b440d0970 con 0x7f1b50075390 2024-04-26T20:20:15.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.930+0000 7f1b4fe00640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b380a3bb0 0x7f1b380a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:15.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.931+0000 7f1b4fe00640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b380a3bb0 0x7f1b380a6070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0095f0 tx=0x7f1b3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:15.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:15.934+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1b4409ca60 con 0x7f1b50075390 2024-04-26T20:20:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:15 smithi082 ceph-mon[28105]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:15 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3813391134' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T20:20:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:15 smithi139 ceph-mon[32999]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:15 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3813391134' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T20:20:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:15 smithi135 ceph-mon[32816]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:15 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3813391134' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T20:20:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.177+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f1b50063530 con 0x7f1b50075390 2024-04-26T20:20:16.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.693+0000 7f1b4d600640 1 -- 172.21.15.82:0/2062106549 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f1b440a0d60 con 0x7f1b50075390 2024-04-26T20:20:16.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b380a3bb0 msgr2=0x7f1b380a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:16.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b380a3bb0 0x7f1b380a6070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0095f0 tx=0x7f1b3c005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:16.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 msgr2=0x7f1b5019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:16.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 0x7f1b5019ab80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e9f0 tx=0x7f1b4400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 shutdown_connections 2024-04-26T20:20:16.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b380a3bb0 0x7f1b380a6070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5010a700 0x7f1b501a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b50076970 0x7f1b5019b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 --2- 172.21.15.82:0/2062106549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b50075390 0x7f1b5019ab80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 >> 172.21.15.82:0/2062106549 conn(0x7f1b500fddd0 msgr2=0x7f1b50106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:16.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 shutdown_connections 2024-04-26T20:20:16.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.697+0000 7f1b56600640 1 -- 172.21.15.82:0/2062106549 wait complete. 2024-04-26T20:20:16.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-26T20:20:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 -- 172.21.15.82:0/3583729537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 msgr2=0x7f9df0078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 --2- 172.21.15.82:0/3583729537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df0078990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 -- 172.21.15.82:0/3583729537 shutdown_connections 2024-04-26T20:20:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 --2- 172.21.15.82:0/3583729537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df0078ed0 0x7f9df0079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 --2- 172.21.15.82:0/3583729537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df0078990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 --2- 172.21.15.82:0/3583729537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9df00772f0 0x7f9df0077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 -- 172.21.15.82:0/3583729537 >> 172.21.15.82:0/3583729537 conn(0x7f9df00fffe0 msgr2=0x7f9df0102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 -- 172.21.15.82:0/3583729537 shutdown_connections 2024-04-26T20:20:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.909+0000 7f9defe00640 1 -- 172.21.15.82:0/3583729537 wait complete. 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.910+0000 7f9defe00640 1 Processor -- start 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 -- start start 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9df00772f0 0x7f9df019f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df0078ed0 0x7f9df01a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9df01149b0 con 0x7f9df0078530 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0114830 con 0x7f9df0078ed0 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9defe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0114b30 con 0x7f9df00772f0 2024-04-26T20:20:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df019f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42890/0 (socket says 172.21.15.82:42890) 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9de7e00640 1 -- 172.21.15.82:0/4098878488 learned_addr learned my addr 172.21.15.82:0/4098878488 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9def400640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df0078ed0 0x7f9df01a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.911+0000 7f9deea00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9df00772f0 0x7f9df019f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7e00640 1 -- 172.21.15.82:0/4098878488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9df00772f0 msgr2=0x7f9df019f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7e00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9df00772f0 0x7f9df019f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7e00640 1 -- 172.21.15.82:0/4098878488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df0078ed0 msgr2=0x7f9df01a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7e00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df0078ed0 0x7f9df01a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7e00640 1 -- 172.21.15.82:0/4098878488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df01a6cf0 con 0x7f9df0078530 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7e00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df019f610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8005940 tx=0x7f9dd8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd803f030 con 0x7f9df0078530 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd8003aa0 con 0x7f9df0078530 2024-04-26T20:20:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8035070 con 0x7f9df0078530 2024-04-26T20:20:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df01a6f80 con 0x7f9df0078530 2024-04-26T20:20:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.912+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df01a73e0 con 0x7f9df0078530 2024-04-26T20:20:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.914+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df01113e0 con 0x7f9df0078530 2024-04-26T20:20:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.916+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9dd8042030 con 0x7f9df0078530 2024-04-26T20:20:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.917+0000 7f9de7400640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9dd40a3bb0 0x7f9dd40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.917+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f9dd80f0c10 con 0x7f9df0078530 2024-04-26T20:20:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.917+0000 7f9deea00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9dd40a3bb0 0x7f9dd40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.918+0000 7f9deea00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9dd40a3bb0 0x7f9dd40a6070 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009bd0 tx=0x7f9de0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:16.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:16.922+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9dd80bcd00 con 0x7f9df0078530 2024-04-26T20:20:17.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:16 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3813391134' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T20:20:17.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:16 smithi135 ceph-mon[32816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:20:17.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:16 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2062106549' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T20:20:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:16 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3813391134' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T20:20:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:16 smithi139 ceph-mon[32999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:20:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:16 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2062106549' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T20:20:17.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.168+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f9df0063530 con 0x7f9df0078530 2024-04-26T20:20:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:16 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3813391134' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T20:20:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:16 smithi082 ceph-mon[28105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:20:17.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:16 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2062106549' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-26T20:20:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.706+0000 7f9de7400640 1 -- 172.21.15.82:0/4098878488 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f9dd80c1000 con 0x7f9df0078530 2024-04-26T20:20:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.711+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9dd40a3bb0 msgr2=0x7f9dd40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.711+0000 7f9defe00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9dd40a3bb0 0x7f9dd40a6070 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009bd0 tx=0x7f9de0005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.711+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 msgr2=0x7f9df019f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.711+0000 7f9defe00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df019f610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8005940 tx=0x7f9dd8031a50 comp rx=0 tx=0).stop 2024-04-26T20:20:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 shutdown_connections 2024-04-26T20:20:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9dd40a3bb0 0x7f9dd40a6070 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df0078ed0 0x7f9df01a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df0078530 0x7f9df019f610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 --2- 172.21.15.82:0/4098878488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9df00772f0 0x7f9df019f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 >> 172.21.15.82:0/4098878488 conn(0x7f9df00fffe0 msgr2=0x7f9df0103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 shutdown_connections 2024-04-26T20:20:17.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.712+0000 7f9defe00640 1 -- 172.21.15.82:0/4098878488 wait complete. 2024-04-26T20:20:17.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-26T20:20:17.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 -- 172.21.15.82:0/2358592189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c102420 msgr2=0x7f728c1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 --2- 172.21.15.82:0/2358592189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c102420 0x7f728c1028a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7284009ca0 tx=0x7f728402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 -- 172.21.15.82:0/2358592189 shutdown_connections 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 --2- 172.21.15.82:0/2358592189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c102420 0x7f728c1028a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 --2- 172.21.15.82:0/2358592189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f728c101a80 0x7f728c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 --2- 172.21.15.82:0/2358592189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c101120 0x7f728c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 -- 172.21.15.82:0/2358592189 >> 172.21.15.82:0/2358592189 conn(0x7f728c0fcce0 msgr2=0x7f728c0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 -- 172.21.15.82:0/2358592189 shutdown_connections 2024-04-26T20:20:17.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.926+0000 7f728be00640 1 -- 172.21.15.82:0/2358592189 wait complete. 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 Processor -- start 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 -- start start 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c101120 0x7f728c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 0x7f728c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f728c102420 0x7f728c1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f728c1105c0 con 0x7f728c101120 2024-04-26T20:20:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f728c110440 con 0x7f728c101a80 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.927+0000 7f728be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f728c110740 con 0x7f728c102420 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 0x7f728c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 0x7f728c19b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39942/0 (socket says 172.21.15.82:39942) 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 -- 172.21.15.82:0/1206786755 learned_addr learned my addr 172.21.15.82:0/1206786755 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c101120 0x7f728c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728b400640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f728c102420 0x7f728c1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 -- 172.21.15.82:0/1206786755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f728c102420 msgr2=0x7f728c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f728c102420 0x7f728c1a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 -- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c101120 msgr2=0x7f728c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c101120 0x7f728c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 -- 172.21.15.82:0/1206786755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728c1a27f0 con 0x7f728c101a80 2024-04-26T20:20:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f728a000640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 0x7f728c19b110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f727800e9f0 tx=0x7f727800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.928+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727800cd80 con 0x7f728c101a80 2024-04-26T20:20:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.929+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72780054d0 con 0x7f728c101a80 2024-04-26T20:20:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.929+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278010690 con 0x7f728c101a80 2024-04-26T20:20:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.929+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728c1a2ae0 con 0x7f728c101a80 2024-04-26T20:20:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.929+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728c1a3030 con 0x7f728c101a80 2024-04-26T20:20:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.930+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728c10c010 con 0x7f728c101a80 2024-04-26T20:20:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.932+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7278004e90 con 0x7f728c101a80 2024-04-26T20:20:17.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.934+0000 7f7290a00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f72700a3c30 0x7f72700a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.934+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f72780d0ab0 con 0x7f728c101a80 2024-04-26T20:20:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.934+0000 7f728aa00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f72700a3c30 0x7f72700a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:17.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.935+0000 7f728aa00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f72700a3c30 0x7f72700a60f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f727c009bd0 tx=0x7f727c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:17.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:17.938+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f727809d1f0 con 0x7f728c101a80 2024-04-26T20:20:18.033 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:20:17.708+0000 7fd343189700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T20:20:18.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:18.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T20:20:18.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2062106549' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T20:20:18.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T20:20:18.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:20:18.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-04-26T20:20:18.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T20:20:18.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:17 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4098878488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2062106549' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T20:20:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:17 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4098878488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T20:20:18.169 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2062106549' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T20:20:18.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:17 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4098878488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T20:20:18.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.183+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f728c063530 con 0x7f728c101a80 2024-04-26T20:20:18.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.721+0000 7f7290a00640 1 -- 172.21.15.82:0/1206786755 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f727809caf0 con 0x7f728c101a80 2024-04-26T20:20:18.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f72700a3c30 msgr2=0x7f72700a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:18.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f72700a3c30 0x7f72700a60f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f727c009bd0 tx=0x7f727c005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:18.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 msgr2=0x7f728c19b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:18.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 0x7f728c19b110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f727800e9f0 tx=0x7f727800edf0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 shutdown_connections 2024-04-26T20:20:18.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f72700a3c30 0x7f72700a60f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f728c102420 0x7f728c1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f728c101a80 0x7f728c19b110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 --2- 172.21.15.82:0/1206786755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f728c101120 0x7f728c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 >> 172.21.15.82:0/1206786755 conn(0x7f728c0fcce0 msgr2=0x7f728c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 shutdown_connections 2024-04-26T20:20:18.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.725+0000 7f728be00640 1 -- 172.21.15.82:0/1206786755 wait complete. 2024-04-26T20:20:18.758 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-04-26T20:20:18.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 -- 172.21.15.82:0/1446519384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 msgr2=0x7f86c410a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 --2- 172.21.15.82:0/1446519384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c410a600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009900 tx=0x7f86ac02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 -- 172.21.15.82:0/1446519384 shutdown_connections 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 --2- 172.21.15.82:0/1446519384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 --2- 172.21.15.82:0/1446519384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c410a600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 --2- 172.21.15.82:0/1446519384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c4108f90 0x7f86c41093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 -- 172.21.15.82:0/1446519384 >> 172.21.15.82:0/1446519384 conn(0x7f86c4077f30 msgr2=0x7f86c407a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 -- 172.21.15.82:0/1446519384 shutdown_connections 2024-04-26T20:20:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.943+0000 7f86c9a00640 1 -- 172.21.15.82:0/1446519384 wait complete. 2024-04-26T20:20:18.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 Processor -- start 2024-04-26T20:20:18.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 -- start start 2024-04-26T20:20:18.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c4108f90 0x7f86c419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:18.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86c4114b20 con 0x7f86c410a180 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41149a0 con 0x7f86c410ab40 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.944+0000 7f86c9a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86c4114ca0 con 0x7f86c4108f90 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86bbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c4108f90 0x7f86c419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39954/0 (socket says 172.21.15.82:39954) 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86bbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c419f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42924/0 (socket says 172.21.15.82:42924) 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 -- 172.21.15.82:0/4073824699 learned_addr learned my addr 172.21.15.82:0/4073824699 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 -- 172.21.15.82:0/4073824699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c4108f90 msgr2=0x7f86c419f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c4108f90 0x7f86c419f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 -- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 msgr2=0x7f86c419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 -- 172.21.15.82:0/4073824699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c41a6dd0 con 0x7f86c410ab40 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.945+0000 7f86c3400640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41a6760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00eb10 tx=0x7f86bc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.946+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc004b20 con 0x7f86c410ab40 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.946+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c41a70c0 con 0x7f86c410ab40 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.946+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86bc004cc0 con 0x7f86c410ab40 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.946+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc010670 con 0x7f86c410ab40 2024-04-26T20:20:18.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.946+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c41a75e0 con 0x7f86c410ab40 2024-04-26T20:20:18.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.947+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c4110330 con 0x7f86c410ab40 2024-04-26T20:20:18.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.949+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f86bc005020 con 0x7f86c410ab40 2024-04-26T20:20:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.950+0000 7f86bb400640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86a80a3bb0 0x7f86a80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.950+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f86bc0d0c50 con 0x7f86c410ab40 2024-04-26T20:20:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.950+0000 7f86c2a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86a80a3bb0 0x7f86a80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.951+0000 7f86c2a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86a80a3bb0 0x7f86a80a6070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86c4109fe0 tx=0x7f86b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:18.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:18.958+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f86bc09d390 con 0x7f86c410ab40 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4098878488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:active 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1206786755' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:20:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:18 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4098878488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:active 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1206786755' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:20:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:18 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:20:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4098878488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T20:20:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:active 2024-04-26T20:20:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T20:20:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-04-26T20:20:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-04-26T20:20:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T20:20:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1206786755' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:20:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:18 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T20:20:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:19.195+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f86c4062d70 con 0x7f86a80a3bb0 2024-04-26T20:20:19.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:20:19.201+0000 7f1228600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:20:19.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:20:19.201+0000 7f1228600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:20:19.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:20:19.201+0000 7f1228600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:20:19.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:20:19.201+0000 7f1228600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:20:19.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:20:19.201+0000 7f1228600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:20:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-04-26T20:20:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T20:20:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:active 2024-04-26T20:20:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T20:20:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-04-26T20:20:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:active 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: Cluster is now healthy 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-04-26T20:20:20.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:19 smithi139 ceph-mon[32999]: from='client.24821 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:active 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:active 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T20:20:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T20:20:20.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: Cluster is now healthy 2024-04-26T20:20:20.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-04-26T20:20:20.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-26T20:20:20.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-04-26T20:20:20.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:19 smithi135 ceph-mon[32816]: from='client.24821 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-04-26T20:20:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T20:20:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:active 2024-04-26T20:20:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-26T20:20:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:active 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: Cluster is now healthy 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-04-26T20:20:20.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:19 smithi082 ceph-mon[28105]: from='client.24821 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:20.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.222+0000 7f86bb400640 1 -- 172.21.15.82:0/4073824699 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86c4062d70 con 0x7f86a80a3bb0 2024-04-26T20:20:20.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.225+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86a80a3bb0 msgr2=0x7f86a80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.225+0000 7f86c9a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86a80a3bb0 0x7f86a80a6070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86c4109fe0 tx=0x7f86b4005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:20.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 msgr2=0x7f86c41a6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41a6760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00eb10 tx=0x7f86bc00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 shutdown_connections 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86a80a3bb0 0x7f86a80a6070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c410ab40 0x7f86c41a6760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86c410a180 0x7f86c419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 --2- 172.21.15.82:0/4073824699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86c4108f90 0x7f86c419f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 >> 172.21.15.82:0/4073824699 conn(0x7f86c4077f30 msgr2=0x7f86c410d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 shutdown_connections 2024-04-26T20:20:20.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.226+0000 7f86c9a00640 1 -- 172.21.15.82:0/4073824699 wait complete. 2024-04-26T20:20:20.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-26T20:20:20.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 -- 172.21.15.82:0/1121952833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50105c60 msgr2=0x7f5f501060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 --2- 172.21.15.82:0/1121952833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50105c60 0x7f5f501060e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009900 tx=0x7f5f3802a410 comp rx=0 tx=0).stop 2024-04-26T20:20:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 -- 172.21.15.82:0/1121952833 shutdown_connections 2024-04-26T20:20:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 --2- 172.21.15.82:0/1121952833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50106620 0x7f5f5010ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 --2- 172.21.15.82:0/1121952833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50105c60 0x7f5f501060e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 --2- 172.21.15.82:0/1121952833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f50104a70 0x7f5f50104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 -- 172.21.15.82:0/1121952833 >> 172.21.15.82:0/1121952833 conn(0x7f5f500fffe0 msgr2=0x7f5f50102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 -- 172.21.15.82:0/1121952833 shutdown_connections 2024-04-26T20:20:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.455+0000 7f5f55c00640 1 -- 172.21.15.82:0/1121952833 wait complete. 2024-04-26T20:20:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 Processor -- start 2024-04-26T20:20:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 -- start start 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 0x7f5f5019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f50105c60 0x7f5f5019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 0x7f5f501a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501105d0 con 0x7f5f50104a70 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50110450 con 0x7f5f50106620 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.456+0000 7f5f55c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50110750 con 0x7f5f50105c60 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f4fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 0x7f5f5019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 0x7f5f501a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f4fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 0x7f5f5019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42950/0 (socket says 172.21.15.82:42950) 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f4fe00640 1 -- 172.21.15.82:0/715033404 learned_addr learned my addr 172.21.15.82:0/715033404 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 0x7f5f501a2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39984/0 (socket says 172.21.15.82:39984) 2024-04-26T20:20:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f47400640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f50105c60 0x7f5f5019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 -- 172.21.15.82:0/715033404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f50105c60 msgr2=0x7f5f5019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f50105c60 0x7f5f5019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 -- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 msgr2=0x7f5f5019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 0x7f5f5019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 -- 172.21.15.82:0/715033404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f501a28d0 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f4fe00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 0x7f5f5019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.457+0000 7f5f55200640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 0x7f5f501a2230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009fd0 tx=0x7f5f4800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.458+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800ce20 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.458+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f48005020 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.458+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48010690 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.458+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f501a2bc0 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.458+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f501a3090 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.459+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5010be60 con 0x7f5f50106620 2024-04-26T20:20:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.461+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5f480054d0 con 0x7f5f50106620 2024-04-26T20:20:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.462+0000 7f5f4d600640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f340a3bb0 0x7f5f340a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.462+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f5f480d0cd0 con 0x7f5f50106620 2024-04-26T20:20:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.462+0000 7f5f4fe00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f340a3bb0 0x7f5f340a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.463+0000 7f5f4fe00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f340a3bb0 0x7f5f340a6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f5019bb60 tx=0x7f5f4000b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.466+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5f4809d410 con 0x7f5f50106620 2024-04-26T20:20:20.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.697+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5f50062d70 con 0x7f5f340a3bb0 2024-04-26T20:20:20.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.736+0000 7f5f4d600640 1 -- 172.21.15.82:0/715033404 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5f50062d70 con 0x7f5f340a3bb0 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f340a3bb0 msgr2=0x7f5f340a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f340a3bb0 0x7f5f340a6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f5019bb60 tx=0x7f5f4000b4a0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 msgr2=0x7f5f501a2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 0x7f5f501a2230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009fd0 tx=0x7f5f4800ef10 comp rx=0 tx=0).stop 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 shutdown_connections 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f340a3bb0 0x7f5f340a6070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f50106620 0x7f5f501a2230 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f50105c60 0x7f5f5019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 --2- 172.21.15.82:0/715033404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f50104a70 0x7f5f5019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 >> 172.21.15.82:0/715033404 conn(0x7f5f500fffe0 msgr2=0x7f5f50109030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:20.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 shutdown_connections 2024-04-26T20:20:20.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.739+0000 7f5f55c00640 1 -- 172.21.15.82:0/715033404 wait complete. 2024-04-26T20:20:20.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-26T20:20:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 -- 172.21.15.82:0/851688118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 msgr2=0x7f5408104fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 --2- 172.21.15.82:0/851688118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f5408104fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009900 tx=0x7f53f802a410 comp rx=0 tx=0).stop 2024-04-26T20:20:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 -- 172.21.15.82:0/851688118 shutdown_connections 2024-04-26T20:20:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 --2- 172.21.15.82:0/851688118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5408106760 0x7f540810cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 --2- 172.21.15.82:0/851688118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5408105da0 0x7f5408106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 --2- 172.21.15.82:0/851688118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f5408104fd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 -- 172.21.15.82:0/851688118 >> 172.21.15.82:0/851688118 conn(0x7f5408100120 msgr2=0x7f5408102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:20.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 -- 172.21.15.82:0/851688118 shutdown_connections 2024-04-26T20:20:20.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.965+0000 7f540ce00640 1 -- 172.21.15.82:0/851688118 wait complete. 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.966+0000 7f540ce00640 1 Processor -- start 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.966+0000 7f540ce00640 1 -- start start 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f540ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f540819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f540ce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5408105da0 0x7f540819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f540ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5408106760 0x7f54081a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f540ce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54081106b0 con 0x7f5408106760 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f540ce00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5408110530 con 0x7f5408104bb0 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f540ce00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5408110830 con 0x7f5408105da0 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f540819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5408105da0 0x7f540819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5406800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5408106760 0x7f54081a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f540819ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:43070/0 (socket says 172.21.15.82:43070) 2024-04-26T20:20:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 -- 172.21.15.82:0/3946335167 learned_addr learned my addr 172.21.15.82:0/3946335167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 -- 172.21.15.82:0/3946335167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5408105da0 msgr2=0x7f540819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5408105da0 0x7f540819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 -- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5408106760 msgr2=0x7f54081a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5408106760 0x7f54081a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.967+0000 7f5405e00640 1 -- 172.21.15.82:0/3946335167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54081a2a50 con 0x7f5408104bb0 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.968+0000 7f5405e00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f540819ae30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53f8006010 tx=0x7f53f80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.968+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f803f030 con 0x7f5408104bb0 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.968+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53f80318f0 con 0x7f5408104bb0 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.968+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8035070 con 0x7f5408104bb0 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.968+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54081a2ce0 con 0x7f5408104bb0 2024-04-26T20:20:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.968+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54081a3180 con 0x7f5408104bb0 2024-04-26T20:20:20.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.969+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540810bff0 con 0x7f5408104bb0 2024-04-26T20:20:20.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.971+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f53f8042030 con 0x7f5408104bb0 2024-04-26T20:20:20.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.972+0000 7f53fea00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53ec0a3c30 0x7f53ec0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:20.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.973+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f53f80f0b10 con 0x7f5408104bb0 2024-04-26T20:20:20.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.973+0000 7f5405400640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53ec0a3c30 0x7f53ec0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:20.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.973+0000 7f5405400640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53ec0a3c30 0x7f53ec0a60f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f540819c340 tx=0x7f53f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:20.977+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f53f80bcc00 con 0x7f5408104bb0 2024-04-26T20:20:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.211+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f5408062e00 con 0x7f53ec0a3c30 2024-04-26T20:20:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.222+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f53f80b9270 con 0x7f5408104bb0 2024-04-26T20:20:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.228+0000 7f53fea00640 1 -- 172.21.15.82:0/3946335167 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5408062e00 con 0x7f53ec0a3c30 2024-04-26T20:20:21.229 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_0/372fbc70-e8b8-4ebc-b2b9-a6f983c74314 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53ec0a3c30 msgr2=0x7f53ec0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53ec0a3c30 0x7f53ec0a60f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f540819c340 tx=0x7f53f0005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 msgr2=0x7f540819ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f540819ae30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53f8006010 tx=0x7f53f80042f0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 shutdown_connections 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53ec0a3c30 0x7f53ec0a60f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5408106760 0x7f54081a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5408105da0 0x7f540819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 --2- 172.21.15.82:0/3946335167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5408104bb0 0x7f540819ae30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 >> 172.21.15.82:0/3946335167 conn(0x7f5408100120 msgr2=0x7f54081091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 shutdown_connections 2024-04-26T20:20:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.232+0000 7f540ce00640 1 -- 172.21.15.82:0/3946335167 wait complete. 2024-04-26T20:20:21.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-26T20:20:21.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 -- 172.21.15.82:0/3752618411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c106620 msgr2=0x7f191c10ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 --2- 172.21.15.82:0/3752618411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c106620 0x7f191c10ceb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1914009ca0 tx=0x7f191402a8b0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 -- 172.21.15.82:0/3752618411 shutdown_connections 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 --2- 172.21.15.82:0/3752618411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c106620 0x7f191c10ceb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 --2- 172.21.15.82:0/3752618411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 0x7f191c1060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 --2- 172.21.15.82:0/3752618411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c104a70 0x7f191c104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 -- 172.21.15.82:0/3752618411 >> 172.21.15.82:0/3752618411 conn(0x7f191c0fffe0 msgr2=0x7f191c102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 -- 172.21.15.82:0/3752618411 shutdown_connections 2024-04-26T20:20:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.446+0000 7f191be00640 1 -- 172.21.15.82:0/3752618411 wait complete. 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 Processor -- start 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 -- start start 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 0x7f191c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 0x7f191c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c106620 0x7f191c1a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1105f0 con 0x7f191c104a70 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f191c110470 con 0x7f191c106620 2024-04-26T20:20:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f191c110770 con 0x7f191c105c60 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.447+0000 7f191aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 0x7f191c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 0x7f191c19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60370/0 (socket says 172.21.15.82:60370) 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 -- 172.21.15.82:0/921234983 learned_addr learned my addr 172.21.15.82:0/921234983 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191a000640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 0x7f191c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191b400640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c106620 0x7f191c1a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 -- 172.21.15.82:0/921234983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 msgr2=0x7f191c19b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 0x7f191c19b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 -- 172.21.15.82:0/921234983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c106620 msgr2=0x7f191c1a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c106620 0x7f191c1a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 -- 172.21.15.82:0/921234983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c1a2840 con 0x7f191c104a70 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191a000640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 0x7f191c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191b400640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c106620 0x7f191c1a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.448+0000 7f191aa00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 0x7f191c19ac30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f190c00e9c0 tx=0x7f190c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.449+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c00cde0 con 0x7f191c104a70 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.449+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f190c0108e0 con 0x7f191c104a70 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.449+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c1a2b30 con 0x7f191c104a70 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.449+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c018960 con 0x7f191c104a70 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.449+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c1a3080 con 0x7f191c104a70 2024-04-26T20:20:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.450+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c10bd30 con 0x7f191c104a70 2024-04-26T20:20:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.452+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f190c01f020 con 0x7f191c104a70 2024-04-26T20:20:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.453+0000 7f1913400640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19000a3c40 0x7f19000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.454+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f190c0d0b30 con 0x7f191c104a70 2024-04-26T20:20:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.454+0000 7f191a000640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19000a3c40 0x7f19000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.454+0000 7f191a000640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19000a3c40 0x7f19000a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1908009fc0 tx=0x7f1908005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:21.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.458+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f190c054060 con 0x7f191c104a70 2024-04-26T20:20:21.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:21 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] up:active 2024-04-26T20:20:21.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:21 smithi139 ceph-mon[32999]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T20:20:21.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:21 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:20:21.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:21 smithi139 ceph-mon[32999]: pgmap v336: 129 pgs: 129 active+clean; 582 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-26T20:20:21.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:21 smithi139 ceph-mon[32999]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:21.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:21 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] up:active 2024-04-26T20:20:21.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:21 smithi135 ceph-mon[32816]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T20:20:21.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:21 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:20:21.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:21 smithi135 ceph-mon[32816]: pgmap v336: 129 pgs: 129 active+clean; 582 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-26T20:20:21.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:21 smithi135 ceph-mon[32816]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:21.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.672+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f191c062e00 con 0x7f19000a3c40 2024-04-26T20:20:21.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:21 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] up:active 2024-04-26T20:20:21.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:21 smithi082 ceph-mon[28105]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T20:20:21.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:21 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:20:21.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:21 smithi082 ceph-mon[28105]: pgmap v336: 129 pgs: 129 active+clean; 582 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.2 KiB/s wr, 5 op/s 2024-04-26T20:20:21.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:21 smithi082 ceph-mon[28105]: from='client.24833 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:21.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.707+0000 7f1913400640 1 -- 172.21.15.82:0/921234983 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f191c062e00 con 0x7f19000a3c40 2024-04-26T20:20:21.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19000a3c40 msgr2=0x7f19000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19000a3c40 0x7f19000a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1908009fc0 tx=0x7f1908005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 msgr2=0x7f191c19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 0x7f191c19ac30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f190c00e9c0 tx=0x7f190c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 shutdown_connections 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19000a3c40 0x7f19000a6100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f191c106620 0x7f191c1a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f191c105c60 0x7f191c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 --2- 172.21.15.82:0/921234983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f191c104a70 0x7f191c19ac30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 >> 172.21.15.82:0/921234983 conn(0x7f191c0fffe0 msgr2=0x7f191c108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 shutdown_connections 2024-04-26T20:20:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.710+0000 7f191be00640 1 -- 172.21.15.82:0/921234983 wait complete. 2024-04-26T20:20:21.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-26T20:20:21.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.927+0000 7fa29fe00640 1 -- 172.21.15.82:0/2633554193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a010a980 msgr2=0x7fa2a01112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.927+0000 7fa29fe00640 1 --2- 172.21.15.82:0/2633554193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a010a980 0x7fa2a01112a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa298009ca0 tx=0x7fa29802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 -- 172.21.15.82:0/2633554193 shutdown_connections 2024-04-26T20:20:21.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 --2- 172.21.15.82:0/2633554193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a010a980 0x7fa2a01112a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 --2- 172.21.15.82:0/2633554193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a0109fc0 0x7fa2a010a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 --2- 172.21.15.82:0/2633554193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 0x7fa2a0109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 -- 172.21.15.82:0/2633554193 >> 172.21.15.82:0/2633554193 conn(0x7fa2a0077e00 msgr2=0x7fa2a007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:21.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 -- 172.21.15.82:0/2633554193 shutdown_connections 2024-04-26T20:20:21.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 -- 172.21.15.82:0/2633554193 wait complete. 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.928+0000 7fa29fe00640 1 Processor -- start 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 -- start start 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 0x7fa2a019f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 0x7fa2a019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a010a980 0x7fa2a01a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01149d0 con 0x7fa2a0109fc0 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0114850 con 0x7fa2a0108e70 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0114b50 con 0x7fa2a010a980 2024-04-26T20:20:21.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 0x7fa2a019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 0x7fa2a019f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60394/0 (socket says 172.21.15.82:60394) 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29e000640 1 -- 172.21.15.82:0/3215694485 learned_addr learned my addr 172.21.15.82:0/3215694485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29ea00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 0x7fa2a019f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.929+0000 7fa29f400640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a010a980 0x7fa2a01a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29e000640 1 -- 172.21.15.82:0/3215694485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a010a980 msgr2=0x7fa2a01a6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29e000640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a010a980 0x7fa2a01a6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29e000640 1 -- 172.21.15.82:0/3215694485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 msgr2=0x7fa2a019f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29e000640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 0x7fa2a019f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29e000640 1 -- 172.21.15.82:0/3215694485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a01a6c70 con 0x7fa2a0109fc0 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29f400640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a010a980 0x7fa2a01a6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29ea00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 0x7fa2a019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29e000640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 0x7fa2a019f5e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e9c0 tx=0x7fa28c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:21.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00cd80 con 0x7fa2a0109fc0 2024-04-26T20:20:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0035f0 con 0x7fa2a0109fc0 2024-04-26T20:20:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a01a6f60 con 0x7fa2a0109fc0 2024-04-26T20:20:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c010690 con 0x7fa2a0109fc0 2024-04-26T20:20:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.930+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01a7420 con 0x7fa2a0109fc0 2024-04-26T20:20:21.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.931+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a0110180 con 0x7fa2a0109fc0 2024-04-26T20:20:21.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.934+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa28c004000 con 0x7fa2a0109fc0 2024-04-26T20:20:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.935+0000 7fa297400640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2840a3cc0 0x7fa2840a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.936+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa28c0d0d30 con 0x7fa2a0109fc0 2024-04-26T20:20:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.936+0000 7fa29ea00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2840a3cc0 0x7fa2840a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:21.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.936+0000 7fa29ea00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2840a3cc0 0x7fa2840a6180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa290009fc0 tx=0x7fa290005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:21.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:21.940+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa28c09d310 con 0x7fa2a0109fc0 2024-04-26T20:20:22.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.158+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa2a0062d70 con 0x7fa2840a3cc0 2024-04-26T20:20:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.163+0000 7fa297400640 1 -- 172.21.15.82:0/3215694485 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa2a0062d70 con 0x7fa2840a3cc0 2024-04-26T20:20:22.164 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2840a3cc0 msgr2=0x7fa2840a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2840a3cc0 0x7fa2840a6180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa290009fc0 tx=0x7fa290005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 msgr2=0x7fa2a019f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 0x7fa2a019f5e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e9c0 tx=0x7fa28c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 shutdown_connections 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa2840a3cc0 0x7fa2840a6180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2a010a980 0x7fa2a01a6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2a0109fc0 0x7fa2a019f5e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 --2- 172.21.15.82:0/3215694485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a0108e70 0x7fa2a019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 >> 172.21.15.82:0/3215694485 conn(0x7fa2a0077e00 msgr2=0x7fa2a010d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 shutdown_connections 2024-04-26T20:20:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.166+0000 7fa29fe00640 1 -- 172.21.15.82:0/3215694485 wait complete. 2024-04-26T20:20:22.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 -- 172.21.15.82:0/2969888976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 msgr2=0x7fa3f4105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 --2- 172.21.15.82:0/2969888976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4105810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009900 tx=0x7fa3e402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 -- 172.21.15.82:0/2969888976 shutdown_connections 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 --2- 172.21.15.82:0/2969888976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4108680 0x7fa3f410aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 --2- 172.21.15.82:0/2969888976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3f4105d50 0x7fa3f4108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 --2- 172.21.15.82:0/2969888976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4105810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 -- 172.21.15.82:0/2969888976 >> 172.21.15.82:0/2969888976 conn(0x7fa3f40fce50 msgr2=0x7fa3f40ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 -- 172.21.15.82:0/2969888976 shutdown_connections 2024-04-26T20:20:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.383+0000 7fa3f9400640 1 -- 172.21.15.82:0/2969888976 wait complete. 2024-04-26T20:20:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 Processor -- start 2024-04-26T20:20:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 -- start start 2024-04-26T20:20:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3f4105d50 0x7fa3f4199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4108680 0x7fa3f41a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f410e520 con 0x7fa3f4103420 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f410e3a0 con 0x7fa3f4108680 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.384+0000 7fa3f9400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f410e6a0 con 0x7fa3f4105d50 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60416/0 (socket says 172.21.15.82:60416) 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 -- 172.21.15.82:0/558082627 learned_addr learned my addr 172.21.15.82:0/558082627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f3200640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4108680 0x7fa3f41a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3ebe00640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3f4105d50 0x7fa3f4199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 -- 172.21.15.82:0/558082627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3f4105d50 msgr2=0x7fa3f4199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3f4105d50 0x7fa3f4199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 -- 172.21.15.82:0/558082627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4108680 msgr2=0x7fa3f41a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4108680 0x7fa3f41a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 -- 172.21.15.82:0/558082627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f41a07e0 con 0x7fa3f4103420 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.385+0000 7fa3f2800640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4198bc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4005ab0 tx=0x7fa3e4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.386+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e403f070 con 0x7fa3f4103420 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.386+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e4031c50 con 0x7fa3f4103420 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.386+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4035030 con 0x7fa3f4103420 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.386+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f41a0a70 con 0x7fa3f4103420 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.386+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f41a0f60 con 0x7fa3f4103420 2024-04-26T20:20:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.387+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f40fe940 con 0x7fa3f4103420 2024-04-26T20:20:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.389+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa3e4042070 con 0x7fa3f4103420 2024-04-26T20:20:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.390+0000 7fa3eb400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3d80a3c40 0x7fa3d80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.390+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa3e40f0fe0 con 0x7fa3f4103420 2024-04-26T20:20:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.390+0000 7fa3ebe00640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3d80a3c40 0x7fa3d80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.391+0000 7fa3ebe00640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3d80a3c40 0x7fa3d80a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa3f419a0d0 tx=0x7fa3dc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.394+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa3e40bd600 con 0x7fa3f4103420 2024-04-26T20:20:22.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:22 smithi082 ceph-mon[28105]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:22.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:22 smithi082 ceph-mon[28105]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-26T20:20:22.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:22 smithi082 ceph-mon[28105]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:22.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:22 smithi139 ceph-mon[32999]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:22.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:22 smithi139 ceph-mon[32999]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-26T20:20:22.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:22 smithi139 ceph-mon[32999]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:22.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:22 smithi135 ceph-mon[32816]: from='client.24839 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:22.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:22 smithi135 ceph-mon[32816]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-26T20:20:22.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:22 smithi135 ceph-mon[32816]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:22.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.634+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f402dd20 con 0x7fa3f4103420 2024-04-26T20:20:22.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.636+0000 7fa3eb400640 1 -- 172.21.15.82:0/558082627 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11951 (secure 0 0 0) 0x7fa3e40bcf00 con 0x7fa3f4103420 2024-04-26T20:20:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:22.637 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:20:20.191502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:20:22.637 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:20:22.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3d80a3c40 msgr2=0x7fa3d80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3d80a3c40 0x7fa3d80a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa3f419a0d0 tx=0x7fa3dc00b390 comp rx=0 tx=0).stop 2024-04-26T20:20:22.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 msgr2=0x7fa3f4198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4198bc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4005ab0 tx=0x7fa3e4003b90 comp rx=0 tx=0).stop 2024-04-26T20:20:22.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 shutdown_connections 2024-04-26T20:20:22.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3d80a3c40 0x7fa3d80a6100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4108680 0x7fa3f41a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3f4105d50 0x7fa3f4199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.638+0000 7fa3f9400640 1 --2- 172.21.15.82:0/558082627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f4103420 0x7fa3f4198bc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.639+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 >> 172.21.15.82:0/558082627 conn(0x7fa3f40fce50 msgr2=0x7fa3f4103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.639+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 shutdown_connections 2024-04-26T20:20:22.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.639+0000 7fa3f9400640 1 -- 172.21.15.82:0/558082627 wait complete. 2024-04-26T20:20:22.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 -- 172.21.15.82:0/1425849886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e010ed20 msgr2=0x7fa6e0111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/1425849886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e010ed20 0x7fa6e0111110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009cd0 tx=0x7fa6d802a8e0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 -- 172.21.15.82:0/1425849886 shutdown_connections 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/1425849886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e010ed20 0x7fa6e0111110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/1425849886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e0075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/1425849886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e0076970 0x7fa6e0074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 -- 172.21.15.82:0/1425849886 >> 172.21.15.82:0/1425849886 conn(0x7fa6e00fdcc0 msgr2=0x7fa6e0100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 -- 172.21.15.82:0/1425849886 shutdown_connections 2024-04-26T20:20:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.850+0000 7fa6e4a00640 1 -- 172.21.15.82:0/1425849886 wait complete. 2024-04-26T20:20:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.851+0000 7fa6e4a00640 1 Processor -- start 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.851+0000 7fa6e4a00640 1 -- start start 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.851+0000 7fa6e4a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.851+0000 7fa6e4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e0076970 0x7fa6e019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.851+0000 7fa6e4a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e010ed20 0x7fa6e01a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6e4a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0114850 con 0x7fa6e0076970 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6e4a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01146d0 con 0x7fa6e0075390 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6e4a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01149d0 con 0x7fa6e010ed20 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:43146/0 (socket says 172.21.15.82:43146) 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 -- 172.21.15.82:0/2145992777 learned_addr learned my addr 172.21.15.82:0/2145992777 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6d5e00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e0076970 0x7fa6e019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6df200640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e010ed20 0x7fa6e01a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 -- 172.21.15.82:0/2145992777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e010ed20 msgr2=0x7fa6e01a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e010ed20 0x7fa6e01a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 -- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e0076970 msgr2=0x7fa6e019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e0076970 0x7fa6e019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 -- 172.21.15.82:0/2145992777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e01a6b30 con 0x7fa6e0075390 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6df200640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e010ed20 0x7fa6e01a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.852+0000 7fa6de800640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e019ef10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000e9f0 tx=0x7fa6d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.853+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d000cd80 con 0x7fa6e0075390 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.853+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d00108e0 con 0x7fa6e0075390 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.853+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e01a6e20 con 0x7fa6e0075390 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.853+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0018980 con 0x7fa6e0075390 2024-04-26T20:20:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.853+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01a7280 con 0x7fa6e0075390 2024-04-26T20:20:22.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.854+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e0104ef0 con 0x7fa6e0075390 2024-04-26T20:20:22.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.856+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa6d0010430 con 0x7fa6e0075390 2024-04-26T20:20:22.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.857+0000 7fa6d7e00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6c40a3c40 0x7fa6c40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:22.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.857+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa6d00d0e40 con 0x7fa6e0075390 2024-04-26T20:20:22.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.857+0000 7fa6d5e00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6c40a3c40 0x7fa6c40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:22.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.858+0000 7fa6d5e00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6c40a3c40 0x7fa6c40a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6e01a0420 tx=0x7fa6c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:22.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:22.860+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa6d009d420 con 0x7fa6e0075390 2024-04-26T20:20:23.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.065+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6e002dca0 con 0x7fa6e0075390 2024-04-26T20:20:23.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.067+0000 7fa6d7e00640 1 -- 172.21.15.82:0/2145992777 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7fa6d009cd20 con 0x7fa6e0075390 2024-04-26T20:20:23.068 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:23.068 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6c40a3c40 msgr2=0x7fa6c40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6c40a3c40 0x7fa6c40a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6e01a0420 tx=0x7fa6c8005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 msgr2=0x7fa6e019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e019ef10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000e9f0 tx=0x7fa6d000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 shutdown_connections 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa6c40a3c40 0x7fa6c40a6100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6e010ed20 0x7fa6e01a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6e0076970 0x7fa6e019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 --2- 172.21.15.82:0/2145992777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6e0075390 0x7fa6e019ef10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 >> 172.21.15.82:0/2145992777 conn(0x7fa6e00fdcc0 msgr2=0x7fa6e01020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 shutdown_connections 2024-04-26T20:20:23.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.070+0000 7fa6e4a00640 1 -- 172.21.15.82:0/2145992777 wait complete. 2024-04-26T20:20:23.090 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T20:20:23.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:20:23.118 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:20:22 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:20:22.710+0000 7fd343189700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T20:20:23.118 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:20:22 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:20:22.710+0000 7fd343189700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-26T20:20:23.118 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:20:22 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:20:22.710+0000 7fd343189700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-26T20:20:23.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 -- 172.21.15.82:0/1155057653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 msgr2=0x7f89fc104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 --2- 172.21.15.82:0/1155057653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc104d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009900 tx=0x7f89ec02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 -- 172.21.15.82:0/1155057653 shutdown_connections 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 --2- 172.21.15.82:0/1155057653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc106510 0x7f89fc10cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 --2- 172.21.15.82:0/1155057653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc105b50 0x7f89fc105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 --2- 172.21.15.82:0/1155057653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc104d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 -- 172.21.15.82:0/1155057653 >> 172.21.15.82:0/1155057653 conn(0x7f89fc0ffeb0 msgr2=0x7f89fc102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 -- 172.21.15.82:0/1155057653 shutdown_connections 2024-04-26T20:20:23.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.285+0000 7f8a01c00640 1 -- 172.21.15.82:0/1155057653 wait complete. 2024-04-26T20:20:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 Processor -- start 2024-04-26T20:20:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 -- start start 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc105b50 0x7f89fc19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc106510 0x7f89fc1a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc110490 con 0x7f89fc104960 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc110310 con 0x7f89fc106510 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f8a01c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc110610 con 0x7f89fc105b50 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f89fbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f89fbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60470/0 (socket says 172.21.15.82:60470) 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.286+0000 7f89fbe00640 1 -- 172.21.15.82:0/581704528 learned_addr learned my addr 172.21.15.82:0/581704528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f8a01200640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc106510 0x7f89fc1a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89f3400640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc105b50 0x7f89fc19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89fbe00640 1 -- 172.21.15.82:0/581704528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc105b50 msgr2=0x7f89fc19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89fbe00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc105b50 0x7f89fc19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89fbe00640 1 -- 172.21.15.82:0/581704528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc106510 msgr2=0x7f89fc1a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89fbe00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc106510 0x7f89fc1a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89fbe00640 1 -- 172.21.15.82:0/581704528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc1a27b0 con 0x7f89fc104960 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89f3400640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc105b50 0x7f89fc19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.287+0000 7f89fbe00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc19ab90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89ec006010 tx=0x7f89ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.288+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec03f030 con 0x7f89fc104960 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.288+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ec031910 con 0x7f89fc104960 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.288+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc1a2a40 con 0x7f89fc104960 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.288+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec035070 con 0x7f89fc104960 2024-04-26T20:20:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.288+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1a2f80 con 0x7f89fc104960 2024-04-26T20:20:23.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.289+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc10bda0 con 0x7f89fc104960 2024-04-26T20:20:23.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.291+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f89ec042030 con 0x7f89fc104960 2024-04-26T20:20:23.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.292+0000 7f89f9600640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89e00a3cc0 0x7f89e00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.292+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f89ec0f0d20 con 0x7f89fc104960 2024-04-26T20:20:23.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.292+0000 7f89f3400640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89e00a3cc0 0x7f89e00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.293+0000 7f89f3400640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89e00a3cc0 0x7f89e00a6180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89fc19c0a0 tx=0x7f89e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.296+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f89ec0bd300 con 0x7f89fc104960 2024-04-26T20:20:23.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:23 smithi082 ceph-mon[28105]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:23 smithi082 ceph-mon[28105]: pgmap v337: 129 pgs: 129 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2024-04-26T20:20:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:23 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/558082627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:20:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:23 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2145992777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.493+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89fc062d70 con 0x7f89e00a3cc0 2024-04-26T20:20:23.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.510+0000 7f89f9600640 1 -- 172.21.15.82:0/581704528 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340371 (secure 0 0 0) 0x7f89fc062d70 con 0x7f89e00a3cc0 2024-04-26T20:20:23.516 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:20:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89e00a3cc0 msgr2=0x7f89e00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89e00a3cc0 0x7f89e00a6180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89fc19c0a0 tx=0x7f89e4005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 msgr2=0x7f89fc19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc19ab90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89ec006010 tx=0x7f89ec0042f0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 shutdown_connections 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89e00a3cc0 0x7f89e00a6180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc106510 0x7f89fc1a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89fc105b50 0x7f89fc19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.518+0000 7f8a01c00640 1 --2- 172.21.15.82:0/581704528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc104960 0x7f89fc19ab90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.519+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 >> 172.21.15.82:0/581704528 conn(0x7f89fc0ffeb0 msgr2=0x7f89fc108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.519+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 shutdown_connections 2024-04-26T20:20:23.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.519+0000 7f8a01c00640 1 -- 172.21.15.82:0/581704528 wait complete. 2024-04-26T20:20:23.537 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-04-26T20:20:22.579190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600736,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":167,"num_read_kb":142,"num_write":371,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375284,"kb_used_data":13652,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566540,"statfs":{"total":1151940427776,"available":1151556136960,"internally_reserved":0,"allocated":13979648,"data_stored":7598792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5869,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":142,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006432"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199398+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:19:58.199398+0000","last_peered":"2024-04-26T20:19:58.199398+0000","last_clean":"2024-04-26T20:19:58.199398+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:19:58.199398+0000","last_undegraded":"2024-04-26T20:19:58.199398+0000","last_fullsized":"2024-04-26T20:19:58.199398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200146+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:19:58.200146+0000","last_peered":"2024-04-26T20:19:58.200146+0000","last_clean":"2024-04-26T20:19:58.200146+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:19:58.200146+0000","last_undegraded":"2024-04-26T20:19:58.200146+0000","last_fullsized":"2024-04-26T20:19:58.200146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199790+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:19:58.199790+0000","last_peered":"2024-04-26T20:19:58.199790+0000","last_clean":"2024-04-26T20:19:58.199790+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:19:58.199790+0000","last_undegraded":"2024-04-26T20:19:58.199790+0000","last_fullsized":"2024-04-26T20:19:58.199790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200160+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:19:58.200160+0000","last_peered":"2024-04-26T20:19:58.200160+0000","last_clean":"2024-04-26T20:19:58.200160+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:19:58.200160+0000","last_undegraded":"2024-04-26T20:19:58.200160+0000","last_fullsized":"2024-04-26T20:19:58.200160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198493+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:19:58.198493+0000","last_peered":"2024-04-26T20:19:58.198493+0000","last_clean":"2024-04-26T20:19:58.198493+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:19:58.198493+0000","last_undegraded":"2024-04-26T20:19:58.198493+0000","last_fullsized":"2024-04-26T20:19:58.198493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199332+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:19:58.199332+0000","last_peered":"2024-04-26T20:19:58.199332+0000","last_clean":"2024-04-26T20:19:58.199332+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:19:58.199332+0000","last_undegraded":"2024-04-26T20:19:58.199332+0000","last_fullsized":"2024-04-26T20:19:58.199332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200574+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:19:58.200574+0000","last_peered":"2024-04-26T20:19:58.200574+0000","last_clean":"2024-04-26T20:19:58.200574+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:19:58.200574+0000","last_undegraded":"2024-04-26T20:19:58.200574+0000","last_fullsized":"2024-04-26T20:19:58.200574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767532+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:19:57.767532+0000","last_peered":"2024-04-26T20:19:57.767532+0000","last_clean":"2024-04-26T20:19:57.767532+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:19:57.767532+0000","last_undegraded":"2024-04-26T20:19:57.767532+0000","last_fullsized":"2024-04-26T20:19:57.767532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198727+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:19:58.198727+0000","last_peered":"2024-04-26T20:19:58.198727+0000","last_clean":"2024-04-26T20:19:58.198727+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:19:58.198727+0000","last_undegraded":"2024-04-26T20:19:58.198727+0000","last_fullsized":"2024-04-26T20:19:58.198727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200145+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:19:58.200145+0000","last_peered":"2024-04-26T20:19:58.200145+0000","last_clean":"2024-04-26T20:19:58.200145+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:19:58.200145+0000","last_undegraded":"2024-04-26T20:19:58.200145+0000","last_fullsized":"2024-04-26T20:19:58.200145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201220+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:19:58.201220+0000","last_peered":"2024-04-26T20:19:58.201220+0000","last_clean":"2024-04-26T20:19:58.201220+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:19:58.201220+0000","last_undegraded":"2024-04-26T20:19:58.201220+0000","last_fullsized":"2024-04-26T20:19:58.201220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200107+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:19:58.200107+0000","last_peered":"2024-04-26T20:19:58.200107+0000","last_clean":"2024-04-26T20:19:58.200107+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:19:58.200107+0000","last_undegraded":"2024-04-26T20:19:58.200107+0000","last_fullsized":"2024-04-26T20:19:58.200107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749151+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:19:57.749151+0000","last_peered":"2024-04-26T20:19:57.749151+0000","last_clean":"2024-04-26T20:19:57.749151+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:19:57.749151+0000","last_undegraded":"2024-04-26T20:19:57.749151+0000","last_fullsized":"2024-04-26T20:19:57.749151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199170+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:19:58.199170+0000","last_peered":"2024-04-26T20:19:58.199170+0000","last_clean":"2024-04-26T20:19:58.199170+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:19:58.199170+0000","last_undegraded":"2024-04-26T20:19:58.199170+0000","last_fullsized":"2024-04-26T20:19:58.199170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199240+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:19:58.199240+0000","last_peered":"2024-04-26T20:19:58.199240+0000","last_clean":"2024-04-26T20:19:58.199240+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:19:58.199240+0000","last_undegraded":"2024-04-26T20:19:58.199240+0000","last_fullsized":"2024-04-26T20:19:58.199240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.197629+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:19:58.197629+0000","last_peered":"2024-04-26T20:19:58.197629+0000","last_clean":"2024-04-26T20:19:58.197629+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:19:58.197629+0000","last_undegraded":"2024-04-26T20:19:58.197629+0000","last_fullsized":"2024-04-26T20:19:58.197629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199156+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:19:58.199156+0000","last_peered":"2024-04-26T20:19:58.199156+0000","last_clean":"2024-04-26T20:19:58.199156+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:19:58.199156+0000","last_undegraded":"2024-04-26T20:19:58.199156+0000","last_fullsized":"2024-04-26T20:19:58.199156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.752738+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:19:57.752738+0000","last_peered":"2024-04-26T20:19:57.752738+0000","last_clean":"2024-04-26T20:19:57.752738+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:19:57.752738+0000","last_undegraded":"2024-04-26T20:19:57.752738+0000","last_fullsized":"2024-04-26T20:19:57.752738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748700+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:19:57.748700+0000","last_peered":"2024-04-26T20:19:57.748700+0000","last_clean":"2024-04-26T20:19:57.748700+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:19:57.748700+0000","last_undegraded":"2024-04-26T20:19:57.748700+0000","last_fullsized":"2024-04-26T20:19:57.748700+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748579+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:19:57.748579+0000","last_peered":"2024-04-26T20:19:57.748579+0000","last_clean":"2024-04-26T20:19:57.748579+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:19:57.748579+0000","last_undegraded":"2024-04-26T20:19:57.748579+0000","last_fullsized":"2024-04-26T20:19:57.748579+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194442+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:20:19.194442+0000","last_peered":"2024-04-26T20:20:19.194442+0000","last_clean":"2024-04-26T20:20:19.194442+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:20:19.194442+0000","last_undegraded":"2024-04-26T20:20:19.194442+0000","last_fullsized":"2024-04-26T20:20:19.194442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768823+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:19:57.768823+0000","last_peered":"2024-04-26T20:19:57.768823+0000","last_clean":"2024-04-26T20:19:57.768823+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:19:57.768823+0000","last_undegraded":"2024-04-26T20:19:57.768823+0000","last_fullsized":"2024-04-26T20:19:57.768823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199177+0000","last_change":"2024-04-26T20:19:56.743137+0000","last_active":"2024-04-26T20:19:58.199177+0000","last_peered":"2024-04-26T20:19:58.199177+0000","last_clean":"2024-04-26T20:19:58.199177+0000","last_became_active":"2024-04-26T20:19:56.742726+0000","last_became_peered":"2024-04-26T20:19:56.742726+0000","last_unstale":"2024-04-26T20:19:58.199177+0000","last_undegraded":"2024-04-26T20:19:58.199177+0000","last_fullsized":"2024-04-26T20:19:58.199177+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:48.893021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768926+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:19:57.768926+0000","last_peered":"2024-04-26T20:19:57.768926+0000","last_clean":"2024-04-26T20:19:57.768926+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:19:57.768926+0000","last_undegraded":"2024-04-26T20:19:57.768926+0000","last_fullsized":"2024-04-26T20:19:57.768926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199968+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:19:58.199968+0000","last_peered":"2024-04-26T20:19:58.199968+0000","last_clean":"2024-04-26T20:19:58.199968+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:19:58.199968+0000","last_undegraded":"2024-04-26T20:19:58.199968+0000","last_fullsized":"2024-04-26T20:19:58.199968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200117+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:19:58.200117+0000","last_peered":"2024-04-26T20:19:58.200117+0000","last_clean":"2024-04-26T20:19:58.200117+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:19:58.200117+0000","last_undegraded":"2024-04-26T20:19:58.200117+0000","last_fullsized":"2024-04-26T20:19:58.200117+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'11","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.193724+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:19.193724+0000","last_peered":"2024-04-26T20:20:19.193724+0000","last_clean":"2024-04-26T20:20:19.193724+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:19.193724+0000","last_undegraded":"2024-04-26T20:20:19.193724+0000","last_fullsized":"2024-04-26T20:20:19.193724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198401+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:19:58.198401+0000","last_peered":"2024-04-26T20:19:58.198401+0000","last_clean":"2024-04-26T20:19:58.198401+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:19:58.198401+0000","last_undegraded":"2024-04-26T20:19:58.198401+0000","last_fullsized":"2024-04-26T20:19:58.198401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199197+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:19:58.199197+0000","last_peered":"2024-04-26T20:19:58.199197+0000","last_clean":"2024-04-26T20:19:58.199197+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:19:58.199197+0000","last_undegraded":"2024-04-26T20:19:58.199197+0000","last_fullsized":"2024-04-26T20:19:58.199197+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194285+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:19.194285+0000","last_peered":"2024-04-26T20:20:19.194285+0000","last_clean":"2024-04-26T20:20:19.194285+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:19.194285+0000","last_undegraded":"2024-04-26T20:20:19.194285+0000","last_fullsized":"2024-04-26T20:20:19.194285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199909+0000","last_change":"2024-04-26T20:19:52.655238+0000","last_active":"2024-04-26T20:19:58.199909+0000","last_peered":"2024-04-26T20:19:58.199909+0000","last_clean":"2024-04-26T20:19:58.199909+0000","last_became_active":"2024-04-26T20:19:52.654894+0000","last_became_peered":"2024-04-26T20:19:52.654894+0000","last_unstale":"2024-04-26T20:19:58.199909+0000","last_undegraded":"2024-04-26T20:19:58.199909+0000","last_fullsized":"2024-04-26T20:19:58.199909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:41.165461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748685+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:19:57.748685+0000","last_peered":"2024-04-26T20:19:57.748685+0000","last_clean":"2024-04-26T20:19:57.748685+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:19:57.748685+0000","last_undegraded":"2024-04-26T20:19:57.748685+0000","last_fullsized":"2024-04-26T20:19:57.748685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:20.182603+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:20:20.182603+0000","last_peered":"2024-04-26T20:20:20.182603+0000","last_clean":"2024-04-26T20:20:20.182603+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:20:20.182603+0000","last_undegraded":"2024-04-26T20:20:20.182603+0000","last_fullsized":"2024-04-26T20:20:20.182603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199520+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:19:58.199520+0000","last_peered":"2024-04-26T20:19:58.199520+0000","last_clean":"2024-04-26T20:19:58.199520+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:19:58.199520+0000","last_undegraded":"2024-04-26T20:19:58.199520+0000","last_fullsized":"2024-04-26T20:19:58.199520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748683+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:19:57.748683+0000","last_peered":"2024-04-26T20:19:57.748683+0000","last_clean":"2024-04-26T20:19:57.748683+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:19:57.748683+0000","last_undegraded":"2024-04-26T20:19:57.748683+0000","last_fullsized":"2024-04-26T20:19:57.748683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:17.729504+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:17.729504+0000","last_peered":"2024-04-26T20:20:17.729504+0000","last_clean":"2024-04-26T20:20:17.729504+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:17.729504+0000","last_undegraded":"2024-04-26T20:20:17.729504+0000","last_fullsized":"2024-04-26T20:20:17.729504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199824+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:19:58.199824+0000","last_peered":"2024-04-26T20:19:58.199824+0000","last_clean":"2024-04-26T20:19:58.199824+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:19:58.199824+0000","last_undegraded":"2024-04-26T20:19:58.199824+0000","last_fullsized":"2024-04-26T20:19:58.199824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199091+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:19:58.199091+0000","last_peered":"2024-04-26T20:19:58.199091+0000","last_clean":"2024-04-26T20:19:58.199091+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:19:58.199091+0000","last_undegraded":"2024-04-26T20:19:58.199091+0000","last_fullsized":"2024-04-26T20:19:58.199091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:17.731745+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:17.731745+0000","last_peered":"2024-04-26T20:20:17.731745+0000","last_clean":"2024-04-26T20:20:17.731745+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:17.731745+0000","last_undegraded":"2024-04-26T20:20:17.731745+0000","last_fullsized":"2024-04-26T20:20:17.731745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767827+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:19:57.767827+0000","last_peered":"2024-04-26T20:19:57.767827+0000","last_clean":"2024-04-26T20:19:57.767827+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:19:57.767827+0000","last_undegraded":"2024-04-26T20:19:57.767827+0000","last_fullsized":"2024-04-26T20:19:57.767827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200156+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:19:58.200156+0000","last_peered":"2024-04-26T20:19:58.200156+0000","last_clean":"2024-04-26T20:19:58.200156+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:19:58.200156+0000","last_undegraded":"2024-04-26T20:19:58.200156+0000","last_fullsized":"2024-04-26T20:19:58.200156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.183162+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:19.183162+0000","last_peered":"2024-04-26T20:20:19.183162+0000","last_clean":"2024-04-26T20:20:19.183162+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:19.183162+0000","last_undegraded":"2024-04-26T20:20:19.183162+0000","last_fullsized":"2024-04-26T20:20:19.183162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.751060+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:19:57.751060+0000","last_peered":"2024-04-26T20:19:57.751060+0000","last_clean":"2024-04-26T20:19:57.751060+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:19:57.751060+0000","last_undegraded":"2024-04-26T20:19:57.751060+0000","last_fullsized":"2024-04-26T20:19:57.751060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768023+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:19:57.768023+0000","last_peered":"2024-04-26T20:19:57.768023+0000","last_clean":"2024-04-26T20:19:57.768023+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:19:57.768023+0000","last_undegraded":"2024-04-26T20:19:57.768023+0000","last_fullsized":"2024-04-26T20:19:57.768023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.720185+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:20:16.720185+0000","last_peered":"2024-04-26T20:20:16.720185+0000","last_clean":"2024-04-26T20:20:16.720185+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:20:16.720185+0000","last_undegraded":"2024-04-26T20:20:16.720185+0000","last_fullsized":"2024-04-26T20:20:16.720185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198539+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:19:58.198539+0000","last_peered":"2024-04-26T20:19:58.198539+0000","last_clean":"2024-04-26T20:19:58.198539+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:19:58.198539+0000","last_undegraded":"2024-04-26T20:19:58.198539+0000","last_fullsized":"2024-04-26T20:19:58.198539+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.750197+0000","last_change":"2024-04-26T20:19:56.745192+0000","last_active":"2024-04-26T20:19:57.750197+0000","last_peered":"2024-04-26T20:19:57.750197+0000","last_clean":"2024-04-26T20:19:57.750197+0000","last_became_active":"2024-04-26T20:19:56.743277+0000","last_became_peered":"2024-04-26T20:19:56.743277+0000","last_unstale":"2024-04-26T20:19:57.750197+0000","last_undegraded":"2024-04-26T20:19:57.750197+0000","last_fullsized":"2024-04-26T20:19:57.750197+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:21.980771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.717142+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:16.717142+0000","last_peered":"2024-04-26T20:20:16.717142+0000","last_clean":"2024-04-26T20:20:16.717142+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:16.717142+0000","last_undegraded":"2024-04-26T20:20:16.717142+0000","last_fullsized":"2024-04-26T20:20:16.717142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200224+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:19:58.200224+0000","last_peered":"2024-04-26T20:19:58.200224+0000","last_clean":"2024-04-26T20:19:58.200224+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:19:58.200224+0000","last_undegraded":"2024-04-26T20:19:58.200224+0000","last_fullsized":"2024-04-26T20:19:58.200224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200367+0000","last_change":"2024-04-26T20:19:56.742172+0000","last_active":"2024-04-26T20:19:58.200367+0000","last_peered":"2024-04-26T20:19:58.200367+0000","last_clean":"2024-04-26T20:19:58.200367+0000","last_became_active":"2024-04-26T20:19:56.741592+0000","last_became_peered":"2024-04-26T20:19:56.741592+0000","last_unstale":"2024-04-26T20:19:58.200367+0000","last_undegraded":"2024-04-26T20:19:58.200367+0000","last_fullsized":"2024-04-26T20:19:58.200367+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:59.045635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.738191+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:18.738191+0000","last_peered":"2024-04-26T20:20:18.738191+0000","last_clean":"2024-04-26T20:20:18.738191+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:18.738191+0000","last_undegraded":"2024-04-26T20:20:18.738191+0000","last_fullsized":"2024-04-26T20:20:18.738191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198610+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:19:58.198610+0000","last_peered":"2024-04-26T20:19:58.198610+0000","last_clean":"2024-04-26T20:19:58.198610+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:19:58.198610+0000","last_undegraded":"2024-04-26T20:19:58.198610+0000","last_fullsized":"2024-04-26T20:19:58.198610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.751980+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:19:57.751980+0000","last_peered":"2024-04-26T20:19:57.751980+0000","last_clean":"2024-04-26T20:19:57.751980+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:19:57.751980+0000","last_undegraded":"2024-04-26T20:19:57.751980+0000","last_fullsized":"2024-04-26T20:19:57.751980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.715981+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:20:16.715981+0000","last_peered":"2024-04-26T20:20:16.715981+0000","last_clean":"2024-04-26T20:20:16.715981+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:20:16.715981+0000","last_undegraded":"2024-04-26T20:20:16.715981+0000","last_fullsized":"2024-04-26T20:20:16.715981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198773+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:19:58.198773+0000","last_peered":"2024-04-26T20:19:58.198773+0000","last_clean":"2024-04-26T20:19:58.198773+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:19:58.198773+0000","last_undegraded":"2024-04-26T20:19:58.198773+0000","last_fullsized":"2024-04-26T20:19:58.198773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200269+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:19:58.200269+0000","last_peered":"2024-04-26T20:19:58.200269+0000","last_clean":"2024-04-26T20:19:58.200269+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:19:58.200269+0000","last_undegraded":"2024-04-26T20:19:58.200269+0000","last_fullsized":"2024-04-26T20:19:58.200269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.191132+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:19.191132+0000","last_peered":"2024-04-26T20:20:19.191132+0000","last_clean":"2024-04-26T20:20:19.191132+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:19.191132+0000","last_undegraded":"2024-04-26T20:20:19.191132+0000","last_fullsized":"2024-04-26T20:20:19.191132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748644+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:19:57.748644+0000","last_peered":"2024-04-26T20:19:57.748644+0000","last_clean":"2024-04-26T20:19:57.748644+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:19:57.748644+0000","last_undegraded":"2024-04-26T20:19:57.748644+0000","last_fullsized":"2024-04-26T20:19:57.748644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198442+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:19:58.198442+0000","last_peered":"2024-04-26T20:19:58.198442+0000","last_clean":"2024-04-26T20:19:58.198442+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:19:58.198442+0000","last_undegraded":"2024-04-26T20:19:58.198442+0000","last_fullsized":"2024-04-26T20:19:58.198442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.193808+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:19.193808+0000","last_peered":"2024-04-26T20:20:19.193808+0000","last_clean":"2024-04-26T20:20:19.193808+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:19.193808+0000","last_undegraded":"2024-04-26T20:20:19.193808+0000","last_fullsized":"2024-04-26T20:20:19.193808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200895+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:19:58.200895+0000","last_peered":"2024-04-26T20:19:58.200895+0000","last_clean":"2024-04-26T20:19:58.200895+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:19:58.200895+0000","last_undegraded":"2024-04-26T20:19:58.200895+0000","last_fullsized":"2024-04-26T20:19:58.200895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.752749+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:19:57.752749+0000","last_peered":"2024-04-26T20:19:57.752749+0000","last_clean":"2024-04-26T20:19:57.752749+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:19:57.752749+0000","last_undegraded":"2024-04-26T20:19:57.752749+0000","last_fullsized":"2024-04-26T20:19:57.752749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:20.184197+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:20:20.184197+0000","last_peered":"2024-04-26T20:20:20.184197+0000","last_clean":"2024-04-26T20:20:20.184197+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:20:20.184197+0000","last_undegraded":"2024-04-26T20:20:20.184197+0000","last_fullsized":"2024-04-26T20:20:20.184197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200433+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:19:58.200433+0000","last_peered":"2024-04-26T20:19:58.200433+0000","last_clean":"2024-04-26T20:19:58.200433+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:19:58.200433+0000","last_undegraded":"2024-04-26T20:19:58.200433+0000","last_fullsized":"2024-04-26T20:19:58.200433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.750204+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:19:57.750204+0000","last_peered":"2024-04-26T20:19:57.750204+0000","last_clean":"2024-04-26T20:19:57.750204+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:19:57.750204+0000","last_undegraded":"2024-04-26T20:19:57.750204+0000","last_fullsized":"2024-04-26T20:19:57.750204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.177670+0000","last_change":"2024-04-26T20:19:51.658967+0000","last_active":"2024-04-26T20:20:19.177670+0000","last_peered":"2024-04-26T20:20:19.177670+0000","last_clean":"2024-04-26T20:20:19.177670+0000","last_became_active":"2024-04-26T20:19:51.658642+0000","last_became_peered":"2024-04-26T20:19:51.658642+0000","last_unstale":"2024-04-26T20:20:19.177670+0000","last_undegraded":"2024-04-26T20:20:19.177670+0000","last_fullsized":"2024-04-26T20:20:19.177670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:41.764324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199961+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:19:58.199961+0000","last_peered":"2024-04-26T20:19:58.199961+0000","last_clean":"2024-04-26T20:19:58.199961+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:19:58.199961+0000","last_undegraded":"2024-04-26T20:19:58.199961+0000","last_fullsized":"2024-04-26T20:19:58.199961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200038+0000","last_change":"2024-04-26T20:19:56.748198+0000","last_active":"2024-04-26T20:19:58.200038+0000","last_peered":"2024-04-26T20:19:58.200038+0000","last_clean":"2024-04-26T20:19:58.200038+0000","last_became_active":"2024-04-26T20:19:56.747877+0000","last_became_peered":"2024-04-26T20:19:56.747877+0000","last_unstale":"2024-04-26T20:19:58.200038+0000","last_undegraded":"2024-04-26T20:19:58.200038+0000","last_fullsized":"2024-04-26T20:19:58.200038+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.366387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.721775+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:18.721775+0000","last_peered":"2024-04-26T20:20:18.721775+0000","last_clean":"2024-04-26T20:20:18.721775+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:18.721775+0000","last_undegraded":"2024-04-26T20:20:18.721775+0000","last_fullsized":"2024-04-26T20:20:18.721775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198732+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:19:58.198732+0000","last_peered":"2024-04-26T20:19:58.198732+0000","last_clean":"2024-04-26T20:19:58.198732+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:19:58.198732+0000","last_undegraded":"2024-04-26T20:19:58.198732+0000","last_fullsized":"2024-04-26T20:19:58.198732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199365+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:19:58.199365+0000","last_peered":"2024-04-26T20:19:58.199365+0000","last_clean":"2024-04-26T20:19:58.199365+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:19:58.199365+0000","last_undegraded":"2024-04-26T20:19:58.199365+0000","last_fullsized":"2024-04-26T20:19:58.199365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.752094+0000","last_change":"2024-04-26T20:19:51.665547+0000","last_active":"2024-04-26T20:19:57.752094+0000","last_peered":"2024-04-26T20:19:57.752094+0000","last_clean":"2024-04-26T20:19:57.752094+0000","last_became_active":"2024-04-26T20:19:51.664955+0000","last_became_peered":"2024-04-26T20:19:51.664955+0000","last_unstale":"2024-04-26T20:19:57.752094+0000","last_undegraded":"2024-04-26T20:19:57.752094+0000","last_fullsized":"2024-04-26T20:19:57.752094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:50.804340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199574+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:19:58.199574+0000","last_peered":"2024-04-26T20:19:58.199574+0000","last_clean":"2024-04-26T20:19:58.199574+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:19:58.199574+0000","last_undegraded":"2024-04-26T20:19:58.199574+0000","last_fullsized":"2024-04-26T20:19:58.199574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749769+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:19:57.749769+0000","last_peered":"2024-04-26T20:19:57.749769+0000","last_clean":"2024-04-26T20:19:57.749769+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:19:57.749769+0000","last_undegraded":"2024-04-26T20:19:57.749769+0000","last_fullsized":"2024-04-26T20:19:57.749769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200825+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:19:58.200825+0000","last_peered":"2024-04-26T20:19:58.200825+0000","last_clean":"2024-04-26T20:19:58.200825+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:19:58.200825+0000","last_undegraded":"2024-04-26T20:19:58.200825+0000","last_fullsized":"2024-04-26T20:19:58.200825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198999+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:19:58.198999+0000","last_peered":"2024-04-26T20:19:58.198999+0000","last_clean":"2024-04-26T20:19:58.198999+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:19:58.198999+0000","last_undegraded":"2024-04-26T20:19:58.198999+0000","last_fullsized":"2024-04-26T20:19:58.198999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749832+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:19:57.749832+0000","last_peered":"2024-04-26T20:19:57.749832+0000","last_clean":"2024-04-26T20:19:57.749832+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:19:57.749832+0000","last_undegraded":"2024-04-26T20:19:57.749832+0000","last_fullsized":"2024-04-26T20:19:57.749832+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199256+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:19:58.199256+0000","last_peered":"2024-04-26T20:19:58.199256+0000","last_clean":"2024-04-26T20:19:58.199256+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:19:58.199256+0000","last_undegraded":"2024-04-26T20:19:58.199256+0000","last_fullsized":"2024-04-26T20:19:58.199256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:20.201804+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:20:20.201804+0000","last_peered":"2024-04-26T20:20:20.201804+0000","last_clean":"2024-04-26T20:20:20.201804+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:20:20.201804+0000","last_undegraded":"2024-04-26T20:20:20.201804+0000","last_fullsized":"2024-04-26T20:20:20.201804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201132+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:19:58.201132+0000","last_peered":"2024-04-26T20:19:58.201132+0000","last_clean":"2024-04-26T20:19:58.201132+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:19:58.201132+0000","last_undegraded":"2024-04-26T20:19:58.201132+0000","last_fullsized":"2024-04-26T20:19:58.201132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767964+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:19:57.767964+0000","last_peered":"2024-04-26T20:19:57.767964+0000","last_clean":"2024-04-26T20:19:57.767964+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:19:57.767964+0000","last_undegraded":"2024-04-26T20:19:57.767964+0000","last_fullsized":"2024-04-26T20:19:57.767964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194453+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:19.194453+0000","last_peered":"2024-04-26T20:20:19.194453+0000","last_clean":"2024-04-26T20:20:19.194453+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:19.194453+0000","last_undegraded":"2024-04-26T20:20:19.194453+0000","last_fullsized":"2024-04-26T20:20:19.194453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200302+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:19:58.200302+0000","last_peered":"2024-04-26T20:19:58.200302+0000","last_clean":"2024-04-26T20:19:58.200302+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:19:58.200302+0000","last_undegraded":"2024-04-26T20:19:58.200302+0000","last_fullsized":"2024-04-26T20:19:58.200302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198925+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:19:58.198925+0000","last_peered":"2024-04-26T20:19:58.198925+0000","last_clean":"2024-04-26T20:19:58.198925+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:19:58.198925+0000","last_undegraded":"2024-04-26T20:19:58.198925+0000","last_fullsized":"2024-04-26T20:19:58.198925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.747751+0000","last_change":"2024-04-26T20:19:52.652945+0000","last_active":"2024-04-26T20:19:57.747751+0000","last_peered":"2024-04-26T20:19:57.747751+0000","last_clean":"2024-04-26T20:19:57.747751+0000","last_became_active":"2024-04-26T20:19:52.651513+0000","last_became_peered":"2024-04-26T20:19:52.651513+0000","last_unstale":"2024-04-26T20:19:57.747751+0000","last_undegraded":"2024-04-26T20:19:57.747751+0000","last_fullsized":"2024-04-26T20:19:57.747751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:58.138256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:17.724902+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:17.724902+0000","last_peered":"2024-04-26T20:20:17.724902+0000","last_clean":"2024-04-26T20:20:17.724902+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:17.724902+0000","last_undegraded":"2024-04-26T20:20:17.724902+0000","last_fullsized":"2024-04-26T20:20:17.724902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199627+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:19:58.199627+0000","last_peered":"2024-04-26T20:19:58.199627+0000","last_clean":"2024-04-26T20:19:58.199627+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:19:58.199627+0000","last_undegraded":"2024-04-26T20:19:58.199627+0000","last_fullsized":"2024-04-26T20:19:58.199627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.177713+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:19.177713+0000","last_peered":"2024-04-26T20:20:19.177713+0000","last_clean":"2024-04-26T20:20:19.177713+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:19.177713+0000","last_undegraded":"2024-04-26T20:20:19.177713+0000","last_fullsized":"2024-04-26T20:20:19.177713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.750170+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:19:57.750170+0000","last_peered":"2024-04-26T20:19:57.750170+0000","last_clean":"2024-04-26T20:19:57.750170+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:19:57.750170+0000","last_undegraded":"2024-04-26T20:19:57.750170+0000","last_fullsized":"2024-04-26T20:19:57.750170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767909+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:19:57.767909+0000","last_peered":"2024-04-26T20:19:57.767909+0000","last_clean":"2024-04-26T20:19:57.767909+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:19:57.767909+0000","last_undegraded":"2024-04-26T20:19:57.767909+0000","last_fullsized":"2024-04-26T20:19:57.767909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.742699+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:20:18.742699+0000","last_peered":"2024-04-26T20:20:18.742699+0000","last_clean":"2024-04-26T20:20:18.742699+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:20:18.742699+0000","last_undegraded":"2024-04-26T20:20:18.742699+0000","last_fullsized":"2024-04-26T20:20:18.742699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768719+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:19:57.768719+0000","last_peered":"2024-04-26T20:19:57.768719+0000","last_clean":"2024-04-26T20:19:57.768719+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:19:57.768719+0000","last_undegraded":"2024-04-26T20:19:57.768719+0000","last_fullsized":"2024-04-26T20:19:57.768719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748227+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:19:57.748227+0000","last_peered":"2024-04-26T20:19:57.748227+0000","last_clean":"2024-04-26T20:19:57.748227+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:19:57.748227+0000","last_undegraded":"2024-04-26T20:19:57.748227+0000","last_fullsized":"2024-04-26T20:19:57.748227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194727+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:19.194727+0000","last_peered":"2024-04-26T20:20:19.194727+0000","last_clean":"2024-04-26T20:20:19.194727+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:19.194727+0000","last_undegraded":"2024-04-26T20:20:19.194727+0000","last_fullsized":"2024-04-26T20:20:19.194727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200347+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:19:58.200347+0000","last_peered":"2024-04-26T20:19:58.200347+0000","last_clean":"2024-04-26T20:19:58.200347+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:19:58.200347+0000","last_undegraded":"2024-04-26T20:19:58.200347+0000","last_fullsized":"2024-04-26T20:19:58.200347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199799+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:19:58.199799+0000","last_peered":"2024-04-26T20:19:58.199799+0000","last_clean":"2024-04-26T20:19:58.199799+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:19:58.199799+0000","last_undegraded":"2024-04-26T20:19:58.199799+0000","last_fullsized":"2024-04-26T20:19:58.199799+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.719620+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:16.719620+0000","last_peered":"2024-04-26T20:20:16.719620+0000","last_clean":"2024-04-26T20:20:16.719620+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:16.719620+0000","last_undegraded":"2024-04-26T20:20:16.719620+0000","last_fullsized":"2024-04-26T20:20:16.719620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198155+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:19:58.198155+0000","last_peered":"2024-04-26T20:19:58.198155+0000","last_clean":"2024-04-26T20:19:58.198155+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:19:58.198155+0000","last_undegraded":"2024-04-26T20:19:58.198155+0000","last_fullsized":"2024-04-26T20:19:58.198155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.753645+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:19:57.753645+0000","last_peered":"2024-04-26T20:19:57.753645+0000","last_clean":"2024-04-26T20:19:57.753645+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:19:57.753645+0000","last_undegraded":"2024-04-26T20:19:57.753645+0000","last_fullsized":"2024-04-26T20:19:57.753645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.742130+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:18.742130+0000","last_peered":"2024-04-26T20:20:18.742130+0000","last_clean":"2024-04-26T20:20:18.742130+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:18.742130+0000","last_undegraded":"2024-04-26T20:20:18.742130+0000","last_fullsized":"2024-04-26T20:20:18.742130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198300+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:19:58.198300+0000","last_peered":"2024-04-26T20:19:58.198300+0000","last_clean":"2024-04-26T20:19:58.198300+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:19:58.198300+0000","last_undegraded":"2024-04-26T20:19:58.198300+0000","last_fullsized":"2024-04-26T20:19:58.198300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199792+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:19:58.199792+0000","last_peered":"2024-04-26T20:19:58.199792+0000","last_clean":"2024-04-26T20:19:58.199792+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:19:58.199792+0000","last_undegraded":"2024-04-26T20:19:58.199792+0000","last_fullsized":"2024-04-26T20:19:58.199792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.740777+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:18.740777+0000","last_peered":"2024-04-26T20:20:18.740777+0000","last_clean":"2024-04-26T20:20:18.740777+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:18.740777+0000","last_undegraded":"2024-04-26T20:20:18.740777+0000","last_fullsized":"2024-04-26T20:20:18.740777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768216+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:19:57.768216+0000","last_peered":"2024-04-26T20:19:57.768216+0000","last_clean":"2024-04-26T20:19:57.768216+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:19:57.768216+0000","last_undegraded":"2024-04-26T20:19:57.768216+0000","last_fullsized":"2024-04-26T20:19:57.768216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199803+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:19:58.199803+0000","last_peered":"2024-04-26T20:19:58.199803+0000","last_clean":"2024-04-26T20:19:58.199803+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:19:58.199803+0000","last_undegraded":"2024-04-26T20:19:58.199803+0000","last_fullsized":"2024-04-26T20:19:58.199803+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.718179+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:16.718179+0000","last_peered":"2024-04-26T20:20:16.718179+0000","last_clean":"2024-04-26T20:20:16.718179+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:16.718179+0000","last_undegraded":"2024-04-26T20:20:16.718179+0000","last_fullsized":"2024-04-26T20:20:16.718179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200869+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:19:58.200869+0000","last_peered":"2024-04-26T20:19:58.200869+0000","last_clean":"2024-04-26T20:19:58.200869+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:19:58.200869+0000","last_undegraded":"2024-04-26T20:19:58.200869+0000","last_fullsized":"2024-04-26T20:19:58.200869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.197751+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:19:58.197751+0000","last_peered":"2024-04-26T20:19:58.197751+0000","last_clean":"2024-04-26T20:19:58.197751+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:19:58.197751+0000","last_undegraded":"2024-04-26T20:19:58.197751+0000","last_fullsized":"2024-04-26T20:19:58.197751+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:21.188300+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:20:21.188300+0000","last_peered":"2024-04-26T20:20:21.188300+0000","last_clean":"2024-04-26T20:20:21.188300+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:20:21.188300+0000","last_undegraded":"2024-04-26T20:20:21.188300+0000","last_fullsized":"2024-04-26T20:20:21.188300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201267+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:19:58.201267+0000","last_peered":"2024-04-26T20:19:58.201267+0000","last_clean":"2024-04-26T20:19:58.201267+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:19:58.201267+0000","last_undegraded":"2024-04-26T20:19:58.201267+0000","last_fullsized":"2024-04-26T20:19:58.201267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199513+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:19:58.199513+0000","last_peered":"2024-04-26T20:19:58.199513+0000","last_clean":"2024-04-26T20:19:58.199513+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:19:58.199513+0000","last_undegraded":"2024-04-26T20:19:58.199513+0000","last_fullsized":"2024-04-26T20:19:58.199513+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.177658+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:19.177658+0000","last_peered":"2024-04-26T20:20:19.177658+0000","last_clean":"2024-04-26T20:20:19.177658+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:19.177658+0000","last_undegraded":"2024-04-26T20:20:19.177658+0000","last_fullsized":"2024-04-26T20:20:19.177658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200842+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:19:58.200842+0000","last_peered":"2024-04-26T20:19:58.200842+0000","last_clean":"2024-04-26T20:19:58.200842+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:19:58.200842+0000","last_undegraded":"2024-04-26T20:19:58.200842+0000","last_fullsized":"2024-04-26T20:19:58.200842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198601+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:19:58.198601+0000","last_peered":"2024-04-26T20:19:58.198601+0000","last_clean":"2024-04-26T20:19:58.198601+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:19:58.198601+0000","last_undegraded":"2024-04-26T20:19:58.198601+0000","last_fullsized":"2024-04-26T20:19:58.198601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.192804+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:19.192804+0000","last_peered":"2024-04-26T20:20:19.192804+0000","last_clean":"2024-04-26T20:20:19.192804+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:19.192804+0000","last_undegraded":"2024-04-26T20:20:19.192804+0000","last_fullsized":"2024-04-26T20:20:19.192804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201135+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:19:58.201135+0000","last_peered":"2024-04-26T20:19:58.201135+0000","last_clean":"2024-04-26T20:19:58.201135+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:19:58.201135+0000","last_undegraded":"2024-04-26T20:19:58.201135+0000","last_fullsized":"2024-04-26T20:19:58.201135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198386+0000","last_change":"2024-04-26T20:19:52.652253+0000","last_active":"2024-04-26T20:19:58.198386+0000","last_peered":"2024-04-26T20:19:58.198386+0000","last_clean":"2024-04-26T20:19:58.198386+0000","last_became_active":"2024-04-26T20:19:52.651928+0000","last_became_peered":"2024-04-26T20:19:52.651928+0000","last_unstale":"2024-04-26T20:19:58.198386+0000","last_undegraded":"2024-04-26T20:19:58.198386+0000","last_fullsized":"2024-04-26T20:19:58.198386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:01.730460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748747+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:19:57.748747+0000","last_peered":"2024-04-26T20:19:57.748747+0000","last_clean":"2024-04-26T20:19:57.748747+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:19:57.748747+0000","last_undegraded":"2024-04-26T20:19:57.748747+0000","last_fullsized":"2024-04-26T20:19:57.748747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748207+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:19:57.748207+0000","last_peered":"2024-04-26T20:19:57.748207+0000","last_clean":"2024-04-26T20:19:57.748207+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:19:57.748207+0000","last_undegraded":"2024-04-26T20:19:57.748207+0000","last_fullsized":"2024-04-26T20:19:57.748207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199855+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:19:58.199855+0000","last_peered":"2024-04-26T20:19:58.199855+0000","last_clean":"2024-04-26T20:19:58.199855+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:19:58.199855+0000","last_undegraded":"2024-04-26T20:19:58.199855+0000","last_fullsized":"2024-04-26T20:19:58.199855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749882+0000","last_change":"2024-04-26T20:19:52.662780+0000","last_active":"2024-04-26T20:19:57.749882+0000","last_peered":"2024-04-26T20:19:57.749882+0000","last_clean":"2024-04-26T20:19:57.749882+0000","last_became_active":"2024-04-26T20:19:52.662277+0000","last_became_peered":"2024-04-26T20:19:52.662277+0000","last_unstale":"2024-04-26T20:19:57.749882+0000","last_undegraded":"2024-04-26T20:19:57.749882+0000","last_fullsized":"2024-04-26T20:19:57.749882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:17.852929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198687+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:19:58.198687+0000","last_peered":"2024-04-26T20:19:58.198687+0000","last_clean":"2024-04-26T20:19:58.198687+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:19:58.198687+0000","last_undegraded":"2024-04-26T20:19:58.198687+0000","last_fullsized":"2024-04-26T20:19:58.198687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748925+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:19:57.748925+0000","last_peered":"2024-04-26T20:19:57.748925+0000","last_clean":"2024-04-26T20:19:57.748925+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:19:57.748925+0000","last_undegraded":"2024-04-26T20:19:57.748925+0000","last_fullsized":"2024-04-26T20:19:57.748925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768911+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:19:57.768911+0000","last_peered":"2024-04-26T20:19:57.768911+0000","last_clean":"2024-04-26T20:19:57.768911+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:19:57.768911+0000","last_undegraded":"2024-04-26T20:19:57.768911+0000","last_fullsized":"2024-04-26T20:19:57.768911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199143+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:19:58.199143+0000","last_peered":"2024-04-26T20:19:58.199143+0000","last_clean":"2024-04-26T20:19:58.199143+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:19:58.199143+0000","last_undegraded":"2024-04-26T20:19:58.199143+0000","last_fullsized":"2024-04-26T20:19:58.199143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767861+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:19:57.767861+0000","last_peered":"2024-04-26T20:19:57.767861+0000","last_clean":"2024-04-26T20:19:57.767861+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:19:57.767861+0000","last_undegraded":"2024-04-26T20:19:57.767861+0000","last_fullsized":"2024-04-26T20:19:57.767861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198016+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:19:58.198016+0000","last_peered":"2024-04-26T20:19:58.198016+0000","last_clean":"2024-04-26T20:19:58.198016+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:19:58.198016+0000","last_undegraded":"2024-04-26T20:19:58.198016+0000","last_fullsized":"2024-04-26T20:19:58.198016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749305+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:19:57.749305+0000","last_peered":"2024-04-26T20:19:57.749305+0000","last_clean":"2024-04-26T20:19:57.749305+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:19:57.749305+0000","last_undegraded":"2024-04-26T20:19:57.749305+0000","last_fullsized":"2024-04-26T20:19:57.749305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198582+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:19:58.198582+0000","last_peered":"2024-04-26T20:19:58.198582+0000","last_clean":"2024-04-26T20:19:58.198582+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:19:58.198582+0000","last_undegraded":"2024-04-26T20:19:58.198582+0000","last_fullsized":"2024-04-26T20:19:58.198582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10368,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":190,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":103083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383699,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":477797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1613824,"data_stored":1072381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":478337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":477953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1068787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495665,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":477937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":519438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":479784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1060864,"data_stored":515950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":477623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920827,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":478306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757302,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1074499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":42223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:20:23.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:20:23.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:23 smithi139 ceph-mon[32999]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:23.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:23 smithi139 ceph-mon[32999]: pgmap v337: 129 pgs: 129 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2024-04-26T20:20:23.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:23 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/558082627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:20:23.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:23 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2145992777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:23.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:23 smithi135 ceph-mon[32816]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:20:23.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:23 smithi135 ceph-mon[32816]: pgmap v337: 129 pgs: 129 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2024-04-26T20:20:23.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:23 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/558082627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:20:23.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:23 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2145992777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:23.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 -- 172.21.15.82:0/1018911626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc104b70 msgr2=0x7f71fc104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 --2- 172.21.15.82:0/1018911626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc104b70 0x7f71fc104f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009900 tx=0x7f71ec02a400 comp rx=0 tx=0).stop 2024-04-26T20:20:23.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 -- 172.21.15.82:0/1018911626 shutdown_connections 2024-04-26T20:20:23.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 --2- 172.21.15.82:0/1018911626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc106720 0x7f71fc10cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 --2- 172.21.15.82:0/1018911626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc105d60 0x7f71fc1061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 --2- 172.21.15.82:0/1018911626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc104b70 0x7f71fc104f90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 -- 172.21.15.82:0/1018911626 >> 172.21.15.82:0/1018911626 conn(0x7f71fc100120 msgr2=0x7f71fc102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:23.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.785+0000 7f7202a00640 1 -- 172.21.15.82:0/1018911626 shutdown_connections 2024-04-26T20:20:23.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.786+0000 7f7202a00640 1 -- 172.21.15.82:0/1018911626 wait complete. 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.786+0000 7f7202a00640 1 Processor -- start 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 -- start start 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 0x7f71fc19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc105d60 0x7f71fc19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc106720 0x7f71fc1a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1106f0 con 0x7f71fc106720 2024-04-26T20:20:23.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc110570 con 0x7f71fc105d60 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7202a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc110870 con 0x7f71fc104b70 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f7200a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc106720 0x7f71fc1a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f71fbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 0x7f71fc19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f71fb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc105d60 0x7f71fc19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f71fbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 0x7f71fc19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33766/0 (socket says 172.21.15.82:33766) 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.787+0000 7f71fbe00640 1 -- 172.21.15.82:0/4023355043 learned_addr learned my addr 172.21.15.82:0/4023355043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71fbe00640 1 -- 172.21.15.82:0/4023355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc105d60 msgr2=0x7f71fc19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71fbe00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc105d60 0x7f71fc19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71fbe00640 1 -- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc106720 msgr2=0x7f71fc1a2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71fbe00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc106720 0x7f71fc1a2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71fbe00640 1 -- 172.21.15.82:0/4023355043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc1a29c0 con 0x7f71fc104b70 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71fbe00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 0x7f71fc19adb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71ec031500 tx=0x7f71ec003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:23.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03f070 con 0x7f71fc104b70 2024-04-26T20:20:23.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ec031c50 con 0x7f71fc104b70 2024-04-26T20:20:23.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc1a2c50 con 0x7f71fc104b70 2024-04-26T20:20:23.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.788+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec035030 con 0x7f71fc104b70 2024-04-26T20:20:23.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.789+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc1a3140 con 0x7f71fc104b70 2024-04-26T20:20:23.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.790+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc10bf10 con 0x7f71fc104b70 2024-04-26T20:20:23.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.792+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f71ec042070 con 0x7f71fc104b70 2024-04-26T20:20:23.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.793+0000 7f71f8c00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71e00a3c40 0x7f71e00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:23.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.793+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f71ec0f1610 con 0x7f71fc104b70 2024-04-26T20:20:23.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.793+0000 7f71fb400640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71e00a3c40 0x7f71e00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.794+0000 7f71fb400640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71e00a3c40 0x7f71e00a6100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009bd0 tx=0x7f71e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:23.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.796+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f71ec0bd600 con 0x7f71fc104b70 2024-04-26T20:20:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:23.979+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71fc062d70 con 0x7f71e00a3c40 2024-04-26T20:20:24.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.003+0000 7f71f8c00640 1 -- 172.21.15.82:0/4023355043 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340371 (secure 0 0 0) 0x7f71fc062d70 con 0x7f71e00a3c40 2024-04-26T20:20:24.008 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71e00a3c40 msgr2=0x7f71e00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71e00a3c40 0x7f71e00a6100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009bd0 tx=0x7f71e8005f90 comp rx=0 tx=0).stop 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 msgr2=0x7f71fc19adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 0x7f71fc19adb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71ec031500 tx=0x7f71ec003c10 comp rx=0 tx=0).stop 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 shutdown_connections 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71e00a3c40 0x7f71e00a6100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc106720 0x7f71fc1a2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71fc105d60 0x7f71fc19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 --2- 172.21.15.82:0/4023355043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71fc104b70 0x7f71fc19adb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 >> 172.21.15.82:0/4023355043 conn(0x7f71fc100120 msgr2=0x7f71fc1090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 shutdown_connections 2024-04-26T20:20:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:24.008+0000 7f7202a00640 1 -- 172.21.15.82:0/4023355043 wait complete. 2024-04-26T20:20:24.029 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-04-26T20:20:22.579190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600736,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":167,"num_read_kb":142,"num_write":371,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375284,"kb_used_data":13652,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566540,"statfs":{"total":1151940427776,"available":1151556136960,"internally_reserved":0,"allocated":13979648,"data_stored":7598792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5869,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":142,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006432"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199398+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:19:58.199398+0000","last_peered":"2024-04-26T20:19:58.199398+0000","last_clean":"2024-04-26T20:19:58.199398+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:19:58.199398+0000","last_undegraded":"2024-04-26T20:19:58.199398+0000","last_fullsized":"2024-04-26T20:19:58.199398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200146+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:19:58.200146+0000","last_peered":"2024-04-26T20:19:58.200146+0000","last_clean":"2024-04-26T20:19:58.200146+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:19:58.200146+0000","last_undegraded":"2024-04-26T20:19:58.200146+0000","last_fullsized":"2024-04-26T20:19:58.200146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199790+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:19:58.199790+0000","last_peered":"2024-04-26T20:19:58.199790+0000","last_clean":"2024-04-26T20:19:58.199790+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:19:58.199790+0000","last_undegraded":"2024-04-26T20:19:58.199790+0000","last_fullsized":"2024-04-26T20:19:58.199790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200160+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:19:58.200160+0000","last_peered":"2024-04-26T20:19:58.200160+0000","last_clean":"2024-04-26T20:19:58.200160+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:19:58.200160+0000","last_undegraded":"2024-04-26T20:19:58.200160+0000","last_fullsized":"2024-04-26T20:19:58.200160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198493+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:19:58.198493+0000","last_peered":"2024-04-26T20:19:58.198493+0000","last_clean":"2024-04-26T20:19:58.198493+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:19:58.198493+0000","last_undegraded":"2024-04-26T20:19:58.198493+0000","last_fullsized":"2024-04-26T20:19:58.198493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199332+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:19:58.199332+0000","last_peered":"2024-04-26T20:19:58.199332+0000","last_clean":"2024-04-26T20:19:58.199332+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:19:58.199332+0000","last_undegraded":"2024-04-26T20:19:58.199332+0000","last_fullsized":"2024-04-26T20:19:58.199332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200574+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:19:58.200574+0000","last_peered":"2024-04-26T20:19:58.200574+0000","last_clean":"2024-04-26T20:19:58.200574+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:19:58.200574+0000","last_undegraded":"2024-04-26T20:19:58.200574+0000","last_fullsized":"2024-04-26T20:19:58.200574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767532+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:19:57.767532+0000","last_peered":"2024-04-26T20:19:57.767532+0000","last_clean":"2024-04-26T20:19:57.767532+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:19:57.767532+0000","last_undegraded":"2024-04-26T20:19:57.767532+0000","last_fullsized":"2024-04-26T20:19:57.767532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198727+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:19:58.198727+0000","last_peered":"2024-04-26T20:19:58.198727+0000","last_clean":"2024-04-26T20:19:58.198727+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:19:58.198727+0000","last_undegraded":"2024-04-26T20:19:58.198727+0000","last_fullsized":"2024-04-26T20:19:58.198727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200145+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:19:58.200145+0000","last_peered":"2024-04-26T20:19:58.200145+0000","last_clean":"2024-04-26T20:19:58.200145+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:19:58.200145+0000","last_undegraded":"2024-04-26T20:19:58.200145+0000","last_fullsized":"2024-04-26T20:19:58.200145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201220+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:19:58.201220+0000","last_peered":"2024-04-26T20:19:58.201220+0000","last_clean":"2024-04-26T20:19:58.201220+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:19:58.201220+0000","last_undegraded":"2024-04-26T20:19:58.201220+0000","last_fullsized":"2024-04-26T20:19:58.201220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200107+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:19:58.200107+0000","last_peered":"2024-04-26T20:19:58.200107+0000","last_clean":"2024-04-26T20:19:58.200107+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:19:58.200107+0000","last_undegraded":"2024-04-26T20:19:58.200107+0000","last_fullsized":"2024-04-26T20:19:58.200107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749151+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:19:57.749151+0000","last_peered":"2024-04-26T20:19:57.749151+0000","last_clean":"2024-04-26T20:19:57.749151+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:19:57.749151+0000","last_undegraded":"2024-04-26T20:19:57.749151+0000","last_fullsized":"2024-04-26T20:19:57.749151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199170+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:19:58.199170+0000","last_peered":"2024-04-26T20:19:58.199170+0000","last_clean":"2024-04-26T20:19:58.199170+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:19:58.199170+0000","last_undegraded":"2024-04-26T20:19:58.199170+0000","last_fullsized":"2024-04-26T20:19:58.199170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199240+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:19:58.199240+0000","last_peered":"2024-04-26T20:19:58.199240+0000","last_clean":"2024-04-26T20:19:58.199240+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:19:58.199240+0000","last_undegraded":"2024-04-26T20:19:58.199240+0000","last_fullsized":"2024-04-26T20:19:58.199240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.197629+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:19:58.197629+0000","last_peered":"2024-04-26T20:19:58.197629+0000","last_clean":"2024-04-26T20:19:58.197629+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:19:58.197629+0000","last_undegraded":"2024-04-26T20:19:58.197629+0000","last_fullsized":"2024-04-26T20:19:58.197629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199156+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:19:58.199156+0000","last_peered":"2024-04-26T20:19:58.199156+0000","last_clean":"2024-04-26T20:19:58.199156+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:19:58.199156+0000","last_undegraded":"2024-04-26T20:19:58.199156+0000","last_fullsized":"2024-04-26T20:19:58.199156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.752738+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:19:57.752738+0000","last_peered":"2024-04-26T20:19:57.752738+0000","last_clean":"2024-04-26T20:19:57.752738+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:19:57.752738+0000","last_undegraded":"2024-04-26T20:19:57.752738+0000","last_fullsized":"2024-04-26T20:19:57.752738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748700+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:19:57.748700+0000","last_peered":"2024-04-26T20:19:57.748700+0000","last_clean":"2024-04-26T20:19:57.748700+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:19:57.748700+0000","last_undegraded":"2024-04-26T20:19:57.748700+0000","last_fullsized":"2024-04-26T20:19:57.748700+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748579+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:19:57.748579+0000","last_peered":"2024-04-26T20:19:57.748579+0000","last_clean":"2024-04-26T20:19:57.748579+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:19:57.748579+0000","last_undegraded":"2024-04-26T20:19:57.748579+0000","last_fullsized":"2024-04-26T20:19:57.748579+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194442+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:20:19.194442+0000","last_peered":"2024-04-26T20:20:19.194442+0000","last_clean":"2024-04-26T20:20:19.194442+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:20:19.194442+0000","last_undegraded":"2024-04-26T20:20:19.194442+0000","last_fullsized":"2024-04-26T20:20:19.194442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768823+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:19:57.768823+0000","last_peered":"2024-04-26T20:19:57.768823+0000","last_clean":"2024-04-26T20:19:57.768823+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:19:57.768823+0000","last_undegraded":"2024-04-26T20:19:57.768823+0000","last_fullsized":"2024-04-26T20:19:57.768823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199177+0000","last_change":"2024-04-26T20:19:56.743137+0000","last_active":"2024-04-26T20:19:58.199177+0000","last_peered":"2024-04-26T20:19:58.199177+0000","last_clean":"2024-04-26T20:19:58.199177+0000","last_became_active":"2024-04-26T20:19:56.742726+0000","last_became_peered":"2024-04-26T20:19:56.742726+0000","last_unstale":"2024-04-26T20:19:58.199177+0000","last_undegraded":"2024-04-26T20:19:58.199177+0000","last_fullsized":"2024-04-26T20:19:58.199177+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:48.893021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768926+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:19:57.768926+0000","last_peered":"2024-04-26T20:19:57.768926+0000","last_clean":"2024-04-26T20:19:57.768926+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:19:57.768926+0000","last_undegraded":"2024-04-26T20:19:57.768926+0000","last_fullsized":"2024-04-26T20:19:57.768926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199968+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:19:58.199968+0000","last_peered":"2024-04-26T20:19:58.199968+0000","last_clean":"2024-04-26T20:19:58.199968+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:19:58.199968+0000","last_undegraded":"2024-04-26T20:19:58.199968+0000","last_fullsized":"2024-04-26T20:19:58.199968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200117+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:19:58.200117+0000","last_peered":"2024-04-26T20:19:58.200117+0000","last_clean":"2024-04-26T20:19:58.200117+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:19:58.200117+0000","last_undegraded":"2024-04-26T20:19:58.200117+0000","last_fullsized":"2024-04-26T20:19:58.200117+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'11","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.193724+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:19.193724+0000","last_peered":"2024-04-26T20:20:19.193724+0000","last_clean":"2024-04-26T20:20:19.193724+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:19.193724+0000","last_undegraded":"2024-04-26T20:20:19.193724+0000","last_fullsized":"2024-04-26T20:20:19.193724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198401+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:19:58.198401+0000","last_peered":"2024-04-26T20:19:58.198401+0000","last_clean":"2024-04-26T20:19:58.198401+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:19:58.198401+0000","last_undegraded":"2024-04-26T20:19:58.198401+0000","last_fullsized":"2024-04-26T20:19:58.198401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199197+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:19:58.199197+0000","last_peered":"2024-04-26T20:19:58.199197+0000","last_clean":"2024-04-26T20:19:58.199197+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:19:58.199197+0000","last_undegraded":"2024-04-26T20:19:58.199197+0000","last_fullsized":"2024-04-26T20:19:58.199197+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194285+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:19.194285+0000","last_peered":"2024-04-26T20:20:19.194285+0000","last_clean":"2024-04-26T20:20:19.194285+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:19.194285+0000","last_undegraded":"2024-04-26T20:20:19.194285+0000","last_fullsized":"2024-04-26T20:20:19.194285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199909+0000","last_change":"2024-04-26T20:19:52.655238+0000","last_active":"2024-04-26T20:19:58.199909+0000","last_peered":"2024-04-26T20:19:58.199909+0000","last_clean":"2024-04-26T20:19:58.199909+0000","last_became_active":"2024-04-26T20:19:52.654894+0000","last_became_peered":"2024-04-26T20:19:52.654894+0000","last_unstale":"2024-04-26T20:19:58.199909+0000","last_undegraded":"2024-04-26T20:19:58.199909+0000","last_fullsized":"2024-04-26T20:19:58.199909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:41.165461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748685+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:19:57.748685+0000","last_peered":"2024-04-26T20:19:57.748685+0000","last_clean":"2024-04-26T20:19:57.748685+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:19:57.748685+0000","last_undegraded":"2024-04-26T20:19:57.748685+0000","last_fullsized":"2024-04-26T20:19:57.748685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:20.182603+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:20:20.182603+0000","last_peered":"2024-04-26T20:20:20.182603+0000","last_clean":"2024-04-26T20:20:20.182603+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:20:20.182603+0000","last_undegraded":"2024-04-26T20:20:20.182603+0000","last_fullsized":"2024-04-26T20:20:20.182603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199520+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:19:58.199520+0000","last_peered":"2024-04-26T20:19:58.199520+0000","last_clean":"2024-04-26T20:19:58.199520+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:19:58.199520+0000","last_undegraded":"2024-04-26T20:19:58.199520+0000","last_fullsized":"2024-04-26T20:19:58.199520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748683+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:19:57.748683+0000","last_peered":"2024-04-26T20:19:57.748683+0000","last_clean":"2024-04-26T20:19:57.748683+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:19:57.748683+0000","last_undegraded":"2024-04-26T20:19:57.748683+0000","last_fullsized":"2024-04-26T20:19:57.748683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:17.729504+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:17.729504+0000","last_peered":"2024-04-26T20:20:17.729504+0000","last_clean":"2024-04-26T20:20:17.729504+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:17.729504+0000","last_undegraded":"2024-04-26T20:20:17.729504+0000","last_fullsized":"2024-04-26T20:20:17.729504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199824+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:19:58.199824+0000","last_peered":"2024-04-26T20:19:58.199824+0000","last_clean":"2024-04-26T20:19:58.199824+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:19:58.199824+0000","last_undegraded":"2024-04-26T20:19:58.199824+0000","last_fullsized":"2024-04-26T20:19:58.199824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199091+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:19:58.199091+0000","last_peered":"2024-04-26T20:19:58.199091+0000","last_clean":"2024-04-26T20:19:58.199091+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:19:58.199091+0000","last_undegraded":"2024-04-26T20:19:58.199091+0000","last_fullsized":"2024-04-26T20:19:58.199091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:17.731745+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:17.731745+0000","last_peered":"2024-04-26T20:20:17.731745+0000","last_clean":"2024-04-26T20:20:17.731745+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:17.731745+0000","last_undegraded":"2024-04-26T20:20:17.731745+0000","last_fullsized":"2024-04-26T20:20:17.731745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767827+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:19:57.767827+0000","last_peered":"2024-04-26T20:19:57.767827+0000","last_clean":"2024-04-26T20:19:57.767827+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:19:57.767827+0000","last_undegraded":"2024-04-26T20:19:57.767827+0000","last_fullsized":"2024-04-26T20:19:57.767827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200156+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:19:58.200156+0000","last_peered":"2024-04-26T20:19:58.200156+0000","last_clean":"2024-04-26T20:19:58.200156+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:19:58.200156+0000","last_undegraded":"2024-04-26T20:19:58.200156+0000","last_fullsized":"2024-04-26T20:19:58.200156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.183162+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:19.183162+0000","last_peered":"2024-04-26T20:20:19.183162+0000","last_clean":"2024-04-26T20:20:19.183162+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:19.183162+0000","last_undegraded":"2024-04-26T20:20:19.183162+0000","last_fullsized":"2024-04-26T20:20:19.183162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.751060+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:19:57.751060+0000","last_peered":"2024-04-26T20:19:57.751060+0000","last_clean":"2024-04-26T20:19:57.751060+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:19:57.751060+0000","last_undegraded":"2024-04-26T20:19:57.751060+0000","last_fullsized":"2024-04-26T20:19:57.751060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768023+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:19:57.768023+0000","last_peered":"2024-04-26T20:19:57.768023+0000","last_clean":"2024-04-26T20:19:57.768023+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:19:57.768023+0000","last_undegraded":"2024-04-26T20:19:57.768023+0000","last_fullsized":"2024-04-26T20:19:57.768023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.720185+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:20:16.720185+0000","last_peered":"2024-04-26T20:20:16.720185+0000","last_clean":"2024-04-26T20:20:16.720185+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:20:16.720185+0000","last_undegraded":"2024-04-26T20:20:16.720185+0000","last_fullsized":"2024-04-26T20:20:16.720185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198539+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:19:58.198539+0000","last_peered":"2024-04-26T20:19:58.198539+0000","last_clean":"2024-04-26T20:19:58.198539+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:19:58.198539+0000","last_undegraded":"2024-04-26T20:19:58.198539+0000","last_fullsized":"2024-04-26T20:19:58.198539+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.750197+0000","last_change":"2024-04-26T20:19:56.745192+0000","last_active":"2024-04-26T20:19:57.750197+0000","last_peered":"2024-04-26T20:19:57.750197+0000","last_clean":"2024-04-26T20:19:57.750197+0000","last_became_active":"2024-04-26T20:19:56.743277+0000","last_became_peered":"2024-04-26T20:19:56.743277+0000","last_unstale":"2024-04-26T20:19:57.750197+0000","last_undegraded":"2024-04-26T20:19:57.750197+0000","last_fullsized":"2024-04-26T20:19:57.750197+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:37:21.980771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.717142+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:16.717142+0000","last_peered":"2024-04-26T20:20:16.717142+0000","last_clean":"2024-04-26T20:20:16.717142+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:16.717142+0000","last_undegraded":"2024-04-26T20:20:16.717142+0000","last_fullsized":"2024-04-26T20:20:16.717142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200224+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:19:58.200224+0000","last_peered":"2024-04-26T20:19:58.200224+0000","last_clean":"2024-04-26T20:19:58.200224+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:19:58.200224+0000","last_undegraded":"2024-04-26T20:19:58.200224+0000","last_fullsized":"2024-04-26T20:19:58.200224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200367+0000","last_change":"2024-04-26T20:19:56.742172+0000","last_active":"2024-04-26T20:19:58.200367+0000","last_peered":"2024-04-26T20:19:58.200367+0000","last_clean":"2024-04-26T20:19:58.200367+0000","last_became_active":"2024-04-26T20:19:56.741592+0000","last_became_peered":"2024-04-26T20:19:56.741592+0000","last_unstale":"2024-04-26T20:19:58.200367+0000","last_undegraded":"2024-04-26T20:19:58.200367+0000","last_fullsized":"2024-04-26T20:19:58.200367+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:59.045635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.738191+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:18.738191+0000","last_peered":"2024-04-26T20:20:18.738191+0000","last_clean":"2024-04-26T20:20:18.738191+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:18.738191+0000","last_undegraded":"2024-04-26T20:20:18.738191+0000","last_fullsized":"2024-04-26T20:20:18.738191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198610+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:19:58.198610+0000","last_peered":"2024-04-26T20:19:58.198610+0000","last_clean":"2024-04-26T20:19:58.198610+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:19:58.198610+0000","last_undegraded":"2024-04-26T20:19:58.198610+0000","last_fullsized":"2024-04-26T20:19:58.198610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.751980+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:19:57.751980+0000","last_peered":"2024-04-26T20:19:57.751980+0000","last_clean":"2024-04-26T20:19:57.751980+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:19:57.751980+0000","last_undegraded":"2024-04-26T20:19:57.751980+0000","last_fullsized":"2024-04-26T20:19:57.751980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.715981+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:20:16.715981+0000","last_peered":"2024-04-26T20:20:16.715981+0000","last_clean":"2024-04-26T20:20:16.715981+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:20:16.715981+0000","last_undegraded":"2024-04-26T20:20:16.715981+0000","last_fullsized":"2024-04-26T20:20:16.715981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198773+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:19:58.198773+0000","last_peered":"2024-04-26T20:19:58.198773+0000","last_clean":"2024-04-26T20:19:58.198773+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:19:58.198773+0000","last_undegraded":"2024-04-26T20:19:58.198773+0000","last_fullsized":"2024-04-26T20:19:58.198773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200269+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:19:58.200269+0000","last_peered":"2024-04-26T20:19:58.200269+0000","last_clean":"2024-04-26T20:19:58.200269+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:19:58.200269+0000","last_undegraded":"2024-04-26T20:19:58.200269+0000","last_fullsized":"2024-04-26T20:19:58.200269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.191132+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:19.191132+0000","last_peered":"2024-04-26T20:20:19.191132+0000","last_clean":"2024-04-26T20:20:19.191132+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:19.191132+0000","last_undegraded":"2024-04-26T20:20:19.191132+0000","last_fullsized":"2024-04-26T20:20:19.191132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748644+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:19:57.748644+0000","last_peered":"2024-04-26T20:19:57.748644+0000","last_clean":"2024-04-26T20:19:57.748644+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:19:57.748644+0000","last_undegraded":"2024-04-26T20:19:57.748644+0000","last_fullsized":"2024-04-26T20:19:57.748644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198442+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:19:58.198442+0000","last_peered":"2024-04-26T20:19:58.198442+0000","last_clean":"2024-04-26T20:19:58.198442+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:19:58.198442+0000","last_undegraded":"2024-04-26T20:19:58.198442+0000","last_fullsized":"2024-04-26T20:19:58.198442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.193808+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:19.193808+0000","last_peered":"2024-04-26T20:20:19.193808+0000","last_clean":"2024-04-26T20:20:19.193808+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:19.193808+0000","last_undegraded":"2024-04-26T20:20:19.193808+0000","last_fullsized":"2024-04-26T20:20:19.193808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200895+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:19:58.200895+0000","last_peered":"2024-04-26T20:19:58.200895+0000","last_clean":"2024-04-26T20:19:58.200895+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:19:58.200895+0000","last_undegraded":"2024-04-26T20:19:58.200895+0000","last_fullsized":"2024-04-26T20:19:58.200895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.752749+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:19:57.752749+0000","last_peered":"2024-04-26T20:19:57.752749+0000","last_clean":"2024-04-26T20:19:57.752749+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:19:57.752749+0000","last_undegraded":"2024-04-26T20:19:57.752749+0000","last_fullsized":"2024-04-26T20:19:57.752749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:20.184197+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:20:20.184197+0000","last_peered":"2024-04-26T20:20:20.184197+0000","last_clean":"2024-04-26T20:20:20.184197+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:20:20.184197+0000","last_undegraded":"2024-04-26T20:20:20.184197+0000","last_fullsized":"2024-04-26T20:20:20.184197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200433+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:19:58.200433+0000","last_peered":"2024-04-26T20:19:58.200433+0000","last_clean":"2024-04-26T20:19:58.200433+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:19:58.200433+0000","last_undegraded":"2024-04-26T20:19:58.200433+0000","last_fullsized":"2024-04-26T20:19:58.200433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.750204+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:19:57.750204+0000","last_peered":"2024-04-26T20:19:57.750204+0000","last_clean":"2024-04-26T20:19:57.750204+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:19:57.750204+0000","last_undegraded":"2024-04-26T20:19:57.750204+0000","last_fullsized":"2024-04-26T20:19:57.750204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.177670+0000","last_change":"2024-04-26T20:19:51.658967+0000","last_active":"2024-04-26T20:20:19.177670+0000","last_peered":"2024-04-26T20:20:19.177670+0000","last_clean":"2024-04-26T20:20:19.177670+0000","last_became_active":"2024-04-26T20:19:51.658642+0000","last_became_peered":"2024-04-26T20:19:51.658642+0000","last_unstale":"2024-04-26T20:20:19.177670+0000","last_undegraded":"2024-04-26T20:20:19.177670+0000","last_fullsized":"2024-04-26T20:20:19.177670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:41.764324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199961+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:19:58.199961+0000","last_peered":"2024-04-26T20:19:58.199961+0000","last_clean":"2024-04-26T20:19:58.199961+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:19:58.199961+0000","last_undegraded":"2024-04-26T20:19:58.199961+0000","last_fullsized":"2024-04-26T20:19:58.199961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200038+0000","last_change":"2024-04-26T20:19:56.748198+0000","last_active":"2024-04-26T20:19:58.200038+0000","last_peered":"2024-04-26T20:19:58.200038+0000","last_clean":"2024-04-26T20:19:58.200038+0000","last_became_active":"2024-04-26T20:19:56.747877+0000","last_became_peered":"2024-04-26T20:19:56.747877+0000","last_unstale":"2024-04-26T20:19:58.200038+0000","last_undegraded":"2024-04-26T20:19:58.200038+0000","last_fullsized":"2024-04-26T20:19:58.200038+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.366387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.721775+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:18.721775+0000","last_peered":"2024-04-26T20:20:18.721775+0000","last_clean":"2024-04-26T20:20:18.721775+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:18.721775+0000","last_undegraded":"2024-04-26T20:20:18.721775+0000","last_fullsized":"2024-04-26T20:20:18.721775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198732+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:19:58.198732+0000","last_peered":"2024-04-26T20:19:58.198732+0000","last_clean":"2024-04-26T20:19:58.198732+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:19:58.198732+0000","last_undegraded":"2024-04-26T20:19:58.198732+0000","last_fullsized":"2024-04-26T20:19:58.198732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199365+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:19:58.199365+0000","last_peered":"2024-04-26T20:19:58.199365+0000","last_clean":"2024-04-26T20:19:58.199365+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:19:58.199365+0000","last_undegraded":"2024-04-26T20:19:58.199365+0000","last_fullsized":"2024-04-26T20:19:58.199365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.752094+0000","last_change":"2024-04-26T20:19:51.665547+0000","last_active":"2024-04-26T20:19:57.752094+0000","last_peered":"2024-04-26T20:19:57.752094+0000","last_clean":"2024-04-26T20:19:57.752094+0000","last_became_active":"2024-04-26T20:19:51.664955+0000","last_became_peered":"2024-04-26T20:19:51.664955+0000","last_unstale":"2024-04-26T20:19:57.752094+0000","last_undegraded":"2024-04-26T20:19:57.752094+0000","last_fullsized":"2024-04-26T20:19:57.752094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:50.804340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199574+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:19:58.199574+0000","last_peered":"2024-04-26T20:19:58.199574+0000","last_clean":"2024-04-26T20:19:58.199574+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:19:58.199574+0000","last_undegraded":"2024-04-26T20:19:58.199574+0000","last_fullsized":"2024-04-26T20:19:58.199574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749769+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:19:57.749769+0000","last_peered":"2024-04-26T20:19:57.749769+0000","last_clean":"2024-04-26T20:19:57.749769+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:19:57.749769+0000","last_undegraded":"2024-04-26T20:19:57.749769+0000","last_fullsized":"2024-04-26T20:19:57.749769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200825+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:19:58.200825+0000","last_peered":"2024-04-26T20:19:58.200825+0000","last_clean":"2024-04-26T20:19:58.200825+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:19:58.200825+0000","last_undegraded":"2024-04-26T20:19:58.200825+0000","last_fullsized":"2024-04-26T20:19:58.200825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198999+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:19:58.198999+0000","last_peered":"2024-04-26T20:19:58.198999+0000","last_clean":"2024-04-26T20:19:58.198999+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:19:58.198999+0000","last_undegraded":"2024-04-26T20:19:58.198999+0000","last_fullsized":"2024-04-26T20:19:58.198999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749832+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:19:57.749832+0000","last_peered":"2024-04-26T20:19:57.749832+0000","last_clean":"2024-04-26T20:19:57.749832+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:19:57.749832+0000","last_undegraded":"2024-04-26T20:19:57.749832+0000","last_fullsized":"2024-04-26T20:19:57.749832+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199256+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:19:58.199256+0000","last_peered":"2024-04-26T20:19:58.199256+0000","last_clean":"2024-04-26T20:19:58.199256+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:19:58.199256+0000","last_undegraded":"2024-04-26T20:19:58.199256+0000","last_fullsized":"2024-04-26T20:19:58.199256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:20.201804+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:20:20.201804+0000","last_peered":"2024-04-26T20:20:20.201804+0000","last_clean":"2024-04-26T20:20:20.201804+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:20:20.201804+0000","last_undegraded":"2024-04-26T20:20:20.201804+0000","last_fullsized":"2024-04-26T20:20:20.201804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201132+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:19:58.201132+0000","last_peered":"2024-04-26T20:19:58.201132+0000","last_clean":"2024-04-26T20:19:58.201132+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:19:58.201132+0000","last_undegraded":"2024-04-26T20:19:58.201132+0000","last_fullsized":"2024-04-26T20:19:58.201132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767964+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:19:57.767964+0000","last_peered":"2024-04-26T20:19:57.767964+0000","last_clean":"2024-04-26T20:19:57.767964+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:19:57.767964+0000","last_undegraded":"2024-04-26T20:19:57.767964+0000","last_fullsized":"2024-04-26T20:19:57.767964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194453+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:19.194453+0000","last_peered":"2024-04-26T20:20:19.194453+0000","last_clean":"2024-04-26T20:20:19.194453+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:19.194453+0000","last_undegraded":"2024-04-26T20:20:19.194453+0000","last_fullsized":"2024-04-26T20:20:19.194453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200302+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:19:58.200302+0000","last_peered":"2024-04-26T20:19:58.200302+0000","last_clean":"2024-04-26T20:19:58.200302+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:19:58.200302+0000","last_undegraded":"2024-04-26T20:19:58.200302+0000","last_fullsized":"2024-04-26T20:19:58.200302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198925+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:19:58.198925+0000","last_peered":"2024-04-26T20:19:58.198925+0000","last_clean":"2024-04-26T20:19:58.198925+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:19:58.198925+0000","last_undegraded":"2024-04-26T20:19:58.198925+0000","last_fullsized":"2024-04-26T20:19:58.198925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.747751+0000","last_change":"2024-04-26T20:19:52.652945+0000","last_active":"2024-04-26T20:19:57.747751+0000","last_peered":"2024-04-26T20:19:57.747751+0000","last_clean":"2024-04-26T20:19:57.747751+0000","last_became_active":"2024-04-26T20:19:52.651513+0000","last_became_peered":"2024-04-26T20:19:52.651513+0000","last_unstale":"2024-04-26T20:19:57.747751+0000","last_undegraded":"2024-04-26T20:19:57.747751+0000","last_fullsized":"2024-04-26T20:19:57.747751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:58.138256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:17.724902+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:17.724902+0000","last_peered":"2024-04-26T20:20:17.724902+0000","last_clean":"2024-04-26T20:20:17.724902+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:17.724902+0000","last_undegraded":"2024-04-26T20:20:17.724902+0000","last_fullsized":"2024-04-26T20:20:17.724902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199627+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:19:58.199627+0000","last_peered":"2024-04-26T20:19:58.199627+0000","last_clean":"2024-04-26T20:19:58.199627+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:19:58.199627+0000","last_undegraded":"2024-04-26T20:19:58.199627+0000","last_fullsized":"2024-04-26T20:19:58.199627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.177713+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:19.177713+0000","last_peered":"2024-04-26T20:20:19.177713+0000","last_clean":"2024-04-26T20:20:19.177713+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:19.177713+0000","last_undegraded":"2024-04-26T20:20:19.177713+0000","last_fullsized":"2024-04-26T20:20:19.177713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.750170+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:19:57.750170+0000","last_peered":"2024-04-26T20:19:57.750170+0000","last_clean":"2024-04-26T20:19:57.750170+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:19:57.750170+0000","last_undegraded":"2024-04-26T20:19:57.750170+0000","last_fullsized":"2024-04-26T20:19:57.750170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767909+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:19:57.767909+0000","last_peered":"2024-04-26T20:19:57.767909+0000","last_clean":"2024-04-26T20:19:57.767909+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:19:57.767909+0000","last_undegraded":"2024-04-26T20:19:57.767909+0000","last_fullsized":"2024-04-26T20:19:57.767909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.742699+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:20:18.742699+0000","last_peered":"2024-04-26T20:20:18.742699+0000","last_clean":"2024-04-26T20:20:18.742699+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:20:18.742699+0000","last_undegraded":"2024-04-26T20:20:18.742699+0000","last_fullsized":"2024-04-26T20:20:18.742699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768719+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:19:57.768719+0000","last_peered":"2024-04-26T20:19:57.768719+0000","last_clean":"2024-04-26T20:19:57.768719+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:19:57.768719+0000","last_undegraded":"2024-04-26T20:19:57.768719+0000","last_fullsized":"2024-04-26T20:19:57.768719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748227+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:19:57.748227+0000","last_peered":"2024-04-26T20:19:57.748227+0000","last_clean":"2024-04-26T20:19:57.748227+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:19:57.748227+0000","last_undegraded":"2024-04-26T20:19:57.748227+0000","last_fullsized":"2024-04-26T20:19:57.748227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.194727+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:19.194727+0000","last_peered":"2024-04-26T20:20:19.194727+0000","last_clean":"2024-04-26T20:20:19.194727+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:19.194727+0000","last_undegraded":"2024-04-26T20:20:19.194727+0000","last_fullsized":"2024-04-26T20:20:19.194727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200347+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:19:58.200347+0000","last_peered":"2024-04-26T20:19:58.200347+0000","last_clean":"2024-04-26T20:19:58.200347+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:19:58.200347+0000","last_undegraded":"2024-04-26T20:19:58.200347+0000","last_fullsized":"2024-04-26T20:19:58.200347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199799+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:19:58.199799+0000","last_peered":"2024-04-26T20:19:58.199799+0000","last_clean":"2024-04-26T20:19:58.199799+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:19:58.199799+0000","last_undegraded":"2024-04-26T20:19:58.199799+0000","last_fullsized":"2024-04-26T20:19:58.199799+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.719620+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:16.719620+0000","last_peered":"2024-04-26T20:20:16.719620+0000","last_clean":"2024-04-26T20:20:16.719620+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:16.719620+0000","last_undegraded":"2024-04-26T20:20:16.719620+0000","last_fullsized":"2024-04-26T20:20:16.719620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198155+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:19:58.198155+0000","last_peered":"2024-04-26T20:19:58.198155+0000","last_clean":"2024-04-26T20:19:58.198155+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:19:58.198155+0000","last_undegraded":"2024-04-26T20:19:58.198155+0000","last_fullsized":"2024-04-26T20:19:58.198155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.753645+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:19:57.753645+0000","last_peered":"2024-04-26T20:19:57.753645+0000","last_clean":"2024-04-26T20:19:57.753645+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:19:57.753645+0000","last_undegraded":"2024-04-26T20:19:57.753645+0000","last_fullsized":"2024-04-26T20:19:57.753645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.742130+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:18.742130+0000","last_peered":"2024-04-26T20:20:18.742130+0000","last_clean":"2024-04-26T20:20:18.742130+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:18.742130+0000","last_undegraded":"2024-04-26T20:20:18.742130+0000","last_fullsized":"2024-04-26T20:20:18.742130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198300+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:19:58.198300+0000","last_peered":"2024-04-26T20:19:58.198300+0000","last_clean":"2024-04-26T20:19:58.198300+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:19:58.198300+0000","last_undegraded":"2024-04-26T20:19:58.198300+0000","last_fullsized":"2024-04-26T20:19:58.198300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199792+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:19:58.199792+0000","last_peered":"2024-04-26T20:19:58.199792+0000","last_clean":"2024-04-26T20:19:58.199792+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:19:58.199792+0000","last_undegraded":"2024-04-26T20:19:58.199792+0000","last_fullsized":"2024-04-26T20:19:58.199792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:18.740777+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:18.740777+0000","last_peered":"2024-04-26T20:20:18.740777+0000","last_clean":"2024-04-26T20:20:18.740777+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:18.740777+0000","last_undegraded":"2024-04-26T20:20:18.740777+0000","last_fullsized":"2024-04-26T20:20:18.740777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768216+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:19:57.768216+0000","last_peered":"2024-04-26T20:19:57.768216+0000","last_clean":"2024-04-26T20:19:57.768216+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:19:57.768216+0000","last_undegraded":"2024-04-26T20:19:57.768216+0000","last_fullsized":"2024-04-26T20:19:57.768216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199803+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:19:58.199803+0000","last_peered":"2024-04-26T20:19:58.199803+0000","last_clean":"2024-04-26T20:19:58.199803+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:19:58.199803+0000","last_undegraded":"2024-04-26T20:19:58.199803+0000","last_fullsized":"2024-04-26T20:19:58.199803+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:16.718179+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:16.718179+0000","last_peered":"2024-04-26T20:20:16.718179+0000","last_clean":"2024-04-26T20:20:16.718179+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:16.718179+0000","last_undegraded":"2024-04-26T20:20:16.718179+0000","last_fullsized":"2024-04-26T20:20:16.718179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200869+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:19:58.200869+0000","last_peered":"2024-04-26T20:19:58.200869+0000","last_clean":"2024-04-26T20:19:58.200869+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:19:58.200869+0000","last_undegraded":"2024-04-26T20:19:58.200869+0000","last_fullsized":"2024-04-26T20:19:58.200869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.197751+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:19:58.197751+0000","last_peered":"2024-04-26T20:19:58.197751+0000","last_clean":"2024-04-26T20:19:58.197751+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:19:58.197751+0000","last_undegraded":"2024-04-26T20:19:58.197751+0000","last_fullsized":"2024-04-26T20:19:58.197751+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:21.188300+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:20:21.188300+0000","last_peered":"2024-04-26T20:20:21.188300+0000","last_clean":"2024-04-26T20:20:21.188300+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:20:21.188300+0000","last_undegraded":"2024-04-26T20:20:21.188300+0000","last_fullsized":"2024-04-26T20:20:21.188300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201267+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:19:58.201267+0000","last_peered":"2024-04-26T20:19:58.201267+0000","last_clean":"2024-04-26T20:19:58.201267+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:19:58.201267+0000","last_undegraded":"2024-04-26T20:19:58.201267+0000","last_fullsized":"2024-04-26T20:19:58.201267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199513+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:19:58.199513+0000","last_peered":"2024-04-26T20:19:58.199513+0000","last_clean":"2024-04-26T20:19:58.199513+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:19:58.199513+0000","last_undegraded":"2024-04-26T20:19:58.199513+0000","last_fullsized":"2024-04-26T20:19:58.199513+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.177658+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:19.177658+0000","last_peered":"2024-04-26T20:20:19.177658+0000","last_clean":"2024-04-26T20:20:19.177658+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:19.177658+0000","last_undegraded":"2024-04-26T20:20:19.177658+0000","last_fullsized":"2024-04-26T20:20:19.177658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.200842+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:19:58.200842+0000","last_peered":"2024-04-26T20:19:58.200842+0000","last_clean":"2024-04-26T20:19:58.200842+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:19:58.200842+0000","last_undegraded":"2024-04-26T20:19:58.200842+0000","last_fullsized":"2024-04-26T20:19:58.200842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198601+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:19:58.198601+0000","last_peered":"2024-04-26T20:19:58.198601+0000","last_clean":"2024-04-26T20:19:58.198601+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:19:58.198601+0000","last_undegraded":"2024-04-26T20:19:58.198601+0000","last_fullsized":"2024-04-26T20:19:58.198601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:20:19.192804+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:19.192804+0000","last_peered":"2024-04-26T20:20:19.192804+0000","last_clean":"2024-04-26T20:20:19.192804+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:19.192804+0000","last_undegraded":"2024-04-26T20:20:19.192804+0000","last_fullsized":"2024-04-26T20:20:19.192804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.201135+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:19:58.201135+0000","last_peered":"2024-04-26T20:19:58.201135+0000","last_clean":"2024-04-26T20:19:58.201135+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:19:58.201135+0000","last_undegraded":"2024-04-26T20:19:58.201135+0000","last_fullsized":"2024-04-26T20:19:58.201135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198386+0000","last_change":"2024-04-26T20:19:52.652253+0000","last_active":"2024-04-26T20:19:58.198386+0000","last_peered":"2024-04-26T20:19:58.198386+0000","last_clean":"2024-04-26T20:19:58.198386+0000","last_became_active":"2024-04-26T20:19:52.651928+0000","last_became_peered":"2024-04-26T20:19:52.651928+0000","last_unstale":"2024-04-26T20:19:58.198386+0000","last_undegraded":"2024-04-26T20:19:58.198386+0000","last_fullsized":"2024-04-26T20:19:58.198386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:01.730460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748747+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:19:57.748747+0000","last_peered":"2024-04-26T20:19:57.748747+0000","last_clean":"2024-04-26T20:19:57.748747+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:19:57.748747+0000","last_undegraded":"2024-04-26T20:19:57.748747+0000","last_fullsized":"2024-04-26T20:19:57.748747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748207+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:19:57.748207+0000","last_peered":"2024-04-26T20:19:57.748207+0000","last_clean":"2024-04-26T20:19:57.748207+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:19:57.748207+0000","last_undegraded":"2024-04-26T20:19:57.748207+0000","last_fullsized":"2024-04-26T20:19:57.748207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199855+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:19:58.199855+0000","last_peered":"2024-04-26T20:19:58.199855+0000","last_clean":"2024-04-26T20:19:58.199855+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:19:58.199855+0000","last_undegraded":"2024-04-26T20:19:58.199855+0000","last_fullsized":"2024-04-26T20:19:58.199855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749882+0000","last_change":"2024-04-26T20:19:52.662780+0000","last_active":"2024-04-26T20:19:57.749882+0000","last_peered":"2024-04-26T20:19:57.749882+0000","last_clean":"2024-04-26T20:19:57.749882+0000","last_became_active":"2024-04-26T20:19:52.662277+0000","last_became_peered":"2024-04-26T20:19:52.662277+0000","last_unstale":"2024-04-26T20:19:57.749882+0000","last_undegraded":"2024-04-26T20:19:57.749882+0000","last_fullsized":"2024-04-26T20:19:57.749882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:17.852929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198687+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:19:58.198687+0000","last_peered":"2024-04-26T20:19:58.198687+0000","last_clean":"2024-04-26T20:19:58.198687+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:19:58.198687+0000","last_undegraded":"2024-04-26T20:19:58.198687+0000","last_fullsized":"2024-04-26T20:19:58.198687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.748925+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:19:57.748925+0000","last_peered":"2024-04-26T20:19:57.748925+0000","last_clean":"2024-04-26T20:19:57.748925+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:19:57.748925+0000","last_undegraded":"2024-04-26T20:19:57.748925+0000","last_fullsized":"2024-04-26T20:19:57.748925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.768911+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:19:57.768911+0000","last_peered":"2024-04-26T20:19:57.768911+0000","last_clean":"2024-04-26T20:19:57.768911+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:19:57.768911+0000","last_undegraded":"2024-04-26T20:19:57.768911+0000","last_fullsized":"2024-04-26T20:19:57.768911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.199143+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:19:58.199143+0000","last_peered":"2024-04-26T20:19:58.199143+0000","last_clean":"2024-04-26T20:19:58.199143+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:19:58.199143+0000","last_undegraded":"2024-04-26T20:19:58.199143+0000","last_fullsized":"2024-04-26T20:19:58.199143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.767861+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:19:57.767861+0000","last_peered":"2024-04-26T20:19:57.767861+0000","last_clean":"2024-04-26T20:19:57.767861+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:19:57.767861+0000","last_undegraded":"2024-04-26T20:19:57.767861+0000","last_fullsized":"2024-04-26T20:19:57.767861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198016+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:19:58.198016+0000","last_peered":"2024-04-26T20:19:58.198016+0000","last_clean":"2024-04-26T20:19:58.198016+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:19:58.198016+0000","last_undegraded":"2024-04-26T20:19:58.198016+0000","last_fullsized":"2024-04-26T20:19:58.198016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:57.749305+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:19:57.749305+0000","last_peered":"2024-04-26T20:19:57.749305+0000","last_clean":"2024-04-26T20:19:57.749305+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:19:57.749305+0000","last_undegraded":"2024-04-26T20:19:57.749305+0000","last_fullsized":"2024-04-26T20:19:57.749305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T20:19:58.198582+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:19:58.198582+0000","last_peered":"2024-04-26T20:19:58.198582+0000","last_clean":"2024-04-26T20:19:58.198582+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:19:58.198582+0000","last_undegraded":"2024-04-26T20:19:58.198582+0000","last_fullsized":"2024-04-26T20:19:58.198582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10368,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":190,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":103083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383699,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":477797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1613824,"data_stored":1072381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":478337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":477953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1589248,"data_stored":1068787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495665,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":477937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":519438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":479784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1060864,"data_stored":515950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":477623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920827,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":478306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757302,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1074499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":42223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:20:24.034 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T20:20:24.035 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T20:20:24.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T20:20:24.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:24 smithi082 ceph-mon[28105]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:20:24.492 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:24.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:24 smithi139 ceph-mon[32999]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:20:24.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:24 smithi135 ceph-mon[32816]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:20:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:25 smithi082 ceph-mon[28105]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:20:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:25 smithi082 ceph-mon[28105]: pgmap v338: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2024-04-26T20:20:25.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:25 smithi139 ceph-mon[32999]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:20:25.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:25 smithi139 ceph-mon[32999]: pgmap v338: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2024-04-26T20:20:25.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:25 smithi135 ceph-mon[32816]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:20:25.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:25 smithi135 ceph-mon[32816]: pgmap v338: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2024-04-26T20:20:26.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 -- 172.21.15.82:0/196015353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e0077450 msgr2=0x7f68e00758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:26.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 --2- 172.21.15.82:0/196015353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e0077450 0x7f68e00758b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009990 tx=0x7f68d0009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 -- 172.21.15.82:0/196015353 shutdown_connections 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 --2- 172.21.15.82:0/196015353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e010f8c0 0x7f68e0111cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 --2- 172.21.15.82:0/196015353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e0077450 0x7f68e00758b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 --2- 172.21.15.82:0/196015353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e0075e80 0x7f68e0076300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.922+0000 7f68e5c00700 1 -- 172.21.15.82:0/196015353 >> 172.21.15.82:0/196015353 conn(0x7f68e00fe860 msgr2=0x7f68e0100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.923+0000 7f68e5c00700 1 -- 172.21.15.82:0/196015353 shutdown_connections 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.923+0000 7f68e5c00700 1 -- 172.21.15.82:0/196015353 wait complete. 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 Processor -- start 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 -- start start 2024-04-26T20:20:26.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e0075e80 0x7f68e019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e0077450 0x7f68e019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 0x7f68e01a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68e0115350 con 0x7f68e010f8c0 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01151d0 con 0x7f68e0075e80 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01154d0 con 0x7f68e0077450 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68d7400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e0077450 0x7f68e019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 0x7f68e01a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68dfe00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e0075e80 0x7f68e019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 0x7f68e01a6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60508/0 (socket says 172.21.15.82:60508) 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.924+0000 7f68e5200700 1 -- 172.21.15.82:0/388075125 learned_addr learned my addr 172.21.15.82:0/388075125 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68d7400700 1 -- 172.21.15.82:0/388075125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e0075e80 msgr2=0x7f68e019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68d7400700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e0075e80 0x7f68e019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68d7400700 1 -- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 msgr2=0x7f68e01a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68d7400700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 0x7f68e01a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68d7400700 1 -- 172.21.15.82:0/388075125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e01a7550 con 0x7f68e0077450 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68e5200700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 0x7f68e01a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.925+0000 7f68d7400700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e0077450 0x7f68e019fe30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68c800e9f0 tx=0x7f68c800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.926+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c800cb70 con 0x7f68e0077450 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.926+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e01a7840 con 0x7f68e0077450 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.926+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68c800ee90 con 0x7f68e0077450 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.926+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8018680 con 0x7f68e0077450 2024-04-26T20:20:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.926+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e01a7dd0 con 0x7f68e0077450 2024-04-26T20:20:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.927+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e0064a80 con 0x7f68e0077450 2024-04-26T20:20:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.929+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f68c801f020 con 0x7f68e0077450 2024-04-26T20:20:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.930+0000 7f68dd600700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68c40a3d80 0x7f68c40a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.931+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f68c80d0760 con 0x7f68e0077450 2024-04-26T20:20:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.931+0000 7f68dfe00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68c40a3d80 0x7f68c40a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.931+0000 7f68dfe00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68c40a3d80 0x7f68c40a6240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f68d000b2e0 tx=0x7f68d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:26.933+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f68c809cd40 con 0x7f68e0077450 2024-04-26T20:20:27.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.248+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f68e002e530 con 0x7f68e0077450 2024-04-26T20:20:27.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.256+0000 7f68dd600700 1 -- 172.21.15.82:0/388075125 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f68e002e530 con 0x7f68e0077450 2024-04-26T20:20:27.257 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-04-26T20:20:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCLDCxmynr8DhAANJ/BoJiSi4Jcy1z0fhyRjw== 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68c40a3d80 msgr2=0x7f68c40a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68c40a3d80 0x7f68c40a6240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f68d000b2e0 tx=0x7f68d0005fb0 comp rx=0 tx=0).stop 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e0077450 msgr2=0x7f68e019fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e0077450 0x7f68e019fe30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68c800e9f0 tx=0x7f68c800ed00 comp rx=0 tx=0).stop 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 shutdown_connections 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68e010f8c0 0x7f68e01a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68c40a3d80 0x7f68c40a6240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e0075e80 0x7f68e019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 --2- 172.21.15.82:0/388075125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68e0077450 0x7f68e019fe30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 >> 172.21.15.82:0/388075125 conn(0x7f68e00fe860 msgr2=0x7f68e0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:27.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 shutdown_connections 2024-04-26T20:20:27.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:27.259+0000 7f68e5c00700 1 -- 172.21.15.82:0/388075125 wait complete. 2024-04-26T20:20:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:27 smithi082 ceph-mon[28105]: pgmap v339: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2024-04-26T20:20:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:27 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/388075125' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:20:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:27 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:20:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:27 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T20:20:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:27 smithi139 ceph-mon[32999]: pgmap v339: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2024-04-26T20:20:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:27 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/388075125' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:20:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:27 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:20:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:27 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T20:20:28.077 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:20:28.077 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T20:20:28.077 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T20:20:28.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:27 smithi135 ceph-mon[32816]: pgmap v339: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2024-04-26T20:20:28.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:27 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/388075125' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:20:28.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:27 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T20:20:28.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:27 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T20:20:28.193 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T20:20:28.194 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T20:20:28.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T20:20:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:29 smithi082 ceph-mon[28105]: pgmap v340: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 KiB/s wr, 25 op/s 2024-04-26T20:20:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:29 smithi139 ceph-mon[32999]: pgmap v340: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 KiB/s wr, 25 op/s 2024-04-26T20:20:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:29 smithi135 ceph-mon[32816]: pgmap v340: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 KiB/s wr, 25 op/s 2024-04-26T20:20:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 -- 172.21.15.82:0/3146529630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150108670 msgr2=0x7f2150110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 --2- 172.21.15.82:0/3146529630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150108670 0x7f2150110240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2148009fc0 tx=0x7f214800b330 comp rx=0 tx=0).stop 2024-04-26T20:20:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 -- 172.21.15.82:0/3146529630 shutdown_connections 2024-04-26T20:20:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 --2- 172.21.15.82:0/3146529630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150108670 0x7f2150110240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 --2- 172.21.15.82:0/3146529630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 --2- 172.21.15.82:0/3146529630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150103f40 0x7f2150107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.033+0000 7f2154a00700 1 -- 172.21.15.82:0/3146529630 >> 172.21.15.82:0/3146529630 conn(0x7f21500fee40 msgr2=0x7f2150101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.034+0000 7f2154a00700 1 -- 172.21.15.82:0/3146529630 shutdown_connections 2024-04-26T20:20:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.034+0000 7f2154a00700 1 -- 172.21.15.82:0/3146529630 wait complete. 2024-04-26T20:20:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 Processor -- start 2024-04-26T20:20:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 -- start start 2024-04-26T20:20:31.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:31.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150103f40 0x7f2150075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:31.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150108670 0x7f21500761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:31.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2150113560 con 0x7f2150103590 2024-04-26T20:20:31.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21501133e0 con 0x7f2150108670 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.035+0000 7f2154a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21501136e0 con 0x7f2150103f40 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40452/0 (socket says 172.21.15.82:40452) 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 -- 172.21.15.82:0/3095869806 learned_addr learned my addr 172.21.15.82:0/3095869806 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214ea00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150103f40 0x7f2150075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214fe00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150108670 0x7f21500761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 -- 172.21.15.82:0/3095869806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150103f40 msgr2=0x7f2150075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150103f40 0x7f2150075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 -- 172.21.15.82:0/3095869806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150108670 msgr2=0x7f21500761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150108670 0x7f21500761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214f400700 1 -- 172.21.15.82:0/3095869806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21501a7fa0 con 0x7f2150103590 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.036+0000 7f214fe00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150108670 0x7f21500761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.037+0000 7f214f400700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150075720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f214000e9c0 tx=0x7f214000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.037+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214000cbd0 con 0x7f2150103590 2024-04-26T20:20:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.037+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21501a8290 con 0x7f2150103590 2024-04-26T20:20:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.037+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f214000cd70 con 0x7f2150103590 2024-04-26T20:20:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.037+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140005550 con 0x7f2150103590 2024-04-26T20:20:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.037+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21501a8820 con 0x7f2150103590 2024-04-26T20:20:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.038+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215006a110 con 0x7f2150103590 2024-04-26T20:20:31.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.040+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2140004750 con 0x7f2150103590 2024-04-26T20:20:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.041+0000 7f2147e00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21340a3d50 0x7f21340a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.042+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f21400d09a0 con 0x7f2150103590 2024-04-26T20:20:31.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.042+0000 7f214ea00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21340a3d50 0x7f21340a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:31.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.042+0000 7f214ea00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21340a3d50 0x7f21340a6210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2150102590 tx=0x7f213c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:31.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.046+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f214009cf80 con 0x7f2150103590 2024-04-26T20:20:31.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.336+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2150076c50 con 0x7f2150103590 2024-04-26T20:20:31.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.352+0000 7f2147e00700 1 -- 172.21.15.82:0/3095869806 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264991 (secure 0 0 0) 0x7f214009c880 con 0x7f2150103590 2024-04-26T20:20:31.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.359+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21340a3d50 msgr2=0x7f21340a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.359+0000 7f2154a00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21340a3d50 0x7f21340a6210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2150102590 tx=0x7f213c009260 comp rx=0 tx=0).stop 2024-04-26T20:20:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.359+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 msgr2=0x7f2150075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.359+0000 7f2154a00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150075720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f214000e9c0 tx=0x7f214000ecd0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.359+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 shutdown_connections 2024-04-26T20:20:31.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.359+0000 7f2154a00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21340a3d50 0x7f21340a6210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.360+0000 7f2154a00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150108670 0x7f21500761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.360+0000 7f2154a00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2150103590 0x7f2150075720 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.360+0000 7f2154a00700 1 --2- 172.21.15.82:0/3095869806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2150103f40 0x7f2150075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.360+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 >> 172.21.15.82:0/3095869806 conn(0x7f21500fee40 msgr2=0x7f21500ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.360+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 shutdown_connections 2024-04-26T20:20:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:31.360+0000 7f2154a00700 1 -- 172.21.15.82:0/3095869806 wait complete. 2024-04-26T20:20:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:31 smithi082 ceph-mon[28105]: pgmap v341: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 23 op/s 2024-04-26T20:20:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:31 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3095869806' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T20:20:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:31 smithi139 ceph-mon[32999]: pgmap v341: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 23 op/s 2024-04-26T20:20:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:31 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3095869806' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T20:20:32.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:31 smithi135 ceph-mon[32816]: pgmap v341: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 23 op/s 2024-04-26T20:20:32.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:31 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3095869806' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T20:20:32.270 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":893198693},{"type":"v1","addr":"172.21.15.82:6801","nonce":893198693}]},"active_addr":"172.21.15.82:6801/893198693","active_change":"2024-04-26T20:11:46.422388+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2506235318}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":701135180}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3121089520}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":393955402}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":99894044}]}]} 2024-04-26T20:20:32.275 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T20:20:32.275 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T20:20:32.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T20:20:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:33.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:33 smithi082 ceph-mon[28105]: pgmap v342: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2024-04-26T20:20:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:33 smithi139 ceph-mon[32999]: pgmap v342: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2024-04-26T20:20:34.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:33 smithi135 ceph-mon[32816]: pgmap v342: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2024-04-26T20:20:35.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.071+0000 7f0216a00700 1 -- 172.21.15.82:0/2454456033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210103470 msgr2=0x7f02101038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.071+0000 7f0216a00700 1 --2- 172.21.15.82:0/2454456033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210103470 0x7f02101038f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009990 tx=0x7f01f8009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 -- 172.21.15.82:0/2454456033 shutdown_connections 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 --2- 172.21.15.82:0/2454456033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103e30 0x7f0210110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 --2- 172.21.15.82:0/2454456033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02101094c0 0x7f02101098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 --2- 172.21.15.82:0/2454456033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0210103470 0x7f02101038f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 -- 172.21.15.82:0/2454456033 >> 172.21.15.82:0/2454456033 conn(0x7f021007a580 msgr2=0x7f021007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 -- 172.21.15.82:0/2454456033 shutdown_connections 2024-04-26T20:20:35.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.072+0000 7f0216a00700 1 -- 172.21.15.82:0/2454456033 wait complete. 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 Processor -- start 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 -- start start 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103470 0x7f021019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210103e30 0x7f021019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 0x7f0210199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0210113640 con 0x7f02101094c0 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02101134c0 con 0x7f0210103e30 2024-04-26T20:20:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.073+0000 7f0216a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02101137c0 con 0x7f0210103470 2024-04-26T20:20:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f0214a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 0x7f0210199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f0207400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210103e30 0x7f021019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f020fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103470 0x7f021019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f0207400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210103e30 0x7f021019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:32814/0 (socket says 172.21.15.82:32814) 2024-04-26T20:20:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f0207400700 1 -- 172.21.15.82:0/2134010044 learned_addr learned my addr 172.21.15.82:0/2134010044 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:35.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f0214a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 0x7f0210199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40474/0 (socket says 172.21.15.82:40474) 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f020fe00700 1 -- 172.21.15.82:0/2134010044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210103e30 msgr2=0x7f021019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f020fe00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210103e30 0x7f021019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f020fe00700 1 -- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 msgr2=0x7f0210199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f020fe00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 0x7f0210199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f020fe00700 1 -- 172.21.15.82:0/2134010044 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021019a0e0 con 0x7f0210103470 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.074+0000 7f0214a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 0x7f0210199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.075+0000 7f020fe00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103470 0x7f021019f7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f020000e9f0 tx=0x7f020000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.075+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020000c9c0 con 0x7f0210103470 2024-04-26T20:20:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.075+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021019a3d0 con 0x7f0210103470 2024-04-26T20:20:35.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.075+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f020000cb60 con 0x7f0210103470 2024-04-26T20:20:35.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.075+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200018680 con 0x7f0210103470 2024-04-26T20:20:35.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.075+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02101a6690 con 0x7f0210103470 2024-04-26T20:20:35.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.076+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021010b930 con 0x7f0210103470 2024-04-26T20:20:35.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.078+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0200010430 con 0x7f0210103470 2024-04-26T20:20:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.080+0000 7f020d600700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f01f40a3cd0 0x7f01f40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.080+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f02000d0c40 con 0x7f0210103470 2024-04-26T20:20:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.080+0000 7f0207400700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f01f40a3cd0 0x7f01f40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:35.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.081+0000 7f0207400700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f01f40a3cd0 0x7f01f40a6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f021007acc0 tx=0x7f01f800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:35.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.082+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f020009d220 con 0x7f0210103470 2024-04-26T20:20:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.313+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f021019aeb0 con 0x7f0210103470 2024-04-26T20:20:35.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.315+0000 7f020d600700 1 -- 172.21.15.82:0/2134010044 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7f020009cb20 con 0x7f0210103470 2024-04-26T20:20:35.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:35.317 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.318+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f01f40a3cd0 msgr2=0x7f01f40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.318+0000 7f0216a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f01f40a3cd0 0x7f01f40a6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f021007acc0 tx=0x7f01f800b280 comp rx=0 tx=0).stop 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.318+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103470 msgr2=0x7f021019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.318+0000 7f0216a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103470 0x7f021019f7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f020000e9f0 tx=0x7f020000ed00 comp rx=0 tx=0).stop 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 shutdown_connections 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02101094c0 0x7f0210199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0210103470 0x7f021019f7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f01f40a3cd0 0x7f01f40a6190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 --2- 172.21.15.82:0/2134010044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0210103e30 0x7f021019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 >> 172.21.15.82:0/2134010044 conn(0x7f021007a580 msgr2=0x7f0210102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 shutdown_connections 2024-04-26T20:20:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:35.319+0000 7f0216a00700 1 -- 172.21.15.82:0/2134010044 wait complete. 2024-04-26T20:20:35.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:35 smithi082 ceph-mon[28105]: pgmap v343: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-04-26T20:20:35.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:35 smithi139 ceph-mon[32999]: pgmap v343: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-04-26T20:20:35.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:35 smithi135 ceph-mon[32816]: pgmap v343: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-04-26T20:20:36.183 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T20:20:36.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T20:20:36.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:36 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2134010044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:36.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:36 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2134010044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:36.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:36 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2134010044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:36.626 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:37 smithi082 ceph-mon[28105]: pgmap v344: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-04-26T20:20:37.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:37 smithi139 ceph-mon[32999]: pgmap v344: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-04-26T20:20:37.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:37 smithi135 ceph-mon[32816]: pgmap v344: 129 pgs: 129 active+clean; 632 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-04-26T20:20:38.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 -- 172.21.15.82:0/703117139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa01142b0 msgr2=0x7feaa01166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 --2- 172.21.15.82:0/703117139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa01142b0 0x7feaa01166a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea98009f90 tx=0x7fea9800b330 comp rx=0 tx=0).stop 2024-04-26T20:20:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 -- 172.21.15.82:0/703117139 shutdown_connections 2024-04-26T20:20:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 --2- 172.21.15.82:0/703117139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa01142b0 0x7feaa01166a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 --2- 172.21.15.82:0/703117139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 0x7feaa0077d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 --2- 172.21.15.82:0/703117139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0078270 0x7feaa0113d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 -- 172.21.15.82:0/703117139 >> 172.21.15.82:0/703117139 conn(0x7feaa0101100 msgr2=0x7feaa0103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.935+0000 7feaa4e00700 1 -- 172.21.15.82:0/703117139 shutdown_connections 2024-04-26T20:20:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.936+0000 7feaa4e00700 1 -- 172.21.15.82:0/703117139 wait complete. 2024-04-26T20:20:38.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.936+0000 7feaa4e00700 1 Processor -- start 2024-04-26T20:20:38.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 -- start start 2024-04-26T20:20:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 0x7feaa01a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa0078270 0x7feaa01a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 0x7feaa01a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0119c00 con 0x7feaa01142b0 2024-04-26T20:20:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0119a80 con 0x7feaa0077950 2024-04-26T20:20:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7feaa4e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0119d80 con 0x7feaa0078270 2024-04-26T20:20:38.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7fea9e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 0x7feaa01a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:38.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7fea9e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 0x7feaa01a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40500/0 (socket says 172.21.15.82:40500) 2024-04-26T20:20:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7fea9e800700 1 -- 172.21.15.82:0/2272772151 learned_addr learned my addr 172.21.15.82:0/2272772151 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7fea9de00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 0x7feaa01a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.937+0000 7fea9d400700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa0078270 0x7feaa01a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9e800700 1 -- 172.21.15.82:0/2272772151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa0078270 msgr2=0x7feaa01a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9e800700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa0078270 0x7feaa01a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9e800700 1 -- 172.21.15.82:0/2272772151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 msgr2=0x7feaa01a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9e800700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 0x7feaa01a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9e800700 1 -- 172.21.15.82:0/2272772151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa01a50b0 con 0x7feaa01142b0 2024-04-26T20:20:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9de00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 0x7feaa01a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.938+0000 7fea9e800700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 0x7feaa01a4970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea98009790 tx=0x7fea9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.939+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98021070 con 0x7feaa01142b0 2024-04-26T20:20:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.939+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa01a5340 con 0x7feaa01142b0 2024-04-26T20:20:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.939+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea98007ac0 con 0x7feaa01142b0 2024-04-26T20:20:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.939+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98005040 con 0x7feaa01142b0 2024-04-26T20:20:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.939+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa01acc20 con 0x7feaa01142b0 2024-04-26T20:20:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.940+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa006a110 con 0x7feaa01142b0 2024-04-26T20:20:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.942+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fea98024070 con 0x7feaa01142b0 2024-04-26T20:20:38.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.943+0000 7fea96a00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea840a3d50 0x7fea840a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:38.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.943+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fea980d19f0 con 0x7feaa01142b0 2024-04-26T20:20:38.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.944+0000 7fea9de00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea840a3d50 0x7fea840a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:38.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.944+0000 7fea9de00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea840a3d50 0x7fea840a6210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea90011490 tx=0x7fea90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:38.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:38.946+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fea9809e060 con 0x7feaa01142b0 2024-04-26T20:20:39.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.156+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feaa002e490 con 0x7feaa01142b0 2024-04-26T20:20:39.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.158+0000 7fea96a00700 1 -- 172.21.15.82:0/2272772151 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24141 (secure 0 0 0) 0x7fea9809d960 con 0x7feaa01142b0 2024-04-26T20:20:39.161 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:20:39.162 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:19:57.194101+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:20:39.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea840a3d50 msgr2=0x7fea840a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea840a3d50 0x7fea840a6210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea90011490 tx=0x7fea90009260 comp rx=0 tx=0).stop 2024-04-26T20:20:39.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 msgr2=0x7feaa01a4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 0x7feaa01a4970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea98009790 tx=0x7fea9800ccb0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 shutdown_connections 2024-04-26T20:20:39.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa01142b0 0x7feaa01a4970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea840a3d50 0x7fea840a6210 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa0077950 0x7feaa01a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 --2- 172.21.15.82:0/2272772151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feaa0078270 0x7feaa01a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 >> 172.21.15.82:0/2272772151 conn(0x7feaa0101100 msgr2=0x7feaa01034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:39.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 shutdown_connections 2024-04-26T20:20:39.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:39.161+0000 7feaa4e00700 1 -- 172.21.15.82:0/2272772151 wait complete. 2024-04-26T20:20:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:39 smithi082 ceph-mon[28105]: pgmap v345: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T20:20:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:39 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2272772151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:40.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T20:20:40.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T20:20:40.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T20:20:40.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T20:20:40.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T20:20:40.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T20:20:40.012 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-26T20:20:40.012 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-26T20:20:40.012 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-26T20:20:40.013 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-26T20:20:40.013 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-26T20:20:40.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-26T20:20:40.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:39 smithi139 ceph-mon[32999]: pgmap v345: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T20:20:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:39 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2272772151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:39 smithi135 ceph-mon[32816]: pgmap v345: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-04-26T20:20:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:39 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2272772151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:20:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:41.051 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:41.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:41 smithi082 ceph-mon[28105]: pgmap v346: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-26T20:20:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:41 smithi139 ceph-mon[32999]: pgmap v346: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-26T20:20:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:41 smithi135 ceph-mon[32816]: pgmap v346: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-26T20:20:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:42.853 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:43.486 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:43.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:43 smithi082 ceph-mon[28105]: pgmap v347: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T20:20:44.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:43 smithi139 ceph-mon[32999]: pgmap v347: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T20:20:44.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:43 smithi135 ceph-mon[32816]: pgmap v347: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-26T20:20:44.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 -- 172.21.15.82:0/3065417837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7968102ab0 msgr2=0x7f796810f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 --2- 172.21.15.82:0/3065417837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7968102ab0 0x7f796810f770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79540098f0 tx=0x7f7954009c00 comp rx=0 tx=0).stop 2024-04-26T20:20:44.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 -- 172.21.15.82:0/3065417837 shutdown_connections 2024-04-26T20:20:44.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 --2- 172.21.15.82:0/3065417837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f796810fcb0 0x7f79681120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 --2- 172.21.15.82:0/3065417837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 0x7f79681024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 --2- 172.21.15.82:0/3065417837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7968102ab0 0x7f796810f770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 -- 172.21.15.82:0/3065417837 >> 172.21.15.82:0/3065417837 conn(0x7f79680fdd40 msgr2=0x7f7968100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.140+0000 7f796e800700 1 -- 172.21.15.82:0/3065417837 shutdown_connections 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.141+0000 7f796e800700 1 -- 172.21.15.82:0/3065417837 wait complete. 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.142+0000 7f796e800700 1 Processor -- start 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.142+0000 7f796e800700 1 -- start start 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 0x7f79681a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796e800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7968102ab0 0x7f79681a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796e800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f796810fcb0 0x7f796819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7968115730 con 0x7f7968102100 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796e800700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79681155b0 con 0x7f7968102ab0 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796e800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f79681158b0 con 0x7f796810fcb0 2024-04-26T20:20:44.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 0x7f79681a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 0x7f79681a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47642/0 (socket says 172.21.15.82:47642) 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 -- 172.21.15.82:0/439815122 learned_addr learned my addr 172.21.15.82:0/439815122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796ca00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7968102ab0 0x7f79681a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796de00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f796810fcb0 0x7f796819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 -- 172.21.15.82:0/439815122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f796810fcb0 msgr2=0x7f796819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f796810fcb0 0x7f796819ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 -- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7968102ab0 msgr2=0x7f79681a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7968102ab0 0x7f79681a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796d400700 1 -- 172.21.15.82:0/439815122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796819c1b0 con 0x7f7968102100 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.143+0000 7f796ca00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7968102ab0 0x7f79681a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.144+0000 7f796d400700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 0x7f79681a1890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f795c00ec10 tx=0x7f795c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.144+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c00cc90 con 0x7f7968102100 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.144+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f795c00ce30 con 0x7f7968102100 2024-04-26T20:20:44.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.144+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796819c4a0 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.144+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c010430 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.144+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79681a8760 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.145+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7968063bb0 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.147+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f795c004000 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.149+0000 7f7966000700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79500a3cd0 0x7f79500a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.149+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f795c0d0cd0 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.149+0000 7f796ca00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79500a3cd0 0x7f79500a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.149+0000 7f7966000700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] conn(0x7f79500ae990 0x7f79500b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.149+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 --> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f795c01aec0 con 0x7f79500ae990 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.149+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f795c0d1080 con 0x7f7968102100 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.150+0000 7f796de00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] conn(0x7f79500ae990 0x7f79500b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.150+0000 7f796ca00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79500a3cd0 0x7f79500a6190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7954009fd0 tx=0x7f7954019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.150+0000 7f796de00700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] conn(0x7f79500ae990 0x7f79500b0dd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:44.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.151+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== osd.4 v2:172.21.15.135:6808/3619586985 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f795c01aec0 con 0x7f79500ae990 2024-04-26T20:20:44.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.170+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 --> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7968064030 con 0x7f79500ae990 2024-04-26T20:20:44.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.171+0000 7f7966000700 1 -- 172.21.15.82:0/439815122 <== osd.4 v2:172.21.15.135:6808/3619586985 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7968064030 con 0x7f79500ae990 2024-04-26T20:20:44.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] conn(0x7f79500ae990 msgr2=0x7f79500b0dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] conn(0x7f79500ae990 0x7f79500b0dd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79500a3cd0 msgr2=0x7f79500a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79500a3cd0 0x7f79500a6190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7954009fd0 tx=0x7f7954019040 comp rx=0 tx=0).stop 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 msgr2=0x7f79681a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 --2- 172.21.15.82:0/439815122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7968102100 0x7f79681a1890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f795c00ec10 tx=0x7f795c00ef20 comp rx=0 tx=0).stop 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796de00700 1 -- 172.21.15.82:0/439815122 reap_dead start 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 shutdown_connections 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 >> 172.21.15.82:0/439815122 conn(0x7f79680fdd40 msgr2=0x7f7968100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 shutdown_connections 2024-04-26T20:20:44.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:44.172+0000 7f796e800700 1 -- 172.21.15.82:0/439815122 wait complete. 2024-04-26T20:20:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:20:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:45 smithi082 ceph-mon[28105]: pgmap v348: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-26T20:20:46.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:45 smithi139 ceph-mon[32999]: pgmap v348: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-26T20:20:46.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:45 smithi135 ceph-mon[32816]: pgmap v348: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-26T20:20:46.906 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-04-26T20:20:46.907 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-04-26T20:20:47.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-26T20:20:47.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-26T20:20:47.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-04-26T20:20:47.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-04-26T20:20:47.020 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-04-26T20:20:47.021 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-26T20:20:47.021 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]: dispatch 2024-04-26T20:20:47.021 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-04-26T20:20:47.021 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-04-26T20:20:47.021 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]: dispatch 2024-04-26T20:20:47.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-04-26T20:20:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-04-26T20:20:47.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-26T20:20:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2024-04-26T20:20:47.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-04-26T20:20:47.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-04-26T20:20:47.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-04-26T20:20:47.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:47 smithi082 ceph-mon[28105]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-04-26T20:20:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-04-26T20:20:48.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:47 smithi139 ceph-mon[32999]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-04-26T20:20:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-04-26T20:20:48.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:47 smithi135 ceph-mon[32816]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T20:20:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:48 smithi082 ceph-mon[28105]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T20:20:49.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:48 smithi139 ceph-mon[32999]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T20:20:49.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:48 smithi135 ceph-mon[32816]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T20:20:49.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:49 smithi082 ceph-mon[28105]: pgmap v352: 129 pgs: 2 peering, 127 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 383 B/s wr, 13 op/s 2024-04-26T20:20:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:49 smithi139 ceph-mon[32999]: pgmap v352: 129 pgs: 2 peering, 127 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 383 B/s wr, 13 op/s 2024-04-26T20:20:50.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:49 smithi135 ceph-mon[32816]: pgmap v352: 129 pgs: 2 peering, 127 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 383 B/s wr, 13 op/s 2024-04-26T20:20:50.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 -- 172.21.15.82:0/1452666310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c107590 msgr2=0x7f1b8c10f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 --2- 172.21.15.82:0/1452666310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c107590 0x7f1b8c10f160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400b0d0 tx=0x7f1b8400b3e0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 -- 172.21.15.82:0/1452666310 shutdown_connections 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 --2- 172.21.15.82:0/1452666310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c107590 0x7f1b8c10f160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 --2- 172.21.15.82:0/1452666310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c1024b0 0x7f1b8c102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 --2- 172.21.15.82:0/1452666310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c102e60 0x7f1b8c106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 -- 172.21.15.82:0/1452666310 >> 172.21.15.82:0/1452666310 conn(0x7f1b8c0fdd40 msgr2=0x7f1b8c100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 -- 172.21.15.82:0/1452666310 shutdown_connections 2024-04-26T20:20:50.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.552+0000 7f1b8be00700 1 -- 172.21.15.82:0/1452666310 wait complete. 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.553+0000 7f1b8be00700 1 Processor -- start 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.553+0000 7f1b8be00700 1 -- start start 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c1024b0 0x7f1b8c1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8be00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c102e60 0x7f1b8c1a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8be00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c107590 0x7f1b8c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112450 con 0x7f1b8c1024b0 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8be00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c1122d0 con 0x7f1b8c107590 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8be00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c1125d0 con 0x7f1b8c102e60 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c1024b0 0x7f1b8c1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c1024b0 0x7f1b8c1a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47666/0 (socket says 172.21.15.82:47666) 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8aa00700 1 -- 172.21.15.82:0/3550578173 learned_addr learned my addr 172.21.15.82:0/3550578173 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8a000700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c102e60 0x7f1b8c1a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:50.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.554+0000 7f1b8b400700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c107590 0x7f1b8c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8aa00700 1 -- 172.21.15.82:0/3550578173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c102e60 msgr2=0x7f1b8c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8aa00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c102e60 0x7f1b8c1a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8aa00700 1 -- 172.21.15.82:0/3550578173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c107590 msgr2=0x7f1b8c19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8aa00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c107590 0x7f1b8c19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8aa00700 1 -- 172.21.15.82:0/3550578173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c19c1a0 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8aa00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c1024b0 0x7f1b8c1a1880 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e9a0 tx=0x7f1b7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ca10 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b7c00cbb0 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c19c490 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c018680 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.555+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a8750 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.556+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b8c063b30 con 0x7f1b8c1024b0 2024-04-26T20:20:50.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.559+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1b7c010430 con 0x7f1b8c1024b0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.560+0000 7f1b90a00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b700a3d50 0x7f1b700a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.560+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1b7c0d0f60 con 0x7f1b8c1024b0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.560+0000 7f1b8a000700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b700a3d50 0x7f1b700a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.560+0000 7f1b90a00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] conn(0x7f1b700aeeb0 0x7f1b700b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.560+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 --> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b7c019ec0 con 0x7f1b700aeeb0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.560+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c0d13b0 con 0x7f1b8c1024b0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.561+0000 7f1b8b400700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] conn(0x7f1b700aeeb0 0x7f1b700b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.561+0000 7f1b8a000700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b700a3d50 0x7f1b700a6210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c108f80 tx=0x7f1b78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.561+0000 7f1b8b400700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] conn(0x7f1b700aeeb0 0x7f1b700b1350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:50.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.562+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== osd.9 v2:172.21.15.82:6826/2126970869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b7c019ec0 con 0x7f1b700aeeb0 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.581+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 --> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b8c063f30 con 0x7f1b700aeeb0 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.581+0000 7f1b90a00700 1 -- 172.21.15.82:0/3550578173 <== osd.9 v2:172.21.15.82:6826/2126970869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1b8c063f30 con 0x7f1b700aeeb0 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] conn(0x7f1b700aeeb0 msgr2=0x7f1b700b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] conn(0x7f1b700aeeb0 0x7f1b700b1350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b700a3d50 msgr2=0x7f1b700a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1b700a3d50 0x7f1b700a6210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c108f80 tx=0x7f1b78009260 comp rx=0 tx=0).stop 2024-04-26T20:20:50.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c1024b0 msgr2=0x7f1b8c1a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:50.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 --2- 172.21.15.82:0/3550578173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b8c1024b0 0x7f1b8c1a1880 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00e9a0 tx=0x7f1b7c00ecb0 comp rx=0 tx=0).stop 2024-04-26T20:20:50.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8b400700 1 -- 172.21.15.82:0/3550578173 reap_dead start 2024-04-26T20:20:50.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 shutdown_connections 2024-04-26T20:20:50.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 >> 172.21.15.82:0/3550578173 conn(0x7f1b8c0fdd40 msgr2=0x7f1b8c10dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:50.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.582+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 shutdown_connections 2024-04-26T20:20:50.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:48.583+0000 7f1b8be00700 1 -- 172.21.15.82:0/3550578173 wait complete. 2024-04-26T20:20:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:51 smithi139 ceph-mon[32999]: pgmap v353: 129 pgs: 2 peering, 127 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:52.092 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:51 smithi082 ceph-mon[28105]: pgmap v353: 129 pgs: 2 peering, 127 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:51 smithi135 ceph-mon[32816]: pgmap v353: 129 pgs: 2 peering, 127 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:53.881 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:53 smithi082 ceph-mon[28105]: pgmap v354: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:53.881 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:54.037 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:53 smithi139 ceph-mon[32999]: pgmap v354: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:54.037 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:54.091 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:53 smithi135 ceph-mon[32816]: pgmap v354: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:54.091 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:55.322 INFO:teuthology.orchestra.run.smithi082.stdout:287762808869 2024-04-26T20:20:55.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-26T20:20:55.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:55 smithi082 ceph-mon[28105]: pgmap v355: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:55 smithi139 ceph-mon[32999]: pgmap v355: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:55 smithi135 ceph-mon[32816]: pgmap v355: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 10 op/s; 13 B/s, 0 objects/s recovering 2024-04-26T20:20:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:20:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 -- 172.21.15.82:0/988895007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c106000 msgr2=0x7fb93c112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 --2- 172.21.15.82:0/988895007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c106000 0x7fb93c112510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb934009990 tx=0x7fb934009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 -- 172.21.15.82:0/988895007 shutdown_connections 2024-04-26T20:20:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 --2- 172.21.15.82:0/988895007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c106000 0x7fb93c112510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 --2- 172.21.15.82:0/988895007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c10b640 0x7fb93c10ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 --2- 172.21.15.82:0/988895007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93c105640 0x7fb93c105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 -- 172.21.15.82:0/988895007 >> 172.21.15.82:0/988895007 conn(0x7fb93c101130 msgr2=0x7fb93c103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 -- 172.21.15.82:0/988895007 shutdown_connections 2024-04-26T20:20:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.438+0000 7fb941400700 1 -- 172.21.15.82:0/988895007 wait complete. 2024-04-26T20:20:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.439+0000 7fb941400700 1 Processor -- start 2024-04-26T20:20:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 -- start start 2024-04-26T20:20:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c105640 0x7fb93c1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93c106000 0x7fb93c1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c10b640 0x7fb93c19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c115880 con 0x7fb93c105640 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c115700 con 0x7fb93c106000 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb941400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c115a00 con 0x7fb93c10b640 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb93a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c105640 0x7fb93c1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb93a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c105640 0x7fb93c1a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40668/0 (socket says 172.21.15.82:40668) 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb93a800700 1 -- 172.21.15.82:0/245841089 learned_addr learned my addr 172.21.15.82:0/245841089 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.440+0000 7fb931e00700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93c106000 0x7fb93c1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93b200700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c10b640 0x7fb93c19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93a800700 1 -- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c10b640 msgr2=0x7fb93c19baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93a800700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c10b640 0x7fb93c19baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93a800700 1 -- 172.21.15.82:0/245841089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93c106000 msgr2=0x7fb93c1a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93a800700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb93c106000 0x7fb93c1a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93a800700 1 -- 172.21.15.82:0/245841089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c19c200 con 0x7fb93c105640 2024-04-26T20:20:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb93a800700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c105640 0x7fb93c1a18e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00ef30 tx=0x7fb92c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.441+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0092e0 con 0x7fb93c105640 2024-04-26T20:20:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.442+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c19c490 con 0x7fb93c105640 2024-04-26T20:20:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.442+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb92c004bb0 con 0x7fb93c105640 2024-04-26T20:20:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.442+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c004040 con 0x7fb93c105640 2024-04-26T20:20:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.442+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c1a87b0 con 0x7fb93c105640 2024-04-26T20:20:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.442+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb93c063bb0 con 0x7fb93c105640 2024-04-26T20:20:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.445+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb92c01b030 con 0x7fb93c105640 2024-04-26T20:20:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.446+0000 7fb933e00700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9200a3cd0 0x7fb9200a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb92c0d0d80 con 0x7fb93c105640 2024-04-26T20:20:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb931e00700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9200a3cd0 0x7fb9200a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb933e00700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] conn(0x7fb9200aee30 0x7fb9200b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 --> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9200b19a0 con 0x7fb9200aee30 2024-04-26T20:20:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb92c0d1130 con 0x7fb93c105640 2024-04-26T20:20:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb93b200700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] conn(0x7fb9200aee30 0x7fb9200b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.447+0000 7fb931e00700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9200a3cd0 0x7fb9200a6190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb924009680 tx=0x7fb924009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.448+0000 7fb93b200700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] conn(0x7fb9200aee30 0x7fb9200b12d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.449+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== osd.5 v2:172.21.15.139:6808/1412243105 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb9200b19a0 con 0x7fb9200aee30 2024-04-26T20:20:57.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.467+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 --> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb93c064030 con 0x7fb9200aee30 2024-04-26T20:20:57.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.467+0000 7fb933e00700 1 -- 172.21.15.82:0/245841089 <== osd.5 v2:172.21.15.139:6808/1412243105 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb93c064030 con 0x7fb9200aee30 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] conn(0x7fb9200aee30 msgr2=0x7fb9200b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] conn(0x7fb9200aee30 0x7fb9200b12d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9200a3cd0 msgr2=0x7fb9200a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9200a3cd0 0x7fb9200a6190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb924009680 tx=0x7fb924009260 comp rx=0 tx=0).stop 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c105640 msgr2=0x7fb93c1a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 --2- 172.21.15.82:0/245841089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93c105640 0x7fb93c1a18e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00ef30 tx=0x7fb92c00c3a0 comp rx=0 tx=0).stop 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb93b200700 1 -- 172.21.15.82:0/245841089 reap_dead start 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 shutdown_connections 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 >> 172.21.15.82:0/245841089 conn(0x7fb93c101130 msgr2=0x7fb93c101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 shutdown_connections 2024-04-26T20:20:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:57.468+0000 7fb941400700 1 -- 172.21.15.82:0/245841089 wait complete. 2024-04-26T20:20:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:57 smithi082 ceph-mon[28105]: pgmap v356: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-04-26T20:20:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:57 smithi139 ceph-mon[32999]: pgmap v356: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-04-26T20:20:58.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:57 smithi135 ceph-mon[32816]: pgmap v356: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-04-26T20:20:58.810 INFO:teuthology.orchestra.run.smithi082.stdout:163208757310 2024-04-26T20:20:58.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 -- 172.21.15.82:0/3446039160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c1094c0 msgr2=0x7f0c2c1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 --2- 172.21.15.82:0/3446039160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c1094c0 0x7f0c2c1098a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009990 tx=0x7f0c1c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 -- 172.21.15.82:0/3446039160 shutdown_connections 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 --2- 172.21.15.82:0/3446039160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c103e30 0x7f0c2c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 --2- 172.21.15.82:0/3446039160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c1094c0 0x7f0c2c1098a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 --2- 172.21.15.82:0/3446039160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c2c103470 0x7f0c2c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 -- 172.21.15.82:0/3446039160 >> 172.21.15.82:0/3446039160 conn(0x7f0c2c07a580 msgr2=0x7f0c2c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 -- 172.21.15.82:0/3446039160 shutdown_connections 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.809+0000 7f0c32400700 1 -- 172.21.15.82:0/3446039160 wait complete. 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.810+0000 7f0c32400700 1 Processor -- start 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.810+0000 7f0c32400700 1 -- start start 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.810+0000 7f0c32400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c103470 0x7f0c2c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.810+0000 7f0c32400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c103e30 0x7f0c2c19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.810+0000 7f0c32400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c2c1094c0 0x7f0c2c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c32400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c113640 con 0x7f0c2c103470 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c32400700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c1134c0 con 0x7f0c2c103e30 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c32400700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c1137c0 con 0x7f0c2c1094c0 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c103470 0x7f0c2c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c103470 0x7f0c2c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40698/0 (socket says 172.21.15.82:40698) 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 -- 172.21.15.82:0/1072162152 learned_addr learned my addr 172.21.15.82:0/1072162152 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:20:59.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2be00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c2c1094c0 0x7f0c2c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2aa00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c103e30 0x7f0c2c19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 -- 172.21.15.82:0/1072162152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c2c1094c0 msgr2=0x7f0c2c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c2c1094c0 0x7f0c2c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 -- 172.21.15.82:0/1072162152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c103e30 msgr2=0x7f0c2c19c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c103e30 0x7f0c2c19c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2b400700 1 -- 172.21.15.82:0/1072162152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1a0d50 con 0x7f0c2c103470 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2be00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c2c1094c0 0x7f0c2c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.811+0000 7f0c2aa00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c2c103e30 0x7f0c2c19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.812+0000 7f0c2b400700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c103470 0x7f0c2c19bd40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000c00 tx=0x7f0c1c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.812+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c027070 con 0x7f0c2c103470 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.812+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c1c022470 con 0x7f0c2c103470 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.812+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1a0fe0 con 0x7f0c2c103470 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.812+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c017650 con 0x7f0c2c103470 2024-04-26T20:20:59.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.812+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c1a88c0 con 0x7f0c2c103470 2024-04-26T20:20:59.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.813+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c2c063b70 con 0x7f0c2c103470 2024-04-26T20:20:59.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.815+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0c1c02a070 con 0x7f0c2c103470 2024-04-26T20:20:59.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.816+0000 7f0c23e00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0c100a3cd0 0x7f0c100a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.817+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0c1c0d17b0 con 0x7f0c2c103470 2024-04-26T20:20:59.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:20:59 smithi082 ceph-mon[28105]: pgmap v357: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 281 B/s wr, 11 op/s; 10 B/s, 0 objects/s recovering 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.817+0000 7f0c2aa00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0c100a3cd0 0x7f0c100a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.817+0000 7f0c23e00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] conn(0x7f0c100aee30 0x7f0c100b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.817+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 --> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c100b19a0 con 0x7f0c100aee30 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.817+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f0c1c0d1b60 con 0x7f0c2c103470 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.817+0000 7f0c2be00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] conn(0x7f0c100aee30 0x7f0c100b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.818+0000 7f0c2aa00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0c100a3cd0 0x7f0c100a6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c07ae10 tx=0x7f0c18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.818+0000 7f0c2be00700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] conn(0x7f0c100aee30 0x7f0c100b12d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.819+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== osd.3 v2:172.21.15.82:6810/825292228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c100b19a0 con 0x7f0c100aee30 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.841+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 --> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c2c063ff0 con 0x7f0c100aee30 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.842+0000 7f0c23e00700 1 -- 172.21.15.82:0/1072162152 <== osd.3 v2:172.21.15.82:6810/825292228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0c2c063ff0 con 0x7f0c100aee30 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.842+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] conn(0x7f0c100aee30 msgr2=0x7f0c100b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.842+0000 7f0c32400700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] conn(0x7f0c100aee30 0x7f0c100b12d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.842+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0c100a3cd0 msgr2=0x7f0c100a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.842+0000 7f0c32400700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0c100a3cd0 0x7f0c100a6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c07ae10 tx=0x7f0c18009260 comp rx=0 tx=0).stop 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.842+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c103470 msgr2=0x7f0c2c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.843+0000 7f0c32400700 1 --2- 172.21.15.82:0/1072162152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c2c103470 0x7f0c2c19bd40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000c00 tx=0x7f0c1c0057c0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.843+0000 7f0c2be00700 1 -- 172.21.15.82:0/1072162152 reap_dead start 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.843+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 shutdown_connections 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.843+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 >> 172.21.15.82:0/1072162152 conn(0x7f0c2c07a580 msgr2=0x7f0c2c10e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.843+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 shutdown_connections 2024-04-26T20:20:59.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.843+0000 7f0c32400700 1 -- 172.21.15.82:0/1072162152 wait complete. 2024-04-26T20:21:00.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:20:59 smithi139 ceph-mon[32999]: pgmap v357: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 281 B/s wr, 11 op/s; 10 B/s, 0 objects/s recovering 2024-04-26T20:21:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:20:59 smithi135 ceph-mon[32816]: pgmap v357: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 281 B/s wr, 11 op/s; 10 B/s, 0 objects/s recovering 2024-04-26T20:21:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:00 smithi082 ceph-mon[28105]: pgmap v358: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-04-26T20:21:01.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:00 smithi139 ceph-mon[32999]: pgmap v358: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-04-26T20:21:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:00 smithi135 ceph-mon[32816]: pgmap v358: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-04-26T20:21:01.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.244+0000 7fd568000700 1 -- 172.21.15.82:0/2825426033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 msgr2=0x7fd56006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.244+0000 7fd568000700 1 --2- 172.21.15.82:0/2825426033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56006b590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009990 tx=0x7fd54c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 -- 172.21.15.82:0/2825426033 shutdown_connections 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 --2- 172.21.15.82:0/2825426033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd56006bad0 0x7fd5601102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 --2- 172.21.15.82:0/2825426033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5601094a0 0x7fd560109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 --2- 172.21.15.82:0/2825426033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56006b590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 -- 172.21.15.82:0/2825426033 >> 172.21.15.82:0/2825426033 conn(0x7fd5600792d0 msgr2=0x7fd5600796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 -- 172.21.15.82:0/2825426033 shutdown_connections 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.245+0000 7fd568000700 1 -- 172.21.15.82:0/2825426033 wait complete. 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.246+0000 7fd568000700 1 Processor -- start 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.246+0000 7fd568000700 1 -- start start 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd568000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd568000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd56006bad0 0x7fd56019c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd568000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5601094a0 0x7fd5601a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd568000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5601135b0 con 0x7fd5601094a0 2024-04-26T20:21:01.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd568000700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd560113430 con 0x7fd56006bad0 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd568000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd560113730 con 0x7fd56006b130 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd565600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd566000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5601094a0 0x7fd5601a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd565600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:35684/0 (socket says 172.21.15.82:35684) 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd565600700 1 -- 172.21.15.82:0/1436923723 learned_addr learned my addr 172.21.15.82:0/1436923723 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.247+0000 7fd564c00700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd56006bad0 0x7fd56019c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd565600700 1 -- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd56006bad0 msgr2=0x7fd56019c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd565600700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd56006bad0 0x7fd56019c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd565600700 1 -- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5601094a0 msgr2=0x7fd5601a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd565600700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5601094a0 0x7fd5601a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd565600700 1 -- 172.21.15.82:0/1436923723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5601a0d20 con 0x7fd56006b130 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd565600700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56019bd10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd55400e9a0 tx=0x7fd55400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55400ca10 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd55400cbb0 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554018680 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5601a1010 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.248+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5601a8890 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.249+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd560063bb0 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.251+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd554010430 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.253+0000 7fd55e000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5480a3d50 0x7fd5480a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.253+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd5540d0a90 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.253+0000 7fd564c00700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5480a3d50 0x7fd5480a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.253+0000 7fd55e000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] conn(0x7fd5480aeeb0 0x7fd5480b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.253+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 --> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd55401ce70 con 0x7fd5480aeeb0 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.253+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fd5540d0e40 con 0x7fd56006b130 2024-04-26T20:21:01.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.254+0000 7fd566000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] conn(0x7fd5480aeeb0 0x7fd5480b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.254+0000 7fd564c00700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5480a3d50 0x7fd5480a6210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0098e0 tx=0x7fd54c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.254+0000 7fd566000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] conn(0x7fd5480aeeb0 0x7fd5480b1350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.255+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== osd.1 v2:172.21.15.135:6800/3571001062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd55401ce70 con 0x7fd5480aeeb0 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.273+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 --> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd560064080 con 0x7fd5480aeeb0 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.274+0000 7fd55e000700 1 -- 172.21.15.82:0/1436923723 <== osd.1 v2:172.21.15.135:6800/3571001062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd560064080 con 0x7fd5480aeeb0 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] conn(0x7fd5480aeeb0 msgr2=0x7fd5480b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] conn(0x7fd5480aeeb0 0x7fd5480b1350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5480a3d50 msgr2=0x7fd5480a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd5480a3d50 0x7fd5480a6210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0098e0 tx=0x7fd54c005960 comp rx=0 tx=0).stop 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 msgr2=0x7fd56019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 --2- 172.21.15.82:0/1436923723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd56006b130 0x7fd56019bd10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd55400e9a0 tx=0x7fd55400ecb0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd566000700 1 -- 172.21.15.82:0/1436923723 reap_dead start 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 shutdown_connections 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 >> 172.21.15.82:0/1436923723 conn(0x7fd5600792d0 msgr2=0x7fd56010e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.275+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 shutdown_connections 2024-04-26T20:21:01.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:01.276+0000 7fd568000700 1 -- 172.21.15.82:0/1436923723 wait complete. 2024-04-26T20:21:01.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 -- 172.21.15.82:0/2450310638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 msgr2=0x7fe28006bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 --2- 172.21.15.82:0/2450310638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe28006bad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009990 tx=0x7fe26c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 -- 172.21.15.82:0/2450310638 shutdown_connections 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 --2- 172.21.15.82:0/2450310638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe280105e60 0x7fe2801062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 --2- 172.21.15.82:0/2450310638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe280108350 0x7fe28006b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 --2- 172.21.15.82:0/2450310638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe28006bad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 -- 172.21.15.82:0/2450310638 >> 172.21.15.82:0/2450310638 conn(0x7fe2800792d0 msgr2=0x7fe2800796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 -- 172.21.15.82:0/2450310638 shutdown_connections 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.892+0000 7fe287000700 1 -- 172.21.15.82:0/2450310638 wait complete. 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.893+0000 7fe287000700 1 Processor -- start 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.893+0000 7fe287000700 1 -- start start 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe287000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe2801a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe287000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe280105e60 0x7fe2801a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe287000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe280108350 0x7fe2801a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe287000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe280119c00 con 0x7fe280105e60 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe287000700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe280119a80 con 0x7fe280108350 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe287000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe280119d80 con 0x7fe28006b670 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe27fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe2801a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe285000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe280108350 0x7fe2801a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe27fe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe2801a0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43618/0 (socket says 172.21.15.82:43618) 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe27fe00700 1 -- 172.21.15.82:0/1177830844 learned_addr learned my addr 172.21.15.82:0/1177830844 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.894+0000 7fe27f400700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe280105e60 0x7fe2801a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27fe00700 1 -- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe280108350 msgr2=0x7fe2801a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27fe00700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe280108350 0x7fe2801a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27fe00700 1 -- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe280105e60 msgr2=0x7fe2801a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27fe00700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe280105e60 0x7fe2801a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27fe00700 1 -- 172.21.15.82:0/1177830844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2801a5160 con 0x7fe28006b670 2024-04-26T20:21:01.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe285000700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe280108350 0x7fe2801a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27fe00700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe2801a0150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e9a0 tx=0x7fe27000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.895+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27000ca10 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.896+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe27000cbb0 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.896+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2801a5450 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.896+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270018680 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.896+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2801accd0 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.897+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe280105820 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.899+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe270010430 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.901+0000 7fe27cc00700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2640a3d50 0x7fe2640a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.901+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe2700d0f30 con 0x7fe28006b670 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.901+0000 7fe27cc00700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] conn(0x7fe2640aeeb0 0x7fe2640b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.901+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 --> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe270019ec0 con 0x7fe2640aeeb0 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.901+0000 7fe27f400700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2640a3d50 0x7fe2640a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.901+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe2700d12e0 con 0x7fe28006b670 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.902+0000 7fe285000700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] conn(0x7fe2640aeeb0 0x7fe2640b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.902+0000 7fe285000700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] conn(0x7fe2640aeeb0 0x7fe2640b1350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.902+0000 7fe27f400700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2640a3d50 0x7fe2640a6210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe28006bf20 tx=0x7fe26c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.903+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== osd.10 v2:172.21.15.135:6824/2039734304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe270019ec0 con 0x7fe2640aeeb0 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.921+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 --> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe280102940 con 0x7fe2640aeeb0 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.922+0000 7fe27cc00700 1 -- 172.21.15.82:0/1177830844 <== osd.10 v2:172.21.15.135:6824/2039734304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe280102940 con 0x7fe2640aeeb0 2024-04-26T20:21:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.922+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] conn(0x7fe2640aeeb0 msgr2=0x7fe2640b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.922+0000 7fe287000700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] conn(0x7fe2640aeeb0 0x7fe2640b1350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2640a3d50 msgr2=0x7fe2640a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe2640a3d50 0x7fe2640a6210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe28006bf20 tx=0x7fe26c005fd0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 msgr2=0x7fe2801a0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 --2- 172.21.15.82:0/1177830844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe28006b670 0x7fe2801a0150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e9a0 tx=0x7fe27000ecb0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe285000700 1 -- 172.21.15.82:0/1177830844 reap_dead start 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 shutdown_connections 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 >> 172.21.15.82:0/1177830844 conn(0x7fe2800792d0 msgr2=0x7fe280104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 shutdown_connections 2024-04-26T20:21:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.923+0000 7fe287000700 1 -- 172.21.15.82:0/1177830844 wait complete. 2024-04-26T20:21:02.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 -- 172.21.15.82:0/2161284746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102320 msgr2=0x7fb7241027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 --2- 172.21.15.82:0/2161284746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102320 0x7fb7241027a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb714009990 tx=0x7fb714009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 -- 172.21.15.82:0/2161284746 shutdown_connections 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 --2- 172.21.15.82:0/2161284746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102ce0 0x7fb72410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 --2- 172.21.15.82:0/2161284746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb724108390 0x7fb724108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 --2- 172.21.15.82:0/2161284746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102320 0x7fb7241027a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 -- 172.21.15.82:0/2161284746 >> 172.21.15.82:0/2161284746 conn(0x7fb7240792d0 msgr2=0x7fb7240796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 -- 172.21.15.82:0/2161284746 shutdown_connections 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.992+0000 7fb72c800700 1 -- 172.21.15.82:0/2161284746 wait complete. 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.993+0000 7fb72c800700 1 Processor -- start 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 -- start start 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102320 0x7fb72419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102ce0 0x7fb72419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:02.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb724108390 0x7fb724199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb724112500 con 0x7fb724102ce0 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb724112380 con 0x7fb724108390 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72c800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb724112680 con 0x7fb724102320 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb729e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102320 0x7fb72419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb729400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102ce0 0x7fb72419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb729e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102320 0x7fb72419f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43624/0 (socket says 172.21.15.82:43624) 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb729e00700 1 -- 172.21.15.82:0/693440982 learned_addr learned my addr 172.21.15.82:0/693440982 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.994+0000 7fb72a800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb724108390 0x7fb724199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb729e00700 1 -- 172.21.15.82:0/693440982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb724108390 msgr2=0x7fb724199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb729e00700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb724108390 0x7fb724199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb729e00700 1 -- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102ce0 msgr2=0x7fb72419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb729e00700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb724102ce0 0x7fb72419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb729e00700 1 -- 172.21.15.82:0/693440982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72419a0b0 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb72a800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb724108390 0x7fb724199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb729e00700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102320 0x7fb72419f790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb71800eb30 tx=0x7fb71800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71800cc90 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7180044d0 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72419a3a0 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718010430 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.995+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7241a6660 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.996+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb72406b450 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.998+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb718003ea0 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:20:59.999+0000 7fb71ea00700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb70c0a3cd0 0x7fb70c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.000+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb7180d0d60 con 0x7fb724102320 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.000+0000 7fb729400700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb70c0a3cd0 0x7fb70c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:02.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.000+0000 7fb71ea00700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] conn(0x7fb70c0aee30 0x7fb70c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.000+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 --> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb70c0b19a0 con 0x7fb70c0aee30 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.000+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb7180d1110 con 0x7fb724102320 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.000+0000 7fb72a800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] conn(0x7fb70c0aee30 0x7fb70c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.001+0000 7fb729400700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb70c0a3cd0 0x7fb70c0a6190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb72406c1e0 tx=0x7fb714005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.001+0000 7fb72a800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] conn(0x7fb70c0aee30 0x7fb70c0b12d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.002+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== osd.6 v2:172.21.15.82:6818/3682218709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb70c0b19a0 con 0x7fb70c0aee30 2024-04-26T20:21:02.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.019+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 --> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb724103a40 con 0x7fb70c0aee30 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.020+0000 7fb71ea00700 1 -- 172.21.15.82:0/693440982 <== osd.6 v2:172.21.15.82:6818/3682218709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb724103a40 con 0x7fb70c0aee30 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] conn(0x7fb70c0aee30 msgr2=0x7fb70c0b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] conn(0x7fb70c0aee30 0x7fb70c0b12d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb70c0a3cd0 msgr2=0x7fb70c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb70c0a3cd0 0x7fb70c0a6190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb72406c1e0 tx=0x7fb714005fd0 comp rx=0 tx=0).stop 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102320 msgr2=0x7fb72419f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 --2- 172.21.15.82:0/693440982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb724102320 0x7fb72419f790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb71800eb30 tx=0x7fb71800ee40 comp rx=0 tx=0).stop 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72a800700 1 -- 172.21.15.82:0/693440982 reap_dead start 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 shutdown_connections 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 >> 172.21.15.82:0/693440982 conn(0x7fb7240792d0 msgr2=0x7fb724106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 shutdown_connections 2024-04-26T20:21:02.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:00.021+0000 7fb72c800700 1 -- 172.21.15.82:0/693440982 wait complete. 2024-04-26T20:21:03.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 -- 172.21.15.82:0/991143506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa000757c0 msgr2=0x7ffa00075ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 --2- 172.21.15.82:0/991143506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa000757c0 0x7ffa00075ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009990 tx=0x7ff9f0009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 -- 172.21.15.82:0/991143506 shutdown_connections 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 --2- 172.21.15.82:0/991143506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00114360 0x7ffa00116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 --2- 172.21.15.82:0/991143506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa000757c0 0x7ffa00075ba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 --2- 172.21.15.82:0/991143506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa000760e0 0x7ffa00113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 -- 172.21.15.82:0/991143506 >> 172.21.15.82:0/991143506 conn(0x7ffa000feea0 msgr2=0x7ffa001012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.384+0000 7ffa04c00700 1 -- 172.21.15.82:0/991143506 shutdown_connections 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.385+0000 7ffa04c00700 1 -- 172.21.15.82:0/991143506 wait complete. 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 Processor -- start 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 -- start start 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa000757c0 0x7ffa001a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa000760e0 0x7ffa001a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00114360 0x7ffa001a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00119b90 con 0x7ffa000760e0 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00119a10 con 0x7ffa000757c0 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.386+0000 7ffa04c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00119d10 con 0x7ffa00114360 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa000760e0 0x7ffa001a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa000760e0 0x7ffa001a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32786/0 (socket says 172.21.15.82:32786) 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 -- 172.21.15.82:0/1318920772 learned_addr learned my addr 172.21.15.82:0/1318920772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9ff400700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa000757c0 0x7ffa001a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9ffe00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00114360 0x7ffa001a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 -- 172.21.15.82:0/1318920772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00114360 msgr2=0x7ffa001a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00114360 0x7ffa001a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 -- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa000757c0 msgr2=0x7ffa001a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa000757c0 0x7ffa001a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 -- 172.21.15.82:0/1318920772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa001a5100 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.387+0000 7ff9f6a00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa000760e0 0x7ffa001a0680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e9c0 tx=0x7ff9e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.388+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800cbd0 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.388+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa001a53f0 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.388+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e800ee60 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.388+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80055c0 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.388+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa001acc70 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.389+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa00063b30 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.391+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff9e8004750 con 0x7ffa000760e0 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.392+0000 7ff9fcc00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e40a3d50 0x7ff9e40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.393+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff9e80d0f30 con 0x7ffa000760e0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.393+0000 7ff9ff400700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e40a3d50 0x7ff9e40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.393+0000 7ff9fcc00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] conn(0x7ff9e40aeeb0 0x7ff9e40b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.393+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 --> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9e40b1a20 con 0x7ff9e40aeeb0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.393+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7ff9e80d12e0 con 0x7ffa000760e0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.394+0000 7ff9ff400700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e40a3d50 0x7ff9e40a6210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006010 tx=0x7ff9f000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.394+0000 7ff9ffe00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] conn(0x7ff9e40aeeb0 0x7ff9e40b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.394+0000 7ff9ffe00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] conn(0x7ff9e40aeeb0 0x7ff9e40b1350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.395+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== osd.7 v2:172.21.15.135:6816/1349628889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9e40b1a20 con 0x7ff9e40aeeb0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.413+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 --> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa00063fb0 con 0x7ff9e40aeeb0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.414+0000 7ff9fcc00700 1 -- 172.21.15.82:0/1318920772 <== osd.7 v2:172.21.15.135:6816/1349628889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffa00063fb0 con 0x7ff9e40aeeb0 2024-04-26T20:21:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.414+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] conn(0x7ff9e40aeeb0 msgr2=0x7ff9e40b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.414+0000 7ffa04c00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] conn(0x7ff9e40aeeb0 0x7ff9e40b1350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e40a3d50 msgr2=0x7ff9e40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e40a3d50 0x7ff9e40a6210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006010 tx=0x7ff9f000b260 comp rx=0 tx=0).stop 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa000760e0 msgr2=0x7ffa001a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 --2- 172.21.15.82:0/1318920772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa000760e0 0x7ffa001a0680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e9c0 tx=0x7ff9e800ecd0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ff9ffe00700 1 -- 172.21.15.82:0/1318920772 reap_dead start 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 shutdown_connections 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 >> 172.21.15.82:0/1318920772 conn(0x7ffa000feea0 msgr2=0x7ffa001006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 shutdown_connections 2024-04-26T20:21:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:03.415+0000 7ffa04c00700 1 -- 172.21.15.82:0/1318920772 wait complete. 2024-04-26T20:21:03.908 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:03 smithi082 ceph-mon[28105]: pgmap v359: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:03 smithi139 ceph-mon[32999]: pgmap v359: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:04.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:03 smithi135 ceph-mon[32816]: pgmap v359: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:05.050 INFO:teuthology.orchestra.run.smithi082.stdout:55834574933 2024-04-26T20:21:05.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T20:21:05.747 INFO:teuthology.orchestra.run.smithi082.stdout:141733920832 2024-04-26T20:21:05.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T20:21:05.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:05 smithi082 ceph-mon[28105]: pgmap v360: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:21:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:197568495673 2024-04-26T20:21:06.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-26T20:21:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:05 smithi139 ceph-mon[32999]: pgmap v360: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:21:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:05 smithi135 ceph-mon[32816]: pgmap v360: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:21:06.970 INFO:teuthology.orchestra.run.smithi082.stdout:107374182475 2024-04-26T20:21:06.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T20:21:07.403 INFO:teuthology.orchestra.run.smithi082.stdout:309237645344 2024-04-26T20:21:07.403 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-26T20:21:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 -- 172.21.15.82:0/3483194347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da4104e80 msgr2=0x7f2da410d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 --2- 172.21.15.82:0/3483194347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da4104e80 0x7f2da410d370 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d900098f0 tx=0x7f2d90009c00 comp rx=0 tx=0).stop 2024-04-26T20:21:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 -- 172.21.15.82:0/3483194347 shutdown_connections 2024-04-26T20:21:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 --2- 172.21.15.82:0/3483194347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da410d990 0x7f2da410fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 --2- 172.21.15.82:0/3483194347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da4104560 0x7f2da4104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 --2- 172.21.15.82:0/3483194347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da4104e80 0x7f2da410d370 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 -- 172.21.15.82:0/3483194347 >> 172.21.15.82:0/3483194347 conn(0x7f2da40fddb0 msgr2=0x7f2da41001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 -- 172.21.15.82:0/3483194347 shutdown_connections 2024-04-26T20:21:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.628+0000 7f2da3200700 1 -- 172.21.15.82:0/3483194347 wait complete. 2024-04-26T20:21:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.629+0000 7f2da3200700 1 Processor -- start 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.629+0000 7f2da3200700 1 -- start start 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da4104560 0x7f2da419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da3200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da4104e80 0x7f2da419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da3200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da410d990 0x7f2da4199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41135b0 con 0x7f2da4104560 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da3200700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2da4113430 con 0x7f2da4104e80 2024-04-26T20:21:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da3200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2da4113730 con 0x7f2da410d990 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da4104560 0x7f2da419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da4104560 0x7f2da419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32814/0 (socket says 172.21.15.82:32814) 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da1e00700 1 -- 172.21.15.82:0/1644090939 learned_addr learned my addr 172.21.15.82:0/1644090939 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.630+0000 7f2da2800700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da410d990 0x7f2da4199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da1400700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da4104e80 0x7f2da419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da2800700 1 -- 172.21.15.82:0/1644090939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da4104e80 msgr2=0x7f2da419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da2800700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da4104e80 0x7f2da419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da2800700 1 -- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da4104560 msgr2=0x7f2da419f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da2800700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da4104560 0x7f2da419f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da2800700 1 -- 172.21.15.82:0/1644090939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da419a180 con 0x7f2da410d990 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.631+0000 7f2da2800700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da410d990 0x7f2da4199a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009cd0 tx=0x7f2d9c00b3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.632+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c003a00 con 0x7f2da410d990 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.632+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d9c014030 con 0x7f2da410d990 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.632+0000 7f2da3200700 1 -- 172.21.15.82:0/1644090939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da419a470 con 0x7f2da410d990 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.632+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c004450 con 0x7f2da410d990 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.632+0000 7f2da3200700 1 -- 172.21.15.82:0/1644090939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da41020f0 con 0x7f2da410d990 2024-04-26T20:21:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.633+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d7c001030 con 0x7f2da410d990 2024-04-26T20:21:07.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.635+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2d9c003ba0 con 0x7f2da410d990 2024-04-26T20:21:07.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.636+0000 7f2d9aa00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2d880a3d50 0x7f2d880a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.636+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2d9c0d03c0 con 0x7f2da410d990 2024-04-26T20:21:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.637+0000 7f2da1e00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2d880a3d50 0x7f2d880a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.637+0000 7f2d9aa00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] conn(0x7f2d880aeeb0 0x7f2d880b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.637+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 --> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d880b1a20 con 0x7f2d880aeeb0 2024-04-26T20:21:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.637+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f2d9c0d0770 con 0x7f2da410d990 2024-04-26T20:21:07.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.637+0000 7f2da1400700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] conn(0x7f2d880aeeb0 0x7f2d880b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:07.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.638+0000 7f2da1e00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2d880a3d50 0x7f2d880a6210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2da4101670 tx=0x7f2d94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:07.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.638+0000 7f2da1400700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] conn(0x7f2d880aeeb0 0x7f2d880b1350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:07.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.640+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== osd.0 v2:172.21.15.82:6802/4190226369 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d880b1a20 con 0x7f2d880aeeb0 2024-04-26T20:21:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.658+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 --> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d7c002e60 con 0x7f2d880aeeb0 2024-04-26T20:21:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d9aa00700 1 -- 172.21.15.82:0/1644090939 <== osd.0 v2:172.21.15.82:6802/4190226369 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2d7c002e60 con 0x7f2d880aeeb0 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] conn(0x7f2d880aeeb0 msgr2=0x7f2d880b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d8fe00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] conn(0x7f2d880aeeb0 0x7f2d880b1350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2d880a3d50 msgr2=0x7f2d880a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d8fe00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2d880a3d50 0x7f2d880a6210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2da4101670 tx=0x7f2d94009260 comp rx=0 tx=0).stop 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da410d990 msgr2=0x7f2da4199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2d8fe00700 1 --2- 172.21.15.82:0/1644090939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da410d990 0x7f2da4199a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009cd0 tx=0x7f2d9c00b3e0 comp rx=0 tx=0).stop 2024-04-26T20:21:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.659+0000 7f2da2800700 1 -- 172.21.15.82:0/1644090939 reap_dead start 2024-04-26T20:21:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.660+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 shutdown_connections 2024-04-26T20:21:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.660+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 >> 172.21.15.82:0/1644090939 conn(0x7f2da40fddb0 msgr2=0x7f2da40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.660+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 shutdown_connections 2024-04-26T20:21:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:07.660+0000 7f2d8fe00700 1 -- 172.21.15.82:0/1644090939 wait complete. 2024-04-26T20:21:07.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:07 smithi082 ceph-mon[28105]: pgmap v361: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:07 smithi139 ceph-mon[32999]: pgmap v361: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:07 smithi135 ceph-mon[32816]: pgmap v361: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:08.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 -- 172.21.15.82:0/1222370718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc1034b0 msgr2=0x7f81bc103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1222370718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc1034b0 0x7f81bc103930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81a80099c0 tx=0x7f81a8009cd0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 -- 172.21.15.82:0/1222370718 shutdown_connections 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1222370718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc103e70 0x7f81bc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1222370718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81bc109550 0x7f81bc109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1222370718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc1034b0 0x7f81bc103930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 -- 172.21.15.82:0/1222370718 >> 172.21.15.82:0/1222370718 conn(0x7f81bc07a610 msgr2=0x7f81bc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:08.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 -- 172.21.15.82:0/1222370718 shutdown_connections 2024-04-26T20:21:08.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.666+0000 7f81c1c00700 1 -- 172.21.15.82:0/1222370718 wait complete. 2024-04-26T20:21:08.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.668+0000 7f81c1c00700 1 Processor -- start 2024-04-26T20:21:08.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.668+0000 7f81c1c00700 1 -- start start 2024-04-26T20:21:08.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81c1c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81bc1034b0 0x7f81bc112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81c1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc103e70 0x7f81bc1125d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81baa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81bc1034b0 0x7f81bc112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81baa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81bc1034b0 0x7f81bc112090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:35742/0 (socket says 172.21.15.82:35742) 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81c1c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc109550 0x7f81bc112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81c1c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc076cc0 con 0x7f81bc103e70 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.670+0000 7f81bb400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc109550 0x7f81bc112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.670+0000 7f81bb400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc109550 0x7f81bc112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59446/0 (socket says 172.21.15.82:59446) 2024-04-26T20:21:08.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.670+0000 7f81bb400700 1 -- 172.21.15.82:0/1942410896 learned_addr learned my addr 172.21.15.82:0/1942410896 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:08.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.669+0000 7f81c1c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc076b40 con 0x7f81bc109550 2024-04-26T20:21:08.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.670+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc076e40 con 0x7f81bc1034b0 2024-04-26T20:21:08.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.670+0000 7f81ba000700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc103e70 0x7f81bc1125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.671+0000 7f81bb400700 1 -- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81bc1034b0 msgr2=0x7f81bc112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.671+0000 7f81bb400700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81bc1034b0 0x7f81bc112090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.671+0000 7f81bb400700 1 -- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc103e70 msgr2=0x7f81bc1125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.671+0000 7f81bb400700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc103e70 0x7f81bc1125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.671+0000 7f81bb400700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc0739b0 con 0x7f81bc109550 2024-04-26T20:21:08.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.671+0000 7f81ba000700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81bc103e70 0x7f81bc1125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:08.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.672+0000 7f81bb400700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc109550 0x7f81bc112b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f81b400ef30 tx=0x7f81b400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:08.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.672+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40092e0 con 0x7f81bc109550 2024-04-26T20:21:08.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.672+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc073c40 con 0x7f81bc109550 2024-04-26T20:21:08.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.672+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc074150 con 0x7f81bc109550 2024-04-26T20:21:08.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.673+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b4004bb0 con 0x7f81bc109550 2024-04-26T20:21:08.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.673+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4004280 con 0x7f81bc109550 2024-04-26T20:21:08.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.674+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f819c001030 con 0x7f81bc109550 2024-04-26T20:21:08.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.675+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f81b401b030 con 0x7f81bc109550 2024-04-26T20:21:08.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.677+0000 7f81b3400700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81a00a3d50 0x7f81a00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.678+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f81b40d0340 con 0x7f81bc109550 2024-04-26T20:21:08.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.678+0000 7f81b3400700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] conn(0x7f81a00aeeb0 0x7f81a00b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.678+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81a00b1a20 con 0x7f81a00aeeb0 2024-04-26T20:21:08.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.678+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f81b40d7050 con 0x7f81bc109550 2024-04-26T20:21:08.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.679+0000 7f81ba000700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] conn(0x7f81a00aeeb0 0x7f81a00b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.679+0000 7f81baa00700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81a00a3d50 0x7f81a00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.680+0000 7f81baa00700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81a00a3d50 0x7f81a00a6210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009680 tx=0x7f81ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:08.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.682+0000 7f81ba000700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] conn(0x7f81a00aeeb0 0x7f81a00b1350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:08.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.683+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== osd.11 v2:172.21.15.139:6824/3441375254 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81a00b1a20 con 0x7f81a00aeeb0 2024-04-26T20:21:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.702+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 --> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f819c002e60 con 0x7f81a00aeeb0 2024-04-26T20:21:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.703+0000 7f81b3400700 1 -- 172.21.15.82:0/1942410896 <== osd.11 v2:172.21.15.139:6824/3441375254 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f819c002e60 con 0x7f81a00aeeb0 2024-04-26T20:21:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.703+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] conn(0x7f81a00aeeb0 msgr2=0x7f81a00b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.703+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] conn(0x7f81a00aeeb0 0x7f81a00b1350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81a00a3d50 msgr2=0x7f81a00a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81a00a3d50 0x7f81a00a6210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009680 tx=0x7f81ac009260 comp rx=0 tx=0).stop 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc109550 msgr2=0x7f81bc112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 --2- 172.21.15.82:0/1942410896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81bc109550 0x7f81bc112b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f81b400ef30 tx=0x7f81b400c3a0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81bb400700 1 -- 172.21.15.82:0/1942410896 reap_dead start 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 shutdown_connections 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 >> 172.21.15.82:0/1942410896 conn(0x7f81bc07a610 msgr2=0x7f81bc107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 shutdown_connections 2024-04-26T20:21:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:08.704+0000 7f81c1c00700 1 -- 172.21.15.82:0/1942410896 wait complete. 2024-04-26T20:21:09.182 INFO:teuthology.orchestra.run.smithi082.stdout:219043332148 2024-04-26T20:21:09.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 -- 172.21.15.82:0/3392830356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075650 msgr2=0x7fb150075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 --2- 172.21.15.82:0/3392830356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075650 0x7fb150075a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098f0 tx=0x7fb140009c00 comp rx=0 tx=0).stop 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 -- 172.21.15.82:0/3392830356 shutdown_connections 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 --2- 172.21.15.82:0/3392830356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb15010fe20 0x7fb150112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 --2- 172.21.15.82:0/3392830356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075650 0x7fb150075a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 --2- 172.21.15.82:0/3392830356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb150075f70 0x7fb15010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 -- 172.21.15.82:0/3392830356 >> 172.21.15.82:0/3392830356 conn(0x7fb15007a5d0 msgr2=0x7fb15007a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 -- 172.21.15.82:0/3392830356 shutdown_connections 2024-04-26T20:21:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.450+0000 7fb154a00700 1 -- 172.21.15.82:0/3392830356 wait complete. 2024-04-26T20:21:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.451+0000 7fb154a00700 1 Processor -- start 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.451+0000 7fb154a00700 1 -- start start 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb154a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb150075650 0x7fb15019be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb154a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075f70 0x7fb15019c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb154a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb15010fe20 0x7fb1501a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb154a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501158b0 con 0x7fb150075650 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb154a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb150115730 con 0x7fb150075f70 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb154a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb150115a30 con 0x7fb15010fe20 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb14de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb150075650 0x7fb15019be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb14d400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075f70 0x7fb15019c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb14e800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb15010fe20 0x7fb1501a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb14d400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075f70 0x7fb15019c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59458/0 (socket says 172.21.15.82:59458) 2024-04-26T20:21:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb14d400700 1 -- 172.21.15.82:0/2119159932 learned_addr learned my addr 172.21.15.82:0/2119159932 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.452+0000 7fb14de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb150075650 0x7fb15019be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32860/0 (socket says 172.21.15.82:32860) 2024-04-26T20:21:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14d400700 1 -- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb15010fe20 msgr2=0x7fb1501a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14d400700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb15010fe20 0x7fb1501a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14d400700 1 -- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb150075650 msgr2=0x7fb15019be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14d400700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb150075650 0x7fb15019be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14d400700 1 -- 172.21.15.82:0/2119159932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1501a0e40 con 0x7fb150075f70 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14de00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb150075650 0x7fb15019be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb14d400700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075f70 0x7fb15019c370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e9c0 tx=0x7fb13c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00ee60 con 0x7fb150075f70 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb13c004ce0 con 0x7fb150075f70 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1501a1130 con 0x7fb150075f70 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.453+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c005280 con 0x7fb150075f70 2024-04-26T20:21:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.455+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb150103470 con 0x7fb150075f70 2024-04-26T20:21:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.455+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb150063bb0 con 0x7fb150075f70 2024-04-26T20:21:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.457+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb13c00c850 con 0x7fb150075f70 2024-04-26T20:21:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.459+0000 7fb146a00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb1340a3d50 0x7fb1340a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.459+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb13c0d8f30 con 0x7fb150075f70 2024-04-26T20:21:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.459+0000 7fb14de00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb1340a3d50 0x7fb1340a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.460+0000 7fb146a00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] conn(0x7fb1340aeeb0 0x7fb1340b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.460+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 --> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb13c009030 con 0x7fb1340aeeb0 2024-04-26T20:21:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.460+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb13c0db550 con 0x7fb150075f70 2024-04-26T20:21:09.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.460+0000 7fb14e800700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] conn(0x7fb1340aeeb0 0x7fb1340b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:09.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.460+0000 7fb14de00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb1340a3d50 0x7fb1340a6210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098c0 tx=0x7fb140019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:09.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.461+0000 7fb14e800700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] conn(0x7fb1340aeeb0 0x7fb1340b1350 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.462+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== osd.8 v2:172.21.15.139:6816/345848933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb13c009030 con 0x7fb1340aeeb0 2024-04-26T20:21:09.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.481+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 --> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb150064030 con 0x7fb1340aeeb0 2024-04-26T20:21:09.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.482+0000 7fb146a00700 1 -- 172.21.15.82:0/2119159932 <== osd.8 v2:172.21.15.139:6816/345848933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb150064030 con 0x7fb1340aeeb0 2024-04-26T20:21:09.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.482+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] conn(0x7fb1340aeeb0 msgr2=0x7fb1340b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:09.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.482+0000 7fb154a00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] conn(0x7fb1340aeeb0 0x7fb1340b1350 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb1340a3d50 msgr2=0x7fb1340a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb1340a3d50 0x7fb1340a6210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098c0 tx=0x7fb140019040 comp rx=0 tx=0).stop 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075f70 msgr2=0x7fb15019c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 --2- 172.21.15.82:0/2119159932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb150075f70 0x7fb15019c370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e9c0 tx=0x7fb13c00ecd0 comp rx=0 tx=0).stop 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb14e800700 1 -- 172.21.15.82:0/2119159932 reap_dead start 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 shutdown_connections 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 >> 172.21.15.82:0/2119159932 conn(0x7fb15007a5d0 msgr2=0x7fb150100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 shutdown_connections 2024-04-26T20:21:09.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:09.483+0000 7fb154a00700 1 -- 172.21.15.82:0/2119159932 wait complete. 2024-04-26T20:21:09.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:09 smithi082 ceph-mon[28105]: pgmap v362: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-26T20:21:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:09 smithi139 ceph-mon[32999]: pgmap v362: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-26T20:21:10.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:09 smithi135 ceph-mon[32816]: pgmap v362: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-26T20:21:10.340 INFO:teuthology.orchestra.run.smithi082.stdout:343597383709 2024-04-26T20:21:10.341 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-26T20:21:11.528 INFO:teuthology.orchestra.run.smithi082.stdout:34359738460 2024-04-26T20:21:11.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T20:21:11.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:11 smithi082 ceph-mon[28105]: pgmap v363: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:21:12.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:11 smithi139 ceph-mon[32999]: pgmap v363: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:21:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:11 smithi135 ceph-mon[32816]: pgmap v363: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-26T20:21:12.337 INFO:teuthology.orchestra.run.smithi082.stdout:253403070510 2024-04-26T20:21:12.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 -- 172.21.15.82:0/3484183462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f810a320 msgr2=0x7fc2f81167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/3484183462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f810a320 0x7fc2f81167c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009f90 tx=0x7fc2f000b330 comp rx=0 tx=0).stop 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 -- 172.21.15.82:0/3484183462 shutdown_connections 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/3484183462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f810a320 0x7fc2f81167c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/3484183462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 0x7fc2f810ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/3484183462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f8109960 0x7fc2f8109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.055+0000 7fc2f7e00700 1 -- 172.21.15.82:0/3484183462 >> 172.21.15.82:0/3484183462 conn(0x7fc2f80791b0 msgr2=0x7fc2f8108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.056+0000 7fc2f7e00700 1 -- 172.21.15.82:0/3484183462 shutdown_connections 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.056+0000 7fc2f7e00700 1 -- 172.21.15.82:0/3484183462 wait complete. 2024-04-26T20:21:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.057+0000 7fc2f7e00700 1 Processor -- start 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.057+0000 7fc2f7e00700 1 -- start start 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f8109960 0x7fc2f819ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f810a320 0x7fc2f81a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 0x7fc2f81a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8119b50 con 0x7fc2f810e830 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81199d0 con 0x7fc2f810a320 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8119cd0 con 0x7fc2f8109960 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 0x7fc2f81a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 0x7fc2f81a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44810/0 (socket says 172.21.15.82:44810) 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 -- 172.21.15.82:0/2366267263 learned_addr learned my addr 172.21.15.82:0/2366267263 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f6a00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f8109960 0x7fc2f819ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2efe00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f810a320 0x7fc2f81a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 -- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f8109960 msgr2=0x7fc2f819ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2f8109960 0x7fc2f819ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 -- 172.21.15.82:0/2366267263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f810a320 msgr2=0x7fc2f81a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f810a320 0x7fc2f81a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.058+0000 7fc2f7400700 1 -- 172.21.15.82:0/2366267263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f81a4fa0 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2efe00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f810a320 0x7fc2f81a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2f7400700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 0x7fc2f81a4860 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009c10 tx=0x7fc2f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0021070 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f0007ac0 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00052a0 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f81a5230 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.059+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f81acb10 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.060+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2f8063b70 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.062+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc2f0024070 con 0x7fc2f810e830 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.064+0000 7fc2ef400700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2dc0a3cd0 0x7fc2dc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.064+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc2f000f020 con 0x7fc2f810e830 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.064+0000 7fc2f6a00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2dc0a3cd0 0x7fc2dc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.064+0000 7fc2ef400700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] conn(0x7fc2dc0aee30 0x7fc2dc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.064+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 --> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2f0026e50 con 0x7fc2dc0aee30 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.064+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fc2f00d2560 con 0x7fc2f810e830 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.065+0000 7fc2efe00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] conn(0x7fc2dc0aee30 0x7fc2dc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.065+0000 7fc2f6a00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2dc0a3cd0 0x7fc2dc0a6190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005fd0 tx=0x7fc2e8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.065+0000 7fc2efe00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] conn(0x7fc2dc0aee30 0x7fc2dc0b12d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.066+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== osd.2 v2:172.21.15.139:6800/3051837314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2f0026e50 con 0x7fc2dc0aee30 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.084+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 --> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc2f8063ff0 con 0x7fc2dc0aee30 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.085+0000 7fc2ef400700 1 -- 172.21.15.82:0/2366267263 <== osd.2 v2:172.21.15.139:6800/3051837314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc2f8063ff0 con 0x7fc2dc0aee30 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.085+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] conn(0x7fc2dc0aee30 msgr2=0x7fc2dc0b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.085+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] conn(0x7fc2dc0aee30 0x7fc2dc0b12d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2dc0a3cd0 msgr2=0x7fc2dc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc2dc0a3cd0 0x7fc2dc0a6190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005fd0 tx=0x7fc2e8009310 comp rx=0 tx=0).stop 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 msgr2=0x7fc2f81a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 --2- 172.21.15.82:0/2366267263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f810e830 0x7fc2f81a4860 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009c10 tx=0x7fc2f000cd50 comp rx=0 tx=0).stop 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7400700 1 -- 172.21.15.82:0/2366267263 reap_dead start 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 shutdown_connections 2024-04-26T20:21:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 >> 172.21.15.82:0/2366267263 conn(0x7fc2f80791b0 msgr2=0x7fc2f8079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:12.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 shutdown_connections 2024-04-26T20:21:12.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:11.086+0000 7fc2f7e00700 1 -- 172.21.15.82:0/2366267263 wait complete. 2024-04-26T20:21:13.224 INFO:teuthology.orchestra.run.smithi082.stdout:77309411410 2024-04-26T20:21:13.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T20:21:13.286 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:13.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:13 smithi082 ceph-mon[28105]: pgmap v364: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-26T20:21:13.763 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:13 smithi139 ceph-mon[32999]: pgmap v364: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-26T20:21:14.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:13 smithi135 ceph-mon[32816]: pgmap v364: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-26T20:21:14.754 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:15.390 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:15 smithi082 ceph-mon[28105]: pgmap v365: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-04-26T20:21:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:15 smithi139 ceph-mon[32999]: pgmap v365: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-04-26T20:21:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:15 smithi135 ceph-mon[32816]: pgmap v365: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-04-26T20:21:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:17.568 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:17 smithi082 ceph-mon[28105]: pgmap v366: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-26T20:21:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:17 smithi139 ceph-mon[32999]: pgmap v366: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-26T20:21:18.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:17 smithi135 ceph-mon[32816]: pgmap v366: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-26T20:21:18.142 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:19.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:19 smithi082 ceph-mon[28105]: pgmap v367: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-26T20:21:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:19 smithi139 ceph-mon[32999]: pgmap v367: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-26T20:21:20.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:19 smithi135 ceph-mon[32816]: pgmap v367: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-26T20:21:21.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:21 smithi082 ceph-mon[28105]: pgmap v368: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:22.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:21 smithi139 ceph-mon[32999]: pgmap v368: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:22.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:21 smithi135 ceph-mon[32816]: pgmap v368: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:23.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:23 smithi082 ceph-mon[28105]: pgmap v369: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 -- 172.21.15.82:0/2895062579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 msgr2=0x7fc90410ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 --2- 172.21.15.82:0/2895062579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 0x7fc90410ba20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8009990 tx=0x7fc8f8009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 -- 172.21.15.82:0/2895062579 shutdown_connections 2024-04-26T20:21:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 --2- 172.21.15.82:0/2895062579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904106000 0x7fc904112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 --2- 172.21.15.82:0/2895062579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 0x7fc90410ba20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 --2- 172.21.15.82:0/2895062579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc904105640 0x7fc904105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 -- 172.21.15.82:0/2895062579 >> 172.21.15.82:0/2895062579 conn(0x7fc904101130 msgr2=0x7fc904103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.946+0000 7fc90b600700 1 -- 172.21.15.82:0/2895062579 shutdown_connections 2024-04-26T20:21:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.947+0000 7fc90b600700 1 -- 172.21.15.82:0/2895062579 wait complete. 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 Processor -- start 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 -- start start 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 0x7fc9041a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc904106000 0x7fc9041a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 0x7fc90419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc904115870 con 0x7fc904105640 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9041156f0 con 0x7fc90410b640 2024-04-26T20:21:23.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.948+0000 7fc90b600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9041159f0 con 0x7fc904106000 2024-04-26T20:21:23.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 0x7fc9041a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 0x7fc9041a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33684/0 (socket says 172.21.15.82:33684) 2024-04-26T20:21:23.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 -- 172.21.15.82:0/3774540843 learned_addr learned my addr 172.21.15.82:0/3774540843 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:23.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc903e00700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc904106000 0x7fc9041a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc909600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 0x7fc90419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 -- 172.21.15.82:0/3774540843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc904106000 msgr2=0x7fc9041a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc904106000 0x7fc9041a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 -- 172.21.15.82:0/3774540843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 msgr2=0x7fc90419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 0x7fc90419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 -- 172.21.15.82:0/3774540843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90419c2b0 con 0x7fc904105640 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.949+0000 7fc908c00700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 0x7fc9041a1940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8000c00 tx=0x7fc8f80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.950+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8027070 con 0x7fc904105640 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.950+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8f8022470 con 0x7fc904105640 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.950+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90419c540 con 0x7fc904105640 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.950+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8017650 con 0x7fc904105640 2024-04-26T20:21:23.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.950+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9041a8810 con 0x7fc904105640 2024-04-26T20:21:23.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.951+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90406a110 con 0x7fc904105640 2024-04-26T20:21:23.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.954+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc8f802a070 con 0x7fc904105640 2024-04-26T20:21:23.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.955+0000 7fc901600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc8ec0a3cd0 0x7fc8ec0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:23.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.955+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc8f80d1630 con 0x7fc904105640 2024-04-26T20:21:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.955+0000 7fc903e00700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc8ec0a3cd0 0x7fc8ec0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.956+0000 7fc903e00700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc8ec0a3cd0 0x7fc8ec0a6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc904103760 tx=0x7fc8f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:23.958+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc8f8013070 con 0x7fc904105640 2024-04-26T20:21:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:23 smithi139 ceph-mon[32999]: pgmap v369: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:24.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:23 smithi135 ceph-mon[32816]: pgmap v369: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.186+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc90402e490 con 0x7fc904105640 2024-04-26T20:21:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.187+0000 7fc901600700 1 -- 172.21.15.82:0/3774540843 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8f809db80 con 0x7fc904105640 2024-04-26T20:21:24.189 INFO:teuthology.orchestra.run.smithi082.stdout:55834574938 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc8ec0a3cd0 msgr2=0x7fc8ec0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc8ec0a3cd0 0x7fc8ec0a6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc904103760 tx=0x7fc8f0009260 comp rx=0 tx=0).stop 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 msgr2=0x7fc9041a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 0x7fc9041a1940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8000c00 tx=0x7fc8f80057c0 comp rx=0 tx=0).stop 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 shutdown_connections 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc8ec0a3cd0 0x7fc8ec0a6190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc90410b640 0x7fc90419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc904105640 0x7fc9041a1940 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 --2- 172.21.15.82:0/3774540843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc904106000 0x7fc9041a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:24.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 >> 172.21.15.82:0/3774540843 conn(0x7fc904101130 msgr2=0x7fc9041017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:24.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 shutdown_connections 2024-04-26T20:21:24.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:24.190+0000 7fc90b600700 1 -- 172.21.15.82:0/3774540843 wait complete. 2024-04-26T20:21:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:24 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3774540843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T20:21:25.081 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:24 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3774540843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T20:21:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:24 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3774540843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T20:21:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:25 smithi082 ceph-mon[28105]: pgmap v370: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:21:26.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:25 smithi139 ceph-mon[32999]: pgmap v370: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:21:26.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:25 smithi135 ceph-mon[32816]: pgmap v370: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:21:27.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 -- 172.21.15.82:0/708073250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 msgr2=0x7f6b1810fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:27.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 --2- 172.21.15.82:0/708073250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 0x7f6b1810fe30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b080098f0 tx=0x7f6b08009c00 comp rx=0 tx=0).stop 2024-04-26T20:21:27.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 -- 172.21.15.82:0/708073250 shutdown_connections 2024-04-26T20:21:27.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 --2- 172.21.15.82:0/708073250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b1810a410 0x7f6b18116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:27.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 --2- 172.21.15.82:0/708073250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 0x7f6b1810fe30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:27.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 --2- 172.21.15.82:0/708073250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18109a50 0x7f6b18109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:27.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 -- 172.21.15.82:0/708073250 >> 172.21.15.82:0/708073250 conn(0x7f6b18076bf0 msgr2=0x7f6b18108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:27.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 -- 172.21.15.82:0/708073250 shutdown_connections 2024-04-26T20:21:27.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.856+0000 7f6b1d200700 1 -- 172.21.15.82:0/708073250 wait complete. 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.857+0000 7f6b1d200700 1 Processor -- start 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 -- start start 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 0x7f6b181a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b1810a410 0x7f6b181a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 0x7f6b181a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18119c30 con 0x7f6b1810a410 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18119ab0 con 0x7f6b18109a50 2024-04-26T20:21:27.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.858+0000 7f6b1d200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18119db0 con 0x7f6b1810fa50 2024-04-26T20:21:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 0x7f6b181a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 0x7f6b181a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44138/0 (socket says 172.21.15.82:44138) 2024-04-26T20:21:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 -- 172.21.15.82:0/477647126 learned_addr learned my addr 172.21.15.82:0/477647126 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b1810a410 0x7f6b181a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b16800700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 0x7f6b181a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 -- 172.21.15.82:0/477647126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 msgr2=0x7f6b181a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 0x7f6b181a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 -- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b1810a410 msgr2=0x7f6b181a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b1810a410 0x7f6b181a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.859+0000 7f6b15e00700 1 -- 172.21.15.82:0/477647126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b181a5130 con 0x7f6b18109a50 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.860+0000 7f6b15e00700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 0x7f6b181a0120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800f990 tx=0x7f6b0800f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.860+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08027070 con 0x7f6b18109a50 2024-04-26T20:21:27.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.860+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b080055f0 con 0x7f6b18109a50 2024-04-26T20:21:27.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.860+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b181a53c0 con 0x7f6b18109a50 2024-04-26T20:21:27.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.860+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08004930 con 0x7f6b18109a50 2024-04-26T20:21:27.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.860+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b181acca0 con 0x7f6b18109a50 2024-04-26T20:21:27.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.861+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b18111fe0 con 0x7f6b18109a50 2024-04-26T20:21:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.863+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6b0802a070 con 0x7f6b18109a50 2024-04-26T20:21:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.864+0000 7f6b0ea00700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6afc0a3cd0 0x7f6afc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.865+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6b080d1290 con 0x7f6b18109a50 2024-04-26T20:21:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.865+0000 7f6b15400700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6afc0a3cd0 0x7f6afc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:27.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.865+0000 7f6b15400700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6afc0a3cd0 0x7f6afc0a6190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6b18078bc0 tx=0x7f6b04009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:27.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:27.869+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6b0805f060 con 0x7f6b18109a50 2024-04-26T20:21:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:27 smithi082 ceph-mon[28105]: pgmap v371: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:27 smithi139 ceph-mon[32999]: pgmap v371: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:28.112 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574933 got 55834574938 for osd.1 2024-04-26T20:21:28.112 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:28.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.114+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f6b181a1480 con 0x7f6b18109a50 2024-04-26T20:21:28.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.115+0000 7f6b0ea00700 1 -- 172.21.15.82:0/477647126 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b08013030 con 0x7f6b18109a50 2024-04-26T20:21:28.116 INFO:teuthology.orchestra.run.smithi082.stdout:287762808877 2024-04-26T20:21:28.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:27 smithi135 ceph-mon[32816]: pgmap v371: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:28.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.117+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6afc0a3cd0 msgr2=0x7f6afc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.117+0000 7f6b1d200700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6afc0a3cd0 0x7f6afc0a6190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6b18078bc0 tx=0x7f6b04009310 comp rx=0 tx=0).stop 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.117+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 msgr2=0x7f6b181a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.117+0000 7f6b1d200700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 0x7f6b181a0120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800f990 tx=0x7f6b0800f9c0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 shutdown_connections 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b1810fa50 0x7f6b181a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6afc0a3cd0 0x7f6afc0a6190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b18109a50 0x7f6b181a0120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 --2- 172.21.15.82:0/477647126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b1810a410 0x7f6b181a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 >> 172.21.15.82:0/477647126 conn(0x7f6b18076bf0 msgr2=0x7f6b18077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 shutdown_connections 2024-04-26T20:21:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.118+0000 7f6b1d200700 1 -- 172.21.15.82:0/477647126 wait complete. 2024-04-26T20:21:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.346+0000 7fa96e600700 1 -- 172.21.15.82:0/1086763021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 msgr2=0x7fa96810fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.346+0000 7fa96e600700 1 --2- 172.21.15.82:0/1086763021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa96810fe30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa958009990 tx=0x7fa958009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 -- 172.21.15.82:0/1086763021 shutdown_connections 2024-04-26T20:21:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 --2- 172.21.15.82:0/1086763021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa96810a410 0x7fa968116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 --2- 172.21.15.82:0/1086763021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa96810fe30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 --2- 172.21.15.82:0/1086763021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa968109a50 0x7fa968109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 -- 172.21.15.82:0/1086763021 >> 172.21.15.82:0/1086763021 conn(0x7fa968076bf0 msgr2=0x7fa968108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 -- 172.21.15.82:0/1086763021 shutdown_connections 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.347+0000 7fa96e600700 1 -- 172.21.15.82:0/1086763021 wait complete. 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.348+0000 7fa96e600700 1 Processor -- start 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.348+0000 7fa96e600700 1 -- start start 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.348+0000 7fa96e600700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 0x7fa9681a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.348+0000 7fa96e600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa96810a410 0x7fa9681a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa96e600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa9681a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa96e600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa968119c30 con 0x7fa96810fa50 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa96e600700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa968119ab0 con 0x7fa968109a50 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa96e600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa968119db0 con 0x7fa96810a410 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 0x7fa9681a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa9681a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 0x7fa9681a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44156/0 (socket says 172.21.15.82:44156) 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 -- 172.21.15.82:0/3348858240 learned_addr learned my addr 172.21.15.82:0/3348858240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa95fe00700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa96810a410 0x7fa9681a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 -- 172.21.15.82:0/3348858240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa96810a410 msgr2=0x7fa9681a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa96810a410 0x7fa9681a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 -- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 msgr2=0x7fa9681a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa9681a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967400700 1 -- 172.21.15.82:0/3348858240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681a50c0 con 0x7fa968109a50 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.349+0000 7fa967e00700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa9681a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.350+0000 7fa967400700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 0x7fa9681a0100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa958000c00 tx=0x7fa95800bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.350+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958027070 con 0x7fa968109a50 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.350+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa958022470 con 0x7fa968109a50 2024-04-26T20:21:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.350+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958017650 con 0x7fa968109a50 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.350+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9681a5350 con 0x7fa968109a50 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.350+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9681acc30 con 0x7fa968109a50 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.351+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa968111fe0 con 0x7fa968109a50 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.353+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa95802a070 con 0x7fa968109a50 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.355+0000 7fa964c00700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa94c0a3d50 0x7fa94c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.355+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa9580d1750 con 0x7fa968109a50 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.355+0000 7fa95fe00700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa94c0a3d50 0x7fa94c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.356+0000 7fa95fe00700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa94c0a3d50 0x7fa94c0a6210 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa950009680 tx=0x7fa950009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:28.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.357+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa958013070 con 0x7fa968109a50 2024-04-26T20:21:28.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.585+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa9681a1410 con 0x7fa968109a50 2024-04-26T20:21:28.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.586+0000 7fa964c00700 1 -- 172.21.15.82:0/3348858240 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa95809dca0 con 0x7fa968109a50 2024-04-26T20:21:28.588 INFO:teuthology.orchestra.run.smithi082.stdout:253403070514 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa94c0a3d50 msgr2=0x7fa94c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa94c0a3d50 0x7fa94c0a6210 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa950009680 tx=0x7fa950009260 comp rx=0 tx=0).stop 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 msgr2=0x7fa9681a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 0x7fa9681a0100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa958000c00 tx=0x7fa95800bfd0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 shutdown_connections 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96810fa50 0x7fa9681a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa94c0a3d50 0x7fa94c0a6210 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.589+0000 7fa96e600700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa968109a50 0x7fa9681a0100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.590+0000 7fa96e600700 1 --2- 172.21.15.82:0/3348858240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa96810a410 0x7fa9681a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.590+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 >> 172.21.15.82:0/3348858240 conn(0x7fa968076bf0 msgr2=0x7fa968077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.590+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 shutdown_connections 2024-04-26T20:21:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.590+0000 7fa96e600700 1 -- 172.21.15.82:0/3348858240 wait complete. 2024-04-26T20:21:28.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:28 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/477647126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T20:21:28.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:28 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3348858240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T20:21:29.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:28 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/477647126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T20:21:29.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:28 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3348858240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T20:21:29.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:28 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/477647126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T20:21:29.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:28 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3348858240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T20:21:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:29 smithi082 ceph-mon[28105]: pgmap v372: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:21:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:29 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2368527362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T20:21:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:29 smithi139 ceph-mon[32999]: pgmap v372: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:21:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:29 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2368527362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T20:21:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:29 smithi135 ceph-mon[32816]: pgmap v372: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:21:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:29 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2368527362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T20:21:30.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 -- 172.21.15.82:0/1492341362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 msgr2=0x7f41e8109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:30.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 --2- 172.21.15.82:0/1492341362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e8109ed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009990 tx=0x7f41d4009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 -- 172.21.15.82:0/1492341362 shutdown_connections 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 --2- 172.21.15.82:0/1492341362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e810a410 0x7f41e8116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 --2- 172.21.15.82:0/1492341362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41e810fa50 0x7f41e810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 --2- 172.21.15.82:0/1492341362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e8109ed0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.870+0000 7f41f0600700 1 -- 172.21.15.82:0/1492341362 >> 172.21.15.82:0/1492341362 conn(0x7f41e8076bf0 msgr2=0x7f41e8108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.871+0000 7f41f0600700 1 -- 172.21.15.82:0/1492341362 shutdown_connections 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.871+0000 7f41f0600700 1 -- 172.21.15.82:0/1492341362 wait complete. 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 Processor -- start 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 -- start start 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e81a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e810a410 0x7f41e81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41e810fa50 0x7f41e81a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8119ce0 con 0x7f41e8109a50 2024-04-26T20:21:30.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8119b60 con 0x7f41e810a410 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.872+0000 7f41f0600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8119e60 con 0x7f41e810fa50 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e81a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41ed200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e810a410 0x7f41e81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e81a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33740/0 (socket says 172.21.15.82:33740) 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 -- 172.21.15.82:0/2368527362 learned_addr learned my addr 172.21.15.82:0/2368527362 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41ee600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41e810fa50 0x7f41e81a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 -- 172.21.15.82:0/2368527362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41e810fa50 msgr2=0x7f41e81a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41e810fa50 0x7f41e81a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 -- 172.21.15.82:0/2368527362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e810a410 msgr2=0x7f41e81a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e810a410 0x7f41e81a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 -- 172.21.15.82:0/2368527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e81a5150 con 0x7f41e8109a50 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.873+0000 7f41edc00700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e81a0190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e9c0 tx=0x7f41dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:30.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.874+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00cbd0 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.874+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e81a5440 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.874+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41dc00ee60 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.874+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0055c0 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.874+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e81accc0 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.875+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e8111fe0 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.877+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f41dc004750 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.878+0000 7f41e6000700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f41d00a3cd0 0x7f41d00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.879+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f41dc0d0b30 con 0x7f41e8109a50 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.879+0000 7f41ed200700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f41d00a3cd0 0x7f41d00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:30.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.879+0000 7f41ed200700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f41d00a3cd0 0x7f41d00a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f41e8078b90 tx=0x7f41d400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:30.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:28.883+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f41dc09cff0 con 0x7f41e8109a50 2024-04-26T20:21:30.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.111+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f41e81a14a0 con 0x7f41e8109a50 2024-04-26T20:21:30.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.112+0000 7f41e6000700 1 -- 172.21.15.82:0/2368527362 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f41dc09c8f0 con 0x7f41e8109a50 2024-04-26T20:21:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:163208757316 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f41d00a3cd0 msgr2=0x7f41d00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f41d00a3cd0 0x7f41d00a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f41e8078b90 tx=0x7f41d400b260 comp rx=0 tx=0).stop 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 msgr2=0x7f41e81a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e81a0190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e9c0 tx=0x7f41dc00ecd0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 shutdown_connections 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41e810fa50 0x7f41e81a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41e8109a50 0x7f41e81a0190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f41d00a3cd0 0x7f41d00a6190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 --2- 172.21.15.82:0/2368527362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e810a410 0x7f41e81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 >> 172.21.15.82:0/2368527362 conn(0x7f41e8076bf0 msgr2=0x7f41e8077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 shutdown_connections 2024-04-26T20:21:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:29.115+0000 7f41f0600700 1 -- 172.21.15.82:0/2368527362 wait complete. 2024-04-26T20:21:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:30 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3911566672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T20:21:31.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:30 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3911566672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T20:21:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:30 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3911566672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T20:21:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:31 smithi082 ceph-mon[28105]: pgmap v373: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:31 smithi139 ceph-mon[32999]: pgmap v373: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:32.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:31 smithi135 ceph-mon[32816]: pgmap v373: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.712+0000 7f1818600700 1 -- 172.21.15.82:0/3034042635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006ba50 msgr2=0x7f181010f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.712+0000 7f1818600700 1 --2- 172.21.15.82:0/3034042635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006ba50 0x7f181010f990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009990 tx=0x7f17fc009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 -- 172.21.15.82:0/3034042635 shutdown_connections 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 --2- 172.21.15.82:0/3034042635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f181010fed0 0x7f18101122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 --2- 172.21.15.82:0/3034042635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181006b130 0x7f181006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 --2- 172.21.15.82:0/3034042635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006ba50 0x7f181010f990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 -- 172.21.15.82:0/3034042635 >> 172.21.15.82:0/3034042635 conn(0x7f18100792d0 msgr2=0x7f18100796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 -- 172.21.15.82:0/3034042635 shutdown_connections 2024-04-26T20:21:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.713+0000 7f1818600700 1 -- 172.21.15.82:0/3034042635 wait complete. 2024-04-26T20:21:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 Processor -- start 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 -- start start 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 0x7f18101a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181006ba50 0x7f18101a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f181010fed0 0x7f181019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1810115810 con 0x7f181006b130 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1810115690 con 0x7f181006ba50 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.714+0000 7f1818600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1810115990 con 0x7f181010fed0 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 0x7f18101a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 0x7f18101a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51486/0 (socket says 172.21.15.82:51486) 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 -- 172.21.15.82:0/2665857796 learned_addr learned my addr 172.21.15.82:0/2665857796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1816600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f181010fed0 0x7f181019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815200700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181006ba50 0x7f18101a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 -- 172.21.15.82:0/2665857796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f181010fed0 msgr2=0x7f181019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f181010fed0 0x7f181019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 -- 172.21.15.82:0/2665857796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181006ba50 msgr2=0x7f18101a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181006ba50 0x7f18101a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.715+0000 7f1815c00700 1 -- 172.21.15.82:0/2665857796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181019c410 con 0x7f181006b130 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.716+0000 7f1815c00700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 0x7f18101a1a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f180400e9a0 tx=0x7f180400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.716+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180400cbd0 con 0x7f181006b130 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.716+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f180400cd70 con 0x7f181006b130 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.716+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181019c700 con 0x7f181006b130 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.716+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804018680 con 0x7f181006b130 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.716+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101a89e0 con 0x7f181006b130 2024-04-26T20:21:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.718+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1810102940 con 0x7f181006b130 2024-04-26T20:21:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.721+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1804010430 con 0x7f181006b130 2024-04-26T20:21:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.722+0000 7f180e000700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f17f80a3cd0 0x7f17f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.723+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f18040d0b70 con 0x7f181006b130 2024-04-26T20:21:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.723+0000 7f1815200700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f17f80a3cd0 0x7f17f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.724+0000 7f1815200700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f17f80a3cd0 0x7f17f80a6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17fc006010 tx=0x7f17fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:32.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.728+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f180409d030 con 0x7f181006b130 2024-04-26T20:21:32.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.969+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f181019cff0 con 0x7f181006b130 2024-04-26T20:21:32.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.969+0000 7f180e000700 1 -- 172.21.15.82:0/2665857796 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f180409c930 con 0x7f181006b130 2024-04-26T20:21:32.971 INFO:teuthology.orchestra.run.smithi082.stdout:107374182481 2024-04-26T20:21:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f17f80a3cd0 msgr2=0x7f17f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f17f80a3cd0 0x7f17f80a6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17fc006010 tx=0x7f17fc01a040 comp rx=0 tx=0).stop 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 msgr2=0x7f18101a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 0x7f18101a1a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f180400e9a0 tx=0x7f180400ecb0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 shutdown_connections 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f181010fed0 0x7f181019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f181006b130 0x7f18101a1a60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f17f80a3cd0 0x7f17f80a6190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 --2- 172.21.15.82:0/2665857796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181006ba50 0x7f18101a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 >> 172.21.15.82:0/2665857796 conn(0x7f18100792d0 msgr2=0x7f18101113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 shutdown_connections 2024-04-26T20:21:32.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:32.973+0000 7f1818600700 1 -- 172.21.15.82:0/2665857796 wait complete. 2024-04-26T20:21:33.123 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808869 got 287762808877 for osd.9 2024-04-26T20:21:33.123 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 -- 172.21.15.82:0/3264346499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 msgr2=0x7f507010ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 --2- 172.21.15.82:0/3264346499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f507010ba40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5060009990 tx=0x7f5060009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 -- 172.21.15.82:0/3264346499 shutdown_connections 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 --2- 172.21.15.82:0/3264346499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5070106020 0x7f5070112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 --2- 172.21.15.82:0/3264346499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f507010ba40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 --2- 172.21.15.82:0/3264346499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f5070105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.206+0000 7f5074e00700 1 -- 172.21.15.82:0/3264346499 >> 172.21.15.82:0/3264346499 conn(0x7f5070101150 msgr2=0x7f5070103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.207+0000 7f5074e00700 1 -- 172.21.15.82:0/3264346499 shutdown_connections 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.207+0000 7f5074e00700 1 -- 172.21.15.82:0/3264346499 wait complete. 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.209+0000 7f5074e00700 1 Processor -- start 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.209+0000 7f5074e00700 1 -- start start 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f5074e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f507019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:33.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f5074e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5070106020 0x7f507019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f5074e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f50701a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f5074e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50701158b0 con 0x7f507010b660 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f5074e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5070115730 con 0x7f5070105660 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f5074e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5070115a30 con 0x7f5070106020 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f506de00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f507019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f506de00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f507019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44204/0 (socket says 172.21.15.82:44204) 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f506d400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5070106020 0x7f507019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.210+0000 7f506de00700 1 -- 172.21.15.82:0/3911566672 learned_addr learned my addr 172.21.15.82:0/3911566672 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.211+0000 7f506e800700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f50701a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506de00700 1 -- 172.21.15.82:0/3911566672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5070106020 msgr2=0x7f507019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506de00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5070106020 0x7f507019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506de00700 1 -- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 msgr2=0x7f50701a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506de00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f50701a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506de00700 1 -- 172.21.15.82:0/3911566672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50701a0d50 con 0x7f5070105660 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506e800700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f50701a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.212+0000 7f506de00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f507019bd40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5060000c00 tx=0x7f50600057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.213+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060027070 con 0x7f5070105660 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.214+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5060022470 con 0x7f5070105660 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.214+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060017650 con 0x7f5070105660 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.214+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50701a0fe0 con 0x7f5070105660 2024-04-26T20:21:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.214+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50701a88c0 con 0x7f5070105660 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.215+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f507006a110 con 0x7f5070105660 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.219+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f506002a070 con 0x7f5070105660 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.220+0000 7f5066a00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50540a3d50 0x7f50540a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.221+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f50600d1610 con 0x7f5070105660 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.221+0000 7f506d400700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50540a3d50 0x7f50540a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.223+0000 7f506d400700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50540a3d50 0x7f50540a6210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5070103750 tx=0x7f505c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.224+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5060013070 con 0x7f5070105660 2024-04-26T20:21:33.189 INFO:teuthology.orchestra.run.smithi082.stdout:219043332153 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.467+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f507002e490 con 0x7f5070105660 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.467+0000 7f5066a00700 1 -- 172.21.15.82:0/3911566672 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f506009db60 con 0x7f5070105660 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50540a3d50 msgr2=0x7f50540a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50540a3d50 0x7f50540a6210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5070103750 tx=0x7f505c009260 comp rx=0 tx=0).stop 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 msgr2=0x7f507019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f507019bd40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5060000c00 tx=0x7f50600057c0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 shutdown_connections 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f507010b660 0x7f50701a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50540a3d50 0x7f50540a6210 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5070105660 0x7f507019bd40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 --2- 172.21.15.82:0/3911566672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5070106020 0x7f507019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.470+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 >> 172.21.15.82:0/3911566672 conn(0x7f5070101150 msgr2=0x7f50701018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.471+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 shutdown_connections 2024-04-26T20:21:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:30.471+0000 7f5074e00700 1 -- 172.21.15.82:0/3911566672 wait complete. 2024-04-26T20:21:33.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:33 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:33 smithi135 ceph-mon[32816]: pgmap v374: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:33.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:33 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2665857796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T20:21:33.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:33.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:33 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:33.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:33 smithi082 ceph-mon[28105]: pgmap v374: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:33.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:33 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2665857796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T20:21:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:33 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:33 smithi139 ceph-mon[32999]: pgmap v374: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:21:33.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:33 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2665857796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T20:21:33.873 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757310 got 163208757316 for osd.5 2024-04-26T20:21:33.874 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:34.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:34.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:34.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:34.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:34.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:34.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:34.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:34.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:21:35.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:35 smithi082 ceph-mon[28105]: pgmap v375: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-26T20:21:35.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:35 smithi139 ceph-mon[32999]: pgmap v375: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-26T20:21:35.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:35 smithi135 ceph-mon[32816]: pgmap v375: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-26T20:21:36.527 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:36 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2659780793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T20:21:36.581 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070510 got 253403070514 for osd.8 2024-04-26T20:21:36.581 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.175+0000 7fda5ba00700 1 -- 172.21.15.82:0/1875387837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406b130 msgr2=0x7fda5406b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.175+0000 7fda5ba00700 1 --2- 172.21.15.82:0/1875387837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406b130 0x7fda5406b590 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fda40009990 tx=0x7fda40009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 -- 172.21.15.82:0/1875387837 shutdown_connections 2024-04-26T20:21:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 --2- 172.21.15.82:0/1875387837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406bad0 0x7fda541102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 --2- 172.21.15.82:0/1875387837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda541094a0 0x7fda54109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 --2- 172.21.15.82:0/1875387837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406b130 0x7fda5406b590 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 -- 172.21.15.82:0/1875387837 >> 172.21.15.82:0/1875387837 conn(0x7fda540792d0 msgr2=0x7fda540796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 -- 172.21.15.82:0/1875387837 shutdown_connections 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.176+0000 7fda5ba00700 1 -- 172.21.15.82:0/1875387837 wait complete. 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.177+0000 7fda5ba00700 1 Processor -- start 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.177+0000 7fda5ba00700 1 -- start start 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda5ba00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406b130 0x7fda5419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda5ba00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 0x7fda5419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda5ba00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda541094a0 0x7fda541a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda5ba00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda54113600 con 0x7fda5406bad0 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda5ba00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda54113480 con 0x7fda541094a0 2024-04-26T20:21:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda5ba00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fda54113780 con 0x7fda5406b130 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda53e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 0x7fda5419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda53e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 0x7fda5419c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51508/0 (socket says 172.21.15.82:51508) 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda53e00700 1 -- 172.21.15.82:0/2659780793 learned_addr learned my addr 172.21.15.82:0/2659780793 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.178+0000 7fda59000700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406b130 0x7fda5419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda59a00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda541094a0 0x7fda541a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda53e00700 1 -- 172.21.15.82:0/2659780793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406b130 msgr2=0x7fda5419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda53e00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406b130 0x7fda5419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda53e00700 1 -- 172.21.15.82:0/2659780793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda541094a0 msgr2=0x7fda541a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda53e00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda541094a0 0x7fda541a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda53e00700 1 -- 172.21.15.82:0/2659780793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda541a0d60 con 0x7fda5406bad0 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda59000700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406b130 0x7fda5419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda53e00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 0x7fda5419c290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda40000c00 tx=0x7fda400057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.179+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40027070 con 0x7fda5406bad0 2024-04-26T20:21:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.180+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda40022470 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.180+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda541a0ff0 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.180+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40017650 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.180+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda541a88d0 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.181+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda54104b50 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.183+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fda4002a070 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.184+0000 7fda51600700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda3c0a3cd0 0x7fda3c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.184+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fda400d15a0 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.184+0000 7fda59000700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda3c0a3cd0 0x7fda3c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.185+0000 7fda59000700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda3c0a3cd0 0x7fda3c0a6190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda48009fd0 tx=0x7fda48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.189+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fda40013070 con 0x7fda5406bad0 2024-04-26T20:21:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.422+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fda541a8aa0 con 0x7fda5406bad0 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stdout:197568495680 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.423+0000 7fda51600700 1 -- 172.21.15.82:0/2659780793 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fda4009daf0 con 0x7fda5406bad0 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.425+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda3c0a3cd0 msgr2=0x7fda3c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.425+0000 7fda5ba00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda3c0a3cd0 0x7fda3c0a6190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda48009fd0 tx=0x7fda48009260 comp rx=0 tx=0).stop 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.425+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 msgr2=0x7fda5419c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.425+0000 7fda5ba00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 0x7fda5419c290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda40000c00 tx=0x7fda400057c0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 shutdown_connections 2024-04-26T20:21:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda3c0a3cd0 0x7fda3c0a6190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda541094a0 0x7fda541a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda5406b130 0x7fda5419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 --2- 172.21.15.82:0/2659780793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda5406bad0 0x7fda5419c290 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 >> 172.21.15.82:0/2659780793 conn(0x7fda540792d0 msgr2=0x7fda541004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 shutdown_connections 2024-04-26T20:21:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.426+0000 7fda5ba00700 1 -- 172.21.15.82:0/2659780793 wait complete. 2024-04-26T20:21:36.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:36 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2659780793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T20:21:36.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:36 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2659780793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T20:21:37.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 -- 172.21.15.82:0/3546658130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51741083b0 msgr2=0x7f5174108790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 --2- 172.21.15.82:0/3546658130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51741083b0 0x7f5174108790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51640099c0 tx=0x7f5164009cd0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 -- 172.21.15.82:0/3546658130 shutdown_connections 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 --2- 172.21.15.82:0/3546658130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5174103e90 0x7f5174110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 --2- 172.21.15.82:0/3546658130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51741083b0 0x7f5174108790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 --2- 172.21.15.82:0/3546658130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 0x7f5174103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 -- 172.21.15.82:0/3546658130 >> 172.21.15.82:0/3546658130 conn(0x7f517407a580 msgr2=0x7f517407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 -- 172.21.15.82:0/3546658130 shutdown_connections 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.272+0000 7f5179200700 1 -- 172.21.15.82:0/3546658130 wait complete. 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.273+0000 7f5179200700 1 Processor -- start 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.273+0000 7f5179200700 1 -- start start 2024-04-26T20:21:37.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5179200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 0x7f517419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5179200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 0x7f517419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5179200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51741083b0 0x7f51741a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5179200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5174113690 con 0x7f5174103e90 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5179200700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5174113510 con 0x7f51741034d0 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5179200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5174113810 con 0x7f51741083b0 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5171400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 0x7f517419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5171400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 0x7f517419c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51528/0 (socket says 172.21.15.82:51528) 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5171400700 1 -- 172.21.15.82:0/1648125141 learned_addr learned my addr 172.21.15.82:0/1648125141 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.274+0000 7f5171e00700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 0x7f517419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171400700 1 -- 172.21.15.82:0/1648125141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51741083b0 msgr2=0x7f51741a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171400700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51741083b0 0x7f51741a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171400700 1 -- 172.21.15.82:0/1648125141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 msgr2=0x7f517419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171400700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 0x7f517419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171400700 1 -- 172.21.15.82:0/1648125141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51741a0dd0 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171e00700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 0x7f517419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f5171400700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 0x7f517419c300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f516000eab0 tx=0x7f516000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.275+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000cbd0 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.276+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51600044d0 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.276+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51741a10c0 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.276+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160010430 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.276+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51741a8940 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.277+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f517406a110 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.279+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5160003e70 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.281+0000 7f516aa00700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51580a3cd0 0x7f51580a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.281+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f51600d0b10 con 0x7f5174103e90 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.281+0000 7f5171e00700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51580a3cd0 0x7f51580a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.282+0000 7f5171e00700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51580a3cd0 0x7f51580a6190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5164003760 tx=0x7f5164005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:37.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.285+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f516009d030 con 0x7f5174103e90 2024-04-26T20:21:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.525+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f51741a8bd0 con 0x7f5174103e90 2024-04-26T20:21:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.526+0000 7f516aa00700 1 -- 172.21.15.82:0/1648125141 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f516009c930 con 0x7f5174103e90 2024-04-26T20:21:37.681 INFO:teuthology.orchestra.run.smithi082.stdout:309237645351 2024-04-26T20:21:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51580a3cd0 msgr2=0x7f51580a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51580a3cd0 0x7f51580a6190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5164003760 tx=0x7f5164005fb0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 msgr2=0x7f517419c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 0x7f517419c300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f516000eab0 tx=0x7f516000edc0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 shutdown_connections 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51741083b0 0x7f51741a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.529+0000 7f5179200700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51580a3cd0 0x7f51580a6190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.530+0000 7f5179200700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51741034d0 0x7f517419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.530+0000 7f5179200700 1 --2- 172.21.15.82:0/1648125141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5174103e90 0x7f517419c300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.530+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 >> 172.21.15.82:0/1648125141 conn(0x7f517407a580 msgr2=0x7f5174101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.530+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 shutdown_connections 2024-04-26T20:21:37.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:36.530+0000 7f5179200700 1 -- 172.21.15.82:0/1648125141 wait complete. 2024-04-26T20:21:37.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:37 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1648125141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T20:21:37.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:37 smithi139 ceph-mon[32999]: pgmap v376: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-26T20:21:37.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:37 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1648125141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T20:21:37.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:37 smithi135 ceph-mon[32816]: pgmap v376: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-26T20:21:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:37 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1648125141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T20:21:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:37 smithi082 ceph-mon[28105]: pgmap v376: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-26T20:21:38.136 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332148 got 219043332153 for osd.7 2024-04-26T20:21:38.136 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:38.305 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495673 got 197568495680 for osd.6 2024-04-26T20:21:38.305 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:39 smithi082 ceph-mon[28105]: pgmap v377: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-26T20:21:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:39 smithi139 ceph-mon[32999]: pgmap v377: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-26T20:21:40.113 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645344 got 309237645351 for osd.10 2024-04-26T20:21:40.113 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:40.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:39 smithi135 ceph-mon[32816]: pgmap v377: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-26T20:21:40.505 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182475 got 107374182481 for osd.3 2024-04-26T20:21:40.505 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 -- 172.21.15.82:0/995015782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 msgr2=0x7fcd3c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 --2- 172.21.15.82:0/995015782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c109880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009990 tx=0x7fcd2c009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 -- 172.21.15.82:0/995015782 shutdown_connections 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 --2- 172.21.15.82:0/995015782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd3c06bad0 0x7fcd3c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 --2- 172.21.15.82:0/995015782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c109880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 --2- 172.21.15.82:0/995015782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 -- 172.21.15.82:0/995015782 >> 172.21.15.82:0/995015782 conn(0x7fcd3c0792d0 msgr2=0x7fcd3c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 -- 172.21.15.82:0/995015782 shutdown_connections 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.075+0000 7fcd41a00700 1 -- 172.21.15.82:0/995015782 wait complete. 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.076+0000 7fcd41a00700 1 Processor -- start 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.076+0000 7fcd41a00700 1 -- start start 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd41a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c1023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd41a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd3c06bad0 0x7fcd3c102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd41a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd41a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c1135b0 con 0x7fcd3c1094a0 2024-04-26T20:21:40.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd41a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c113430 con 0x7fcd3c06bad0 2024-04-26T20:21:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd41a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c113730 con 0x7fcd3c06b130 2024-04-26T20:21:40.696 INFO:teuthology.orchestra.run.smithi082.stdout:343597383715 2024-04-26T20:21:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd3aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c1023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd3aa00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c1023f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:55542/0 (socket says 172.21.15.82:55542) 2024-04-26T20:21:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd3aa00700 1 -- 172.21.15.82:0/4276068854 learned_addr learned my addr 172.21.15.82:0/4276068854 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.077+0000 7fcd3b400700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd3aa00700 1 -- 172.21.15.82:0/4276068854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd3c06bad0 msgr2=0x7fcd3c102930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd3aa00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd3c06bad0 0x7fcd3c102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd3aa00700 1 -- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 msgr2=0x7fcd3c102e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd3aa00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c102e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd3aa00700 1 -- 172.21.15.82:0/4276068854 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c1a8090 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd3aa00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c1023f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00b6c0 tx=0x7fcd2c00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00fd40 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd2c027070 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3c1998a0 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.078+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0179b0 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.079+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3c199dd0 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.080+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3c06a110 con 0x7fcd3c06b130 2024-04-26T20:21:40.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.082+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcd2c009d10 con 0x7fcd3c06b130 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.083+0000 7fcd33400700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcd200b4d60 0x7fcd200b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.083+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcd2c0d0dc0 con 0x7fcd3c06b130 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.083+0000 7fcd3a000700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcd200b4d60 0x7fcd200b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.084+0000 7fcd3a000700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcd200b4d60 0x7fcd200b7220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005950 tx=0x7fcd280058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.087+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fcd2c013070 con 0x7fcd3c06b130 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.311+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fcd3c02e650 con 0x7fcd3c06b130 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.312+0000 7fcd33400700 1 -- 172.21.15.82:0/4276068854 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcd2c09d420 con 0x7fcd3c06b130 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcd200b4d60 msgr2=0x7fcd200b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcd200b4d60 0x7fcd200b7220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005950 tx=0x7fcd280058e0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 msgr2=0x7fcd3c1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c1023f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00b6c0 tx=0x7fcd2c00bfd0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 shutdown_connections 2024-04-26T20:21:40.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd3c06b130 0x7fcd3c1023f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcd200b4d60 0x7fcd200b7220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 --2- 172.21.15.82:0/4276068854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd3c06bad0 0x7fcd3c102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 >> 172.21.15.82:0/4276068854 conn(0x7fcd3c0792d0 msgr2=0x7fcd3c1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:40.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 shutdown_connections 2024-04-26T20:21:40.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.315+0000 7fcd41a00700 1 -- 172.21.15.82:0/4276068854 wait complete. 2024-04-26T20:21:40.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:40 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4276068854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T20:21:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:40 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4276068854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T20:21:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:40 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4276068854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T20:21:41.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383709 got 343597383715 for osd.11 2024-04-26T20:21:41.839 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 -- 172.21.15.82:0/2778795732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c103f60 msgr2=0x7f6f6c107fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2778795732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c103f60 0x7f6f6c107fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6f580099c0 tx=0x7f6f58009cd0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 -- 172.21.15.82:0/2778795732 shutdown_connections 2024-04-26T20:21:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2778795732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f6c108690 0x7f6f6c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2778795732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c1035b0 0x7f6f6c103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2778795732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c103f60 0x7f6f6c107fb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 -- 172.21.15.82:0/2778795732 >> 172.21.15.82:0/2778795732 conn(0x7f6f6c0feea0 msgr2=0x7f6f6c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 -- 172.21.15.82:0/2778795732 shutdown_connections 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.709+0000 7f6f72e00700 1 -- 172.21.15.82:0/2778795732 wait complete. 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.710+0000 7f6f72e00700 1 Processor -- start 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.710+0000 7f6f72e00700 1 -- start start 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c1035b0 0x7f6f6c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f6c103f60 0x7f6f6c1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 0x7f6f6c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c113570 con 0x7f6f6c108690 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c1133f0 con 0x7f6f6c1035b0 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c1136f0 con 0x7f6f6c103f60 2024-04-26T20:21:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 0x7f6f6c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 0x7f6f6c19bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51570/0 (socket says 172.21.15.82:51570) 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f72400700 1 -- 172.21.15.82:0/2844941969 learned_addr learned my addr 172.21.15.82:0/2844941969 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f71000700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f6c103f60 0x7f6f6c1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.711+0000 7f6f71a00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c1035b0 0x7f6f6c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72400700 1 -- 172.21.15.82:0/2844941969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f6c103f60 msgr2=0x7f6f6c1a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72400700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f6c103f60 0x7f6f6c1a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72400700 1 -- 172.21.15.82:0/2844941969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c1035b0 msgr2=0x7f6f6c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72400700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c1035b0 0x7f6f6c1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72400700 1 -- 172.21.15.82:0/2844941969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c19c210 con 0x7f6f6c108690 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72400700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 0x7f6f6c19bab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400ef30 tx=0x7f6f6400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f640092e0 con 0x7f6f6c108690 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f64004bb0 con 0x7f6f6c108690 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64004020 con 0x7f6f6c108690 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c19c4a0 con 0x7f6f6c108690 2024-04-26T20:21:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.712+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c1a87c0 con 0x7f6f6c108690 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.713+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c06a110 con 0x7f6f6c108690 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.715+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6f6401b030 con 0x7f6f6c108690 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.716+0000 7f6f6a000700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6f540a3d50 0x7f6f540a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.717+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6f640d0280 con 0x7f6f6c108690 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.717+0000 7f6f71a00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6f540a3d50 0x7f6f540a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.717+0000 7f6f71a00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6f540a3d50 0x7f6f540a6210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c19cbf0 tx=0x7f6f60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.721+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6f64022020 con 0x7f6f6c108690 2024-04-26T20:21:41.893 INFO:teuthology.orchestra.run.smithi082.stdout:141733920843 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.952+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6f6c1a8990 con 0x7f6f6c108690 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.953+0000 7f6f6a000700 1 -- 172.21.15.82:0/2844941969 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6f64010040 con 0x7f6f6c108690 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6f540a3d50 msgr2=0x7f6f540a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6f540a3d50 0x7f6f540a6210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c19cbf0 tx=0x7f6f60009260 comp rx=0 tx=0).stop 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 msgr2=0x7f6f6c19bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 0x7f6f6c19bab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400ef30 tx=0x7f6f6400c3a0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 shutdown_connections 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6c108690 0x7f6f6c19bab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6f540a3d50 0x7f6f540a6210 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c1035b0 0x7f6f6c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 --2- 172.21.15.82:0/2844941969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f6c103f60 0x7f6f6c1a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 >> 172.21.15.82:0/2844941969 conn(0x7f6f6c0feea0 msgr2=0x7f6f6c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 shutdown_connections 2024-04-26T20:21:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:40.956+0000 7f6f72e00700 1 -- 172.21.15.82:0/2844941969 wait complete. 2024-04-26T20:21:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:41 smithi139 ceph-mon[32999]: pgmap v378: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-26T20:21:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:41 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2844941969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T20:21:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:41 smithi135 ceph-mon[32816]: pgmap v378: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-26T20:21:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:41 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2844941969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T20:21:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:41 smithi082 ceph-mon[28105]: pgmap v378: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-26T20:21:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:41 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2844941969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T20:21:42.675 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920832 got 141733920843 for osd.4 2024-04-26T20:21:42.675 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:43 smithi082 ceph-mon[28105]: pgmap v379: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-04-26T20:21:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:43 smithi139 ceph-mon[32999]: pgmap v379: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-04-26T20:21:44.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:43 smithi135 ceph-mon[32816]: pgmap v379: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.991+0000 7facc6e00700 1 -- 172.21.15.82:0/3385476594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc010fe80 msgr2=0x7facc0112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.991+0000 7facc6e00700 1 --2- 172.21.15.82:0/3385476594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc010fe80 0x7facc0112270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7facb8009990 tx=0x7facb8009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 -- 172.21.15.82:0/3385476594 shutdown_connections 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 --2- 172.21.15.82:0/3385476594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc010fe80 0x7facc0112270 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 --2- 172.21.15.82:0/3385476594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc0075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 --2- 172.21.15.82:0/3385476594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facc0075f70 0x7facc010f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 -- 172.21.15.82:0/3385476594 >> 172.21.15.82:0/3385476594 conn(0x7facc007a580 msgr2=0x7facc007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 -- 172.21.15.82:0/3385476594 shutdown_connections 2024-04-26T20:21:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.992+0000 7facc6e00700 1 -- 172.21.15.82:0/3385476594 wait complete. 2024-04-26T20:21:44.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.993+0000 7facc6e00700 1 Processor -- start 2024-04-26T20:21:44.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.993+0000 7facc6e00700 1 -- start start 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.993+0000 7facc6e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.993+0000 7facc6e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc0075f70 0x7facc01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facc6e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facc010fe80 0x7facc019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facc6e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7facc0115880 con 0x7facc0075f70 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facc6e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7facc0115700 con 0x7facc0075650 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facc6e00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7facc0115a00 con 0x7facc010fe80 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc01a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41738/0 (socket says 172.21.15.82:41738) 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 -- 172.21.15.82:0/3947130411 learned_addr learned my addr 172.21.15.82:0/3947130411 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facb7400700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc0075f70 0x7facc01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facc4e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facc010fe80 0x7facc019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 -- 172.21.15.82:0/3947130411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facc010fe80 msgr2=0x7facc019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facc010fe80 0x7facc019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 -- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc0075f70 msgr2=0x7facc01a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc0075f70 0x7facc01a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.994+0000 7facbfe00700 1 -- 172.21.15.82:0/3947130411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc019c200 con 0x7facc0075650 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.995+0000 7facbfe00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc01a18e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facb000ef10 tx=0x7facb000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.995+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb000c9c0 con 0x7facc0075650 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.995+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb0019070 con 0x7facc0075650 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.995+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc019c490 con 0x7facc0075650 2024-04-26T20:21:44.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.995+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0014480 con 0x7facc0075650 2024-04-26T20:21:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.995+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc01a87b0 con 0x7facc0075650 2024-04-26T20:21:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.996+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc006a110 con 0x7facc0075650 2024-04-26T20:21:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:44.998+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7facb0012050 con 0x7facc0075650 2024-04-26T20:21:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.000+0000 7facbd600700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faca40a3cd0 0x7faca40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.000+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7facb00d0860 con 0x7facc0075650 2024-04-26T20:21:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.000+0000 7facb7400700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faca40a3cd0 0x7faca40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.001+0000 7facb7400700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faca40a3cd0 0x7faca40a6190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7facc0111a40 tx=0x7faca800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:45.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.004+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7facb0010040 con 0x7facc0075650 2024-04-26T20:21:45.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.231+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7facc01a8980 con 0x7facc0075650 2024-04-26T20:21:45.232 INFO:teuthology.orchestra.run.smithi082.stdout:34359738467 2024-04-26T20:21:45.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.232+0000 7facbd600700 1 -- 172.21.15.82:0/3947130411 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7facb009cd20 con 0x7facc0075650 2024-04-26T20:21:45.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 -- 172.21.15.82:0/2082313982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075650 msgr2=0x7f4270075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 --2- 172.21.15.82:0/2082313982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075650 0x7f4270075a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4260009990 tx=0x7f4260009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 -- 172.21.15.82:0/2082313982 shutdown_connections 2024-04-26T20:21:45.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 --2- 172.21.15.82:0/2082313982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 0x7f4270112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 --2- 172.21.15.82:0/2082313982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075650 0x7f4270075a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 --2- 172.21.15.82:0/2082313982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4270075f70 0x7f427010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 -- 172.21.15.82:0/2082313982 >> 172.21.15.82:0/2082313982 conn(0x7f427007a5d0 msgr2=0x7f427007a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:45.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 -- 172.21.15.82:0/2082313982 shutdown_connections 2024-04-26T20:21:45.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7f4275c00700 1 -- 172.21.15.82:0/2082313982 wait complete. 2024-04-26T20:21:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faca40a3cd0 msgr2=0x7faca40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7facc6e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faca40a3cd0 0x7faca40a6190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7facc0111a40 tx=0x7faca800b410 comp rx=0 tx=0).stop 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 msgr2=0x7facc01a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.235+0000 7facc6e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc01a18e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facb000ef10 tx=0x7facb000c3a0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 shutdown_connections 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facc010fe80 0x7facc019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faca40a3cd0 0x7faca40a6190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facc0075650 0x7facc01a18e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 --2- 172.21.15.82:0/3947130411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc0075f70 0x7facc01a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 >> 172.21.15.82:0/3947130411 conn(0x7facc007a580 msgr2=0x7facc01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 shutdown_connections 2024-04-26T20:21:45.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.236+0000 7facc6e00700 1 -- 172.21.15.82:0/3947130411 wait complete. 2024-04-26T20:21:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 Processor -- start 2024-04-26T20:21:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 -- start start 2024-04-26T20:21:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4270075650 0x7f427019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 0x7f427019c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 0x7f42701a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4270115870 con 0x7f4270075650 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42701156f0 con 0x7f427010fe20 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.237+0000 7f4275c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42701159f0 con 0x7f4270075f70 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 0x7f427019c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 0x7f427019c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:35250/0 (socket says 172.21.15.82:35250) 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 -- 172.21.15.82:0/2080211751 learned_addr learned my addr 172.21.15.82:0/2080211751 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426f400700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 0x7f42701a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 -- 172.21.15.82:0/2080211751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 msgr2=0x7f42701a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 0x7f42701a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 -- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4270075650 msgr2=0x7f427019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4270075650 0x7f427019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426e000700 1 -- 172.21.15.82:0/2080211751 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42701a0db0 con 0x7f4270075f70 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.238+0000 7f426f400700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 0x7f42701a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.239+0000 7f426e000700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 0x7f427019c2e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e9a0 tx=0x7f425c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.239+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c00cbd0 con 0x7f4270075f70 2024-04-26T20:21:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.239+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f425c00cd70 con 0x7f4270075f70 2024-04-26T20:21:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.239+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42701a10a0 con 0x7f4270075f70 2024-04-26T20:21:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.239+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c018680 con 0x7f4270075f70 2024-04-26T20:21:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.239+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701a8920 con 0x7f4270075f70 2024-04-26T20:21:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.240+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4250005330 con 0x7f4270075f70 2024-04-26T20:21:45.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.244+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f425c018820 con 0x7f4270075f70 2024-04-26T20:21:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.246+0000 7f4267400700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42540a3d50 0x7f42540a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.246+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f425c0d0f80 con 0x7f4270075f70 2024-04-26T20:21:45.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.246+0000 7f426ea00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42540a3d50 0x7f42540a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.247+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f425c09d440 con 0x7f4270075f70 2024-04-26T20:21:45.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.247+0000 7f426ea00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42540a3d50 0x7f42540a6210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f42600098e0 tx=0x7f4260005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:45.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.480+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f42500058f0 con 0x7f4270075f70 2024-04-26T20:21:45.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.480+0000 7f4267400700 1 -- 172.21.15.82:0/2080211751 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f425c09cd40 con 0x7f4270075f70 2024-04-26T20:21:45.481 INFO:teuthology.orchestra.run.smithi082.stdout:77309411417 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42540a3d50 msgr2=0x7f42540a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42540a3d50 0x7f42540a6210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f42600098e0 tx=0x7f4260005fb0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 msgr2=0x7f427019c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 0x7f427019c2e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e9a0 tx=0x7f425c00ed60 comp rx=0 tx=0).stop 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 shutdown_connections 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42540a3d50 0x7f42540a6210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427010fe20 0x7f42701a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4270075650 0x7f427019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 --2- 172.21.15.82:0/2080211751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4270075f70 0x7f427019c2e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 >> 172.21.15.82:0/2080211751 conn(0x7f427007a5d0 msgr2=0x7f4270100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 shutdown_connections 2024-04-26T20:21:45.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:45.484+0000 7f4275c00700 1 -- 172.21.15.82:0/2080211751 wait complete. 2024-04-26T20:21:45.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:45 smithi082 ceph-mon[28105]: pgmap v380: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-26T20:21:45.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:45 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3947130411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T20:21:45.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:45 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2080211751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T20:21:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:45 smithi139 ceph-mon[32999]: pgmap v380: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-26T20:21:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:45 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3947130411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T20:21:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:45 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2080211751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T20:21:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:45 smithi135 ceph-mon[32816]: pgmap v380: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-26T20:21:46.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:45 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3947130411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T20:21:46.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:45 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2080211751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T20:21:46.397 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411410 got 77309411417 for osd.2 2024-04-26T20:21:46.398 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:46.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738460 got 34359738467 for osd.0 2024-04-26T20:21:46.945 DEBUG:teuthology.parallel:result is None 2024-04-26T20:21:46.945 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T20:21:46.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T20:21:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:47.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:47 smithi082 ceph-mon[28105]: pgmap v381: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:47 smithi139 ceph-mon[32999]: pgmap v381: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:48.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:47 smithi135 ceph-mon[32816]: pgmap v381: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:21:49.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 -- 172.21.15.82:0/3045872899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 msgr2=0x7f20601038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 --2- 172.21.15.82:0/3045872899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f20601038f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20480098f0 tx=0x7f2048009c00 comp rx=0 tx=0).stop 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 -- 172.21.15.82:0/3045872899 shutdown_connections 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 --2- 172.21.15.82:0/3045872899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 0x7f2060110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 --2- 172.21.15.82:0/3045872899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 0x7f20601098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 --2- 172.21.15.82:0/3045872899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f20601038f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 -- 172.21.15.82:0/3045872899 >> 172.21.15.82:0/3045872899 conn(0x7f206007a580 msgr2=0x7f206007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 -- 172.21.15.82:0/3045872899 shutdown_connections 2024-04-26T20:21:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.765+0000 7f2065800700 1 -- 172.21.15.82:0/3045872899 wait complete. 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 Processor -- start 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 -- start start 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f206019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 0x7f206019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 0x7f20601999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2060113630 con 0x7f2060103e30 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20601134b0 con 0x7f20601094c0 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.767+0000 7f2065800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f20601137b0 con 0x7f2060103470 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f205f400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 0x7f20601999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f2056000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 0x7f206019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f205f400700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 0x7f20601999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41780/0 (socket says 172.21.15.82:41780) 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f205f400700 1 -- 172.21.15.82:0/3656744305 learned_addr learned my addr 172.21.15.82:0/3656744305 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f205ea00700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f206019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f2056000700 1 -- 172.21.15.82:0/3656744305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 msgr2=0x7f206019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f2056000700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f206019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f2056000700 1 -- 172.21.15.82:0/3656744305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 msgr2=0x7f20601999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f2056000700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 0x7f20601999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f2056000700 1 -- 172.21.15.82:0/3656744305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206019a150 con 0x7f2060103e30 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.768+0000 7f205ea00700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f206019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.769+0000 7f2056000700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 0x7f206019fd70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f204800c010 tx=0x7f204800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.769+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20480050c0 con 0x7f2060103e30 2024-04-26T20:21:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.769+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204800b560 con 0x7f2060103e30 2024-04-26T20:21:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.769+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206019a3e0 con 0x7f2060103e30 2024-04-26T20:21:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.769+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048003a00 con 0x7f2060103e30 2024-04-26T20:21:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.769+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20601a6700 con 0x7f2060103e30 2024-04-26T20:21:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.770+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206006a110 con 0x7f2060103e30 2024-04-26T20:21:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.772+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f204800b710 con 0x7f2060103e30 2024-04-26T20:21:49.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.773+0000 7f2057e00700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f20440a3cd0 0x7f20440a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:49.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.774+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f20480d16f0 con 0x7f2060103e30 2024-04-26T20:21:49.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.774+0000 7f205ea00700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f20440a3cd0 0x7f20440a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:49.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.775+0000 7f205ea00700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f20440a3cd0 0x7f20440a6190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f206019ab30 tx=0x7f205000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:49.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:49.778+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2048013030 con 0x7f2060103e30 2024-04-26T20:21:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:49 smithi082 ceph-mon[28105]: pgmap v382: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:21:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.002+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2060063860 con 0x7f20440a3cd0 2024-04-26T20:21:50.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.019+0000 7f2057e00700 1 -- 172.21.15.82:0/3656744305 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340406 (secure 0 0 0) 0x7f2060063860 con 0x7f20440a3cd0 2024-04-26T20:21:50.022 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:21:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.030+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f20440a3cd0 msgr2=0x7f20440a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f20440a3cd0 0x7f20440a6190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f206019ab30 tx=0x7f205000b040 comp rx=0 tx=0).stop 2024-04-26T20:21:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 msgr2=0x7f206019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 0x7f206019fd70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f204800c010 tx=0x7f204800fa00 comp rx=0 tx=0).stop 2024-04-26T20:21:50.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 shutdown_connections 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f20440a3cd0 0x7f20440a6190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20601094c0 0x7f20601999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2060103470 0x7f206019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 --2- 172.21.15.82:0/3656744305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2060103e30 0x7f206019fd70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 >> 172.21.15.82:0/3656744305 conn(0x7f206007a580 msgr2=0x7f2060102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 shutdown_connections 2024-04-26T20:21:50.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:50.031+0000 7f2065800700 1 -- 172.21.15.82:0/3656744305 wait complete. 2024-04-26T20:21:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:21:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:49 smithi139 ceph-mon[32999]: pgmap v382: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:21:50.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:49 smithi135 ceph-mon[32816]: pgmap v382: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:21:50.985 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-04-26T20:21:48.621311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652632,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1045,"num_read_kb":637,"num_write":426,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375928,"kb_used_data":14216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565896,"statfs":{"total":1151940427776,"available":1151555477504,"internally_reserved":0,"allocated":14557184,"data_stored":7943606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006165"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683338+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:20:47.683338+0000","last_peered":"2024-04-26T20:20:47.683338+0000","last_clean":"2024-04-26T20:20:47.683338+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:20:47.683338+0000","last_undegraded":"2024-04-26T20:20:47.683338+0000","last_fullsized":"2024-04-26T20:20:47.683338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694621+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:20:47.694621+0000","last_peered":"2024-04-26T20:20:47.694621+0000","last_clean":"2024-04-26T20:20:47.694621+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:20:47.694621+0000","last_undegraded":"2024-04-26T20:20:47.694621+0000","last_fullsized":"2024-04-26T20:20:47.694621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693141+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:20:47.693141+0000","last_peered":"2024-04-26T20:20:47.693141+0000","last_clean":"2024-04-26T20:20:47.693141+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:20:47.693141+0000","last_undegraded":"2024-04-26T20:20:47.693141+0000","last_fullsized":"2024-04-26T20:20:47.693141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683550+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:20:47.683550+0000","last_peered":"2024-04-26T20:20:47.683550+0000","last_clean":"2024-04-26T20:20:47.683550+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:20:47.683550+0000","last_undegraded":"2024-04-26T20:20:47.683550+0000","last_fullsized":"2024-04-26T20:20:47.683550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682467+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:20:47.682467+0000","last_peered":"2024-04-26T20:20:47.682467+0000","last_clean":"2024-04-26T20:20:47.682467+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:20:47.682467+0000","last_undegraded":"2024-04-26T20:20:47.682467+0000","last_fullsized":"2024-04-26T20:20:47.682467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819733+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:20:47.819733+0000","last_peered":"2024-04-26T20:20:47.819733+0000","last_clean":"2024-04-26T20:20:47.819733+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:20:47.819733+0000","last_undegraded":"2024-04-26T20:20:47.819733+0000","last_fullsized":"2024-04-26T20:20:47.819733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818584+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:20:47.818584+0000","last_peered":"2024-04-26T20:20:47.818584+0000","last_clean":"2024-04-26T20:20:47.818584+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:20:47.818584+0000","last_undegraded":"2024-04-26T20:20:47.818584+0000","last_fullsized":"2024-04-26T20:20:47.818584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680822+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:20:47.680822+0000","last_peered":"2024-04-26T20:20:47.680822+0000","last_clean":"2024-04-26T20:20:47.680822+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:20:47.680822+0000","last_undegraded":"2024-04-26T20:20:47.680822+0000","last_fullsized":"2024-04-26T20:20:47.680822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820727+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:20:47.820727+0000","last_peered":"2024-04-26T20:20:47.820727+0000","last_clean":"2024-04-26T20:20:47.820727+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:20:47.820727+0000","last_undegraded":"2024-04-26T20:20:47.820727+0000","last_fullsized":"2024-04-26T20:20:47.820727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820297+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:20:47.820297+0000","last_peered":"2024-04-26T20:20:47.820297+0000","last_clean":"2024-04-26T20:20:47.820297+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:20:47.820297+0000","last_undegraded":"2024-04-26T20:20:47.820297+0000","last_fullsized":"2024-04-26T20:20:47.820297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819599+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:20:47.819599+0000","last_peered":"2024-04-26T20:20:47.819599+0000","last_clean":"2024-04-26T20:20:47.819599+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:20:47.819599+0000","last_undegraded":"2024-04-26T20:20:47.819599+0000","last_fullsized":"2024-04-26T20:20:47.819599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683426+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:20:47.683426+0000","last_peered":"2024-04-26T20:20:47.683426+0000","last_clean":"2024-04-26T20:20:47.683426+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:20:47.683426+0000","last_undegraded":"2024-04-26T20:20:47.683426+0000","last_fullsized":"2024-04-26T20:20:47.683426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693893+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:20:47.693893+0000","last_peered":"2024-04-26T20:20:47.693893+0000","last_clean":"2024-04-26T20:20:47.693893+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:20:47.693893+0000","last_undegraded":"2024-04-26T20:20:47.693893+0000","last_fullsized":"2024-04-26T20:20:47.693893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692653+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:20:47.692653+0000","last_peered":"2024-04-26T20:20:47.692653+0000","last_clean":"2024-04-26T20:20:47.692653+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:20:47.692653+0000","last_undegraded":"2024-04-26T20:20:47.692653+0000","last_fullsized":"2024-04-26T20:20:47.692653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692119+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:20:47.692119+0000","last_peered":"2024-04-26T20:20:47.692119+0000","last_clean":"2024-04-26T20:20:47.692119+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:20:47.692119+0000","last_undegraded":"2024-04-26T20:20:47.692119+0000","last_fullsized":"2024-04-26T20:20:47.692119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819497+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:20:47.819497+0000","last_peered":"2024-04-26T20:20:47.819497+0000","last_clean":"2024-04-26T20:20:47.819497+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:20:47.819497+0000","last_undegraded":"2024-04-26T20:20:47.819497+0000","last_fullsized":"2024-04-26T20:20:47.819497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683178+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:20:47.683178+0000","last_peered":"2024-04-26T20:20:47.683178+0000","last_clean":"2024-04-26T20:20:47.683178+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:20:47.683178+0000","last_undegraded":"2024-04-26T20:20:47.683178+0000","last_fullsized":"2024-04-26T20:20:47.683178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683266+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:20:47.683266+0000","last_peered":"2024-04-26T20:20:47.683266+0000","last_clean":"2024-04-26T20:20:47.683266+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:20:47.683266+0000","last_undegraded":"2024-04-26T20:20:47.683266+0000","last_fullsized":"2024-04-26T20:20:47.683266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680866+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:20:47.680866+0000","last_peered":"2024-04-26T20:20:47.680866+0000","last_clean":"2024-04-26T20:20:47.680866+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:20:47.680866+0000","last_undegraded":"2024-04-26T20:20:47.680866+0000","last_fullsized":"2024-04-26T20:20:47.680866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680433+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:20:47.680433+0000","last_peered":"2024-04-26T20:20:47.680433+0000","last_clean":"2024-04-26T20:20:47.680433+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:20:47.680433+0000","last_undegraded":"2024-04-26T20:20:47.680433+0000","last_fullsized":"2024-04-26T20:20:47.680433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:44.356883+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:21:44.356883+0000","last_peered":"2024-04-26T20:21:44.356883+0000","last_clean":"2024-04-26T20:21:44.356883+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:21:44.356883+0000","last_undegraded":"2024-04-26T20:21:44.356883+0000","last_fullsized":"2024-04-26T20:21:44.356883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688469+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:20:47.688469+0000","last_peered":"2024-04-26T20:20:47.688469+0000","last_clean":"2024-04-26T20:20:47.688469+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:20:47.688469+0000","last_undegraded":"2024-04-26T20:20:47.688469+0000","last_fullsized":"2024-04-26T20:20:47.688469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695528+0000","last_change":"2024-04-26T20:20:47.695528+0000","last_active":"2024-04-26T20:20:47.695528+0000","last_peered":"2024-04-26T20:20:47.695528+0000","last_clean":"2024-04-26T20:20:47.695528+0000","last_became_active":"2024-04-26T20:20:47.695083+0000","last_became_peered":"2024-04-26T20:20:47.695083+0000","last_unstale":"2024-04-26T20:20:47.695528+0000","last_undegraded":"2024-04-26T20:20:47.695528+0000","last_fullsized":"2024-04-26T20:20:47.695528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:14.240451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688647+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:20:47.688647+0000","last_peered":"2024-04-26T20:20:47.688647+0000","last_clean":"2024-04-26T20:20:47.688647+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:20:47.688647+0000","last_undegraded":"2024-04-26T20:20:47.688647+0000","last_fullsized":"2024-04-26T20:20:47.688647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695987+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:20:47.695987+0000","last_peered":"2024-04-26T20:20:47.695987+0000","last_clean":"2024-04-26T20:20:47.695987+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:20:47.695987+0000","last_undegraded":"2024-04-26T20:20:47.695987+0000","last_fullsized":"2024-04-26T20:20:47.695987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682807+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:20:47.682807+0000","last_peered":"2024-04-26T20:20:47.682807+0000","last_clean":"2024-04-26T20:20:47.682807+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:20:47.682807+0000","last_undegraded":"2024-04-26T20:20:47.682807+0000","last_fullsized":"2024-04-26T20:20:47.682807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682300+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:47.682300+0000","last_peered":"2024-04-26T20:20:47.682300+0000","last_clean":"2024-04-26T20:20:47.682300+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:47.682300+0000","last_undegraded":"2024-04-26T20:20:47.682300+0000","last_fullsized":"2024-04-26T20:20:47.682300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820462+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:20:47.820462+0000","last_peered":"2024-04-26T20:20:47.820462+0000","last_clean":"2024-04-26T20:20:47.820462+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:20:47.820462+0000","last_undegraded":"2024-04-26T20:20:47.820462+0000","last_fullsized":"2024-04-26T20:20:47.820462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682683+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:20:47.682683+0000","last_peered":"2024-04-26T20:20:47.682683+0000","last_clean":"2024-04-26T20:20:47.682683+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:20:47.682683+0000","last_undegraded":"2024-04-26T20:20:47.682683+0000","last_fullsized":"2024-04-26T20:20:47.682683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682649+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:47.682649+0000","last_peered":"2024-04-26T20:20:47.682649+0000","last_clean":"2024-04-26T20:20:47.682649+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:47.682649+0000","last_undegraded":"2024-04-26T20:20:47.682649+0000","last_fullsized":"2024-04-26T20:20:47.682649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.821791+0000","last_change":"2024-04-26T20:20:47.821791+0000","last_active":"2024-04-26T20:20:47.821791+0000","last_peered":"2024-04-26T20:20:47.821791+0000","last_clean":"2024-04-26T20:20:47.821791+0000","last_became_active":"2024-04-26T20:20:47.821338+0000","last_became_peered":"2024-04-26T20:20:47.821338+0000","last_unstale":"2024-04-26T20:20:47.821791+0000","last_undegraded":"2024-04-26T20:20:47.821791+0000","last_fullsized":"2024-04-26T20:20:47.821791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:45.027699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680752+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:20:47.680752+0000","last_peered":"2024-04-26T20:20:47.680752+0000","last_clean":"2024-04-26T20:20:47.680752+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:20:47.680752+0000","last_undegraded":"2024-04-26T20:20:47.680752+0000","last_fullsized":"2024-04-26T20:20:47.680752+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:45.301453+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:21:45.301453+0000","last_peered":"2024-04-26T20:21:45.301453+0000","last_clean":"2024-04-26T20:21:45.301453+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:21:45.301453+0000","last_undegraded":"2024-04-26T20:21:45.301453+0000","last_fullsized":"2024-04-26T20:21:45.301453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683171+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:20:47.683171+0000","last_peered":"2024-04-26T20:20:47.683171+0000","last_clean":"2024-04-26T20:20:47.683171+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:20:47.683171+0000","last_undegraded":"2024-04-26T20:20:47.683171+0000","last_fullsized":"2024-04-26T20:20:47.683171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680535+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:20:47.680535+0000","last_peered":"2024-04-26T20:20:47.680535+0000","last_clean":"2024-04-26T20:20:47.680535+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:20:47.680535+0000","last_undegraded":"2024-04-26T20:20:47.680535+0000","last_fullsized":"2024-04-26T20:20:47.680535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819581+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:47.819581+0000","last_peered":"2024-04-26T20:20:47.819581+0000","last_clean":"2024-04-26T20:20:47.819581+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:47.819581+0000","last_undegraded":"2024-04-26T20:20:47.819581+0000","last_fullsized":"2024-04-26T20:20:47.819581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686726+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:20:47.686726+0000","last_peered":"2024-04-26T20:20:47.686726+0000","last_clean":"2024-04-26T20:20:47.686726+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:20:47.686726+0000","last_undegraded":"2024-04-26T20:20:47.686726+0000","last_fullsized":"2024-04-26T20:20:47.686726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683086+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:20:47.683086+0000","last_peered":"2024-04-26T20:20:47.683086+0000","last_clean":"2024-04-26T20:20:47.683086+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:20:47.683086+0000","last_undegraded":"2024-04-26T20:20:47.683086+0000","last_fullsized":"2024-04-26T20:20:47.683086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694333+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:47.694333+0000","last_peered":"2024-04-26T20:20:47.694333+0000","last_clean":"2024-04-26T20:20:47.694333+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:47.694333+0000","last_undegraded":"2024-04-26T20:20:47.694333+0000","last_fullsized":"2024-04-26T20:20:47.694333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681117+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:20:47.681117+0000","last_peered":"2024-04-26T20:20:47.681117+0000","last_clean":"2024-04-26T20:20:47.681117+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:20:47.681117+0000","last_undegraded":"2024-04-26T20:20:47.681117+0000","last_fullsized":"2024-04-26T20:20:47.681117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694126+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:20:47.694126+0000","last_peered":"2024-04-26T20:20:47.694126+0000","last_clean":"2024-04-26T20:20:47.694126+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:20:47.694126+0000","last_undegraded":"2024-04-26T20:20:47.694126+0000","last_fullsized":"2024-04-26T20:20:47.694126+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686552+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:47.686552+0000","last_peered":"2024-04-26T20:20:47.686552+0000","last_clean":"2024-04-26T20:20:47.686552+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:47.686552+0000","last_undegraded":"2024-04-26T20:20:47.686552+0000","last_fullsized":"2024-04-26T20:20:47.686552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685291+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:20:47.685291+0000","last_peered":"2024-04-26T20:20:47.685291+0000","last_clean":"2024-04-26T20:20:47.685291+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:20:47.685291+0000","last_undegraded":"2024-04-26T20:20:47.685291+0000","last_fullsized":"2024-04-26T20:20:47.685291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681210+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:20:47.681210+0000","last_peered":"2024-04-26T20:20:47.681210+0000","last_clean":"2024-04-26T20:20:47.681210+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:20:47.681210+0000","last_undegraded":"2024-04-26T20:20:47.681210+0000","last_fullsized":"2024-04-26T20:20:47.681210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":209,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.303478+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:21:47.303478+0000","last_peered":"2024-04-26T20:21:47.303478+0000","last_clean":"2024-04-26T20:21:47.303478+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:21:47.303478+0000","last_undegraded":"2024-04-26T20:21:47.303478+0000","last_fullsized":"2024-04-26T20:21:47.303478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820338+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:20:47.820338+0000","last_peered":"2024-04-26T20:20:47.820338+0000","last_clean":"2024-04-26T20:20:47.820338+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:20:47.820338+0000","last_undegraded":"2024-04-26T20:20:47.820338+0000","last_fullsized":"2024-04-26T20:20:47.820338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.700943+0000","last_change":"2024-04-26T20:20:47.700375+0000","last_active":"2024-04-26T20:20:47.700943+0000","last_peered":"2024-04-26T20:20:47.700943+0000","last_clean":"2024-04-26T20:20:47.700943+0000","last_became_active":"2024-04-26T20:20:47.699843+0000","last_became_peered":"2024-04-26T20:20:47.699843+0000","last_unstale":"2024-04-26T20:20:47.700943+0000","last_undegraded":"2024-04-26T20:20:47.700943+0000","last_fullsized":"2024-04-26T20:20:47.700943+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:53.112700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819887+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:47.819887+0000","last_peered":"2024-04-26T20:20:47.819887+0000","last_clean":"2024-04-26T20:20:47.819887+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:47.819887+0000","last_undegraded":"2024-04-26T20:20:47.819887+0000","last_fullsized":"2024-04-26T20:20:47.819887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696239+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:20:47.696239+0000","last_peered":"2024-04-26T20:20:47.696239+0000","last_clean":"2024-04-26T20:20:47.696239+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:20:47.696239+0000","last_undegraded":"2024-04-26T20:20:47.696239+0000","last_fullsized":"2024-04-26T20:20:47.696239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.821914+0000","last_change":"2024-04-26T20:20:47.821914+0000","last_active":"2024-04-26T20:20:47.821914+0000","last_peered":"2024-04-26T20:20:47.821914+0000","last_clean":"2024-04-26T20:20:47.821914+0000","last_became_active":"2024-04-26T20:20:47.821365+0000","last_became_peered":"2024-04-26T20:20:47.821365+0000","last_unstale":"2024-04-26T20:20:47.821914+0000","last_undegraded":"2024-04-26T20:20:47.821914+0000","last_fullsized":"2024-04-26T20:20:47.821914+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:12.969419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687601+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:47.687601+0000","last_peered":"2024-04-26T20:20:47.687601+0000","last_clean":"2024-04-26T20:20:47.687601+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:47.687601+0000","last_undegraded":"2024-04-26T20:20:47.687601+0000","last_fullsized":"2024-04-26T20:20:47.687601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820612+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:20:47.820612+0000","last_peered":"2024-04-26T20:20:47.820612+0000","last_clean":"2024-04-26T20:20:47.820612+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:20:47.820612+0000","last_undegraded":"2024-04-26T20:20:47.820612+0000","last_fullsized":"2024-04-26T20:20:47.820612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683429+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:20:47.683429+0000","last_peered":"2024-04-26T20:20:47.683429+0000","last_clean":"2024-04-26T20:20:47.683429+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:20:47.683429+0000","last_undegraded":"2024-04-26T20:20:47.683429+0000","last_fullsized":"2024-04-26T20:20:47.683429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'35","reported_seq":247,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.303371+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:21:47.303371+0000","last_peered":"2024-04-26T20:21:47.303371+0000","last_clean":"2024-04-26T20:21:47.303371+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:21:47.303371+0000","last_undegraded":"2024-04-26T20:21:47.303371+0000","last_fullsized":"2024-04-26T20:21:47.303371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":185,"num_read_kb":145,"num_write":37,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683195+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:20:47.683195+0000","last_peered":"2024-04-26T20:20:47.683195+0000","last_clean":"2024-04-26T20:20:47.683195+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:20:47.683195+0000","last_undegraded":"2024-04-26T20:20:47.683195+0000","last_fullsized":"2024-04-26T20:20:47.683195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687829+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:20:47.687829+0000","last_peered":"2024-04-26T20:20:47.687829+0000","last_clean":"2024-04-26T20:20:47.687829+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:20:47.687829+0000","last_undegraded":"2024-04-26T20:20:47.687829+0000","last_fullsized":"2024-04-26T20:20:47.687829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680566+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:47.680566+0000","last_peered":"2024-04-26T20:20:47.680566+0000","last_clean":"2024-04-26T20:20:47.680566+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:47.680566+0000","last_undegraded":"2024-04-26T20:20:47.680566+0000","last_fullsized":"2024-04-26T20:20:47.680566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693771+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:20:47.693771+0000","last_peered":"2024-04-26T20:20:47.693771+0000","last_clean":"2024-04-26T20:20:47.693771+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:20:47.693771+0000","last_undegraded":"2024-04-26T20:20:47.693771+0000","last_fullsized":"2024-04-26T20:20:47.693771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682728+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:20:47.682728+0000","last_peered":"2024-04-26T20:20:47.682728+0000","last_clean":"2024-04-26T20:20:47.682728+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:20:47.682728+0000","last_undegraded":"2024-04-26T20:20:47.682728+0000","last_fullsized":"2024-04-26T20:20:47.682728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686886+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:47.686886+0000","last_peered":"2024-04-26T20:20:47.686886+0000","last_clean":"2024-04-26T20:20:47.686886+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:47.686886+0000","last_undegraded":"2024-04-26T20:20:47.686886+0000","last_fullsized":"2024-04-26T20:20:47.686886+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819068+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:20:47.819068+0000","last_peered":"2024-04-26T20:20:47.819068+0000","last_clean":"2024-04-26T20:20:47.819068+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:20:47.819068+0000","last_undegraded":"2024-04-26T20:20:47.819068+0000","last_fullsized":"2024-04-26T20:20:47.819068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682394+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:20:47.682394+0000","last_peered":"2024-04-26T20:20:47.682394+0000","last_clean":"2024-04-26T20:20:47.682394+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:20:47.682394+0000","last_undegraded":"2024-04-26T20:20:47.682394+0000","last_fullsized":"2024-04-26T20:20:47.682394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:44.334720+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:21:44.334720+0000","last_peered":"2024-04-26T20:21:44.334720+0000","last_clean":"2024-04-26T20:21:44.334720+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:21:44.334720+0000","last_undegraded":"2024-04-26T20:21:44.334720+0000","last_fullsized":"2024-04-26T20:21:44.334720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818469+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:20:47.818469+0000","last_peered":"2024-04-26T20:20:47.818469+0000","last_clean":"2024-04-26T20:20:47.818469+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:20:47.818469+0000","last_undegraded":"2024-04-26T20:20:47.818469+0000","last_fullsized":"2024-04-26T20:20:47.818469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694405+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:20:47.694405+0000","last_peered":"2024-04-26T20:20:47.694405+0000","last_clean":"2024-04-26T20:20:47.694405+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:20:47.694405+0000","last_undegraded":"2024-04-26T20:20:47.694405+0000","last_fullsized":"2024-04-26T20:20:47.694405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.715108+0000","last_change":"2024-04-26T20:20:47.714651+0000","last_active":"2024-04-26T20:20:47.715108+0000","last_peered":"2024-04-26T20:20:47.715108+0000","last_clean":"2024-04-26T20:20:47.715108+0000","last_became_active":"2024-04-26T20:20:47.700320+0000","last_became_peered":"2024-04-26T20:20:47.700320+0000","last_unstale":"2024-04-26T20:20:47.715108+0000","last_undegraded":"2024-04-26T20:20:47.715108+0000","last_fullsized":"2024-04-26T20:20:47.715108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:19.935988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686270+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:20:47.686270+0000","last_peered":"2024-04-26T20:20:47.686270+0000","last_clean":"2024-04-26T20:20:47.686270+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:20:47.686270+0000","last_undegraded":"2024-04-26T20:20:47.686270+0000","last_fullsized":"2024-04-26T20:20:47.686270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822518+0000","last_change":"2024-04-26T20:20:47.821839+0000","last_active":"2024-04-26T20:20:47.822518+0000","last_peered":"2024-04-26T20:20:47.822518+0000","last_clean":"2024-04-26T20:20:47.822518+0000","last_became_active":"2024-04-26T20:20:47.821302+0000","last_became_peered":"2024-04-26T20:20:47.821302+0000","last_unstale":"2024-04-26T20:20:47.822518+0000","last_undegraded":"2024-04-26T20:20:47.822518+0000","last_fullsized":"2024-04-26T20:20:47.822518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:38.771597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683319+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:47.683319+0000","last_peered":"2024-04-26T20:20:47.683319+0000","last_clean":"2024-04-26T20:20:47.683319+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:47.683319+0000","last_undegraded":"2024-04-26T20:20:47.683319+0000","last_fullsized":"2024-04-26T20:20:47.683319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683122+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:20:47.683122+0000","last_peered":"2024-04-26T20:20:47.683122+0000","last_clean":"2024-04-26T20:20:47.683122+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:20:47.683122+0000","last_undegraded":"2024-04-26T20:20:47.683122+0000","last_fullsized":"2024-04-26T20:20:47.683122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682693+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:20:47.682693+0000","last_peered":"2024-04-26T20:20:47.682693+0000","last_clean":"2024-04-26T20:20:47.682693+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:20:47.682693+0000","last_undegraded":"2024-04-26T20:20:47.682693+0000","last_fullsized":"2024-04-26T20:20:47.682693+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.701523+0000","last_change":"2024-04-26T20:20:47.701523+0000","last_active":"2024-04-26T20:20:47.701523+0000","last_peered":"2024-04-26T20:20:47.701523+0000","last_clean":"2024-04-26T20:20:47.701523+0000","last_became_active":"2024-04-26T20:20:47.700711+0000","last_became_peered":"2024-04-26T20:20:47.700711+0000","last_unstale":"2024-04-26T20:20:47.701523+0000","last_undegraded":"2024-04-26T20:20:47.701523+0000","last_fullsized":"2024-04-26T20:20:47.701523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:37.623094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820119+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:20:47.820119+0000","last_peered":"2024-04-26T20:20:47.820119+0000","last_clean":"2024-04-26T20:20:47.820119+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:20:47.820119+0000","last_undegraded":"2024-04-26T20:20:47.820119+0000","last_fullsized":"2024-04-26T20:20:47.820119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697607+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:20:47.697607+0000","last_peered":"2024-04-26T20:20:47.697607+0000","last_clean":"2024-04-26T20:20:47.697607+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:20:47.697607+0000","last_undegraded":"2024-04-26T20:20:47.697607+0000","last_fullsized":"2024-04-26T20:20:47.697607+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:46.361766+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:21:46.361766+0000","last_peered":"2024-04-26T20:21:46.361766+0000","last_clean":"2024-04-26T20:21:46.361766+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:21:46.361766+0000","last_undegraded":"2024-04-26T20:21:46.361766+0000","last_fullsized":"2024-04-26T20:21:46.361766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819746+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:20:47.819746+0000","last_peered":"2024-04-26T20:20:47.819746+0000","last_clean":"2024-04-26T20:20:47.819746+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:20:47.819746+0000","last_undegraded":"2024-04-26T20:20:47.819746+0000","last_fullsized":"2024-04-26T20:20:47.819746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694796+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:20:47.694796+0000","last_peered":"2024-04-26T20:20:47.694796+0000","last_clean":"2024-04-26T20:20:47.694796+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:20:47.694796+0000","last_undegraded":"2024-04-26T20:20:47.694796+0000","last_fullsized":"2024-04-26T20:20:47.694796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686801+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:20:47.686801+0000","last_peered":"2024-04-26T20:20:47.686801+0000","last_clean":"2024-04-26T20:20:47.686801+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:20:47.686801+0000","last_undegraded":"2024-04-26T20:20:47.686801+0000","last_fullsized":"2024-04-26T20:20:47.686801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:45.335742+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:21:45.335742+0000","last_peered":"2024-04-26T20:21:45.335742+0000","last_clean":"2024-04-26T20:21:45.335742+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:21:45.335742+0000","last_undegraded":"2024-04-26T20:21:45.335742+0000","last_fullsized":"2024-04-26T20:21:45.335742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":89,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819385+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:20:47.819385+0000","last_peered":"2024-04-26T20:20:47.819385+0000","last_clean":"2024-04-26T20:20:47.819385+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:20:47.819385+0000","last_undegraded":"2024-04-26T20:20:47.819385+0000","last_fullsized":"2024-04-26T20:20:47.819385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684108+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:20:47.684108+0000","last_peered":"2024-04-26T20:20:47.684108+0000","last_clean":"2024-04-26T20:20:47.684108+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:20:47.684108+0000","last_undegraded":"2024-04-26T20:20:47.684108+0000","last_fullsized":"2024-04-26T20:20:47.684108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683013+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:47.683013+0000","last_peered":"2024-04-26T20:20:47.683013+0000","last_clean":"2024-04-26T20:20:47.683013+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:47.683013+0000","last_undegraded":"2024-04-26T20:20:47.683013+0000","last_fullsized":"2024-04-26T20:20:47.683013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820401+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:20:47.820401+0000","last_peered":"2024-04-26T20:20:47.820401+0000","last_clean":"2024-04-26T20:20:47.820401+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:20:47.820401+0000","last_undegraded":"2024-04-26T20:20:47.820401+0000","last_fullsized":"2024-04-26T20:20:47.820401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687153+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:20:47.687153+0000","last_peered":"2024-04-26T20:20:47.687153+0000","last_clean":"2024-04-26T20:20:47.687153+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:20:47.687153+0000","last_undegraded":"2024-04-26T20:20:47.687153+0000","last_fullsized":"2024-04-26T20:20:47.687153+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697300+0000","last_change":"2024-04-26T20:20:47.697300+0000","last_active":"2024-04-26T20:20:47.697300+0000","last_peered":"2024-04-26T20:20:47.697300+0000","last_clean":"2024-04-26T20:20:47.697300+0000","last_became_active":"2024-04-26T20:20:47.696809+0000","last_became_peered":"2024-04-26T20:20:47.696809+0000","last_unstale":"2024-04-26T20:20:47.697300+0000","last_undegraded":"2024-04-26T20:20:47.697300+0000","last_fullsized":"2024-04-26T20:20:47.697300+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:01.540485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818312+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:47.818312+0000","last_peered":"2024-04-26T20:20:47.818312+0000","last_clean":"2024-04-26T20:20:47.818312+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:47.818312+0000","last_undegraded":"2024-04-26T20:20:47.818312+0000","last_fullsized":"2024-04-26T20:20:47.818312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682687+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:20:47.682687+0000","last_peered":"2024-04-26T20:20:47.682687+0000","last_clean":"2024-04-26T20:20:47.682687+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:20:47.682687+0000","last_undegraded":"2024-04-26T20:20:47.682687+0000","last_fullsized":"2024-04-26T20:20:47.682687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683090+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:47.683090+0000","last_peered":"2024-04-26T20:20:47.683090+0000","last_clean":"2024-04-26T20:20:47.683090+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:47.683090+0000","last_undegraded":"2024-04-26T20:20:47.683090+0000","last_fullsized":"2024-04-26T20:20:47.683090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697823+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:20:47.697823+0000","last_peered":"2024-04-26T20:20:47.697823+0000","last_clean":"2024-04-26T20:20:47.697823+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:20:47.697823+0000","last_undegraded":"2024-04-26T20:20:47.697823+0000","last_fullsized":"2024-04-26T20:20:47.697823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681165+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:20:47.681165+0000","last_peered":"2024-04-26T20:20:47.681165+0000","last_clean":"2024-04-26T20:20:47.681165+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:20:47.681165+0000","last_undegraded":"2024-04-26T20:20:47.681165+0000","last_fullsized":"2024-04-26T20:20:47.681165+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684118+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:20:47.684118+0000","last_peered":"2024-04-26T20:20:47.684118+0000","last_clean":"2024-04-26T20:20:47.684118+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:20:47.684118+0000","last_undegraded":"2024-04-26T20:20:47.684118+0000","last_fullsized":"2024-04-26T20:20:47.684118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683915+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:20:47.683915+0000","last_peered":"2024-04-26T20:20:47.683915+0000","last_clean":"2024-04-26T20:20:47.683915+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:20:47.683915+0000","last_undegraded":"2024-04-26T20:20:47.683915+0000","last_fullsized":"2024-04-26T20:20:47.683915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680154+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:20:47.680154+0000","last_peered":"2024-04-26T20:20:47.680154+0000","last_clean":"2024-04-26T20:20:47.680154+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:20:47.680154+0000","last_undegraded":"2024-04-26T20:20:47.680154+0000","last_fullsized":"2024-04-26T20:20:47.680154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683262+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:47.683262+0000","last_peered":"2024-04-26T20:20:47.683262+0000","last_clean":"2024-04-26T20:20:47.683262+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:47.683262+0000","last_undegraded":"2024-04-26T20:20:47.683262+0000","last_fullsized":"2024-04-26T20:20:47.683262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694740+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:20:47.694740+0000","last_peered":"2024-04-26T20:20:47.694740+0000","last_clean":"2024-04-26T20:20:47.694740+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:20:47.694740+0000","last_undegraded":"2024-04-26T20:20:47.694740+0000","last_fullsized":"2024-04-26T20:20:47.694740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683088+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:20:47.683088+0000","last_peered":"2024-04-26T20:20:47.683088+0000","last_clean":"2024-04-26T20:20:47.683088+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:20:47.683088+0000","last_undegraded":"2024-04-26T20:20:47.683088+0000","last_fullsized":"2024-04-26T20:20:47.683088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819502+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:47.819502+0000","last_peered":"2024-04-26T20:20:47.819502+0000","last_clean":"2024-04-26T20:20:47.819502+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:47.819502+0000","last_undegraded":"2024-04-26T20:20:47.819502+0000","last_fullsized":"2024-04-26T20:20:47.819502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682196+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:20:47.682196+0000","last_peered":"2024-04-26T20:20:47.682196+0000","last_clean":"2024-04-26T20:20:47.682196+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:20:47.682196+0000","last_undegraded":"2024-04-26T20:20:47.682196+0000","last_fullsized":"2024-04-26T20:20:47.682196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682892+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:20:47.682892+0000","last_peered":"2024-04-26T20:20:47.682892+0000","last_clean":"2024-04-26T20:20:47.682892+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:20:47.682892+0000","last_undegraded":"2024-04-26T20:20:47.682892+0000","last_fullsized":"2024-04-26T20:20:47.682892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680144+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:47.680144+0000","last_peered":"2024-04-26T20:20:47.680144+0000","last_clean":"2024-04-26T20:20:47.680144+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:47.680144+0000","last_undegraded":"2024-04-26T20:20:47.680144+0000","last_fullsized":"2024-04-26T20:20:47.680144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683565+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:20:47.683565+0000","last_peered":"2024-04-26T20:20:47.683565+0000","last_clean":"2024-04-26T20:20:47.683565+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:20:47.683565+0000","last_undegraded":"2024-04-26T20:20:47.683565+0000","last_fullsized":"2024-04-26T20:20:47.683565+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682836+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:20:47.682836+0000","last_peered":"2024-04-26T20:20:47.682836+0000","last_clean":"2024-04-26T20:20:47.682836+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:20:47.682836+0000","last_undegraded":"2024-04-26T20:20:47.682836+0000","last_fullsized":"2024-04-26T20:20:47.682836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680277+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:47.680277+0000","last_peered":"2024-04-26T20:20:47.680277+0000","last_clean":"2024-04-26T20:20:47.680277+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:47.680277+0000","last_undegraded":"2024-04-26T20:20:47.680277+0000","last_fullsized":"2024-04-26T20:20:47.680277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685616+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:20:47.685616+0000","last_peered":"2024-04-26T20:20:47.685616+0000","last_clean":"2024-04-26T20:20:47.685616+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:20:47.685616+0000","last_undegraded":"2024-04-26T20:20:47.685616+0000","last_fullsized":"2024-04-26T20:20:47.685616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683053+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:20:47.683053+0000","last_peered":"2024-04-26T20:20:47.683053+0000","last_clean":"2024-04-26T20:20:47.683053+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:20:47.683053+0000","last_undegraded":"2024-04-26T20:20:47.683053+0000","last_fullsized":"2024-04-26T20:20:47.683053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682576+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:47.682576+0000","last_peered":"2024-04-26T20:20:47.682576+0000","last_clean":"2024-04-26T20:20:47.682576+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:47.682576+0000","last_undegraded":"2024-04-26T20:20:47.682576+0000","last_fullsized":"2024-04-26T20:20:47.682576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819016+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:20:47.819016+0000","last_peered":"2024-04-26T20:20:47.819016+0000","last_clean":"2024-04-26T20:20:47.819016+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:20:47.819016+0000","last_undegraded":"2024-04-26T20:20:47.819016+0000","last_fullsized":"2024-04-26T20:20:47.819016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818816+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:20:47.818816+0000","last_peered":"2024-04-26T20:20:47.818816+0000","last_clean":"2024-04-26T20:20:47.818816+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:20:47.818816+0000","last_undegraded":"2024-04-26T20:20:47.818816+0000","last_fullsized":"2024-04-26T20:20:47.818816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:45.359484+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:21:45.359484+0000","last_peered":"2024-04-26T20:21:45.359484+0000","last_clean":"2024-04-26T20:21:45.359484+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:21:45.359484+0000","last_undegraded":"2024-04-26T20:21:45.359484+0000","last_fullsized":"2024-04-26T20:21:45.359484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819630+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:20:47.819630+0000","last_peered":"2024-04-26T20:20:47.819630+0000","last_clean":"2024-04-26T20:20:47.819630+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:20:47.819630+0000","last_undegraded":"2024-04-26T20:20:47.819630+0000","last_fullsized":"2024-04-26T20:20:47.819630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692667+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:20:47.692667+0000","last_peered":"2024-04-26T20:20:47.692667+0000","last_clean":"2024-04-26T20:20:47.692667+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:20:47.692667+0000","last_undegraded":"2024-04-26T20:20:47.692667+0000","last_fullsized":"2024-04-26T20:20:47.692667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687715+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:47.687715+0000","last_peered":"2024-04-26T20:20:47.687715+0000","last_clean":"2024-04-26T20:20:47.687715+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:47.687715+0000","last_undegraded":"2024-04-26T20:20:47.687715+0000","last_fullsized":"2024-04-26T20:20:47.687715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819345+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:20:47.819345+0000","last_peered":"2024-04-26T20:20:47.819345+0000","last_clean":"2024-04-26T20:20:47.819345+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:20:47.819345+0000","last_undegraded":"2024-04-26T20:20:47.819345+0000","last_fullsized":"2024-04-26T20:20:47.819345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685915+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:20:47.685915+0000","last_peered":"2024-04-26T20:20:47.685915+0000","last_clean":"2024-04-26T20:20:47.685915+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:20:47.685915+0000","last_undegraded":"2024-04-26T20:20:47.685915+0000","last_fullsized":"2024-04-26T20:20:47.685915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692811+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:47.692811+0000","last_peered":"2024-04-26T20:20:47.692811+0000","last_clean":"2024-04-26T20:20:47.692811+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:47.692811+0000","last_undegraded":"2024-04-26T20:20:47.692811+0000","last_fullsized":"2024-04-26T20:20:47.692811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819954+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:20:47.819954+0000","last_peered":"2024-04-26T20:20:47.819954+0000","last_clean":"2024-04-26T20:20:47.819954+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:20:47.819954+0000","last_undegraded":"2024-04-26T20:20:47.819954+0000","last_fullsized":"2024-04-26T20:20:47.819954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.691705+0000","last_change":"2024-04-26T20:20:47.691705+0000","last_active":"2024-04-26T20:20:47.691705+0000","last_peered":"2024-04-26T20:20:47.691705+0000","last_clean":"2024-04-26T20:20:47.691705+0000","last_became_active":"2024-04-26T20:20:47.691330+0000","last_became_peered":"2024-04-26T20:20:47.691330+0000","last_unstale":"2024-04-26T20:20:47.691705+0000","last_undegraded":"2024-04-26T20:20:47.691705+0000","last_fullsized":"2024-04-26T20:20:47.691705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:36.045725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680555+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:20:47.680555+0000","last_peered":"2024-04-26T20:20:47.680555+0000","last_clean":"2024-04-26T20:20:47.680555+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:20:47.680555+0000","last_undegraded":"2024-04-26T20:20:47.680555+0000","last_fullsized":"2024-04-26T20:20:47.680555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680256+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:20:47.680256+0000","last_peered":"2024-04-26T20:20:47.680256+0000","last_clean":"2024-04-26T20:20:47.680256+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:20:47.680256+0000","last_undegraded":"2024-04-26T20:20:47.680256+0000","last_fullsized":"2024-04-26T20:20:47.680256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692886+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:20:47.692886+0000","last_peered":"2024-04-26T20:20:47.692886+0000","last_clean":"2024-04-26T20:20:47.692886+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:20:47.692886+0000","last_undegraded":"2024-04-26T20:20:47.692886+0000","last_fullsized":"2024-04-26T20:20:47.692886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.701792+0000","last_change":"2024-04-26T20:20:47.701792+0000","last_active":"2024-04-26T20:20:47.701792+0000","last_peered":"2024-04-26T20:20:47.701792+0000","last_clean":"2024-04-26T20:20:47.701792+0000","last_became_active":"2024-04-26T20:20:47.701226+0000","last_became_peered":"2024-04-26T20:20:47.701226+0000","last_unstale":"2024-04-26T20:20:47.701792+0000","last_undegraded":"2024-04-26T20:20:47.701792+0000","last_fullsized":"2024-04-26T20:20:47.701792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:56.095557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682901+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:20:47.682901+0000","last_peered":"2024-04-26T20:20:47.682901+0000","last_clean":"2024-04-26T20:20:47.682901+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:20:47.682901+0000","last_undegraded":"2024-04-26T20:20:47.682901+0000","last_fullsized":"2024-04-26T20:20:47.682901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680987+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:20:47.680987+0000","last_peered":"2024-04-26T20:20:47.680987+0000","last_clean":"2024-04-26T20:20:47.680987+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:20:47.680987+0000","last_undegraded":"2024-04-26T20:20:47.680987+0000","last_fullsized":"2024-04-26T20:20:47.680987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684389+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:20:47.684389+0000","last_peered":"2024-04-26T20:20:47.684389+0000","last_clean":"2024-04-26T20:20:47.684389+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:20:47.684389+0000","last_undegraded":"2024-04-26T20:20:47.684389+0000","last_fullsized":"2024-04-26T20:20:47.684389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686689+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:20:47.686689+0000","last_peered":"2024-04-26T20:20:47.686689+0000","last_clean":"2024-04-26T20:20:47.686689+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:20:47.686689+0000","last_undegraded":"2024-04-26T20:20:47.686689+0000","last_fullsized":"2024-04-26T20:20:47.686689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681474+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:20:47.681474+0000","last_peered":"2024-04-26T20:20:47.681474+0000","last_clean":"2024-04-26T20:20:47.681474+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:20:47.681474+0000","last_undegraded":"2024-04-26T20:20:47.681474+0000","last_fullsized":"2024-04-26T20:20:47.681474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819202+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:20:47.819202+0000","last_peered":"2024-04-26T20:20:47.819202+0000","last_clean":"2024-04-26T20:20:47.819202+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:20:47.819202+0000","last_undegraded":"2024-04-26T20:20:47.819202+0000","last_fullsized":"2024-04-26T20:20:47.819202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693786+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:20:47.693786+0000","last_peered":"2024-04-26T20:20:47.693786+0000","last_clean":"2024-04-26T20:20:47.693786+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:20:47.693786+0000","last_undegraded":"2024-04-26T20:20:47.693786+0000","last_fullsized":"2024-04-26T20:20:47.693786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682912+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:20:47.682912+0000","last_peered":"2024-04-26T20:20:47.682912+0000","last_clean":"2024-04-26T20:20:47.682912+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:20:47.682912+0000","last_undegraded":"2024-04-26T20:20:47.682912+0000","last_fullsized":"2024-04-26T20:20:47.682912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62030,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":919,"num_read_kb":528,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":186090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37024,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708128,"statfs":{"total":95995035648,"available":95957123072,"internally_reserved":0,"allocated":1720320,"data_stored":1143458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1060864,"data_stored":505451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":501621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1650688,"data_stored":1098230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495683,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":496859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":552715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":498706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411418,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":553326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":501324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1658880,"data_stored":1093421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:21:50.991 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T20:21:51.484 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:51.881 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:51 smithi082 ceph-mon[28105]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:21:51.882 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:51 smithi082 ceph-mon[28105]: pgmap v383: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:51 smithi139 ceph-mon[32999]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:21:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:51 smithi139 ceph-mon[32999]: pgmap v383: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:51 smithi135 ceph-mon[32816]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:21:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:51 smithi135 ceph-mon[32816]: pgmap v383: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 -- 172.21.15.82:0/2826643698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3010b640 msgr2=0x7fce3010ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 --2- 172.21.15.82:0/2826643698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3010b640 0x7fce3010ba20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce24009990 tx=0x7fce24009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 -- 172.21.15.82:0/2826643698 shutdown_connections 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 --2- 172.21.15.82:0/2826643698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106000 0x7fce30112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 --2- 172.21.15.82:0/2826643698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce3010b640 0x7fce3010ba20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 --2- 172.21.15.82:0/2826643698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce30105640 0x7fce30105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 -- 172.21.15.82:0/2826643698 >> 172.21.15.82:0/2826643698 conn(0x7fce30101130 msgr2=0x7fce30103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 -- 172.21.15.82:0/2826643698 shutdown_connections 2024-04-26T20:21:53.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.748+0000 7fce37a00700 1 -- 172.21.15.82:0/2826643698 wait complete. 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.749+0000 7fce37a00700 1 Processor -- start 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.749+0000 7fce37a00700 1 -- start start 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce37a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30105640 0x7fce3019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce37a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30106000 0x7fce3019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce37a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 0x7fce301a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce37a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce30115870 con 0x7fce3010b640 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce37a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce301156f0 con 0x7fce30106000 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce37a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce301159f0 con 0x7fce30105640 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 0x7fce301a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:53.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 0x7fce301a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55558/0 (socket says 172.21.15.82:55558) 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 -- 172.21.15.82:0/1769033400 learned_addr learned my addr 172.21.15.82:0/1769033400 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35000700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30105640 0x7fce3019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce2fe00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30106000 0x7fce3019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 -- 172.21.15.82:0/1769033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30105640 msgr2=0x7fce3019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30105640 0x7fce3019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 -- 172.21.15.82:0/1769033400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30106000 msgr2=0x7fce3019c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.750+0000 7fce35a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30106000 0x7fce3019c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce35a00700 1 -- 172.21.15.82:0/1769033400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce301a0d30 con 0x7fce3010b640 2024-04-26T20:21:53.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce35a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 0x7fce301a05f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fce28007ee0 tx=0x7fce2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28004bb0 con 0x7fce3010b640 2024-04-26T20:21:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce301a1020 con 0x7fce3010b640 2024-04-26T20:21:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce28004d50 con 0x7fce3010b640 2024-04-26T20:21:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce280058c0 con 0x7fce3010b640 2024-04-26T20:21:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.751+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce301a88a0 con 0x7fce3010b640 2024-04-26T20:21:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.753+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3010dbd0 con 0x7fce3010b640 2024-04-26T20:21:53.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.754+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fce2801a020 con 0x7fce3010b640 2024-04-26T20:21:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.757+0000 7fce2d600700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fce180a3cd0 0x7fce180a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.757+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fce280cff40 con 0x7fce3010b640 2024-04-26T20:21:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.757+0000 7fce35000700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fce180a3cd0 0x7fce180a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.758+0000 7fce35000700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fce180a3cd0 0x7fce180a6190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce2400b2e0 tx=0x7fce24005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:53.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.761+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fce28010070 con 0x7fce3010b640 2024-04-26T20:21:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:53 smithi082 ceph-mon[28105]: pgmap v384: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:21:53.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:53.986+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce30063860 con 0x7fce180a3cd0 2024-04-26T20:21:54.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.000+0000 7fce2d600700 1 -- 172.21.15.82:0/1769033400 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340430 (secure 0 0 0) 0x7fce2407b1e0 con 0x7fce180a3cd0 2024-04-26T20:21:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fce180a3cd0 msgr2=0x7fce180a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fce180a3cd0 0x7fce180a6190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce2400b2e0 tx=0x7fce24005fd0 comp rx=0 tx=0).stop 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 msgr2=0x7fce301a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 0x7fce301a05f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fce28007ee0 tx=0x7fce2800d3b0 comp rx=0 tx=0).stop 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 shutdown_connections 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3010b640 0x7fce301a05f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30105640 0x7fce3019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fce180a3cd0 0x7fce180a6190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 --2- 172.21.15.82:0/1769033400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30106000 0x7fce3019c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.008+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 >> 172.21.15.82:0/1769033400 conn(0x7fce30101130 msgr2=0x7fce30101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.009+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 shutdown_connections 2024-04-26T20:21:54.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:54.009+0000 7fce37a00700 1 -- 172.21.15.82:0/1769033400 wait complete. 2024-04-26T20:21:54.011 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:21:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:53 smithi139 ceph-mon[32999]: pgmap v384: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:21:54.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:53 smithi135 ceph-mon[32816]: pgmap v384: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:21:54.872 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-04-26T20:21:52.623446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652632,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1070,"num_read_kb":647,"num_write":429,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375928,"kb_used_data":14216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565896,"statfs":{"total":1151940427776,"available":1151555477504,"internally_reserved":0,"allocated":14557184,"data_stored":7943606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":60,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006152"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683338+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:20:47.683338+0000","last_peered":"2024-04-26T20:20:47.683338+0000","last_clean":"2024-04-26T20:20:47.683338+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:20:47.683338+0000","last_undegraded":"2024-04-26T20:20:47.683338+0000","last_fullsized":"2024-04-26T20:20:47.683338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694621+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:20:47.694621+0000","last_peered":"2024-04-26T20:20:47.694621+0000","last_clean":"2024-04-26T20:20:47.694621+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:20:47.694621+0000","last_undegraded":"2024-04-26T20:20:47.694621+0000","last_fullsized":"2024-04-26T20:20:47.694621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693141+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:20:47.693141+0000","last_peered":"2024-04-26T20:20:47.693141+0000","last_clean":"2024-04-26T20:20:47.693141+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:20:47.693141+0000","last_undegraded":"2024-04-26T20:20:47.693141+0000","last_fullsized":"2024-04-26T20:20:47.693141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683550+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:20:47.683550+0000","last_peered":"2024-04-26T20:20:47.683550+0000","last_clean":"2024-04-26T20:20:47.683550+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:20:47.683550+0000","last_undegraded":"2024-04-26T20:20:47.683550+0000","last_fullsized":"2024-04-26T20:20:47.683550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682467+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:20:47.682467+0000","last_peered":"2024-04-26T20:20:47.682467+0000","last_clean":"2024-04-26T20:20:47.682467+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:20:47.682467+0000","last_undegraded":"2024-04-26T20:20:47.682467+0000","last_fullsized":"2024-04-26T20:20:47.682467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819733+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:20:47.819733+0000","last_peered":"2024-04-26T20:20:47.819733+0000","last_clean":"2024-04-26T20:20:47.819733+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:20:47.819733+0000","last_undegraded":"2024-04-26T20:20:47.819733+0000","last_fullsized":"2024-04-26T20:20:47.819733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818584+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:20:47.818584+0000","last_peered":"2024-04-26T20:20:47.818584+0000","last_clean":"2024-04-26T20:20:47.818584+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:20:47.818584+0000","last_undegraded":"2024-04-26T20:20:47.818584+0000","last_fullsized":"2024-04-26T20:20:47.818584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680822+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:20:47.680822+0000","last_peered":"2024-04-26T20:20:47.680822+0000","last_clean":"2024-04-26T20:20:47.680822+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:20:47.680822+0000","last_undegraded":"2024-04-26T20:20:47.680822+0000","last_fullsized":"2024-04-26T20:20:47.680822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820727+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:20:47.820727+0000","last_peered":"2024-04-26T20:20:47.820727+0000","last_clean":"2024-04-26T20:20:47.820727+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:20:47.820727+0000","last_undegraded":"2024-04-26T20:20:47.820727+0000","last_fullsized":"2024-04-26T20:20:47.820727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820297+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:20:47.820297+0000","last_peered":"2024-04-26T20:20:47.820297+0000","last_clean":"2024-04-26T20:20:47.820297+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:20:47.820297+0000","last_undegraded":"2024-04-26T20:20:47.820297+0000","last_fullsized":"2024-04-26T20:20:47.820297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819599+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:20:47.819599+0000","last_peered":"2024-04-26T20:20:47.819599+0000","last_clean":"2024-04-26T20:20:47.819599+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:20:47.819599+0000","last_undegraded":"2024-04-26T20:20:47.819599+0000","last_fullsized":"2024-04-26T20:20:47.819599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683426+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:20:47.683426+0000","last_peered":"2024-04-26T20:20:47.683426+0000","last_clean":"2024-04-26T20:20:47.683426+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:20:47.683426+0000","last_undegraded":"2024-04-26T20:20:47.683426+0000","last_fullsized":"2024-04-26T20:20:47.683426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693893+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:20:47.693893+0000","last_peered":"2024-04-26T20:20:47.693893+0000","last_clean":"2024-04-26T20:20:47.693893+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:20:47.693893+0000","last_undegraded":"2024-04-26T20:20:47.693893+0000","last_fullsized":"2024-04-26T20:20:47.693893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692653+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:20:47.692653+0000","last_peered":"2024-04-26T20:20:47.692653+0000","last_clean":"2024-04-26T20:20:47.692653+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:20:47.692653+0000","last_undegraded":"2024-04-26T20:20:47.692653+0000","last_fullsized":"2024-04-26T20:20:47.692653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692119+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:20:47.692119+0000","last_peered":"2024-04-26T20:20:47.692119+0000","last_clean":"2024-04-26T20:20:47.692119+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:20:47.692119+0000","last_undegraded":"2024-04-26T20:20:47.692119+0000","last_fullsized":"2024-04-26T20:20:47.692119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819497+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:20:47.819497+0000","last_peered":"2024-04-26T20:20:47.819497+0000","last_clean":"2024-04-26T20:20:47.819497+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:20:47.819497+0000","last_undegraded":"2024-04-26T20:20:47.819497+0000","last_fullsized":"2024-04-26T20:20:47.819497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683178+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:20:47.683178+0000","last_peered":"2024-04-26T20:20:47.683178+0000","last_clean":"2024-04-26T20:20:47.683178+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:20:47.683178+0000","last_undegraded":"2024-04-26T20:20:47.683178+0000","last_fullsized":"2024-04-26T20:20:47.683178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683266+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:20:47.683266+0000","last_peered":"2024-04-26T20:20:47.683266+0000","last_clean":"2024-04-26T20:20:47.683266+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:20:47.683266+0000","last_undegraded":"2024-04-26T20:20:47.683266+0000","last_fullsized":"2024-04-26T20:20:47.683266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680866+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:20:47.680866+0000","last_peered":"2024-04-26T20:20:47.680866+0000","last_clean":"2024-04-26T20:20:47.680866+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:20:47.680866+0000","last_undegraded":"2024-04-26T20:20:47.680866+0000","last_fullsized":"2024-04-26T20:20:47.680866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680433+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:20:47.680433+0000","last_peered":"2024-04-26T20:20:47.680433+0000","last_clean":"2024-04-26T20:20:47.680433+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:20:47.680433+0000","last_undegraded":"2024-04-26T20:20:47.680433+0000","last_fullsized":"2024-04-26T20:20:47.680433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:49.366239+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:21:49.366239+0000","last_peered":"2024-04-26T20:21:49.366239+0000","last_clean":"2024-04-26T20:21:49.366239+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:21:49.366239+0000","last_undegraded":"2024-04-26T20:21:49.366239+0000","last_fullsized":"2024-04-26T20:21:49.366239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688469+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:20:47.688469+0000","last_peered":"2024-04-26T20:20:47.688469+0000","last_clean":"2024-04-26T20:20:47.688469+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:20:47.688469+0000","last_undegraded":"2024-04-26T20:20:47.688469+0000","last_fullsized":"2024-04-26T20:20:47.688469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695528+0000","last_change":"2024-04-26T20:20:47.695528+0000","last_active":"2024-04-26T20:20:47.695528+0000","last_peered":"2024-04-26T20:20:47.695528+0000","last_clean":"2024-04-26T20:20:47.695528+0000","last_became_active":"2024-04-26T20:20:47.695083+0000","last_became_peered":"2024-04-26T20:20:47.695083+0000","last_unstale":"2024-04-26T20:20:47.695528+0000","last_undegraded":"2024-04-26T20:20:47.695528+0000","last_fullsized":"2024-04-26T20:20:47.695528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:14.240451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688647+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:20:47.688647+0000","last_peered":"2024-04-26T20:20:47.688647+0000","last_clean":"2024-04-26T20:20:47.688647+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:20:47.688647+0000","last_undegraded":"2024-04-26T20:20:47.688647+0000","last_fullsized":"2024-04-26T20:20:47.688647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695987+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:20:47.695987+0000","last_peered":"2024-04-26T20:20:47.695987+0000","last_clean":"2024-04-26T20:20:47.695987+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:20:47.695987+0000","last_undegraded":"2024-04-26T20:20:47.695987+0000","last_fullsized":"2024-04-26T20:20:47.695987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682807+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:20:47.682807+0000","last_peered":"2024-04-26T20:20:47.682807+0000","last_clean":"2024-04-26T20:20:47.682807+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:20:47.682807+0000","last_undegraded":"2024-04-26T20:20:47.682807+0000","last_fullsized":"2024-04-26T20:20:47.682807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682300+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:47.682300+0000","last_peered":"2024-04-26T20:20:47.682300+0000","last_clean":"2024-04-26T20:20:47.682300+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:47.682300+0000","last_undegraded":"2024-04-26T20:20:47.682300+0000","last_fullsized":"2024-04-26T20:20:47.682300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820462+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:20:47.820462+0000","last_peered":"2024-04-26T20:20:47.820462+0000","last_clean":"2024-04-26T20:20:47.820462+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:20:47.820462+0000","last_undegraded":"2024-04-26T20:20:47.820462+0000","last_fullsized":"2024-04-26T20:20:47.820462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682683+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:20:47.682683+0000","last_peered":"2024-04-26T20:20:47.682683+0000","last_clean":"2024-04-26T20:20:47.682683+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:20:47.682683+0000","last_undegraded":"2024-04-26T20:20:47.682683+0000","last_fullsized":"2024-04-26T20:20:47.682683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682649+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:47.682649+0000","last_peered":"2024-04-26T20:20:47.682649+0000","last_clean":"2024-04-26T20:20:47.682649+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:47.682649+0000","last_undegraded":"2024-04-26T20:20:47.682649+0000","last_fullsized":"2024-04-26T20:20:47.682649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.821791+0000","last_change":"2024-04-26T20:20:47.821791+0000","last_active":"2024-04-26T20:20:47.821791+0000","last_peered":"2024-04-26T20:20:47.821791+0000","last_clean":"2024-04-26T20:20:47.821791+0000","last_became_active":"2024-04-26T20:20:47.821338+0000","last_became_peered":"2024-04-26T20:20:47.821338+0000","last_unstale":"2024-04-26T20:20:47.821791+0000","last_undegraded":"2024-04-26T20:20:47.821791+0000","last_fullsized":"2024-04-26T20:20:47.821791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:45.027699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680752+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:20:47.680752+0000","last_peered":"2024-04-26T20:20:47.680752+0000","last_clean":"2024-04-26T20:20:47.680752+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:20:47.680752+0000","last_undegraded":"2024-04-26T20:20:47.680752+0000","last_fullsized":"2024-04-26T20:20:47.680752+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:50.308144+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:21:50.308144+0000","last_peered":"2024-04-26T20:21:50.308144+0000","last_clean":"2024-04-26T20:21:50.308144+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:21:50.308144+0000","last_undegraded":"2024-04-26T20:21:50.308144+0000","last_fullsized":"2024-04-26T20:21:50.308144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683171+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:20:47.683171+0000","last_peered":"2024-04-26T20:20:47.683171+0000","last_clean":"2024-04-26T20:20:47.683171+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:20:47.683171+0000","last_undegraded":"2024-04-26T20:20:47.683171+0000","last_fullsized":"2024-04-26T20:20:47.683171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680535+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:20:47.680535+0000","last_peered":"2024-04-26T20:20:47.680535+0000","last_clean":"2024-04-26T20:20:47.680535+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:20:47.680535+0000","last_undegraded":"2024-04-26T20:20:47.680535+0000","last_fullsized":"2024-04-26T20:20:47.680535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819581+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:47.819581+0000","last_peered":"2024-04-26T20:20:47.819581+0000","last_clean":"2024-04-26T20:20:47.819581+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:47.819581+0000","last_undegraded":"2024-04-26T20:20:47.819581+0000","last_fullsized":"2024-04-26T20:20:47.819581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686726+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:20:47.686726+0000","last_peered":"2024-04-26T20:20:47.686726+0000","last_clean":"2024-04-26T20:20:47.686726+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:20:47.686726+0000","last_undegraded":"2024-04-26T20:20:47.686726+0000","last_fullsized":"2024-04-26T20:20:47.686726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683086+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:20:47.683086+0000","last_peered":"2024-04-26T20:20:47.683086+0000","last_clean":"2024-04-26T20:20:47.683086+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:20:47.683086+0000","last_undegraded":"2024-04-26T20:20:47.683086+0000","last_fullsized":"2024-04-26T20:20:47.683086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694333+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:47.694333+0000","last_peered":"2024-04-26T20:20:47.694333+0000","last_clean":"2024-04-26T20:20:47.694333+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:47.694333+0000","last_undegraded":"2024-04-26T20:20:47.694333+0000","last_fullsized":"2024-04-26T20:20:47.694333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681117+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:20:47.681117+0000","last_peered":"2024-04-26T20:20:47.681117+0000","last_clean":"2024-04-26T20:20:47.681117+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:20:47.681117+0000","last_undegraded":"2024-04-26T20:20:47.681117+0000","last_fullsized":"2024-04-26T20:20:47.681117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694126+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:20:47.694126+0000","last_peered":"2024-04-26T20:20:47.694126+0000","last_clean":"2024-04-26T20:20:47.694126+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:20:47.694126+0000","last_undegraded":"2024-04-26T20:20:47.694126+0000","last_fullsized":"2024-04-26T20:20:47.694126+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686552+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:47.686552+0000","last_peered":"2024-04-26T20:20:47.686552+0000","last_clean":"2024-04-26T20:20:47.686552+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:47.686552+0000","last_undegraded":"2024-04-26T20:20:47.686552+0000","last_fullsized":"2024-04-26T20:20:47.686552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685291+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:20:47.685291+0000","last_peered":"2024-04-26T20:20:47.685291+0000","last_clean":"2024-04-26T20:20:47.685291+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:20:47.685291+0000","last_undegraded":"2024-04-26T20:20:47.685291+0000","last_fullsized":"2024-04-26T20:20:47.685291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681210+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:20:47.681210+0000","last_peered":"2024-04-26T20:20:47.681210+0000","last_clean":"2024-04-26T20:20:47.681210+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:20:47.681210+0000","last_undegraded":"2024-04-26T20:20:47.681210+0000","last_fullsized":"2024-04-26T20:20:47.681210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":209,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.303478+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:21:47.303478+0000","last_peered":"2024-04-26T20:21:47.303478+0000","last_clean":"2024-04-26T20:21:47.303478+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:21:47.303478+0000","last_undegraded":"2024-04-26T20:21:47.303478+0000","last_fullsized":"2024-04-26T20:21:47.303478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820338+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:20:47.820338+0000","last_peered":"2024-04-26T20:20:47.820338+0000","last_clean":"2024-04-26T20:20:47.820338+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:20:47.820338+0000","last_undegraded":"2024-04-26T20:20:47.820338+0000","last_fullsized":"2024-04-26T20:20:47.820338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.700943+0000","last_change":"2024-04-26T20:20:47.700375+0000","last_active":"2024-04-26T20:20:47.700943+0000","last_peered":"2024-04-26T20:20:47.700943+0000","last_clean":"2024-04-26T20:20:47.700943+0000","last_became_active":"2024-04-26T20:20:47.699843+0000","last_became_peered":"2024-04-26T20:20:47.699843+0000","last_unstale":"2024-04-26T20:20:47.700943+0000","last_undegraded":"2024-04-26T20:20:47.700943+0000","last_fullsized":"2024-04-26T20:20:47.700943+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:53.112700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819887+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:47.819887+0000","last_peered":"2024-04-26T20:20:47.819887+0000","last_clean":"2024-04-26T20:20:47.819887+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:47.819887+0000","last_undegraded":"2024-04-26T20:20:47.819887+0000","last_fullsized":"2024-04-26T20:20:47.819887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696239+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:20:47.696239+0000","last_peered":"2024-04-26T20:20:47.696239+0000","last_clean":"2024-04-26T20:20:47.696239+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:20:47.696239+0000","last_undegraded":"2024-04-26T20:20:47.696239+0000","last_fullsized":"2024-04-26T20:20:47.696239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.821914+0000","last_change":"2024-04-26T20:20:47.821914+0000","last_active":"2024-04-26T20:20:47.821914+0000","last_peered":"2024-04-26T20:20:47.821914+0000","last_clean":"2024-04-26T20:20:47.821914+0000","last_became_active":"2024-04-26T20:20:47.821365+0000","last_became_peered":"2024-04-26T20:20:47.821365+0000","last_unstale":"2024-04-26T20:20:47.821914+0000","last_undegraded":"2024-04-26T20:20:47.821914+0000","last_fullsized":"2024-04-26T20:20:47.821914+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:12.969419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687601+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:47.687601+0000","last_peered":"2024-04-26T20:20:47.687601+0000","last_clean":"2024-04-26T20:20:47.687601+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:47.687601+0000","last_undegraded":"2024-04-26T20:20:47.687601+0000","last_fullsized":"2024-04-26T20:20:47.687601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820612+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:20:47.820612+0000","last_peered":"2024-04-26T20:20:47.820612+0000","last_clean":"2024-04-26T20:20:47.820612+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:20:47.820612+0000","last_undegraded":"2024-04-26T20:20:47.820612+0000","last_fullsized":"2024-04-26T20:20:47.820612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683429+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:20:47.683429+0000","last_peered":"2024-04-26T20:20:47.683429+0000","last_clean":"2024-04-26T20:20:47.683429+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:20:47.683429+0000","last_undegraded":"2024-04-26T20:20:47.683429+0000","last_fullsized":"2024-04-26T20:20:47.683429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'35","reported_seq":247,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.303371+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:21:47.303371+0000","last_peered":"2024-04-26T20:21:47.303371+0000","last_clean":"2024-04-26T20:21:47.303371+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:21:47.303371+0000","last_undegraded":"2024-04-26T20:21:47.303371+0000","last_fullsized":"2024-04-26T20:21:47.303371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54826,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":185,"num_read_kb":145,"num_write":37,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683195+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:20:47.683195+0000","last_peered":"2024-04-26T20:20:47.683195+0000","last_clean":"2024-04-26T20:20:47.683195+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:20:47.683195+0000","last_undegraded":"2024-04-26T20:20:47.683195+0000","last_fullsized":"2024-04-26T20:20:47.683195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687829+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:20:47.687829+0000","last_peered":"2024-04-26T20:20:47.687829+0000","last_clean":"2024-04-26T20:20:47.687829+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:20:47.687829+0000","last_undegraded":"2024-04-26T20:20:47.687829+0000","last_fullsized":"2024-04-26T20:20:47.687829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680566+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:47.680566+0000","last_peered":"2024-04-26T20:20:47.680566+0000","last_clean":"2024-04-26T20:20:47.680566+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:47.680566+0000","last_undegraded":"2024-04-26T20:20:47.680566+0000","last_fullsized":"2024-04-26T20:20:47.680566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693771+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:20:47.693771+0000","last_peered":"2024-04-26T20:20:47.693771+0000","last_clean":"2024-04-26T20:20:47.693771+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:20:47.693771+0000","last_undegraded":"2024-04-26T20:20:47.693771+0000","last_fullsized":"2024-04-26T20:20:47.693771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682728+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:20:47.682728+0000","last_peered":"2024-04-26T20:20:47.682728+0000","last_clean":"2024-04-26T20:20:47.682728+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:20:47.682728+0000","last_undegraded":"2024-04-26T20:20:47.682728+0000","last_fullsized":"2024-04-26T20:20:47.682728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686886+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:47.686886+0000","last_peered":"2024-04-26T20:20:47.686886+0000","last_clean":"2024-04-26T20:20:47.686886+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:47.686886+0000","last_undegraded":"2024-04-26T20:20:47.686886+0000","last_fullsized":"2024-04-26T20:20:47.686886+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819068+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:20:47.819068+0000","last_peered":"2024-04-26T20:20:47.819068+0000","last_clean":"2024-04-26T20:20:47.819068+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:20:47.819068+0000","last_undegraded":"2024-04-26T20:20:47.819068+0000","last_fullsized":"2024-04-26T20:20:47.819068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682394+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:20:47.682394+0000","last_peered":"2024-04-26T20:20:47.682394+0000","last_clean":"2024-04-26T20:20:47.682394+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:20:47.682394+0000","last_undegraded":"2024-04-26T20:20:47.682394+0000","last_fullsized":"2024-04-26T20:20:47.682394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:49.343956+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:21:49.343956+0000","last_peered":"2024-04-26T20:21:49.343956+0000","last_clean":"2024-04-26T20:21:49.343956+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:21:49.343956+0000","last_undegraded":"2024-04-26T20:21:49.343956+0000","last_fullsized":"2024-04-26T20:21:49.343956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818469+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:20:47.818469+0000","last_peered":"2024-04-26T20:20:47.818469+0000","last_clean":"2024-04-26T20:20:47.818469+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:20:47.818469+0000","last_undegraded":"2024-04-26T20:20:47.818469+0000","last_fullsized":"2024-04-26T20:20:47.818469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694405+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:20:47.694405+0000","last_peered":"2024-04-26T20:20:47.694405+0000","last_clean":"2024-04-26T20:20:47.694405+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:20:47.694405+0000","last_undegraded":"2024-04-26T20:20:47.694405+0000","last_fullsized":"2024-04-26T20:20:47.694405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.715108+0000","last_change":"2024-04-26T20:20:47.714651+0000","last_active":"2024-04-26T20:20:47.715108+0000","last_peered":"2024-04-26T20:20:47.715108+0000","last_clean":"2024-04-26T20:20:47.715108+0000","last_became_active":"2024-04-26T20:20:47.700320+0000","last_became_peered":"2024-04-26T20:20:47.700320+0000","last_unstale":"2024-04-26T20:20:47.715108+0000","last_undegraded":"2024-04-26T20:20:47.715108+0000","last_fullsized":"2024-04-26T20:20:47.715108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:19.935988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686270+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:20:47.686270+0000","last_peered":"2024-04-26T20:20:47.686270+0000","last_clean":"2024-04-26T20:20:47.686270+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:20:47.686270+0000","last_undegraded":"2024-04-26T20:20:47.686270+0000","last_fullsized":"2024-04-26T20:20:47.686270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822518+0000","last_change":"2024-04-26T20:20:47.821839+0000","last_active":"2024-04-26T20:20:47.822518+0000","last_peered":"2024-04-26T20:20:47.822518+0000","last_clean":"2024-04-26T20:20:47.822518+0000","last_became_active":"2024-04-26T20:20:47.821302+0000","last_became_peered":"2024-04-26T20:20:47.821302+0000","last_unstale":"2024-04-26T20:20:47.822518+0000","last_undegraded":"2024-04-26T20:20:47.822518+0000","last_fullsized":"2024-04-26T20:20:47.822518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:38.771597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683319+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:47.683319+0000","last_peered":"2024-04-26T20:20:47.683319+0000","last_clean":"2024-04-26T20:20:47.683319+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:47.683319+0000","last_undegraded":"2024-04-26T20:20:47.683319+0000","last_fullsized":"2024-04-26T20:20:47.683319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683122+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:20:47.683122+0000","last_peered":"2024-04-26T20:20:47.683122+0000","last_clean":"2024-04-26T20:20:47.683122+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:20:47.683122+0000","last_undegraded":"2024-04-26T20:20:47.683122+0000","last_fullsized":"2024-04-26T20:20:47.683122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682693+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:20:47.682693+0000","last_peered":"2024-04-26T20:20:47.682693+0000","last_clean":"2024-04-26T20:20:47.682693+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:20:47.682693+0000","last_undegraded":"2024-04-26T20:20:47.682693+0000","last_fullsized":"2024-04-26T20:20:47.682693+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.701523+0000","last_change":"2024-04-26T20:20:47.701523+0000","last_active":"2024-04-26T20:20:47.701523+0000","last_peered":"2024-04-26T20:20:47.701523+0000","last_clean":"2024-04-26T20:20:47.701523+0000","last_became_active":"2024-04-26T20:20:47.700711+0000","last_became_peered":"2024-04-26T20:20:47.700711+0000","last_unstale":"2024-04-26T20:20:47.701523+0000","last_undegraded":"2024-04-26T20:20:47.701523+0000","last_fullsized":"2024-04-26T20:20:47.701523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:37.623094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820119+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:20:47.820119+0000","last_peered":"2024-04-26T20:20:47.820119+0000","last_clean":"2024-04-26T20:20:47.820119+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:20:47.820119+0000","last_undegraded":"2024-04-26T20:20:47.820119+0000","last_fullsized":"2024-04-26T20:20:47.820119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697607+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:20:47.697607+0000","last_peered":"2024-04-26T20:20:47.697607+0000","last_clean":"2024-04-26T20:20:47.697607+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:20:47.697607+0000","last_undegraded":"2024-04-26T20:20:47.697607+0000","last_fullsized":"2024-04-26T20:20:47.697607+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:46.361766+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:21:46.361766+0000","last_peered":"2024-04-26T20:21:46.361766+0000","last_clean":"2024-04-26T20:21:46.361766+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:21:46.361766+0000","last_undegraded":"2024-04-26T20:21:46.361766+0000","last_fullsized":"2024-04-26T20:21:46.361766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819746+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:20:47.819746+0000","last_peered":"2024-04-26T20:20:47.819746+0000","last_clean":"2024-04-26T20:20:47.819746+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:20:47.819746+0000","last_undegraded":"2024-04-26T20:20:47.819746+0000","last_fullsized":"2024-04-26T20:20:47.819746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694796+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:20:47.694796+0000","last_peered":"2024-04-26T20:20:47.694796+0000","last_clean":"2024-04-26T20:20:47.694796+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:20:47.694796+0000","last_undegraded":"2024-04-26T20:20:47.694796+0000","last_fullsized":"2024-04-26T20:20:47.694796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686801+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:20:47.686801+0000","last_peered":"2024-04-26T20:20:47.686801+0000","last_clean":"2024-04-26T20:20:47.686801+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:20:47.686801+0000","last_undegraded":"2024-04-26T20:20:47.686801+0000","last_fullsized":"2024-04-26T20:20:47.686801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:50.345189+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:21:50.345189+0000","last_peered":"2024-04-26T20:21:50.345189+0000","last_clean":"2024-04-26T20:21:50.345189+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:21:50.345189+0000","last_undegraded":"2024-04-26T20:21:50.345189+0000","last_fullsized":"2024-04-26T20:21:50.345189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819385+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:20:47.819385+0000","last_peered":"2024-04-26T20:20:47.819385+0000","last_clean":"2024-04-26T20:20:47.819385+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:20:47.819385+0000","last_undegraded":"2024-04-26T20:20:47.819385+0000","last_fullsized":"2024-04-26T20:20:47.819385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684108+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:20:47.684108+0000","last_peered":"2024-04-26T20:20:47.684108+0000","last_clean":"2024-04-26T20:20:47.684108+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:20:47.684108+0000","last_undegraded":"2024-04-26T20:20:47.684108+0000","last_fullsized":"2024-04-26T20:20:47.684108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683013+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:47.683013+0000","last_peered":"2024-04-26T20:20:47.683013+0000","last_clean":"2024-04-26T20:20:47.683013+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:47.683013+0000","last_undegraded":"2024-04-26T20:20:47.683013+0000","last_fullsized":"2024-04-26T20:20:47.683013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820401+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:20:47.820401+0000","last_peered":"2024-04-26T20:20:47.820401+0000","last_clean":"2024-04-26T20:20:47.820401+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:20:47.820401+0000","last_undegraded":"2024-04-26T20:20:47.820401+0000","last_fullsized":"2024-04-26T20:20:47.820401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687153+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:20:47.687153+0000","last_peered":"2024-04-26T20:20:47.687153+0000","last_clean":"2024-04-26T20:20:47.687153+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:20:47.687153+0000","last_undegraded":"2024-04-26T20:20:47.687153+0000","last_fullsized":"2024-04-26T20:20:47.687153+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697300+0000","last_change":"2024-04-26T20:20:47.697300+0000","last_active":"2024-04-26T20:20:47.697300+0000","last_peered":"2024-04-26T20:20:47.697300+0000","last_clean":"2024-04-26T20:20:47.697300+0000","last_became_active":"2024-04-26T20:20:47.696809+0000","last_became_peered":"2024-04-26T20:20:47.696809+0000","last_unstale":"2024-04-26T20:20:47.697300+0000","last_undegraded":"2024-04-26T20:20:47.697300+0000","last_fullsized":"2024-04-26T20:20:47.697300+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:01.540485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818312+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:47.818312+0000","last_peered":"2024-04-26T20:20:47.818312+0000","last_clean":"2024-04-26T20:20:47.818312+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:47.818312+0000","last_undegraded":"2024-04-26T20:20:47.818312+0000","last_fullsized":"2024-04-26T20:20:47.818312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682687+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:20:47.682687+0000","last_peered":"2024-04-26T20:20:47.682687+0000","last_clean":"2024-04-26T20:20:47.682687+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:20:47.682687+0000","last_undegraded":"2024-04-26T20:20:47.682687+0000","last_fullsized":"2024-04-26T20:20:47.682687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683090+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:47.683090+0000","last_peered":"2024-04-26T20:20:47.683090+0000","last_clean":"2024-04-26T20:20:47.683090+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:47.683090+0000","last_undegraded":"2024-04-26T20:20:47.683090+0000","last_fullsized":"2024-04-26T20:20:47.683090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697823+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:20:47.697823+0000","last_peered":"2024-04-26T20:20:47.697823+0000","last_clean":"2024-04-26T20:20:47.697823+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:20:47.697823+0000","last_undegraded":"2024-04-26T20:20:47.697823+0000","last_fullsized":"2024-04-26T20:20:47.697823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681165+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:20:47.681165+0000","last_peered":"2024-04-26T20:20:47.681165+0000","last_clean":"2024-04-26T20:20:47.681165+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:20:47.681165+0000","last_undegraded":"2024-04-26T20:20:47.681165+0000","last_fullsized":"2024-04-26T20:20:47.681165+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684268+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:20:47.684268+0000","last_peered":"2024-04-26T20:20:47.684268+0000","last_clean":"2024-04-26T20:20:47.684268+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:20:47.684268+0000","last_undegraded":"2024-04-26T20:20:47.684268+0000","last_fullsized":"2024-04-26T20:20:47.684268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683915+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:20:47.683915+0000","last_peered":"2024-04-26T20:20:47.683915+0000","last_clean":"2024-04-26T20:20:47.683915+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:20:47.683915+0000","last_undegraded":"2024-04-26T20:20:47.683915+0000","last_fullsized":"2024-04-26T20:20:47.683915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680154+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:20:47.680154+0000","last_peered":"2024-04-26T20:20:47.680154+0000","last_clean":"2024-04-26T20:20:47.680154+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:20:47.680154+0000","last_undegraded":"2024-04-26T20:20:47.680154+0000","last_fullsized":"2024-04-26T20:20:47.680154+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683262+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:47.683262+0000","last_peered":"2024-04-26T20:20:47.683262+0000","last_clean":"2024-04-26T20:20:47.683262+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:47.683262+0000","last_undegraded":"2024-04-26T20:20:47.683262+0000","last_fullsized":"2024-04-26T20:20:47.683262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694740+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:20:47.694740+0000","last_peered":"2024-04-26T20:20:47.694740+0000","last_clean":"2024-04-26T20:20:47.694740+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:20:47.694740+0000","last_undegraded":"2024-04-26T20:20:47.694740+0000","last_fullsized":"2024-04-26T20:20:47.694740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683088+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:20:47.683088+0000","last_peered":"2024-04-26T20:20:47.683088+0000","last_clean":"2024-04-26T20:20:47.683088+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:20:47.683088+0000","last_undegraded":"2024-04-26T20:20:47.683088+0000","last_fullsized":"2024-04-26T20:20:47.683088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819502+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:47.819502+0000","last_peered":"2024-04-26T20:20:47.819502+0000","last_clean":"2024-04-26T20:20:47.819502+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:47.819502+0000","last_undegraded":"2024-04-26T20:20:47.819502+0000","last_fullsized":"2024-04-26T20:20:47.819502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682196+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:20:47.682196+0000","last_peered":"2024-04-26T20:20:47.682196+0000","last_clean":"2024-04-26T20:20:47.682196+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:20:47.682196+0000","last_undegraded":"2024-04-26T20:20:47.682196+0000","last_fullsized":"2024-04-26T20:20:47.682196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682892+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:20:47.682892+0000","last_peered":"2024-04-26T20:20:47.682892+0000","last_clean":"2024-04-26T20:20:47.682892+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:20:47.682892+0000","last_undegraded":"2024-04-26T20:20:47.682892+0000","last_fullsized":"2024-04-26T20:20:47.682892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680144+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:47.680144+0000","last_peered":"2024-04-26T20:20:47.680144+0000","last_clean":"2024-04-26T20:20:47.680144+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:47.680144+0000","last_undegraded":"2024-04-26T20:20:47.680144+0000","last_fullsized":"2024-04-26T20:20:47.680144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683565+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:20:47.683565+0000","last_peered":"2024-04-26T20:20:47.683565+0000","last_clean":"2024-04-26T20:20:47.683565+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:20:47.683565+0000","last_undegraded":"2024-04-26T20:20:47.683565+0000","last_fullsized":"2024-04-26T20:20:47.683565+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682836+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:20:47.682836+0000","last_peered":"2024-04-26T20:20:47.682836+0000","last_clean":"2024-04-26T20:20:47.682836+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:20:47.682836+0000","last_undegraded":"2024-04-26T20:20:47.682836+0000","last_fullsized":"2024-04-26T20:20:47.682836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680277+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:47.680277+0000","last_peered":"2024-04-26T20:20:47.680277+0000","last_clean":"2024-04-26T20:20:47.680277+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:47.680277+0000","last_undegraded":"2024-04-26T20:20:47.680277+0000","last_fullsized":"2024-04-26T20:20:47.680277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685616+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:20:47.685616+0000","last_peered":"2024-04-26T20:20:47.685616+0000","last_clean":"2024-04-26T20:20:47.685616+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:20:47.685616+0000","last_undegraded":"2024-04-26T20:20:47.685616+0000","last_fullsized":"2024-04-26T20:20:47.685616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683053+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:20:47.683053+0000","last_peered":"2024-04-26T20:20:47.683053+0000","last_clean":"2024-04-26T20:20:47.683053+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:20:47.683053+0000","last_undegraded":"2024-04-26T20:20:47.683053+0000","last_fullsized":"2024-04-26T20:20:47.683053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682576+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:47.682576+0000","last_peered":"2024-04-26T20:20:47.682576+0000","last_clean":"2024-04-26T20:20:47.682576+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:47.682576+0000","last_undegraded":"2024-04-26T20:20:47.682576+0000","last_fullsized":"2024-04-26T20:20:47.682576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819016+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:20:47.819016+0000","last_peered":"2024-04-26T20:20:47.819016+0000","last_clean":"2024-04-26T20:20:47.819016+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:20:47.819016+0000","last_undegraded":"2024-04-26T20:20:47.819016+0000","last_fullsized":"2024-04-26T20:20:47.819016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818816+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:20:47.818816+0000","last_peered":"2024-04-26T20:20:47.818816+0000","last_clean":"2024-04-26T20:20:47.818816+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:20:47.818816+0000","last_undegraded":"2024-04-26T20:20:47.818816+0000","last_fullsized":"2024-04-26T20:20:47.818816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:50.369467+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:21:50.369467+0000","last_peered":"2024-04-26T20:21:50.369467+0000","last_clean":"2024-04-26T20:21:50.369467+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:21:50.369467+0000","last_undegraded":"2024-04-26T20:21:50.369467+0000","last_fullsized":"2024-04-26T20:21:50.369467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819630+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:20:47.819630+0000","last_peered":"2024-04-26T20:20:47.819630+0000","last_clean":"2024-04-26T20:20:47.819630+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:20:47.819630+0000","last_undegraded":"2024-04-26T20:20:47.819630+0000","last_fullsized":"2024-04-26T20:20:47.819630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692667+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:20:47.692667+0000","last_peered":"2024-04-26T20:20:47.692667+0000","last_clean":"2024-04-26T20:20:47.692667+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:20:47.692667+0000","last_undegraded":"2024-04-26T20:20:47.692667+0000","last_fullsized":"2024-04-26T20:20:47.692667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687715+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:47.687715+0000","last_peered":"2024-04-26T20:20:47.687715+0000","last_clean":"2024-04-26T20:20:47.687715+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:47.687715+0000","last_undegraded":"2024-04-26T20:20:47.687715+0000","last_fullsized":"2024-04-26T20:20:47.687715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819345+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:20:47.819345+0000","last_peered":"2024-04-26T20:20:47.819345+0000","last_clean":"2024-04-26T20:20:47.819345+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:20:47.819345+0000","last_undegraded":"2024-04-26T20:20:47.819345+0000","last_fullsized":"2024-04-26T20:20:47.819345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685915+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:20:47.685915+0000","last_peered":"2024-04-26T20:20:47.685915+0000","last_clean":"2024-04-26T20:20:47.685915+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:20:47.685915+0000","last_undegraded":"2024-04-26T20:20:47.685915+0000","last_fullsized":"2024-04-26T20:20:47.685915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692811+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:47.692811+0000","last_peered":"2024-04-26T20:20:47.692811+0000","last_clean":"2024-04-26T20:20:47.692811+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:47.692811+0000","last_undegraded":"2024-04-26T20:20:47.692811+0000","last_fullsized":"2024-04-26T20:20:47.692811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819954+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:20:47.819954+0000","last_peered":"2024-04-26T20:20:47.819954+0000","last_clean":"2024-04-26T20:20:47.819954+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:20:47.819954+0000","last_undegraded":"2024-04-26T20:20:47.819954+0000","last_fullsized":"2024-04-26T20:20:47.819954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.691705+0000","last_change":"2024-04-26T20:20:47.691705+0000","last_active":"2024-04-26T20:20:47.691705+0000","last_peered":"2024-04-26T20:20:47.691705+0000","last_clean":"2024-04-26T20:20:47.691705+0000","last_became_active":"2024-04-26T20:20:47.691330+0000","last_became_peered":"2024-04-26T20:20:47.691330+0000","last_unstale":"2024-04-26T20:20:47.691705+0000","last_undegraded":"2024-04-26T20:20:47.691705+0000","last_fullsized":"2024-04-26T20:20:47.691705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:36.045725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680555+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:20:47.680555+0000","last_peered":"2024-04-26T20:20:47.680555+0000","last_clean":"2024-04-26T20:20:47.680555+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:20:47.680555+0000","last_undegraded":"2024-04-26T20:20:47.680555+0000","last_fullsized":"2024-04-26T20:20:47.680555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680256+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:20:47.680256+0000","last_peered":"2024-04-26T20:20:47.680256+0000","last_clean":"2024-04-26T20:20:47.680256+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:20:47.680256+0000","last_undegraded":"2024-04-26T20:20:47.680256+0000","last_fullsized":"2024-04-26T20:20:47.680256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692886+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:20:47.692886+0000","last_peered":"2024-04-26T20:20:47.692886+0000","last_clean":"2024-04-26T20:20:47.692886+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:20:47.692886+0000","last_undegraded":"2024-04-26T20:20:47.692886+0000","last_fullsized":"2024-04-26T20:20:47.692886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.701792+0000","last_change":"2024-04-26T20:20:47.701792+0000","last_active":"2024-04-26T20:20:47.701792+0000","last_peered":"2024-04-26T20:20:47.701792+0000","last_clean":"2024-04-26T20:20:47.701792+0000","last_became_active":"2024-04-26T20:20:47.701226+0000","last_became_peered":"2024-04-26T20:20:47.701226+0000","last_unstale":"2024-04-26T20:20:47.701792+0000","last_undegraded":"2024-04-26T20:20:47.701792+0000","last_fullsized":"2024-04-26T20:20:47.701792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:56.095557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682901+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:20:47.682901+0000","last_peered":"2024-04-26T20:20:47.682901+0000","last_clean":"2024-04-26T20:20:47.682901+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:20:47.682901+0000","last_undegraded":"2024-04-26T20:20:47.682901+0000","last_fullsized":"2024-04-26T20:20:47.682901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680987+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:20:47.680987+0000","last_peered":"2024-04-26T20:20:47.680987+0000","last_clean":"2024-04-26T20:20:47.680987+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:20:47.680987+0000","last_undegraded":"2024-04-26T20:20:47.680987+0000","last_fullsized":"2024-04-26T20:20:47.680987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684389+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:20:47.684389+0000","last_peered":"2024-04-26T20:20:47.684389+0000","last_clean":"2024-04-26T20:20:47.684389+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:20:47.684389+0000","last_undegraded":"2024-04-26T20:20:47.684389+0000","last_fullsized":"2024-04-26T20:20:47.684389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686689+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:20:47.686689+0000","last_peered":"2024-04-26T20:20:47.686689+0000","last_clean":"2024-04-26T20:20:47.686689+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:20:47.686689+0000","last_undegraded":"2024-04-26T20:20:47.686689+0000","last_fullsized":"2024-04-26T20:20:47.686689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681474+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:20:47.681474+0000","last_peered":"2024-04-26T20:20:47.681474+0000","last_clean":"2024-04-26T20:20:47.681474+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:20:47.681474+0000","last_undegraded":"2024-04-26T20:20:47.681474+0000","last_fullsized":"2024-04-26T20:20:47.681474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819202+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:20:47.819202+0000","last_peered":"2024-04-26T20:20:47.819202+0000","last_clean":"2024-04-26T20:20:47.819202+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:20:47.819202+0000","last_undegraded":"2024-04-26T20:20:47.819202+0000","last_fullsized":"2024-04-26T20:20:47.819202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693786+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:20:47.693786+0000","last_peered":"2024-04-26T20:20:47.693786+0000","last_clean":"2024-04-26T20:20:47.693786+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:20:47.693786+0000","last_undegraded":"2024-04-26T20:20:47.693786+0000","last_fullsized":"2024-04-26T20:20:47.693786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682912+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:20:47.682912+0000","last_peered":"2024-04-26T20:20:47.682912+0000","last_clean":"2024-04-26T20:20:47.682912+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:20:47.682912+0000","last_undegraded":"2024-04-26T20:20:47.682912+0000","last_fullsized":"2024-04-26T20:20:47.682912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62030,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":944,"num_read_kb":538,"num_write":246,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":186090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37024,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708128,"statfs":{"total":95995035648,"available":95957123072,"internally_reserved":0,"allocated":1720320,"data_stored":1143458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808882,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1060864,"data_stored":505451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070519,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":501621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1650688,"data_stored":1098230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":496859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":552715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738469,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":498706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":553326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":501324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1658880,"data_stored":1093421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:21:54.877 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T20:21:54.877 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T20:21:54.877 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T20:21:54.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T20:21:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:21:55.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:55 smithi082 ceph-mon[28105]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:21:55.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:55 smithi082 ceph-mon[28105]: pgmap v385: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:21:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:55 smithi139 ceph-mon[32999]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:21:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:55 smithi139 ceph-mon[32999]: pgmap v385: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:21:56.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:55 smithi135 ceph-mon[32816]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:21:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:55 smithi135 ceph-mon[32816]: pgmap v385: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:21:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:57 smithi082 ceph-mon[28105]: pgmap v386: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:21:58.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 -- 172.21.15.82:0/4077974345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c075f70 msgr2=0x7f570c10f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 --2- 172.21.15.82:0/4077974345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c075f70 0x7f570c10f940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009990 tx=0x7f56f4009ca0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 -- 172.21.15.82:0/4077974345 shutdown_connections 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 --2- 172.21.15.82:0/4077974345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c10fe80 0x7f570c112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 --2- 172.21.15.82:0/4077974345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f570c075650 0x7f570c075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 --2- 172.21.15.82:0/4077974345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c075f70 0x7f570c10f940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 -- 172.21.15.82:0/4077974345 >> 172.21.15.82:0/4077974345 conn(0x7f570c07a580 msgr2=0x7f570c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 -- 172.21.15.82:0/4077974345 shutdown_connections 2024-04-26T20:21:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.023+0000 7f5711000700 1 -- 172.21.15.82:0/4077974345 wait complete. 2024-04-26T20:21:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.024+0000 7f5711000700 1 Processor -- start 2024-04-26T20:21:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 -- start start 2024-04-26T20:21:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f570c075650 0x7f570c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:58.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 0x7f570c19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:58.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c10fe80 0x7f570c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:58.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f570c115870 con 0x7f570c075f70 2024-04-26T20:21:58.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1156f0 con 0x7f570c10fe80 2024-04-26T20:21:58.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5711000700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1159f0 con 0x7f570c075650 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5701400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 0x7f570c19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5701400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 0x7f570c19c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55576/0 (socket says 172.21.15.82:55576) 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.025+0000 7f5701400700 1 -- 172.21.15.82:0/2793342295 learned_addr learned my addr 172.21.15.82:0/2793342295 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5709e00700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f570c075650 0x7f570c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f570a800700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c10fe80 0x7f570c1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5701400700 1 -- 172.21.15.82:0/2793342295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f570c075650 msgr2=0x7f570c19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5701400700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f570c075650 0x7f570c19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5701400700 1 -- 172.21.15.82:0/2793342295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c10fe80 msgr2=0x7f570c1a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5701400700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c10fe80 0x7f570c1a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5701400700 1 -- 172.21.15.82:0/2793342295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c1a0d40 con 0x7f570c075f70 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f570a800700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c10fe80 0x7f570c1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.026+0000 7f5701400700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 0x7f570c19c2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f56f4000c00 tx=0x7f56f40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.027+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4027070 con 0x7f570c075f70 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.027+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56f4022470 con 0x7f570c075f70 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.027+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c1a0fd0 con 0x7f570c075f70 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.027+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4017650 con 0x7f570c075f70 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.027+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c1a88b0 con 0x7f570c075f70 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.028+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570c06a110 con 0x7f570c075f70 2024-04-26T20:21:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.030+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f56f402a070 con 0x7f570c075f70 2024-04-26T20:21:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.032+0000 7f5703400700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56f00a3cd0 0x7f56f00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.033+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f56f40d1680 con 0x7f570c075f70 2024-04-26T20:21:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.033+0000 7f5709e00700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56f00a3cd0 0x7f56f00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.033+0000 7f5709e00700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56f00a3cd0 0x7f56f00a6190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009da0 tx=0x7f56fc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.035+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f56f4013070 con 0x7f570c075f70 2024-04-26T20:21:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:57 smithi139 ceph-mon[32999]: pgmap v386: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:21:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:57 smithi135 ceph-mon[32816]: pgmap v386: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:21:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.307+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f570c02e490 con 0x7f570c075f70 2024-04-26T20:21:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.308+0000 7f5703400700 1 -- 172.21.15.82:0/2793342295 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f56f409dbd0 con 0x7f570c075f70 2024-04-26T20:21:58.309 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:21:58.309 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56f00a3cd0 msgr2=0x7f56f00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56f00a3cd0 0x7f56f00a6190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009da0 tx=0x7f56fc00b040 comp rx=0 tx=0).stop 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 msgr2=0x7f570c19c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 0x7f570c19c2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f56f4000c00 tx=0x7f56f40057c0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 shutdown_connections 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f56f00a3cd0 0x7f56f00a6190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c10fe80 0x7f570c1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f570c075650 0x7f570c19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 --2- 172.21.15.82:0/2793342295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f570c075f70 0x7f570c19c2c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 >> 172.21.15.82:0/2793342295 conn(0x7f570c07a580 msgr2=0x7f570c100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 shutdown_connections 2024-04-26T20:21:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:58.311+0000 7f5711000700 1 -- 172.21.15.82:0/2793342295 wait complete. 2024-04-26T20:21:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2793342295' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T20:21:59.092 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2793342295' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T20:21:59.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2793342295' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T20:21:59.155 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T20:21:59.155 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 -- 172.21.15.82:0/1427359480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 msgr2=0x7fb4d4109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1427359480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 0x7fb4d4109ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc009ca0 tx=0x7fb4cc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 -- 172.21.15.82:0/1427359480 shutdown_connections 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1427359480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 0x7fb4d4109ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1427359480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4102860 0x7fb4d4102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1427359480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4d4101670 0x7fb4d4101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 -- 172.21.15.82:0/1427359480 >> 172.21.15.82:0/1427359480 conn(0x7fb4d40fcbc0 msgr2=0x7fb4d40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 -- 172.21.15.82:0/1427359480 shutdown_connections 2024-04-26T20:21:59.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.366+0000 7fb4d3200640 1 -- 172.21.15.82:0/1427359480 wait complete. 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 Processor -- start 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 -- start start 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 0x7fb4d4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4d4102860 0x7fb4d4198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 0x7fb4d419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d410d1f0 con 0x7fb4d4101670 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d410d070 con 0x7fb4d4103220 2024-04-26T20:21:59.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d3200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d410d370 con 0x7fb4d4102860 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 0x7fb4d4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 0x7fb4d4198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55600/0 (socket says 172.21.15.82:55600) 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d1e00640 1 -- 172.21.15.82:0/1088171029 learned_addr learned my addr 172.21.15.82:0/1088171029 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.368+0000 7fb4d1400640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4d4102860 0x7fb4d4198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d2800640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 0x7fb4d419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d1e00640 1 -- 172.21.15.82:0/1088171029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4d4102860 msgr2=0x7fb4d4198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d1e00640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4d4102860 0x7fb4d4198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d1e00640 1 -- 172.21.15.82:0/1088171029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 msgr2=0x7fb4d419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d1e00640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 0x7fb4d419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d1e00640 1 -- 172.21.15.82:0/1088171029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d41a0540 con 0x7fb4d4101670 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d1e00640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 0x7fb4d4198920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400e9c0 tx=0x7fb4c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400cd80 con 0x7fb4d4101670 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d41a0830 con 0x7fb4d4101670 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.369+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4c40035f0 con 0x7fb4d4101670 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.370+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d41a0d30 con 0x7fb4d4101670 2024-04-26T20:21:59.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.370+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4010630 con 0x7fb4d4101670 2024-04-26T20:21:59.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.371+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d41a0fe0 con 0x7fb4d4101670 2024-04-26T20:21:59.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.373+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb4c4004000 con 0x7fb4d4101670 2024-04-26T20:21:59.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.374+0000 7fb4caa00640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4b80a3c40 0x7fb4b80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.374+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb4c40d0dd0 con 0x7fb4d4101670 2024-04-26T20:21:59.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.374+0000 7fb4d1400640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4b80a3c40 0x7fb4b80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.375+0000 7fb4d1400640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4b80a3c40 0x7fb4b80a6100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4199e30 tx=0x7fb4c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.379+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb4c409d290 con 0x7fb4d4101670 2024-04-26T20:21:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.586+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4d41a1250 con 0x7fb4d4101670 2024-04-26T20:21:59.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.591+0000 7fb4caa00640 1 -- 172.21.15.82:0/1088171029 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7fb4c409cb90 con 0x7fb4d4101670 2024-04-26T20:21:59.592 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:21:59.592 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:21:59.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4b80a3c40 msgr2=0x7fb4b80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4b80a3c40 0x7fb4b80a6100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4199e30 tx=0x7fb4c0005f90 comp rx=0 tx=0).stop 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 msgr2=0x7fb4d4198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 0x7fb4d4198920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400e9c0 tx=0x7fb4c400ee80 comp rx=0 tx=0).stop 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 shutdown_connections 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb4b80a3c40 0x7fb4b80a6100 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4d4103220 0x7fb4d419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4d4102860 0x7fb4d4198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 --2- 172.21.15.82:0/1088171029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4d4101670 0x7fb4d4198920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 >> 172.21.15.82:0/1088171029 conn(0x7fb4d40fcbc0 msgr2=0x7fb4d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 shutdown_connections 2024-04-26T20:21:59.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.594+0000 7fb4d3200640 1 -- 172.21.15.82:0/1088171029 wait complete. 2024-04-26T20:21:59.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:21:59.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:21:59.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.822+0000 7f49ea800640 1 -- 172.21.15.82:0/1309719536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e410a830 msgr2=0x7f49e410ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.822+0000 7f49ea800640 1 --2- 172.21.15.82:0/1309719536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e410a830 0x7f49e410ccc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009ca0 tx=0x7f49dc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 -- 172.21.15.82:0/1309719536 shutdown_connections 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 --2- 172.21.15.82:0/1309719536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e410a830 0x7f49e410ccc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 --2- 172.21.15.82:0/1309719536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49e4075390 0x7f49e4075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 --2- 172.21.15.82:0/1309719536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4076970 0x7f49e4074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 -- 172.21.15.82:0/1309719536 >> 172.21.15.82:0/1309719536 conn(0x7f49e40fdee0 msgr2=0x7f49e4100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 -- 172.21.15.82:0/1309719536 shutdown_connections 2024-04-26T20:21:59.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.823+0000 7f49ea800640 1 -- 172.21.15.82:0/1309719536 wait complete. 2024-04-26T20:21:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 Processor -- start 2024-04-26T20:21:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 -- start start 2024-04-26T20:21:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 0x7f49e419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4076970 0x7f49e419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49e410a830 0x7f49e41a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49e41106d0 con 0x7f49e4076970 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4110550 con 0x7f49e4075390 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.824+0000 7f49ea800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4110850 con 0x7f49e410a830 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 0x7f49e419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4076970 0x7f49e419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 0x7f49e419ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60360/0 (socket says 172.21.15.82:60360) 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e3400640 1 -- 172.21.15.82:0/395054361 learned_addr learned my addr 172.21.15.82:0/395054361 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e3e00640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49e410a830 0x7f49e41a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 -- 172.21.15.82:0/395054361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49e410a830 msgr2=0x7f49e41a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49e410a830 0x7f49e41a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 -- 172.21.15.82:0/395054361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 msgr2=0x7f49e419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 0x7f49e419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 -- 172.21.15.82:0/395054361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e41a2980 con 0x7f49e4076970 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e3400640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 0x7f49e419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.825+0000 7f49e2a00640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4076970 0x7f49e419b2a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49d000e9f0 tx=0x7f49d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.826+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ccc0 con 0x7f49e4076970 2024-04-26T20:21:59.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.826+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d0005020 con 0x7f49e4076970 2024-04-26T20:21:59.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.826+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0004a00 con 0x7f49e4076970 2024-04-26T20:21:59.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.826+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e41a2c70 con 0x7f49e4076970 2024-04-26T20:21:59.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.826+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e41a3170 con 0x7f49e4076970 2024-04-26T20:21:59.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.827+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e4109560 con 0x7f49e4076970 2024-04-26T20:21:59.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.830+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f49d0004ba0 con 0x7f49e4076970 2024-04-26T20:21:59.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.831+0000 7f49dbe00640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49c80a3c40 0x7f49c80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.831+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f49d00d08d0 con 0x7f49e4076970 2024-04-26T20:21:59.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.831+0000 7f49e3400640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49c80a3c40 0x7f49c80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.832+0000 7f49e3400640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49c80a3c40 0x7f49c80a6100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f49d4011550 tx=0x7f49d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:21:59.836+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f49d009cd90 con 0x7f49e4076970 2024-04-26T20:21:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:59 smithi082 ceph-mon[28105]: pgmap v387: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-26T20:21:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:21:59 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1088171029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:00.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.038+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49e402dcd0 con 0x7f49e4076970 2024-04-26T20:22:00.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.039+0000 7f49dbe00640 1 -- 172.21.15.82:0/395054361 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f49d009c690 con 0x7f49e4076970 2024-04-26T20:22:00.039 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.041+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49c80a3c40 msgr2=0x7f49c80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.041+0000 7f49ea800640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49c80a3c40 0x7f49c80a6100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f49d4011550 tx=0x7f49d4005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.041+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4076970 msgr2=0x7f49e419b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.041+0000 7f49ea800640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4076970 0x7f49e419b2a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49d000e9f0 tx=0x7f49d000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 shutdown_connections 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49c80a3c40 0x7f49c80a6100 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49e410a830 0x7f49e41a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49e4076970 0x7f49e419b2a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 --2- 172.21.15.82:0/395054361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49e4075390 0x7f49e419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 >> 172.21.15.82:0/395054361 conn(0x7f49e40fdee0 msgr2=0x7f49e4106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 shutdown_connections 2024-04-26T20:22:00.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.042+0000 7f49ea800640 1 -- 172.21.15.82:0/395054361 wait complete. 2024-04-26T20:22:00.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:00.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:59 smithi139 ceph-mon[32999]: pgmap v387: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-26T20:22:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:21:59 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1088171029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:00.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:59 smithi135 ceph-mon[32816]: pgmap v387: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-26T20:22:00.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:21:59 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1088171029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 -- 172.21.15.82:0/437769230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 msgr2=0x7f46b41093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 --2- 172.21.15.82:0/437769230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b41093b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009900 tx=0x7f46a802a410 comp rx=0 tx=0).stop 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 -- 172.21.15.82:0/437769230 shutdown_connections 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 --2- 172.21.15.82:0/437769230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 0x7f46b41113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 --2- 172.21.15.82:0/437769230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b410a180 0x7f46b410a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 --2- 172.21.15.82:0/437769230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b41093b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 -- 172.21.15.82:0/437769230 >> 172.21.15.82:0/437769230 conn(0x7f46b4077f30 msgr2=0x7f46b407a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 -- 172.21.15.82:0/437769230 shutdown_connections 2024-04-26T20:22:00.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.266+0000 7f46bc400640 1 -- 172.21.15.82:0/437769230 wait complete. 2024-04-26T20:22:00.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.267+0000 7f46bc400640 1 Processor -- start 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.267+0000 7f46bc400640 1 -- start start 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46bc400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b419f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46bc400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b410a180 0x7f46b419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46bc400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 0x7f46b41a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46bc400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4114a90 con 0x7f46b4108f90 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46bc400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4114910 con 0x7f46b410a180 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46bc400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4114c10 con 0x7f46b410ab40 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46b9a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b419f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46ba400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 0x7f46b41a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46ba400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 0x7f46b41a6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41832/0 (socket says 172.21.15.82:41832) 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46ba400640 1 -- 172.21.15.82:0/2846739301 learned_addr learned my addr 172.21.15.82:0/2846739301 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:00.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46b9a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b419f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55652/0 (socket says 172.21.15.82:55652) 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.268+0000 7f46b9000640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b410a180 0x7f46b419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b9a00640 1 -- 172.21.15.82:0/2846739301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 msgr2=0x7f46b41a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b9a00640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 0x7f46b41a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b9a00640 1 -- 172.21.15.82:0/2846739301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b410a180 msgr2=0x7f46b419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b9a00640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b410a180 0x7f46b419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b9a00640 1 -- 172.21.15.82:0/2846739301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b41a6e00 con 0x7f46b4108f90 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b9a00640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b419f230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006010 tx=0x7f46a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a803f030 con 0x7f46b4108f90 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a80318f0 con 0x7f46b4108f90 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41a7090 con 0x7f46b4108f90 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8035070 con 0x7f46b4108f90 2024-04-26T20:22:00.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.269+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a75d0 con 0x7f46b4108f90 2024-04-26T20:22:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.270+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4110420 con 0x7f46b4108f90 2024-04-26T20:22:00.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.272+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f46a8042030 con 0x7f46b4108f90 2024-04-26T20:22:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.274+0000 7f46b2000640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f469c0a3cc0 0x7f469c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.274+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f46a80f0cb0 con 0x7f46b4108f90 2024-04-26T20:22:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.274+0000 7f46b9000640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f469c0a3cc0 0x7f469c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.275+0000 7f46b9000640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f469c0a3cc0 0x7f469c0a6180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46b41a06f0 tx=0x7f46a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:00.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.278+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f46a80bcb20 con 0x7f46b4108f90 2024-04-26T20:22:00.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.482+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f46b402dcf0 con 0x7f46b4108f90 2024-04-26T20:22:00.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.483+0000 7f46b2000640 1 -- 172.21.15.82:0/2846739301 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f46a80c0e20 con 0x7f46b4108f90 2024-04-26T20:22:00.483 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f469c0a3cc0 msgr2=0x7f469c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f469c0a3cc0 0x7f469c0a6180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46b41a06f0 tx=0x7f46a0005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 msgr2=0x7f46b419f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b419f230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006010 tx=0x7f46a80042f0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 shutdown_connections 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f469c0a3cc0 0x7f469c0a6180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b410ab40 0x7f46b41a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b410a180 0x7f46b419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 --2- 172.21.15.82:0/2846739301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4108f90 0x7f46b419f230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.485+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 >> 172.21.15.82:0/2846739301 conn(0x7f46b4077f30 msgr2=0x7f46b410d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:00.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.486+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 shutdown_connections 2024-04-26T20:22:00.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.486+0000 7f46bc400640 1 -- 172.21.15.82:0/2846739301 wait complete. 2024-04-26T20:22:00.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1846252565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 msgr2=0x7f7b98106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1846252565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b98106200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009900 tx=0x7f7b8002a410 comp rx=0 tx=0).stop 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1846252565 shutdown_connections 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1846252565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98106740 0x7f7b9810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1846252565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b98106200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1846252565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b98104b90 0x7f7b98104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1846252565 >> 172.21.15.82:0/1846252565 conn(0x7f7b98100120 msgr2=0x7f7b98102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:00.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1846252565 shutdown_connections 2024-04-26T20:22:00.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.709+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1846252565 wait complete. 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.710+0000 7f7b9ec00640 1 Processor -- start 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.710+0000 7f7b9ec00640 1 -- start start 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9ec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98104b90 0x7f7b9807a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9ec00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b9807ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9ec00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b98106740 0x7f7b98077250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9ec00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b981106a0 con 0x7f7b98105d80 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9ec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b98110520 con 0x7f7b98104b90 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9ec00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b98110820 con 0x7f7b98106740 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b8f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b9807ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b8f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b9807ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55678/0 (socket says 172.21.15.82:55678) 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b8f400640 1 -- 172.21.15.82:0/1495936245 learned_addr learned my addr 172.21.15.82:0/1495936245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b97e00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98104b90 0x7f7b9807a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b9cc00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b98106740 0x7f7b98077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b8f400640 1 -- 172.21.15.82:0/1495936245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b98106740 msgr2=0x7f7b98077250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.711+0000 7f7b8f400640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b98106740 0x7f7b98077250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b8f400640 1 -- 172.21.15.82:0/1495936245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98104b90 msgr2=0x7f7b9807a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b8f400640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98104b90 0x7f7b9807a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b8f400640 1 -- 172.21.15.82:0/1495936245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b98077b10 con 0x7f7b98105d80 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b97e00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98104b90 0x7f7b9807a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b8f400640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b9807ac20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005940 tx=0x7f7b80031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8003f030 con 0x7f7b98105d80 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b80003aa0 con 0x7f7b98105d80 2024-04-26T20:22:00.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80035070 con 0x7f7b98105d80 2024-04-26T20:22:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b981a7190 con 0x7f7b98105d80 2024-04-26T20:22:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.712+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b981a7540 con 0x7f7b98105d80 2024-04-26T20:22:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.714+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9810beb0 con 0x7f7b98105d80 2024-04-26T20:22:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.716+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7b80042030 con 0x7f7b98105d80 2024-04-26T20:22:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.718+0000 7f7b95600640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7b7c0a3c40 0x7f7b7c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.718+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7b800f0ee0 con 0x7f7b98105d80 2024-04-26T20:22:00.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.718+0000 7f7b97e00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7b7c0a3c40 0x7f7b7c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:00.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.719+0000 7f7b97e00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7b7c0a3c40 0x7f7b7c0a6100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b88005fd0 tx=0x7f7b8800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:00.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.722+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7b800bcd50 con 0x7f7b98105d80 2024-04-26T20:22:00.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.926+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7b98063530 con 0x7f7b98105d80 2024-04-26T20:22:00.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.927+0000 7f7b95600640 1 -- 172.21.15.82:0/1495936245 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f7b800c1050 con 0x7f7b98105d80 2024-04-26T20:22:00.927 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.929+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7b7c0a3c40 msgr2=0x7f7b7c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7b7c0a3c40 0x7f7b7c0a6100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b88005fd0 tx=0x7f7b8800b410 comp rx=0 tx=0).stop 2024-04-26T20:22:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 msgr2=0x7f7b9807ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b9807ac20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005940 tx=0x7f7b80031a50 comp rx=0 tx=0).stop 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 shutdown_connections 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7b7c0a3c40 0x7f7b7c0a6100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b98106740 0x7f7b98077250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b98105d80 0x7f7b9807ac20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 --2- 172.21.15.82:0/1495936245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b98104b90 0x7f7b9807a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 >> 172.21.15.82:0/1495936245 conn(0x7f7b98100120 msgr2=0x7f7b98109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 shutdown_connections 2024-04-26T20:22:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:00.930+0000 7f7b9ec00640 1 -- 172.21.15.82:0/1495936245 wait complete. 2024-04-26T20:22:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:00 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/395054361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:00 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2846739301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:00 smithi082 ceph-mon[28105]: pgmap v388: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:22:00.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:00 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/395054361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:00 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2846739301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:00 smithi139 ceph-mon[32999]: pgmap v388: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:22:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:00 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/395054361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:00 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2846739301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:00 smithi135 ceph-mon[32816]: pgmap v388: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 -- 172.21.15.82:0/339663654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4075390 msgr2=0x7feea4075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 --2- 172.21.15.82:0/339663654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4075390 0x7feea4075810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fee90009890 tx=0x7fee9002a360 comp rx=0 tx=0).stop 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 -- 172.21.15.82:0/339663654 shutdown_connections 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 --2- 172.21.15.82:0/339663654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 --2- 172.21.15.82:0/339663654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4075390 0x7feea4075810 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 --2- 172.21.15.82:0/339663654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feea4076970 0x7feea4074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 -- 172.21.15.82:0/339663654 >> 172.21.15.82:0/339663654 conn(0x7feea40fde30 msgr2=0x7feea4100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:01.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 -- 172.21.15.82:0/339663654 shutdown_connections 2024-04-26T20:22:01.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.147+0000 7feea8e00640 1 -- 172.21.15.82:0/339663654 wait complete. 2024-04-26T20:22:01.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.148+0000 7feea8e00640 1 Processor -- start 2024-04-26T20:22:01.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.148+0000 7feea8e00640 1 -- start start 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea8e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feea4075390 0x7feea419f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4076970 0x7feea419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea8e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea41a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea8e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feea4114950 con 0x7feea410ee90 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea8e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feea41147d0 con 0x7feea4076970 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea8e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feea4114ad0 con 0x7feea4075390 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea41a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea41a6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44066/0 (socket says 172.21.15.82:44066) 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea3e00640 1 -- 172.21.15.82:0/445391645 learned_addr learned my addr 172.21.15.82:0/445391645 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea3400640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feea4075390 0x7feea419f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.149+0000 7feea2a00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4076970 0x7feea419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea3e00640 1 -- 172.21.15.82:0/445391645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feea4075390 msgr2=0x7feea419f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea3e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feea4075390 0x7feea419f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea3e00640 1 -- 172.21.15.82:0/445391645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4076970 msgr2=0x7feea419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea3e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4076970 0x7feea419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea3e00640 1 -- 172.21.15.82:0/445391645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea41a6d80 con 0x7feea410ee90 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea3e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea41a6710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00eb10 tx=0x7fee9c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00ce20 con 0x7feea410ee90 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea41a7070 con 0x7feea410ee90 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee9c005020 con 0x7feea410ee90 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c010690 con 0x7feea410ee90 2024-04-26T20:22:01.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.150+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea41a7540 con 0x7feea410ee90 2024-04-26T20:22:01.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.152+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea4105060 con 0x7feea410ee90 2024-04-26T20:22:01.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.154+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fee9c005510 con 0x7feea410ee90 2024-04-26T20:22:01.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.155+0000 7fee9be00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fee880a3c40 0x7fee880a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.155+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fee9c0d0ed0 con 0x7feea410ee90 2024-04-26T20:22:01.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.155+0000 7feea3400640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fee880a3c40 0x7fee880a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.156+0000 7feea3400640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fee880a3c40 0x7fee880a6100 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee94005fd0 tx=0x7fee94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:01.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.159+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fee9c09d390 con 0x7feea410ee90 2024-04-26T20:22:01.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.360+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7feea4063530 con 0x7feea410ee90 2024-04-26T20:22:01.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.360+0000 7fee9be00640 1 -- 172.21.15.82:0/445391645 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fee9c09cc90 con 0x7feea410ee90 2024-04-26T20:22:01.361 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fee880a3c40 msgr2=0x7fee880a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fee880a3c40 0x7fee880a6100 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee94005fd0 tx=0x7fee94009260 comp rx=0 tx=0).stop 2024-04-26T20:22:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 msgr2=0x7feea41a6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea41a6710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00eb10 tx=0x7fee9c00ef10 comp rx=0 tx=0).stop 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 shutdown_connections 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fee880a3c40 0x7fee880a6100 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea410ee90 0x7feea41a6710 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feea4076970 0x7feea419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 --2- 172.21.15.82:0/445391645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feea4075390 0x7feea419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 >> 172.21.15.82:0/445391645 conn(0x7feea40fde30 msgr2=0x7feea4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 shutdown_connections 2024-04-26T20:22:01.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.363+0000 7feea8e00640 1 -- 172.21.15.82:0/445391645 wait complete. 2024-04-26T20:22:01.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:01.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 -- 172.21.15.82:0/2354468584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4109f80 msgr2=0x7f47b410a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 --2- 172.21.15.82:0/2354468584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4109f80 0x7f47b410a400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009860 tx=0x7f47a002a340 comp rx=0 tx=0).stop 2024-04-26T20:22:01.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 -- 172.21.15.82:0/2354468584 shutdown_connections 2024-04-26T20:22:01.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 --2- 172.21.15.82:0/2354468584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 0x7f47b41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 --2- 172.21.15.82:0/2354468584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4109f80 0x7f47b410a400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 --2- 172.21.15.82:0/2354468584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47b4108d90 0x7f47b41091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.588+0000 7f47b9400640 1 -- 172.21.15.82:0/2354468584 >> 172.21.15.82:0/2354468584 conn(0x7f47b4077d30 msgr2=0x7f47b407a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:01.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.589+0000 7f47b9400640 1 -- 172.21.15.82:0/2354468584 shutdown_connections 2024-04-26T20:22:01.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.589+0000 7f47b9400640 1 -- 172.21.15.82:0/2354468584 wait complete. 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.589+0000 7f47b9400640 1 Processor -- start 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 -- start start 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 0x7f47b419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47b4109f80 0x7f47b419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 0x7f47b41a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47b41148a0 con 0x7f47b410a940 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4114720 con 0x7f47b4108d90 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b9400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4114a20 con 0x7f47b4109f80 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 0x7f47b419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 0x7f47b41a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 0x7f47b419ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:36846/0 (socket says 172.21.15.82:36846) 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b3e00640 1 -- 172.21.15.82:0/3602025484 learned_addr learned my addr 172.21.15.82:0/3602025484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.590+0000 7f47b3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47b4109f80 0x7f47b419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b3e00640 1 -- 172.21.15.82:0/3602025484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47b4109f80 msgr2=0x7f47b419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b3e00640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47b4109f80 0x7f47b419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b3e00640 1 -- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 msgr2=0x7f47b41a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b3e00640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 0x7f47b41a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b3e00640 1 -- 172.21.15.82:0/3602025484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b41a6bb0 con 0x7f47b4108d90 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b8a00640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 0x7f47b41a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b3e00640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 0x7f47b419ef90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47a400e9f0 tx=0x7f47a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a400ccc0 con 0x7f47b4108d90 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47a40035f0 con 0x7f47b4108d90 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a400ce60 con 0x7f47b4108d90 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b41a6ea0 con 0x7f47b4108d90 2024-04-26T20:22:01.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.591+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b41a7300 con 0x7f47b4108d90 2024-04-26T20:22:01.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.593+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b4110180 con 0x7f47b4108d90 2024-04-26T20:22:01.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.595+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f47a4004000 con 0x7f47b4108d90 2024-04-26T20:22:01.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.596+0000 7f47b0c00640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47980a3c40 0x7f47980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:01.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.596+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f47a40d0c60 con 0x7f47b4108d90 2024-04-26T20:22:01.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.596+0000 7f47b3400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47980a3c40 0x7f47980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:01.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.597+0000 7f47b3400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47980a3c40 0x7f47980a6100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f47a002a930 tx=0x7f47a0030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:01.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.599+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f47a409d160 con 0x7f47b4108d90 2024-04-26T20:22:01.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.835+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47b402dd80 con 0x7f47b4108d90 2024-04-26T20:22:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.836+0000 7f47b0c00640 1 -- 172.21.15.82:0/3602025484 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11951 (secure 0 0 0) 0x7f47a409ca60 con 0x7f47b4108d90 2024-04-26T20:22:01.837 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:01.837 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:20:20.191502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:22:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47980a3c40 msgr2=0x7f47980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47980a3c40 0x7f47980a6100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f47a002a930 tx=0x7f47a0030450 comp rx=0 tx=0).stop 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 msgr2=0x7f47b419ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 0x7f47b419ef90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47a400e9f0 tx=0x7f47a400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 shutdown_connections 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47980a3c40 0x7f47980a6100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b410a940 0x7f47b41a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47b4109f80 0x7f47b419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.839+0000 7f47b9400640 1 --2- 172.21.15.82:0/3602025484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b4108d90 0x7f47b419ef90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.840+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 >> 172.21.15.82:0/3602025484 conn(0x7f47b4077d30 msgr2=0x7f47b410d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.840+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 shutdown_connections 2024-04-26T20:22:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:01.840+0000 7f47b9400640 1 -- 172.21.15.82:0/3602025484 wait complete. 2024-04-26T20:22:01.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:02.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 -- 172.21.15.82:0/467513724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48102770 msgr2=0x7f5a48102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 --2- 172.21.15.82:0/467513724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48102770 0x7f5a48102b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009860 tx=0x7f5a3802a340 comp rx=0 tx=0).stop 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 -- 172.21.15.82:0/467513724 shutdown_connections 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 --2- 172.21.15.82:0/467513724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48104320 0x7f5a4810abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 --2- 172.21.15.82:0/467513724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a48103960 0x7f5a48103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 --2- 172.21.15.82:0/467513724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48102770 0x7f5a48102b90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 -- 172.21.15.82:0/467513724 >> 172.21.15.82:0/467513724 conn(0x7f5a480fdce0 msgr2=0x7f5a48100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 -- 172.21.15.82:0/467513724 shutdown_connections 2024-04-26T20:22:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.052+0000 7f5a47200640 1 -- 172.21.15.82:0/467513724 wait complete. 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.053+0000 7f5a47200640 1 Processor -- start 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.053+0000 7f5a47200640 1 -- start start 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a47200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 0x7f5a4819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a47200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a48103960 0x7f5a4819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a47200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48104320 0x7f5a481a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a47200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4810e270 con 0x7f5a48102770 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a47200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4810e0f0 con 0x7f5a48104320 2024-04-26T20:22:02.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a47200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4810e3f0 con 0x7f5a48103960 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 0x7f5a4819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 0x7f5a4819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44110/0 (socket says 172.21.15.82:44110) 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 -- 172.21.15.82:0/1116665528 learned_addr learned my addr 172.21.15.82:0/1116665528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45400640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a48103960 0x7f5a4819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 -- 172.21.15.82:0/1116665528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a48103960 msgr2=0x7f5a4819b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a48103960 0x7f5a4819b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 -- 172.21.15.82:0/1116665528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48104320 msgr2=0x7f5a481a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a46800640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48104320 0x7f5a481a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48104320 0x7f5a481a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a45e00640 1 -- 172.21.15.82:0/1116665528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481a27d0 con 0x7f5a48102770 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.054+0000 7f5a46800640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48104320 0x7f5a481a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.055+0000 7f5a45e00640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 0x7f5a4819abb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a380057c0 tx=0x7f5a38032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.055+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38037040 con 0x7f5a48102770 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.055+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a38030bd0 con 0x7f5a48102770 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.055+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38005280 con 0x7f5a48102770 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.055+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481a2a60 con 0x7f5a48102770 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.055+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a481a2ef0 con 0x7f5a48102770 2024-04-26T20:22:02.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.056+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a481a3120 con 0x7f5a48102770 2024-04-26T20:22:02.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.058+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5a38043020 con 0x7f5a48102770 2024-04-26T20:22:02.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.059+0000 7f5a3ea00640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a2c0a3c40 0x7f5a2c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.060+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5a380efe60 con 0x7f5a48102770 2024-04-26T20:22:02.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.060+0000 7f5a45400640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a2c0a3c40 0x7f5a2c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.060+0000 7f5a45400640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a2c0a3c40 0x7f5a2c0a6100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a4819c0c0 tx=0x7f5a34005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.064+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5a380bc430 con 0x7f5a48102770 2024-04-26T20:22:02.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:01 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1495936245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:02.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:01 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/445391645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:01 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1495936245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:01 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/445391645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:01 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1495936245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:01 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/445391645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:02.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.266+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a481a34b0 con 0x7f5a48102770 2024-04-26T20:22:02.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.270+0000 7f5a3ea00640 1 -- 172.21.15.82:0/1116665528 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f5a380bbd30 con 0x7f5a48102770 2024-04-26T20:22:02.271 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a2c0a3c40 msgr2=0x7f5a2c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a2c0a3c40 0x7f5a2c0a6100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a4819c0c0 tx=0x7f5a34005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 msgr2=0x7f5a4819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 0x7f5a4819abb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a380057c0 tx=0x7f5a38032da0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 shutdown_connections 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a2c0a3c40 0x7f5a2c0a6100 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a48104320 0x7f5a481a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a48103960 0x7f5a4819b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 --2- 172.21.15.82:0/1116665528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a48102770 0x7f5a4819abb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 >> 172.21.15.82:0/1116665528 conn(0x7f5a480fdce0 msgr2=0x7f5a48074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.273+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 shutdown_connections 2024-04-26T20:22:02.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.274+0000 7f5a47200640 1 -- 172.21.15.82:0/1116665528 wait complete. 2024-04-26T20:22:02.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:22:02.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 -- 172.21.15.82:0/2746055577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 msgr2=0x7fe13410adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 --2- 172.21.15.82:0/2746055577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 0x7fe13410adc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009be0 tx=0x7fe12c02a6c0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 -- 172.21.15.82:0/2746055577 shutdown_connections 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 --2- 172.21.15.82:0/2746055577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 0x7fe13410adc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 --2- 172.21.15.82:0/2746055577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134103b70 0x7fe134103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 --2- 172.21.15.82:0/2746055577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134102980 0x7fe134102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 -- 172.21.15.82:0/2746055577 >> 172.21.15.82:0/2746055577 conn(0x7fe1340fdf10 msgr2=0x7fe134100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 -- 172.21.15.82:0/2746055577 shutdown_connections 2024-04-26T20:22:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.499+0000 7fe138a00640 1 -- 172.21.15.82:0/2746055577 wait complete. 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.500+0000 7fe138a00640 1 Processor -- start 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 -- start start 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 0x7fe13419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 0x7fe13419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 0x7fe1341a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe13410e4b0 con 0x7fe134103b70 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe13410e330 con 0x7fe134104530 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe138a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe13410e630 con 0x7fe134102980 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe131400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 0x7fe13419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe131e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 0x7fe13419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe131e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 0x7fe13419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46400/0 (socket says 172.21.15.82:46400) 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe131400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 0x7fe13419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44138/0 (socket says 172.21.15.82:44138) 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe131e00640 1 -- 172.21.15.82:0/1579078275 learned_addr learned my addr 172.21.15.82:0/1579078275 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.501+0000 7fe132800640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 0x7fe1341a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131e00640 1 -- 172.21.15.82:0/1579078275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 msgr2=0x7fe1341a2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131e00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 0x7fe1341a2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131e00640 1 -- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 msgr2=0x7fe13419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131e00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 0x7fe13419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131e00640 1 -- 172.21.15.82:0/1579078275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1341a29c0 con 0x7fe134102980 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131400640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 0x7fe13419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe131e00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 0x7fe13419adb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe12400e9a0 tx=0x7fe12400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12400cd80 con 0x7fe134102980 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.502+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1341a2cb0 con 0x7fe134102980 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.503+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1341a31a0 con 0x7fe134102980 2024-04-26T20:22:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.503+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1240108e0 con 0x7fe134102980 2024-04-26T20:22:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.503+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1240188e0 con 0x7fe134102980 2024-04-26T20:22:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.504+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1341a3430 con 0x7fe134102980 2024-04-26T20:22:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.506+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe124010430 con 0x7fe134102980 2024-04-26T20:22:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.507+0000 7fe12aa00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe1180a3c40 0x7fe1180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.507+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe1240d0ff0 con 0x7fe134102980 2024-04-26T20:22:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.507+0000 7fe131400640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe1180a3c40 0x7fe1180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.508+0000 7fe131400640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe1180a3c40 0x7fe1180a6100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe120009fc0 tx=0x7fe120005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.510+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe124026020 con 0x7fe134102980 2024-04-26T20:22:02.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.711+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1341a3600 con 0x7fe134102980 2024-04-26T20:22:02.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.712+0000 7fe12aa00640 1 -- 172.21.15.82:0/1579078275 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fe12409d510 con 0x7fe134102980 2024-04-26T20:22:02.712 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.714+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe1180a3c40 msgr2=0x7fe1180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.714+0000 7fe138a00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe1180a3c40 0x7fe1180a6100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe120009fc0 tx=0x7fe120005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.714+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 msgr2=0x7fe13419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.714+0000 7fe138a00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 0x7fe13419adb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe12400e9a0 tx=0x7fe12400ee60 comp rx=0 tx=0).stop 2024-04-26T20:22:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 shutdown_connections 2024-04-26T20:22:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe1180a3c40 0x7fe1180a6100 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe134104530 0x7fe1341a2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe134103b70 0x7fe13419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 --2- 172.21.15.82:0/1579078275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe134102980 0x7fe13419adb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 >> 172.21.15.82:0/1579078275 conn(0x7fe1340fdf10 msgr2=0x7fe134074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 shutdown_connections 2024-04-26T20:22:02.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.715+0000 7fe138a00640 1 -- 172.21.15.82:0/1579078275 wait complete. 2024-04-26T20:22:02.735 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 -- 172.21.15.82:0/1728964511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f0103a30 msgr2=0x7fc9f0103eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1728964511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f0103a30 0x7fc9f0103eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009860 tx=0x7fc9dc02a340 comp rx=0 tx=0).stop 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 -- 172.21.15.82:0/1728964511 shutdown_connections 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1728964511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f01043f0 0x7fc9f010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1728964511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f0103a30 0x7fc9f0103eb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1728964511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0102840 0x7fc9f0102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 -- 172.21.15.82:0/1728964511 >> 172.21.15.82:0/1728964511 conn(0x7fc9f00fddd0 msgr2=0x7fc9f01001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 -- 172.21.15.82:0/1728964511 shutdown_connections 2024-04-26T20:22:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.933+0000 7fc9f6000640 1 -- 172.21.15.82:0/1728964511 wait complete. 2024-04-26T20:22:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 Processor -- start 2024-04-26T20:22:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 -- start start 2024-04-26T20:22:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f0102840 0x7fc9f019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 0x7fc9f019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f01043f0 0x7fc9f01a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f010e350 con 0x7fc9f01043f0 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f010e1d0 con 0x7fc9f0103a30 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.934+0000 7fc9f6000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f010e4d0 con 0x7fc9f0102840 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 0x7fc9f019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9f5600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f01043f0 0x7fc9f01a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9f4c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f0102840 0x7fc9f019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 0x7fc9f019b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:36914/0 (socket says 172.21.15.82:36914) 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 -- 172.21.15.82:0/1807923214 learned_addr learned my addr 172.21.15.82:0/1807923214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 -- 172.21.15.82:0/1807923214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f0102840 msgr2=0x7fc9f019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f0102840 0x7fc9f019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 -- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f01043f0 msgr2=0x7fc9f01a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f01043f0 0x7fc9f01a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 -- 172.21.15.82:0/1807923214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f01a28c0 con 0x7fc9f0103a30 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.935+0000 7fc9efe00640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 0x7fc9f019b1c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc005940 tx=0x7fc9dc02ae20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.936+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc040020 con 0x7fc9f0103a30 2024-04-26T20:22:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.936+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9dc030e50 con 0x7fc9f0103a30 2024-04-26T20:22:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.936+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc037040 con 0x7fc9f0103a30 2024-04-26T20:22:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.936+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f01a2b50 con 0x7fc9f0103a30 2024-04-26T20:22:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.936+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f01a2ff0 con 0x7fc9f0103a30 2024-04-26T20:22:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.937+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f01a3220 con 0x7fc9f0103a30 2024-04-26T20:22:02.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.939+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc9dc043020 con 0x7fc9f0103a30 2024-04-26T20:22:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.940+0000 7fc9ed600640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9d80a3cc0 0x7fc9d80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.940+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc9dc0f0780 con 0x7fc9f0103a30 2024-04-26T20:22:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.941+0000 7fc9f4c00640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9d80a3cc0 0x7fc9d80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.941+0000 7fc9f4c00640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9d80a3cc0 0x7fc9d80a6180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9f019bb50 tx=0x7fc9e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:02.943+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc9dc04a020 con 0x7fc9f0103a30 2024-04-26T20:22:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:02 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3602025484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:02 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1116665528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:02 smithi139 ceph-mon[32999]: pgmap v389: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:22:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:02 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1579078275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:03.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:02 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3602025484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:03.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:02 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1116665528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:03.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:02 smithi135 ceph-mon[32816]: pgmap v389: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:22:03.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:02 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1579078275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:03.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.127+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc9f01a3510 con 0x7fc9f0103a30 2024-04-26T20:22:03.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.128+0000 7fc9ed600640 1 -- 172.21.15.82:0/1807923214 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fc9dc0bcdd0 con 0x7fc9f0103a30 2024-04-26T20:22:03.129 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9d80a3cc0 msgr2=0x7fc9d80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9d80a3cc0 0x7fc9d80a6180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9f019bb50 tx=0x7fc9e4005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 msgr2=0x7fc9f019b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 0x7fc9f019b1c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc005940 tx=0x7fc9dc02ae20 comp rx=0 tx=0).stop 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 shutdown_connections 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9d80a3cc0 0x7fc9d80a6180 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9f01043f0 0x7fc9f01a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f0103a30 0x7fc9f019b1c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 --2- 172.21.15.82:0/1807923214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f0102840 0x7fc9f019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 >> 172.21.15.82:0/1807923214 conn(0x7fc9f00fddd0 msgr2=0x7fc9f0109200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 shutdown_connections 2024-04-26T20:22:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.131+0000 7fc9f6000640 1 -- 172.21.15.82:0/1807923214 wait complete. 2024-04-26T20:22:03.148 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:02 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3602025484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:03.148 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:02 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1116665528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:03.148 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:02 smithi082 ceph-mon[28105]: pgmap v389: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T20:22:03.148 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:02 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1579078275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:03.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 -- 172.21.15.82:0/104757383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 msgr2=0x7fb9f41055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 --2- 172.21.15.82:0/104757383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f41055c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009900 tx=0x7fb9e402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 -- 172.21.15.82:0/104757383 shutdown_connections 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 --2- 172.21.15.82:0/104757383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9f4108430 0x7fb9f410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 --2- 172.21.15.82:0/104757383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9f4105b00 0x7fb9f4107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 --2- 172.21.15.82:0/104757383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f41055c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 -- 172.21.15.82:0/104757383 >> 172.21.15.82:0/104757383 conn(0x7fb9f40fcc00 msgr2=0x7fb9f40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 -- 172.21.15.82:0/104757383 shutdown_connections 2024-04-26T20:22:03.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.356+0000 7fb9f3200640 1 -- 172.21.15.82:0/104757383 wait complete. 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 Processor -- start 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 -- start start 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9f4105b00 0x7fb9f419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9f4108430 0x7fb9f41a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f410e300 con 0x7fb9f4108430 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f410e180 con 0x7fb9f4105b00 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.357+0000 7fb9f3200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f410e480 con 0x7fb9f41031d0 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9f4105b00 0x7fb9f419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46434/0 (socket says 172.21.15.82:46434) 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 -- 172.21.15.82:0/3388665372 learned_addr learned my addr 172.21.15.82:0/3388665372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f2800640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9f4108430 0x7fb9f41a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 -- 172.21.15.82:0/3388665372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9f4105b00 msgr2=0x7fb9f419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9f4105b00 0x7fb9f419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 -- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9f4108430 msgr2=0x7fb9f41a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9f4108430 0x7fb9f41a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.358+0000 7fb9f1e00640 1 -- 172.21.15.82:0/3388665372 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f41a2810 con 0x7fb9f41031d0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.359+0000 7fb9f1e00640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f419abf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4005ab0 tx=0x7fb9e4003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.359+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e403f070 con 0x7fb9f41031d0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.359+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9e4031c50 con 0x7fb9f41031d0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.359+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4035030 con 0x7fb9f41031d0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.359+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f41a2aa0 con 0x7fb9f41031d0 2024-04-26T20:22:03.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.359+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f41a2f90 con 0x7fb9f41031d0 2024-04-26T20:22:03.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.360+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f4109f80 con 0x7fb9f41031d0 2024-04-26T20:22:03.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.362+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb9e4042070 con 0x7fb9f41031d0 2024-04-26T20:22:03.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.364+0000 7fb9eaa00640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9d80a3c40 0x7fb9d80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.364+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb9e40f17a0 con 0x7fb9f41031d0 2024-04-26T20:22:03.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.364+0000 7fb9f1400640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9d80a3c40 0x7fb9d80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.365+0000 7fb9f1400640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9d80a3c40 0x7fb9d80a6100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb9f419c100 tx=0x7fb9e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:03.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.366+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb9e40bd610 con 0x7fb9f41031d0 2024-04-26T20:22:03.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.572+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb9f402dc60 con 0x7fb9f41031d0 2024-04-26T20:22:03.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.573+0000 7fb9eaa00640 1 -- 172.21.15.82:0/3388665372 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fb9e40c1910 con 0x7fb9f41031d0 2024-04-26T20:22:03.573 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9d80a3c40 msgr2=0x7fb9d80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9d80a3c40 0x7fb9d80a6100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb9f419c100 tx=0x7fb9e0005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 msgr2=0x7fb9f419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f419abf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4005ab0 tx=0x7fb9e4003b90 comp rx=0 tx=0).stop 2024-04-26T20:22:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 shutdown_connections 2024-04-26T20:22:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb9d80a3c40 0x7fb9d80a6100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9f4108430 0x7fb9f41a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9f4105b00 0x7fb9f419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 --2- 172.21.15.82:0/3388665372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9f41031d0 0x7fb9f419abf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 >> 172.21.15.82:0/3388665372 conn(0x7fb9f40fcc00 msgr2=0x7fb9f41029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 shutdown_connections 2024-04-26T20:22:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.576+0000 7fb9f3200640 1 -- 172.21.15.82:0/3388665372 wait complete. 2024-04-26T20:22:03.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 -- 172.21.15.82:0/1692428957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4104b90 msgr2=0x7faec4104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 --2- 172.21.15.82:0/1692428957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4104b90 0x7faec4104fb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009900 tx=0x7faeb402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 -- 172.21.15.82:0/1692428957 shutdown_connections 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 --2- 172.21.15.82:0/1692428957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec4106740 0x7faec410cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 --2- 172.21.15.82:0/1692428957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faec4105d80 0x7faec4106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 --2- 172.21.15.82:0/1692428957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4104b90 0x7faec4104fb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 -- 172.21.15.82:0/1692428957 >> 172.21.15.82:0/1692428957 conn(0x7faec4100120 msgr2=0x7faec4102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 -- 172.21.15.82:0/1692428957 shutdown_connections 2024-04-26T20:22:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.801+0000 7faec8a00640 1 -- 172.21.15.82:0/1692428957 wait complete. 2024-04-26T20:22:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.802+0000 7faec8a00640 1 Processor -- start 2024-04-26T20:22:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.802+0000 7faec8a00640 1 -- start start 2024-04-26T20:22:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec8a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faec4104b90 0x7faec419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 0x7faec419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec4106740 0x7faec41a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faec41106b0 con 0x7faec4105d80 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec8a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faec4110530 con 0x7faec4106740 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec8a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faec4110830 con 0x7faec4104b90 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 0x7faec419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 0x7faec419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44208/0 (socket says 172.21.15.82:44208) 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faec4104b90 0x7faec419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 -- 172.21.15.82:0/170452368 learned_addr learned my addr 172.21.15.82:0/170452368 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec2800640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec4106740 0x7faec41a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 -- 172.21.15.82:0/170452368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faec4104b90 msgr2=0x7faec419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faec4104b90 0x7faec419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 -- 172.21.15.82:0/170452368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec4106740 msgr2=0x7faec41a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec4106740 0x7faec41a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.803+0000 7faec1400640 1 -- 172.21.15.82:0/170452368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec41a2a30 con 0x7faec4105d80 2024-04-26T20:22:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.804+0000 7faec1400640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 0x7faec419b350 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faeb000e9f0 tx=0x7faeb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.804+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb000cd80 con 0x7faec4105d80 2024-04-26T20:22:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.804+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faeb00054d0 con 0x7faec4105d80 2024-04-26T20:22:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.804+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec41a2d20 con 0x7faec4105d80 2024-04-26T20:22:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.804+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0010690 con 0x7faec4105d80 2024-04-26T20:22:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.804+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41a31c0 con 0x7faec4105d80 2024-04-26T20:22:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.805+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec410bf50 con 0x7faec4105d80 2024-04-26T20:22:03.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.808+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7faeb0004e90 con 0x7faec4105d80 2024-04-26T20:22:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.809+0000 7faebaa00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faea80a3c40 0x7faea80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.810+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7faeb00d0d30 con 0x7faec4105d80 2024-04-26T20:22:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.810+0000 7faec1e00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faea80a3c40 0x7faea80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.811+0000 7faec1e00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faea80a3c40 0x7faea80a6100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009230 tx=0x7faeb40314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:03.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:03.814+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7faeb009d1f0 con 0x7faec4105d80 2024-04-26T20:22:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:03 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1807923214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:03 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3388665372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:04.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.018+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faec402dd20 con 0x7faec4105d80 2024-04-26T20:22:04.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.019+0000 7faebaa00640 1 -- 172.21.15.82:0/170452368 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7faeb009caf0 con 0x7faec4105d80 2024-04-26T20:22:04.020 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faea80a3c40 msgr2=0x7faea80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faea80a3c40 0x7faea80a6100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009230 tx=0x7faeb40314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 msgr2=0x7faec419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 0x7faec419b350 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faeb000e9f0 tx=0x7faeb000edf0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 shutdown_connections 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faea80a3c40 0x7faea80a6100 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faec4106740 0x7faec41a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec4105d80 0x7faec419b350 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 --2- 172.21.15.82:0/170452368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faec4104b90 0x7faec419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 >> 172.21.15.82:0/170452368 conn(0x7faec4100120 msgr2=0x7faec4109120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:04.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 shutdown_connections 2024-04-26T20:22:04.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.022+0000 7faec8a00640 1 -- 172.21.15.82:0/170452368 wait complete. 2024-04-26T20:22:04.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:04.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:03 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1807923214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:03 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3388665372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:04.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:03 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1807923214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:04.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:03 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3388665372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 -- 172.21.15.82:0/530427166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4106740 msgr2=0x7f18a410cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 --2- 172.21.15.82:0/530427166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4106740 0x7f18a410cfd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f189c009be0 tx=0x7f189c02a6d0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 -- 172.21.15.82:0/530427166 shutdown_connections 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 --2- 172.21.15.82:0/530427166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4106740 0x7f18a410cfd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 --2- 172.21.15.82:0/530427166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4105d80 0x7f18a4106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 --2- 172.21.15.82:0/530427166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a4104b90 0x7f18a4104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 -- 172.21.15.82:0/530427166 >> 172.21.15.82:0/530427166 conn(0x7f18a4100120 msgr2=0x7f18a4102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 -- 172.21.15.82:0/530427166 shutdown_connections 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.244+0000 7f18a9800640 1 -- 172.21.15.82:0/530427166 wait complete. 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.245+0000 7f18a9800640 1 Processor -- start 2024-04-26T20:22:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.245+0000 7f18a9800640 1 -- start start 2024-04-26T20:22:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 0x7f18a419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a9800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4105d80 0x7f18a419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a4106740 0x7f18a41a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a9800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41106a0 con 0x7f18a4104b90 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a9800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4110520 con 0x7f18a4106740 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a9800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4110820 con 0x7f18a4105d80 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 0x7f18a419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 0x7f18a419ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44220/0 (socket says 172.21.15.82:44220) 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 -- 172.21.15.82:0/3329702864 learned_addr learned my addr 172.21.15.82:0/3329702864 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2000640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4105d80 0x7f18a419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a3400640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a4106740 0x7f18a41a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 -- 172.21.15.82:0/3329702864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4105d80 msgr2=0x7f18a419b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4105d80 0x7f18a419b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 -- 172.21.15.82:0/3329702864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a4106740 msgr2=0x7f18a41a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a4106740 0x7f18a41a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.246+0000 7f18a2a00640 1 -- 172.21.15.82:0/3329702864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a41a2960 con 0x7f18a4104b90 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.247+0000 7f18a2a00640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 0x7f18a419ad40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f189400e9c0 tx=0x7f189400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.247+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189400cd80 con 0x7f18a4104b90 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.247+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18940035f0 con 0x7f18a4104b90 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.247+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894010690 con 0x7f18a4104b90 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.247+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a41a2c50 con 0x7f18a4104b90 2024-04-26T20:22:04.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.247+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a41a31a0 con 0x7f18a4104b90 2024-04-26T20:22:04.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.249+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a410beb0 con 0x7f18a4104b90 2024-04-26T20:22:04.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.251+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f18940037a0 con 0x7f18a4104b90 2024-04-26T20:22:04.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.252+0000 7f189b400640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f18880a3cc0 0x7f18880a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.253+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f18940d0c30 con 0x7f18a4104b90 2024-04-26T20:22:04.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.253+0000 7f18a2000640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f18880a3cc0 0x7f18880a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.253+0000 7f18a2000640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f18880a3cc0 0x7f18880a6180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18a419c250 tx=0x7f188c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.256+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f189409d0f0 con 0x7f18a4104b90 2024-04-26T20:22:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.501+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18a402dd80 con 0x7f18a4104b90 2024-04-26T20:22:04.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.503+0000 7f189b400640 1 -- 172.21.15.82:0/3329702864 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11951 (secure 0 0 0) 0x7f189409c9f0 con 0x7f18a4104b90 2024-04-26T20:22:04.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:04.505 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:20:20.191502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:22:04.505 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:22:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f18880a3cc0 msgr2=0x7f18880a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f18880a3cc0 0x7f18880a6180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18a419c250 tx=0x7f188c009260 comp rx=0 tx=0).stop 2024-04-26T20:22:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 msgr2=0x7f18a419ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 0x7f18a419ad40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f189400e9c0 tx=0x7f189400ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 shutdown_connections 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f18880a3cc0 0x7f18880a6180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a4106740 0x7f18a41a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18a4105d80 0x7f18a419b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 --2- 172.21.15.82:0/3329702864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18a4104b90 0x7f18a419ad40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 >> 172.21.15.82:0/3329702864 conn(0x7f18a4100120 msgr2=0x7f18a4109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 shutdown_connections 2024-04-26T20:22:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.506+0000 7f18a9800640 1 -- 172.21.15.82:0/3329702864 wait complete. 2024-04-26T20:22:04.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 -- 172.21.15.82:0/1692622003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4105b80 msgr2=0x7f93c4106000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 --2- 172.21.15.82:0/1692622003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4105b80 0x7f93c4106000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f93b0009900 tx=0x7f93b002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 -- 172.21.15.82:0/1692622003 shutdown_connections 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 --2- 172.21.15.82:0/1692622003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93c4106540 0x7f93c410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 --2- 172.21.15.82:0/1692622003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4105b80 0x7f93c4106000 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 --2- 172.21.15.82:0/1692622003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93c4104990 0x7f93c4104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 -- 172.21.15.82:0/1692622003 >> 172.21.15.82:0/1692622003 conn(0x7f93c40fff00 msgr2=0x7f93c4102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 -- 172.21.15.82:0/1692622003 shutdown_connections 2024-04-26T20:22:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.718+0000 7f93c3200640 1 -- 172.21.15.82:0/1692622003 wait complete. 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.719+0000 7f93c3200640 1 Processor -- start 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.719+0000 7f93c3200640 1 -- start start 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 0x7f93c419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93c4105b80 0x7f93c419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93c4106540 0x7f93c41a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41104a0 con 0x7f93c4104990 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4110320 con 0x7f93c4105b80 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c3200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4110620 con 0x7f93c4106540 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 0x7f93c419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 0x7f93c419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44232/0 (socket says 172.21.15.82:44232) 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 -- 172.21.15.82:0/3049441503 learned_addr learned my addr 172.21.15.82:0/3049441503 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1400640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93c4105b80 0x7f93c419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c2800640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93c4106540 0x7f93c41a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 -- 172.21.15.82:0/3049441503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93c4106540 msgr2=0x7f93c41a2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93c4106540 0x7f93c41a2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 -- 172.21.15.82:0/3049441503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93c4105b80 msgr2=0x7f93c419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93c4105b80 0x7f93c419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.720+0000 7f93c1e00640 1 -- 172.21.15.82:0/3049441503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c41a2790 con 0x7f93c4104990 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.721+0000 7f93c1e00640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 0x7f93c419ab70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f93b400d950 tx=0x7f93b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.721+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4017020 con 0x7f93c4104990 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.721+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b4009c30 con 0x7f93c4104990 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.721+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b400f690 con 0x7f93c4104990 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.721+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c41a2a80 con 0x7f93c4104990 2024-04-26T20:22:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.721+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41a2fa0 con 0x7f93c4104990 2024-04-26T20:22:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.722+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c410bd50 con 0x7f93c4104990 2024-04-26T20:22:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.724+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f93b401a020 con 0x7f93c4104990 2024-04-26T20:22:04.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.726+0000 7f93baa00640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f93a80a3c40 0x7f93a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.726+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f93b40d07f0 con 0x7f93c4104990 2024-04-26T20:22:04.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.726+0000 7f93c1400640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f93a80a3c40 0x7f93a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.727+0000 7f93c1400640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f93a80a3c40 0x7f93a80a6100 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.730+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f93b4021020 con 0x7f93c4104990 2024-04-26T20:22:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:04 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/170452368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:04 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3329702864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:04 smithi082 ceph-mon[28105]: pgmap v390: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.940+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93c402db50 con 0x7f93c4104990 2024-04-26T20:22:04.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.944+0000 7f93baa00640 1 -- 172.21.15.82:0/3049441503 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f93b4009de0 con 0x7f93c4104990 2024-04-26T20:22:04.945 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:04.945 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f93a80a3c40 msgr2=0x7f93a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f93a80a3c40 0x7f93a80a6100 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b00314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 msgr2=0x7f93c419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 0x7f93c419ab70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f93b400d950 tx=0x7f93b400de10 comp rx=0 tx=0).stop 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 shutdown_connections 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f93a80a3c40 0x7f93a80a6100 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93c4106540 0x7f93c41a2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93c4105b80 0x7f93c419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 --2- 172.21.15.82:0/3049441503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c4104990 0x7f93c419ab70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 >> 172.21.15.82:0/3049441503 conn(0x7f93c40fff00 msgr2=0x7f93c4108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 shutdown_connections 2024-04-26T20:22:04.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:04.947+0000 7f93c3200640 1 -- 172.21.15.82:0/3049441503 wait complete. 2024-04-26T20:22:04.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:04 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/170452368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:04 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3329702864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:04 smithi139 ceph-mon[32999]: pgmap v390: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:05.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:04 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/170452368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:05.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:04 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3329702864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:05.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:04 smithi135 ceph-mon[32816]: pgmap v390: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:05.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 -- 172.21.15.82:0/751367740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac10a940 msgr2=0x7f6bac1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 --2- 172.21.15.82:0/751367740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac10a940 0x7f6bac1111d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009ca0 tx=0x7f6ba402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 -- 172.21.15.82:0/751367740 shutdown_connections 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 --2- 172.21.15.82:0/751367740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac10a940 0x7f6bac1111d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 --2- 172.21.15.82:0/751367740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bac109f80 0x7f6bac10a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 --2- 172.21.15.82:0/751367740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac108d90 0x7f6bac1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 -- 172.21.15.82:0/751367740 >> 172.21.15.82:0/751367740 conn(0x7f6bac077d30 msgr2=0x7f6bac07a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 -- 172.21.15.82:0/751367740 shutdown_connections 2024-04-26T20:22:05.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.164+0000 7f6bb2000640 1 -- 172.21.15.82:0/751367740 wait complete. 2024-04-26T20:22:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 Processor -- start 2024-04-26T20:22:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 -- start start 2024-04-26T20:22:05.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac108d90 0x7f6bac19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bac109f80 0x7f6bac19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 0x7f6bac1a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac114910 con 0x7f6bac10a940 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac114790 con 0x7f6bac109f80 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.165+0000 7f6bb2000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac114a90 con 0x7f6bac108d90 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 0x7f6bac1a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 0x7f6bac1a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44246/0 (socket says 172.21.15.82:44246) 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 -- 172.21.15.82:0/3128000740 learned_addr learned my addr 172.21.15.82:0/3128000740 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6babe00640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bac109f80 0x7f6bac19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb0c00640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac108d90 0x7f6bac19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 -- 172.21.15.82:0/3128000740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac108d90 msgr2=0x7f6bac19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac108d90 0x7f6bac19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 -- 172.21.15.82:0/3128000740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bac109f80 msgr2=0x7f6bac19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bac109f80 0x7f6bac19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 -- 172.21.15.82:0/3128000740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac1a6b70 con 0x7f6bac10a940 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.166+0000 7f6bb1600640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 0x7f6bac1a6500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4033040 tx=0x7f6ba40316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.167+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4003b70 con 0x7f6bac10a940 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.167+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac1a6e00 con 0x7f6bac10a940 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.167+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba4003d10 con 0x7f6bac10a940 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.167+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba402fb40 con 0x7f6bac10a940 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.167+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac1a72c0 con 0x7f6bac10a940 2024-04-26T20:22:05.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.168+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bac1100b0 con 0x7f6bac10a940 2024-04-26T20:22:05.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.170+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6ba4004610 con 0x7f6bac10a940 2024-04-26T20:22:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.171+0000 7f6ba9600640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6b940a3c40 0x7f6b940a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.171+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6ba40f1d50 con 0x7f6bac10a940 2024-04-26T20:22:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.171+0000 7f6bb0c00640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6b940a3c40 0x7f6b940a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.172+0000 7f6bb0c00640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6b940a3c40 0x7f6b940a6100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6bac109de0 tx=0x7f6ba0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.175+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6ba40be320 con 0x7f6bac10a940 2024-04-26T20:22:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.412+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bac02dcd0 con 0x7f6bac10a940 2024-04-26T20:22:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.414+0000 7f6ba9600640 1 -- 172.21.15.82:0/3128000740 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11951 (secure 0 0 0) 0x7f6ba40a8090 con 0x7f6bac10a940 2024-04-26T20:22:05.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:05.415 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:20:20.191502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:22:05.415 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:22:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.416+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6b940a3c40 msgr2=0x7f6b940a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.416+0000 7f6bb2000640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6b940a3c40 0x7f6b940a6100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6bac109de0 tx=0x7f6ba0005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.416+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 msgr2=0x7f6bac1a6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.416+0000 7f6bb2000640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 0x7f6bac1a6500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4033040 tx=0x7f6ba40316f0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 shutdown_connections 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6b940a3c40 0x7f6b940a6100 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bac10a940 0x7f6bac1a6500 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bac109f80 0x7f6bac19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 --2- 172.21.15.82:0/3128000740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6bac108d90 0x7f6bac19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 >> 172.21.15.82:0/3128000740 conn(0x7f6bac077d30 msgr2=0x7f6bac10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 shutdown_connections 2024-04-26T20:22:05.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.417+0000 7f6bb2000640 1 -- 172.21.15.82:0/3128000740 wait complete. 2024-04-26T20:22:05.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T20:19:52.134957+0000', 'modified': '2024-04-26T20:20:20.191502+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24584, 'mds_1': 24554, 'mds_2': 24550, 'mds_3': 24529, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/3324936648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3324936648}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 3324936648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'l', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.139:6833/4280186600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 4280186600}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 4280186600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'j', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/3327585570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 3327585570}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 3327585570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/1988909695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 1988909695}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 1988909695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/2462659708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 2462659708}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 2462659708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/1503486498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 1503486498}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 1503486498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.139:6837/4255230594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 4255230594}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 4255230594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.139:6839/1238493959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 1238493959}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 1238493959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24554': {'gid': 24554, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.82:6839/1585592636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1585592636}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1585592636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24584': {'gid': 24584, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6839/1800754758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1800754758}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1800754758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24584, 'qdb_cluster': [24554, 24584, 24454, 24529, 24550]} 2024-04-26T20:22:05.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T20:22:05.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 -- 172.21.15.82:0/4030285580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c103410 msgr2=0x7f392c105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 --2- 172.21.15.82:0/4030285580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c103410 0x7f392c105800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3920009900 tx=0x7f392002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 -- 172.21.15.82:0/4030285580 shutdown_connections 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 --2- 172.21.15.82:0/4030285580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c108670 0x7f392c10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 --2- 172.21.15.82:0/4030285580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 0x7f392c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 --2- 172.21.15.82:0/4030285580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c103410 0x7f392c105800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 -- 172.21.15.82:0/4030285580 >> 172.21.15.82:0/4030285580 conn(0x7f392c0fce20 msgr2=0x7f392c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 -- 172.21.15.82:0/4030285580 shutdown_connections 2024-04-26T20:22:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.638+0000 7f3934600640 1 -- 172.21.15.82:0/4030285580 wait complete. 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.639+0000 7f3934600640 1 Processor -- start 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.639+0000 7f3934600640 1 -- start start 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3934600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 0x7f392c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3934600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 0x7f392c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3934600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c108670 0x7f392c1a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3934600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f392c10e4f0 con 0x7f392c103410 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3934600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f392c10e370 con 0x7f392c105d40 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3934600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f392c10e670 con 0x7f392c108670 2024-04-26T20:22:05.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3931c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 0x7f392c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3931c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 0x7f392c198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44260/0 (socket says 172.21.15.82:44260) 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3931c00640 1 -- 172.21.15.82:0/2462374546 learned_addr learned my addr 172.21.15.82:0/2462374546 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3931200640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 0x7f392c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3932600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c108670 0x7f392c1a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.640+0000 7f3931c00640 1 -- 172.21.15.82:0/2462374546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c108670 msgr2=0x7f392c1a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3931c00640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c108670 0x7f392c1a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3931c00640 1 -- 172.21.15.82:0/2462374546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 msgr2=0x7f392c199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3931c00640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 0x7f392c199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3931c00640 1 -- 172.21.15.82:0/2462374546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c1a0850 con 0x7f392c103410 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3931200640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 0x7f392c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3931c00640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 0x7f392c198c40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3920005940 tx=0x7f39200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f392a000640 1 -- 172.21.15.82:0/2462374546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392003f030 con 0x7f392c103410 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c1a0ae0 con 0x7f392c103410 2024-04-26T20:22:05.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f392a000640 1 -- 172.21.15.82:0/2462374546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3920003cb0 con 0x7f392c103410 2024-04-26T20:22:05.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f392a000640 1 -- 172.21.15.82:0/2462374546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920035070 con 0x7f392c103410 2024-04-26T20:22:05.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.641+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c1a0fd0 con 0x7f392c103410 2024-04-26T20:22:05.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.644+0000 7f39375c9740 1 Processor -- start 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.644+0000 7f392a000640 1 -- 172.21.15.82:0/2462374546 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3920042030 con 0x7f392c103410 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.644+0000 7f39375c9740 1 -- start start 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f39375c9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 0x560b359fe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f39375c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359feae0 0x560b35a035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f39375c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f39375c9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b35962600 con 0x560b359fe0f0 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f39375c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560b358ff100 con 0x560b359feae0 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f39375c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560b3595e5c0 con 0x560b35a03c50 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 0x560b359fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 0x560b359fe510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44272/0 (socket says 172.21.15.82:44272) 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 -- 172.21.15.82:0/3043935302 learned_addr learned my addr 172.21.15.82:0/3043935302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3931200640 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3931c00640 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359feae0 0x560b35a035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 -- 172.21.15.82:0/3043935302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 msgr2=0x560b35a060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 -- 172.21.15.82:0/3043935302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359feae0 msgr2=0x560b35a035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359feae0 0x560b35a035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.645+0000 7f3932600640 1 -- 172.21.15.82:0/3043935302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b356742d0 con 0x560b359fe0f0 2024-04-26T20:22:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f3932600640 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 0x560b359fe510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3924009fd0 tx=0x7f39240118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16212ad35eb5445 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f391ea00640 1 -- 172.21.15.82:0/3043935302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924004d20 con 0x560b359fe0f0 2024-04-26T20:22:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f391ea00640 1 -- 172.21.15.82:0/3043935302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3924004050 con 0x560b359fe0f0 2024-04-26T20:22:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f391ea00640 1 -- 172.21.15.82:0/3043935302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924005260 con 0x560b359fe0f0 2024-04-26T20:22:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f392a000640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f39140a3c40 0x7f39140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f392a000640 1 -- 172.21.15.82:0/2462374546 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f39200f0d10 con 0x7f392c103410 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.646+0000 7f3931c00640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f39140a3c40 0x7f39140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 -- 172.21.15.82:0/3043935302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 msgr2=0x560b359fe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 0x560b359fe510 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3924009fd0 tx=0x7f39240118d0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 -- 172.21.15.82:0/3043935302 shutdown_connections 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359feae0 0x560b35a035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 --2- 172.21.15.82:0/3043935302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359fe0f0 0x560b359fe510 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 -- 172.21.15.82:0/3043935302 >> 172.21.15.82:0/3043935302 conn(0x560b35992d10 msgr2=0x560b359f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f3931c00640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f39140a3c40 0x7f39140a6100 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x560b359feee0 tx=0x7f392002a3f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 -- 172.21.15.82:0/3043935302 shutdown_connections 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.647+0000 7f39375c9740 1 -- 172.21.15.82:0/3043935302 wait complete. 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 -- start start 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 Processor -- start 2024-04-26T20:22:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a08510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a08a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b35a06c00 con 0x560b359feae0 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560b358e9f70 con 0x560b359fe0f0 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560b35a06d80 con 0x560b35a03c50 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f39375c9740 10 client.0 _ll_register_callbacks cb 0x560b35958480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.648+0000 7f3931200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a08a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a08a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44286/0 (socket says 172.21.15.82:44286) 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 -- 172.21.15.82:0/1258692742 learned_addr learned my addr 172.21.15.82:0/1258692742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3932600640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a08510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3932600640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 -- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 msgr2=0x560b35a0fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 -- 172.21.15.82:0/1258692742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 msgr2=0x560b35a08510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a08510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 -- 172.21.15.82:0/1258692742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3573e6b0 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3932600640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3931200640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a08a50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3918012d20 tx=0x7f391800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97d13f19f5f6569 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3913400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.649+0000 7f3913400640 1 -- 172.21.15.82:0/1258692742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918012110 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f3913400640 1 -- 172.21.15.82:0/1258692742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f3918004050 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3924004050 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f3913400640 1 -- 172.21.15.82:0/1258692742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39180122b0 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 10 client.15042 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b35a12b40 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f3913400640 1 -- 172.21.15.82:0/1258692742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3924004050 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f3913400640 1 -- 172.21.15.82:0/1258692742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3918010430 con 0x560b359feae0 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 10 client.15042 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 10 client.15042 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-26T20:22:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 20 client.15042 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a151c0 0x560b35a16630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 4 client.15042 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.650+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b35970210 con 0x560b35a151c0 2024-04-26T20:22:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.651+0000 7f3932600640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a151c0 0x560b35a16630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.651+0000 7f3932600640 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a151c0 0x560b35a16630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85555cf63941156b server_cookie=b2483677fcc1eac0 in_seq=0 out_seq=0 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.651+0000 7f3913400640 10 client.15042 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.652+0000 7f3913400640 1 -- 172.21.15.82:0/1258692742 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560b35970210 con 0x560b35a151c0 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.652+0000 7f3913400640 10 client.15042 handle_command_reply: tid=0 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.652+0000 7f39375c9740 1 client.15042 shutdown 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 msgr2=0x560b35a08a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a08a50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3918012d20 tx=0x7f391800f790 comp rx=0 tx=0).stop 2024-04-26T20:22:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 shutdown_connections 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a151c0 0x560b35a16630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a08a50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f3913400640 0 client.15042 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 --2- 172.21.15.82:0/1258692742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a08510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 >> 172.21.15.82:0/1258692742 conn(0x560b35992d10 msgr2=0x560b359f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 shutdown_connections 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 1 -- 172.21.15.82:0/1258692742 wait complete. 2024-04-26T20:22:05.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.653+0000 7f39375c9740 20 client.15042 trim_cache size 0 max 16384 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 Processor -- start 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 -- start start 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b359fe0f0 0x560b35a03510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b35a03c50 0x560b359ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b35a14970 con 0x560b359feae0 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560b35a15040 con 0x560b35a03c50 2024-04-26T20:22:05.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.672+0000 7f39375c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560b35a15710 con 0x560b359fe0f0 2024-04-26T20:22:05.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44290/0 (socket says 172.21.15.82:44290) 2024-04-26T20:22:05.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 -- 172.21.15.82:0/2330950097 learned_addr learned my addr 172.21.15.82:0/2330950097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3932600640 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b359fe0f0 0x560b35a03510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 -- 172.21.15.82:0/2330950097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b359fe0f0 msgr2=0x560b35a03510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b359fe0f0 0x560b35a03510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 -- 172.21.15.82:0/2330950097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b35a03c50 msgr2=0x560b359ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3932600640 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b35a03c50 0x560b359ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b35a03c50 0x560b359ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 -- 172.21.15.82:0/2330950097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b35a09500 con 0x560b359feae0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3932600640 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b35a03c50 0x560b359ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.673+0000 7f3931200640 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0fa50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3918009710 tx=0x7f3918012990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5185f6e51e4eefc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f391e000640 1 -- 172.21.15.82:0/2330950097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391802e070 con 0x560b359feae0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f391e000640 1 -- 172.21.15.82:0/2330950097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f391800fe80 con 0x560b359feae0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f391e000640 1 -- 172.21.15.82:0/2330950097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918003850 con 0x560b359feae0 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 -- 172.21.15.82:0/2330950097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 msgr2=0x560b35a0fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0fa50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3918009710 tx=0x7f3918012990 comp rx=0 tx=0).stop 2024-04-26T20:22:05.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 -- 172.21.15.82:0/2330950097 shutdown_connections 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b35a03c50 0x560b359ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0fa50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 --2- 172.21.15.82:0/2330950097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b359fe0f0 0x560b35a03510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.674+0000 7f39375c9740 1 -- 172.21.15.82:0/2330950097 >> 172.21.15.82:0/2330950097 conn(0x560b35992d10 msgr2=0x560b359f4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 -- 172.21.15.82:0/2330950097 shutdown_connections 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 -- 172.21.15.82:0/2330950097 wait complete. 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 -- start start 2024-04-26T20:22:05.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 Processor -- start 2024-04-26T20:22:05.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a0bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560b35a164b0 con 0x560b359feae0 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560b35a15de0 con 0x560b359fe0f0 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.675+0000 7f39375c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560b35a16b80 con 0x560b35a03c50 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f39375c9740 10 client.0 _ll_register_callbacks cb 0x7f3918009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3932600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a0bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44306/0 (socket says 172.21.15.82:44306) 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 -- 172.21.15.82:0/3286932080 learned_addr learned my addr 172.21.15.82:0/3286932080 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3932600640 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 -- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 msgr2=0x560b35a0ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 -- 172.21.15.82:0/3286932080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 msgr2=0x560b35a0bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a0bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 -- 172.21.15.82:0/3286932080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b35a0f2a0 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3931200640 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0c120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f39180059f0 tx=0x7f3918005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab0b9f1863fb4b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.676+0000 7f3913400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f3913400640 1 -- 172.21.15.82:0/3286932080 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918037060 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f3913400640 1 -- 172.21.15.82:0/3286932080 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f39180053e0 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b3596a080 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f3913400640 1 -- 172.21.15.82:0/3286932080 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f391803e050 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f39375c9740 10 client.15048 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b35a7b6a0 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f3913400640 1 -- 172.21.15.82:0/3286932080 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560b3596a080 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.677+0000 7f3913400640 1 -- 172.21.15.82:0/3286932080 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39180325e0 con 0x560b359feae0 2024-04-26T20:22:05.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f39375c9740 10 client.15048 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f39375c9740 10 client.15048 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f39375c9740 20 client.15048 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f39375c9740 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a7fed0 0x560b35a7ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f39375c9740 4 client.15048 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "status"}) -- 0x560b358e5860 con 0x560b35a7fed0 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f3932600640 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a7fed0 0x560b35a7ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f3913400640 10 client.15048 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.678+0000 7f3932600640 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a7fed0 0x560b35a7ebe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=21aa74a574f6cc86 server_cookie=5d2b7bf42f015858 in_seq=0 out_seq=0 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f3913400640 1 -- 172.21.15.82:0/3286932080 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560b358e5860 con 0x560b35a7fed0 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f3913400640 10 client.15048 handle_command_reply: tid=0 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 client.15048 shutdown 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 msgr2=0x560b35a0c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0c120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f39180059f0 tx=0x7f3918005270 comp rx=0 tx=0).stop 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 shutdown_connections 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x560b35a7fed0 0x560b35a7ebe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560b35a03c50 0x560b35a0ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b359feae0 0x560b35a0c120 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f3913400640 0 client.15048 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 --2- 172.21.15.82:0/3286932080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560b359fe0f0 0x560b35a0bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 >> 172.21.15.82:0/3286932080 conn(0x560b35992d10 msgr2=0x560b35a03150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 shutdown_connections 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 1 -- 172.21.15.82:0/3286932080 wait complete. 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.679+0000 7f39375c9740 20 client.15048 trim_cache size 0 max 16384 2024-04-26T20:22:05.684 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24454, 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 106.496166942, 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 176.39307157799999 2024-04-26T20:22:05.685 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f39140a3c40 msgr2=0x7f39140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f39140a3c40 0x7f39140a6100 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x560b359feee0 tx=0x7f392002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 msgr2=0x7f392c198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 0x7f392c198c40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3920005940 tx=0x7f39200042f0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 shutdown_connections 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f39140a3c40 0x7f39140a6100 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f392c108670 0x7f392c1a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c105d40 0x7f392c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 --2- 172.21.15.82:0/2462374546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f392c103410 0x7f392c198c40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 >> 172.21.15.82:0/2462374546 conn(0x7f392c0fce20 msgr2=0x7f392c105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 shutdown_connections 2024-04-26T20:22:05.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.680+0000 7f3934600640 1 -- 172.21.15.82:0/2462374546 wait complete. 2024-04-26T20:22:05.697 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 -- 172.21.15.82:0/121227224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 msgr2=0x7feca4104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 --2- 172.21.15.82:0/121227224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca4104db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec98009900 tx=0x7fec9802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 -- 172.21.15.82:0/121227224 shutdown_connections 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 --2- 172.21.15.82:0/121227224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feca4106540 0x7feca410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 --2- 172.21.15.82:0/121227224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 0x7feca4106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 --2- 172.21.15.82:0/121227224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca4104db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 -- 172.21.15.82:0/121227224 >> 172.21.15.82:0/121227224 conn(0x7feca40fff00 msgr2=0x7feca4102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 -- 172.21.15.82:0/121227224 shutdown_connections 2024-04-26T20:22:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.884+0000 7fecab200640 1 -- 172.21.15.82:0/121227224 wait complete. 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.885+0000 7fecab200640 1 Processor -- start 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 -- start start 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 0x7feca419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feca4106540 0x7feca41a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feca4110510 con 0x7feca4105b80 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feca4110390 con 0x7feca4106540 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecab200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feca4110690 con 0x7feca4104990 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7feca9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7feca9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 0x7feca419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7feca9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46588/0 (socket says 172.21.15.82:46588) 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7feca9e00640 1 -- 172.21.15.82:0/3802946364 learned_addr learned my addr 172.21.15.82:0/3802946364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.886+0000 7fecaa800640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feca4106540 0x7feca41a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7feca9400640 1 -- 172.21.15.82:0/3802946364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 msgr2=0x7feca419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7feca9400640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7feca9400640 1 -- 172.21.15.82:0/3802946364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feca4106540 msgr2=0x7feca41a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7feca9400640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feca4106540 0x7feca41a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7feca9400640 1 -- 172.21.15.82:0/3802946364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca41a27d0 con 0x7feca4105b80 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7feca9400640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 0x7feca419b0f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e9f0 tx=0x7fec9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7fec9ea00640 1 -- 172.21.15.82:0/3802946364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9400cd80 con 0x7feca4105b80 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7fec9ea00640 1 -- 172.21.15.82:0/3802946364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec940035f0 con 0x7feca4105b80 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca41a2ac0 con 0x7feca4105b80 2024-04-26T20:22:05.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.887+0000 7fec9ea00640 1 -- 172.21.15.82:0/3802946364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94010690 con 0x7feca4105b80 2024-04-26T20:22:05.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.888+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41a3010 con 0x7feca4105b80 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 Processor -- start 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 -- start start 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de37b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de3807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de3832b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8de2df600 con 0x55d8de37bcb0 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8de27c100 con 0x55d8de380e20 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.891+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8de2db5c0 con 0x55d8de37b2c0 2024-04-26T20:22:05.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de3807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de3807b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44312/0 (socket says 172.21.15.82:44312) 2024-04-26T20:22:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 -- 172.21.15.82:0/424198898 learned_addr learned my addr 172.21.15.82:0/424198898 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7fecaa800640 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de37b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7fec9ea00640 1 -- 172.21.15.82:0/3802946364 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fec940037a0 con 0x7feca4105b80 2024-04-26T20:22:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 -- 172.21.15.82:0/424198898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 msgr2=0x55d8de37b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de37b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 -- 172.21.15.82:0/424198898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 msgr2=0x55d8de3832b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de3832b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.892+0000 7feca9e00640 1 -- 172.21.15.82:0/424198898 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ddff12d0 con 0x55d8de37bcb0 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.893+0000 7feca9e00640 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de3807b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec9802a9e0 tx=0x7fec98004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0410daf9cf8b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.893+0000 7fec93000640 1 -- 172.21.15.82:0/424198898 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98035030 con 0x55d8de37bcb0 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.893+0000 7fec93000640 1 -- 172.21.15.82:0/424198898 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec98040070 con 0x55d8de37bcb0 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.893+0000 7fec93000640 1 -- 172.21.15.82:0/424198898 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98031900 con 0x55d8de37bcb0 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.893+0000 7fec9ea00640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fec8c0a3c40 0x7fec8c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 -- 172.21.15.82:0/424198898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 msgr2=0x55d8de3807b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fec9ea00640 1 -- 172.21.15.82:0/3802946364 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fec940d0ba0 con 0x7feca4105b80 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de3807b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec9802a9e0 tx=0x7fec98004040 comp rx=0 tx=0).stop 2024-04-26T20:22:05.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaa800640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fec8c0a3c40 0x7fec8c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 -- 172.21.15.82:0/424198898 shutdown_connections 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de3832b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de3807b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/424198898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de37b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 -- 172.21.15.82:0/424198898 >> 172.21.15.82:0/424198898 conn(0x55d8de30fd10 msgr2=0x55d8de376d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 -- 172.21.15.82:0/424198898 shutdown_connections 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaf5f1740 1 -- 172.21.15.82:0/424198898 wait complete. 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.894+0000 7fecaa800640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fec8c0a3c40 0x7fec8c0a6100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55d8de37c510 tx=0x7feca0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 -- start start 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 Processor -- start 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de385780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 0x55d8de385cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de380e20 0x55d8de38cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8de383d70 con 0x55d8de380e20 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8de266f70 con 0x55d8de37bcb0 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8de383ef0 con 0x55d8de37b2c0 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.895+0000 7fecaf5f1740 10 client.0 _ll_register_callbacks cb 0x55d8de2d5480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7fecaa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de380e20 0x55d8de38cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de385780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 0x55d8de385cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de385780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46606/0 (socket says 172.21.15.82:46606) 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 0x55d8de385cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37100/0 (socket says 172.21.15.82:37100) 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 -- 172.21.15.82:0/2571869669 learned_addr learned my addr 172.21.15.82:0/2571869669 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 -- 172.21.15.82:0/2571869669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 msgr2=0x55d8de385cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 0x55d8de385cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 -- 172.21.15.82:0/2571869669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de380e20 msgr2=0x55d8de38cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de380e20 0x55d8de38cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 -- 172.21.15.82:0/2571869669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8de0bb6b0 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9400640 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 0x55d8de385cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7feca9e00640 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de385780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec98006010 tx=0x7fec980044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fd5bf7cf50ca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.896+0000 7fec87400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fec87400640 1 -- 172.21.15.82:0/2571869669 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98052060 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec98040070 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fec87400640 1 -- 172.21.15.82:0/2571869669 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fec98003a00 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fec87400640 1 -- 172.21.15.82:0/2571869669 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec98059050 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fecaf5f1740 10 client.25183 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8de383dc0 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fec87400640 1 -- 172.21.15.82:0/2571869669 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec98040070 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fec87400640 1 -- 172.21.15.82:0/2571869669 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec980454e0 con 0x55d8de37b2c0 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.897+0000 7fecaf5f1740 10 client.25183 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7fecaf5f1740 10 client.25183 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:22:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7fecaf5f1740 20 client.25183 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de391e10 0x55d8de393280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7fecaf5f1740 4 client.25183 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8de2ed210 con 0x55d8de391e10 2024-04-26T20:22:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7feca9400640 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de391e10 0x55d8de393280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7feca9400640 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de391e10 0x55d8de393280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=31a9d8c345056941 server_cookie=1063cafdcdb8f9e3 in_seq=0 out_seq=0 2024-04-26T20:22:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.898+0000 7fec87400640 10 client.25183 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.899+0000 7fec87400640 1 -- 172.21.15.82:0/2571869669 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8de2ed210 con 0x55d8de391e10 2024-04-26T20:22:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.899+0000 7fec87400640 10 client.25183 handle_command_reply: tid=0 2024-04-26T20:22:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 client.25183 shutdown 2024-04-26T20:22:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 msgr2=0x55d8de385780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de385780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec98006010 tx=0x7fec980044e0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 shutdown_connections 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de380e20 0x55d8de38cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de391e10 0x55d8de393280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de37bcb0 0x55d8de385cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2571869669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de385780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fec87400640 0 client.25183 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 >> 172.21.15.82:0/2571869669 conn(0x55d8de30fd10 msgr2=0x55d8de375f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 shutdown_connections 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2571869669 wait complete. 2024-04-26T20:22:05.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.900+0000 7fecaf5f1740 20 client.25183 trim_cache size 0 max 16384 2024-04-26T20:22:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.919+0000 7fecaf5f1740 1 Processor -- start 2024-04-26T20:22:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.919+0000 7fecaf5f1740 1 -- start start 2024-04-26T20:22:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de375de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de38cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de384a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8de3915c0 con 0x55d8de37bcb0 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8de391c90 con 0x55d8de380e20 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8de392360 con 0x55d8de37b2c0 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de38cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de38cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44324/0 (socket says 172.21.15.82:44324) 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 -- 172.21.15.82:0/3600987475 learned_addr learned my addr 172.21.15.82:0/3600987475 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9e00640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de375de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaa800640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de384a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 -- 172.21.15.82:0/3600987475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 msgr2=0x55d8de375de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de375de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 -- 172.21.15.82:0/3600987475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 msgr2=0x55d8de384a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de384a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9400640 1 -- 172.21.15.82:0/3600987475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8de37c090 con 0x55d8de37bcb0 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7fecaa800640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de384a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.920+0000 7feca9e00640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de375de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.921+0000 7feca9400640 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de38cc50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fec9400cfd0 tx=0x7fec94087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b46cfe6dedd1478 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.921+0000 7fec92600640 1 -- 172.21.15.82:0/3600987475 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940b5070 con 0x55d8de37bcb0 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.921+0000 7fec92600640 1 -- 172.21.15.82:0/3600987475 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec940a0d70 con 0x55d8de37bcb0 2024-04-26T20:22:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.921+0000 7fec92600640 1 -- 172.21.15.82:0/3600987475 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94099030 con 0x55d8de37bcb0 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.921+0000 7fecaf5f1740 1 -- 172.21.15.82:0/3600987475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 msgr2=0x55d8de38cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.921+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de38cc50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fec9400cfd0 tx=0x7fec94087040 comp rx=0 tx=0).stop 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 -- 172.21.15.82:0/3600987475 shutdown_connections 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de384a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de38cc50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/3600987475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de375de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 -- 172.21.15.82:0/3600987475 >> 172.21.15.82:0/3600987475 conn(0x55d8de30fd10 msgr2=0x55d8de3756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 -- 172.21.15.82:0/3600987475 shutdown_connections 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 -- 172.21.15.82:0/3600987475 wait complete. 2024-04-26T20:22:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 -- start start 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.922+0000 7fecaf5f1740 1 Processor -- start 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de388820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de388d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de38bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8de393100 con 0x55d8de37bcb0 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8de392a30 con 0x55d8de380e20 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8de3937d0 con 0x55d8de37b2c0 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaf5f1740 10 client.0 _ll_register_callbacks cb 0x7feca0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de388d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de388d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44334/0 (socket says 172.21.15.82:44334) 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 -- 172.21.15.82:0/2577818536 learned_addr learned my addr 172.21.15.82:0/2577818536 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de388820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaa800640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de38bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 -- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 msgr2=0x55d8de388820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de388820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 -- 172.21.15.82:0/2577818536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 msgr2=0x55d8de38bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de38bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9400640 1 -- 172.21.15.82:0/2577818536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8de38c370 con 0x55d8de37bcb0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7fecaa800640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de38bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.923+0000 7feca9e00640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de388820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7feca9400640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de388d60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec9400c6a0 tx=0x7fec940d0f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d65ced2f84c87d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fec87400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fec87400640 1 -- 172.21.15.82:0/2577818536 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9407f030 con 0x55d8de37bcb0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fec87400640 1 -- 172.21.15.82:0/2577818536 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fec9409aa60 con 0x55d8de37bcb0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec940a0d70 con 0x55d8de37bcb0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fec87400640 1 -- 172.21.15.82:0/2577818536 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec940b5070 con 0x55d8de37bcb0 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fecaf5f1740 10 client.15066 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8de3f81a0 con 0x55d8de37bcb0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.924+0000 7fec87400640 1 -- 172.21.15.82:0/2577818536 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec940a0d70 con 0x55d8de37bcb0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fec87400640 1 -- 172.21.15.82:0/2577818536 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec940870b0 con 0x55d8de37bcb0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fecaf5f1740 10 client.15066 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fecaf5f1740 10 client.15066 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fecaf5f1740 20 client.15066 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de3fc8d0 0x55d8de3f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fecaf5f1740 4 client.15066 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "status"}) -- 0x55d8de2e7080 con 0x55d8de3fc8d0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7feca9e00640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de3fc8d0 0x55d8de3f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7feca9e00640 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de3fc8d0 0x55d8de3f93e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23901eba8762f930 server_cookie=8949ecc3038891bc in_seq=0 out_seq=0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.925+0000 7fec87400640 10 client.15066 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fec87400640 1 -- 172.21.15.82:0/2577818536 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d8de2e7080 con 0x55d8de3fc8d0 2024-04-26T20:22:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fec87400640 10 client.15066 handle_command_reply: tid=0 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 client.15066 shutdown 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 msgr2=0x55d8de388d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de388d60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec9400c6a0 tx=0x7fec940d0f30 comp rx=0 tx=0).stop 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 shutdown_connections 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55d8de3fc8d0 0x55d8de3f93e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8de380e20 0x55d8de38bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8de37bcb0 0x55d8de388d60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 --2- 172.21.15.82:0/2577818536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8de37b2c0 0x55d8de388820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fec87400640 0 client.15066 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 >> 172.21.15.82:0/2577818536 conn(0x55d8de30fd10 msgr2=0x55d8de375f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 shutdown_connections 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 1 -- 172.21.15.82:0/2577818536 wait complete. 2024-04-26T20:22:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.926+0000 7fecaf5f1740 20 client.15066 trim_cache size 0 max 16384 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24529, 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 107.19904350500001, 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 156.657188797 2024-04-26T20:22:05.934 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fec8c0a3c40 msgr2=0x7fec8c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fec8c0a3c40 0x7fec8c0a6100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55d8de37c510 tx=0x7feca0009500 comp rx=0 tx=0).stop 2024-04-26T20:22:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 msgr2=0x7feca419b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 0x7feca419b0f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e9f0 tx=0x7fec9400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 shutdown_connections 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fec8c0a3c40 0x7fec8c0a6100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feca4106540 0x7feca41a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4105b80 0x7feca419b0f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 --2- 172.21.15.82:0/3802946364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feca4104990 0x7feca419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 >> 172.21.15.82:0/3802946364 conn(0x7feca40fff00 msgr2=0x7feca4108e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 shutdown_connections 2024-04-26T20:22:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:05.927+0000 7fecab200640 1 -- 172.21.15.82:0/3802946364 wait complete. 2024-04-26T20:22:05.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-26T20:22:06.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:05 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3049441503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:06.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:05 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3128000740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:06.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:05 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3049441503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:05 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3128000740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:05 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3049441503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:05 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3128000740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 -- 172.21.15.82:0/2778454237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d4108d90 msgr2=0x7f16d41091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 --2- 172.21.15.82:0/2778454237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d4108d90 0x7f16d41091b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009900 tx=0x7f16c402a410 comp rx=0 tx=0).stop 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 -- 172.21.15.82:0/2778454237 shutdown_connections 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 --2- 172.21.15.82:0/2778454237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d410a940 0x7f16d41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 --2- 172.21.15.82:0/2778454237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d4109f80 0x7f16d410a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 --2- 172.21.15.82:0/2778454237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d4108d90 0x7f16d41091b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 -- 172.21.15.82:0/2778454237 >> 172.21.15.82:0/2778454237 conn(0x7f16d4077d30 msgr2=0x7f16d407a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 -- 172.21.15.82:0/2778454237 shutdown_connections 2024-04-26T20:22:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.130+0000 7f16d3200640 1 -- 172.21.15.82:0/2778454237 wait complete. 2024-04-26T20:22:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.131+0000 7f16d3200640 1 Processor -- start 2024-04-26T20:22:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.131+0000 7f16d3200640 1 -- start start 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d4108d90 0x7f16d419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4109f80 0x7f16d419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 0x7f16d41a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41148c0 con 0x7f16d410a940 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16d4114740 con 0x7f16d4108d90 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d3200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d4114a40 con 0x7f16d4109f80 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 0x7f16d41a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 0x7f16d41a6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44350/0 (socket says 172.21.15.82:44350) 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 -- 172.21.15.82:0/947748036 learned_addr learned my addr 172.21.15.82:0/947748036 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d1e00640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d4108d90 0x7f16d419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16cbe00640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4109f80 0x7f16d419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 -- 172.21.15.82:0/947748036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4109f80 msgr2=0x7f16d419f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4109f80 0x7f16d419f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 -- 172.21.15.82:0/947748036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d4108d90 msgr2=0x7f16d419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d4108d90 0x7f16d419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.132+0000 7f16d2800640 1 -- 172.21.15.82:0/947748036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d41a6be0 con 0x7f16d410a940 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.133+0000 7f16d2800640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 0x7f16d41a6570 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00eb10 tx=0x7f16cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.133+0000 7f16caa00640 1 -- 172.21.15.82:0/947748036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc004b20 con 0x7f16d410a940 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.133+0000 7f16caa00640 1 -- 172.21.15.82:0/947748036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16cc004cc0 con 0x7f16d410a940 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.133+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d41a6ed0 con 0x7f16d410a940 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.133+0000 7f16caa00640 1 -- 172.21.15.82:0/947748036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc010670 con 0x7f16d410a940 2024-04-26T20:22:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.133+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d41a73e0 con 0x7f16d410a940 2024-04-26T20:22:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.136+0000 7f16db987740 1 Processor -- start 2024-04-26T20:22:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.136+0000 7f16caa00640 1 -- 172.21.15.82:0/947748036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f16cc005020 con 0x7f16d410a940 2024-04-26T20:22:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.136+0000 7f16db987740 1 -- start start 2024-04-26T20:22:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16db987740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16db987740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 0x56121cd4f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16db987740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4fe20 0x56121cd522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16db987740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56121ccae600 con 0x56121cd4acb0 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16db987740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56121cc4b100 con 0x56121cd4a2c0 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16db987740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56121ccaa5c0 con 0x56121cd4fe20 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 0x56121cd4f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 0x56121cd4f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44352/0 (socket says 172.21.15.82:44352) 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 -- 172.21.15.82:0/1625018282 learned_addr learned my addr 172.21.15.82:0/1625018282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16cbe00640 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16cbe00640 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4fe20 0x56121cd522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 -- 172.21.15.82:0/1625018282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4fe20 msgr2=0x56121cd522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4fe20 0x56121cd522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 -- 172.21.15.82:0/1625018282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 msgr2=0x56121cd4a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16d1e00640 1 -- 172.21.15.82:0/1625018282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121c9c02d0 con 0x56121cd4acb0 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.137+0000 7f16cbe00640 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16d1e00640 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 0x56121cd4f7b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009900 tx=0x7f16c4031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61337d497233c97 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16caa00640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f16b80a3cc0 0x7f16b80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16c3000640 1 -- 172.21.15.82:0/1625018282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4035030 con 0x56121cd4acb0 2024-04-26T20:22:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16c3000640 1 -- 172.21.15.82:0/1625018282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16c4040070 con 0x56121cd4acb0 2024-04-26T20:22:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16c3000640 1 -- 172.21.15.82:0/1625018282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4003950 con 0x56121cd4acb0 2024-04-26T20:22:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16caa00640 1 -- 172.21.15.82:0/947748036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f16cc0d0d50 con 0x7f16d410a940 2024-04-26T20:22:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.138+0000 7f16cbe00640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f16b80a3cc0 0x7f16b80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 -- 172.21.15.82:0/1625018282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 msgr2=0x56121cd4f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16cbe00640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f16b80a3cc0 0x7f16b80a6180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56121cd4b510 tx=0x7f16bc014040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 0x56121cd4f7b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009900 tx=0x7f16c4031b10 comp rx=0 tx=0).stop 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 -- 172.21.15.82:0/1625018282 shutdown_connections 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4fe20 0x56121cd522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4acb0 0x56121cd4f7b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 --2- 172.21.15.82:0/1625018282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 -- 172.21.15.82:0/1625018282 >> 172.21.15.82:0/1625018282 conn(0x56121ccded10 msgr2=0x56121cd45d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 -- 172.21.15.82:0/1625018282 shutdown_connections 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 -- 172.21.15.82:0/1625018282 wait complete. 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.139+0000 7f16db987740 1 -- start start 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 Processor -- start 2024-04-26T20:22:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd54700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd54c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56121cd52d70 con 0x56121cd4fe20 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56121cc35f70 con 0x56121cd4a2c0 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56121cd52ef0 con 0x56121cd4acb0 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16db987740 10 client.0 _ll_register_callbacks cb 0x56121cca4480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.140+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44360/0 (socket says 172.21.15.82:44360) 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 -- 172.21.15.82:0/21039832 learned_addr learned my addr 172.21.15.82:0/21039832 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16cbe00640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd54c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d1e00640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd54700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 -- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 msgr2=0x56121cd54c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd54c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 -- 172.21.15.82:0/21039832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 msgr2=0x56121cd54700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd54700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 -- 172.21.15.82:0/21039832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121ca8a6b0 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16d2800640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bc10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0994e0 tx=0x7f16cc09c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88cf2b9b8f6c662 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16b7400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.141+0000 7f16b7400640 1 -- 172.21.15.82:0/21039832 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc09cb10 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16b7400640 1 -- 172.21.15.82:0/21039832 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f16cc09cd70 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c4040070 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16b7400640 1 -- 172.21.15.82:0/21039832 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16cc0a0ec0 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 10 client.15078 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56121cd5ec30 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16b7400640 1 -- 172.21.15.82:0/21039832 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16c4040070 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16b7400640 1 -- 172.21.15.82:0/21039832 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f16cc0b8070 con 0x56121cd4fe20 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 10 client.15078 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 10 client.15078 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 20 client.15078 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cd61300 0x56121cd62770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.142+0000 7f16db987740 4 client.15078 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.143+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56121ccbc210 con 0x56121cd61300 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.143+0000 7f16d1e00640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cd61300 0x56121cd62770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.143+0000 7f16d1e00640 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cd61300 0x56121cd62770 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10ee6ac6e58f474 server_cookie=2441177949d45c76 in_seq=0 out_seq=0 2024-04-26T20:22:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.143+0000 7f16b7400640 10 client.15078 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16b7400640 1 -- 172.21.15.82:0/21039832 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56121ccbc210 con 0x56121cd61300 2024-04-26T20:22:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16b7400640 10 client.15078 handle_command_reply: tid=0 2024-04-26T20:22:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16db987740 1 client.15078 shutdown 2024-04-26T20:22:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 msgr2=0x56121cd5bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16db987740 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bc10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0994e0 tx=0x7f16cc09c650 comp rx=0 tx=0).stop 2024-04-26T20:22:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 shutdown_connections 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.144+0000 7f16db987740 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cd61300 0x56121cd62770 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bc10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16b7400640 0 client.15078 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd54c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 1 --2- 172.21.15.82:0/21039832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd54700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 >> 172.21.15.82:0/21039832 conn(0x56121ccded10 msgr2=0x56121cd44f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 shutdown_connections 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 1 -- 172.21.15.82:0/21039832 wait complete. 2024-04-26T20:22:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.145+0000 7f16db987740 20 client.15078 trim_cache size 0 max 16384 2024-04-26T20:22:06.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 Processor -- start 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 -- start start 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd4c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56121cd60ab0 con 0x56121cd4fe20 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56121cd61180 con 0x56121cd4a2c0 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16db987740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56121cd61850 con 0x56121cd4acb0 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44362/0 (socket says 172.21.15.82:44362) 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16d2800640 1 -- 172.21.15.82:0/1033446769 learned_addr learned my addr 172.21.15.82:0/1033446769 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16cbe00640 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd4c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.164+0000 7f16d1e00640 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16d2800640 1 -- 172.21.15.82:0/1033446769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 msgr2=0x56121cd4c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16d2800640 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd4c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16d2800640 1 -- 172.21.15.82:0/1033446769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 msgr2=0x56121cd4c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16d2800640 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16d2800640 1 -- 172.21.15.82:0/1033446769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121cd53020 con 0x56121cd4fe20 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16d2800640 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bbd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16cc098f70 tx=0x7f16cc09c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b8b90a6c18a734 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16c2600640 1 -- 172.21.15.82:0/1033446769 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc09c470 con 0x56121cd4fe20 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16c2600640 1 -- 172.21.15.82:0/1033446769 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16cc09cb10 con 0x56121cd4fe20 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.165+0000 7f16c2600640 1 -- 172.21.15.82:0/1033446769 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc09cfd0 con 0x56121cd4fe20 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 -- 172.21.15.82:0/1033446769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 msgr2=0x56121cd5bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bbd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16cc098f70 tx=0x7f16cc09c780 comp rx=0 tx=0).stop 2024-04-26T20:22:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 -- 172.21.15.82:0/1033446769 shutdown_connections 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5bbd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4acb0 0x56121cd4c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 --2- 172.21.15.82:0/1033446769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4a2c0 0x56121cd4c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 -- 172.21.15.82:0/1033446769 >> 172.21.15.82:0/1033446769 conn(0x56121ccded10 msgr2=0x56121cd40df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 -- 172.21.15.82:0/1033446769 shutdown_connections 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 -- 172.21.15.82:0/1033446769 wait complete. 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.166+0000 7f16db987740 1 -- start start 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 Processor -- start 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 0x56121cd59e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4acb0 0x56121cd5a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56121cd625f0 con 0x56121cd4fe20 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56121cd61f20 con 0x56121cd4acb0 2024-04-26T20:22:06.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56121cd62cc0 con 0x56121cd4a2c0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16db987740 10 client.0 _ll_register_callbacks cb 0x7f16cc098e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16d1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 0x56121cd59e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16cbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4acb0 0x56121cd5a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16d1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 0x56121cd59e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46674/0 (socket says 172.21.15.82:46674) 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.167+0000 7f16d1e00640 1 -- 172.21.15.82:0/656287873 learned_addr learned my addr 172.21.15.82:0/656287873 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d1e00640 1 -- 172.21.15.82:0/656287873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4acb0 msgr2=0x56121cd5a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d1e00640 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4acb0 0x56121cd5a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d1e00640 1 -- 172.21.15.82:0/656287873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 msgr2=0x56121cd5a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d1e00640 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d1e00640 1 -- 172.21.15.82:0/656287873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121cd5b0e0 con 0x56121cd4a2c0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d2800640 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16d1e00640 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 0x56121cd59e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16c4006010 tx=0x7f16c40319e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ae9e354f6f1996c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16b7400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16b7400640 1 -- 172.21.15.82:0/656287873 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4054020 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16cc09cb10 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16b7400640 1 -- 172.21.15.82:0/656287873 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f16c40042c0 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16b7400640 1 -- 172.21.15.82:0/656287873 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16c4035040 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16db987740 10 client.25207 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.168+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56121cdc74e0 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16b7400640 1 -- 172.21.15.82:0/656287873 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16cc09cb10 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16b7400640 1 -- 172.21.15.82:0/656287873 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f16c4003b20 con 0x56121cd4a2c0 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16db987740 10 client.25207 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16db987740 10 client.25207 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16db987740 20 client.25207 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16db987740 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cdcbcb0 0x56121cdca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16db987740 4 client.25207 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:06.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "status"}) -- 0x56121ccb6080 con 0x56121cdcbcb0 2024-04-26T20:22:06.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.169+0000 7f16cbe00640 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cdcbcb0 0x56121cdca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16cbe00640 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cdcbcb0 0x56121cdca9c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d1fd2c1340c4ff6 server_cookie=9a8db605311dd82b in_seq=0 out_seq=0 2024-04-26T20:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16b7400640 10 client.25207 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16b7400640 1 -- 172.21.15.82:0/656287873 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56121ccb6080 con 0x56121cdcbcb0 2024-04-26T20:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16b7400640 10 client.25207 handle_command_reply: tid=0 2024-04-26T20:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 client.25207 shutdown 2024-04-26T20:22:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 msgr2=0x56121cd59e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 0x56121cd59e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16c4006010 tx=0x7f16c40319e0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 shutdown_connections 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56121cdcbcb0 0x56121cdca9c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56121cd4fe20 0x56121cd5a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56121cd4acb0 0x56121cd5a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16b7400640 0 client.25207 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 --2- 172.21.15.82:0/656287873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56121cd4a2c0 0x56121cd59e10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.170+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 >> 172.21.15.82:0/656287873 conn(0x56121ccded10 msgr2=0x56121cd54620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 shutdown_connections 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16db987740 1 -- 172.21.15.82:0/656287873 wait complete. 2024-04-26T20:22:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16db987740 20 client.25207 trim_cache size 0 max 16384 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24550, 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 108.453955909, 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 151.17481155900001 2024-04-26T20:22:06.177 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f16b80a3cc0 msgr2=0x7f16b80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f16b80a3cc0 0x7f16b80a6180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56121cd4b510 tx=0x7f16bc014040 comp rx=0 tx=0).stop 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 msgr2=0x7f16d41a6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 0x7f16d41a6570 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00eb10 tx=0x7f16cc00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 shutdown_connections 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f16b80a3cc0 0x7f16b80a6180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16d410a940 0x7f16d41a6570 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4109f80 0x7f16d419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 --2- 172.21.15.82:0/947748036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d4108d90 0x7f16d419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.171+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 >> 172.21.15.82:0/947748036 conn(0x7f16d4077d30 msgr2=0x7f16d410d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.172+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 shutdown_connections 2024-04-26T20:22:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.172+0000 7f16d3200640 1 -- 172.21.15.82:0/947748036 wait complete. 2024-04-26T20:22:06.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 -- 172.21.15.82:0/2948242186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64108500 msgr2=0x7f7d6410a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 --2- 172.21.15.82:0/2948242186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64108500 0x7f7d6410a8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009ca0 tx=0x7f7d5c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 -- 172.21.15.82:0/2948242186 shutdown_connections 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 --2- 172.21.15.82:0/2948242186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64108500 0x7f7d6410a8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 --2- 172.21.15.82:0/2948242186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d64105bd0 0x7f7d64107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 --2- 172.21.15.82:0/2948242186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d641032a0 0x7f7d64105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 -- 172.21.15.82:0/2948242186 >> 172.21.15.82:0/2948242186 conn(0x7f7d640fcbb0 msgr2=0x7f7d640ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 -- 172.21.15.82:0/2948242186 shutdown_connections 2024-04-26T20:22:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.378+0000 7f7d68a00640 1 -- 172.21.15.82:0/2948242186 wait complete. 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.379+0000 7f7d68a00640 1 Processor -- start 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.379+0000 7f7d68a00640 1 -- start start 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d68a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d641032a0 0x7f7d6419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d68a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 0x7f7d6419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d68a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d64108500 0x7f7d641a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d68a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6410e310 con 0x7f7d64105bd0 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d68a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6410e190 con 0x7f7d64108500 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d68a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6410e490 con 0x7f7d641032a0 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 0x7f7d6419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 0x7f7d6419b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44384/0 (socket says 172.21.15.82:44384) 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 -- 172.21.15.82:0/426261422 learned_addr learned my addr 172.21.15.82:0/426261422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d63400640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d641032a0 0x7f7d6419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d63e00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d64108500 0x7f7d641a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 -- 172.21.15.82:0/426261422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d641032a0 msgr2=0x7f7d6419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d641032a0 0x7f7d6419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 -- 172.21.15.82:0/426261422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d64108500 msgr2=0x7f7d641a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d64108500 0x7f7d641a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d62a00640 1 -- 172.21.15.82:0/426261422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d641a2830 con 0x7f7d64105bd0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d63e00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d64108500 0x7f7d641a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.380+0000 7f7d63400640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d641032a0 0x7f7d6419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.381+0000 7f7d62a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 0x7f7d6419b160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000e9f0 tx=0x7f7d5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.381+0000 7f7d5be00640 1 -- 172.21.15.82:0/426261422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000ccc0 con 0x7f7d64105bd0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.381+0000 7f7d5be00640 1 -- 172.21.15.82:0/426261422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d500054d0 con 0x7f7d64105bd0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.381+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d641a2b20 con 0x7f7d64105bd0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.381+0000 7f7d5be00640 1 -- 172.21.15.82:0/426261422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50010430 con 0x7f7d64105bd0 2024-04-26T20:22:06.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.381+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d641a3020 con 0x7f7d64105bd0 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.384+0000 7f7d6ce33740 1 Processor -- start 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.384+0000 7f7d5be00640 1 -- 172.21.15.82:0/426261422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7d500046c0 con 0x7f7d64105bd0 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.384+0000 7f7d6ce33740 1 -- start start 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 0x5616644b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b8cb0 0x5616644bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644bde20 0x5616644c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56166441c600 con 0x5616644b82c0 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616643b9100 con 0x5616644bde20 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616644185c0 con 0x5616644b8cb0 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 0x5616644b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 0x5616644b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44400/0 (socket says 172.21.15.82:44400) 2024-04-26T20:22:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 -- 172.21.15.82:0/2863133109 learned_addr learned my addr 172.21.15.82:0/2863133109 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d62a00640 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644bde20 0x5616644c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63400640 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b8cb0 0x5616644bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 -- 172.21.15.82:0/2863133109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b8cb0 msgr2=0x5616644bd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b8cb0 0x5616644bd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 -- 172.21.15.82:0/2863133109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644bde20 msgr2=0x5616644c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644bde20 0x5616644c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d63e00640 1 -- 172.21.15.82:0/2863133109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166412e2d0 con 0x5616644b82c0 2024-04-26T20:22:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.385+0000 7f7d62a00640 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644bde20 0x5616644c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d63e00640 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 0x5616644b86e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c005e30 tx=0x7f7d5c005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38c3fa5cb1f6f69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d5be00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7d480a3c40 0x7f7d480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d5be00640 1 -- 172.21.15.82:0/426261422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7d500d0e70 con 0x7f7d64105bd0 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d63400640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7d480a3c40 0x7f7d480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d4fe00640 1 -- 172.21.15.82:0/2863133109 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c031650 con 0x5616644b82c0 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d4fe00640 1 -- 172.21.15.82:0/2863133109 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d5c036040 con 0x5616644b82c0 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.386+0000 7f7d4fe00640 1 -- 172.21.15.82:0/2863133109 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c004700 con 0x5616644b82c0 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 -- 172.21.15.82:0/2863133109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 msgr2=0x5616644b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d63400640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7d480a3c40 0x7f7d480a6100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5616644b90b0 tx=0x7f7d54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 0x5616644b86e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c005e30 tx=0x7f7d5c005f70 comp rx=0 tx=0).stop 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 -- 172.21.15.82:0/2863133109 shutdown_connections 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644bde20 0x5616644c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b8cb0 0x5616644bd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/2863133109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b82c0 0x5616644b86e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 -- 172.21.15.82:0/2863133109 >> 172.21.15.82:0/2863133109 conn(0x56166444cd10 msgr2=0x5616644b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 -- 172.21.15.82:0/2863133109 shutdown_connections 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.387+0000 7f7d6ce33740 1 -- 172.21.15.82:0/2863133109 wait complete. 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 -- start start 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 Processor -- start 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616644c0d70 con 0x5616644b8cb0 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616643a3f70 con 0x5616644b82c0 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616644c0ef0 con 0x5616644bde20 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.388+0000 7f7d6ce33740 10 client.0 _ll_register_callbacks cb 0x561664412480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d63400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44414/0 (socket says 172.21.15.82:44414) 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 -- 172.21.15.82:0/787061040 learned_addr learned my addr 172.21.15.82:0/787061040 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 -- 172.21.15.82:0/787061040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 msgr2=0x5616644c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 -- 172.21.15.82:0/787061040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 msgr2=0x5616644c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 -- 172.21.15.82:0/787061040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616641f86b0 con 0x5616644b8cb0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d62a00640 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c2c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d500ce4d0 tx=0x7f7d50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895e2771e3691567 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d4cc00640 1 -- 172.21.15.82:0/787061040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50087040 con 0x5616644b8cb0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d4cc00640 1 -- 172.21.15.82:0/787061040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7d500a5450 con 0x5616644b8cb0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.389+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d5c036040 con 0x5616644b8cb0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d4cc00640 1 -- 172.21.15.82:0/787061040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d5009adb0 con 0x5616644b8cb0 2024-04-26T20:22:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 10 client.15096 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616644ccd70 con 0x5616644b8cb0 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d4cc00640 1 -- 172.21.15.82:0/787061040 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d5c036040 con 0x5616644b8cb0 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d4cc00640 1 -- 172.21.15.82:0/787061040 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d50005000 con 0x5616644b8cb0 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 10 client.15096 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 10 client.15096 resolve_mds: resolved name 'g' to daemon mds.g 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 20 client.15096 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x5616644cf170 0x5616644d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 4 client.15096 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.390+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56166442a210 con 0x5616644cf170 2024-04-26T20:22:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.391+0000 7f7d63400640 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x5616644cf170 0x5616644d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.391+0000 7f7d63400640 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x5616644cf170 0x5616644d05e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d763eb24e439551f server_cookie=938c3eb36aa2e0a in_seq=0 out_seq=0 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.391+0000 7f7d4cc00640 10 client.15096 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d4cc00640 1 -- 172.21.15.82:0/787061040 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56166442a210 con 0x5616644cf170 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d4cc00640 10 client.15096 handle_command_reply: tid=0 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 client.15096 shutdown 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 msgr2=0x5616644c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c2c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d500ce4d0 tx=0x7f7d50017000 comp rx=0 tx=0).stop 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 shutdown_connections 2024-04-26T20:22:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x5616644cf170 0x5616644d05e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c2c90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/787061040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d4cc00640 0 client.15096 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.392+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 >> 172.21.15.82:0/787061040 conn(0x56166444cd10 msgr2=0x5616644b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.393+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 shutdown_connections 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.393+0000 7f7d6ce33740 1 -- 172.21.15.82:0/787061040 wait complete. 2024-04-26T20:22:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.393+0000 7f7d6ce33740 20 client.15096 trim_cache size 0 max 16384 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.411+0000 7f7d6ce33740 1 Processor -- start 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.411+0000 7f7d6ce33740 1 -- start start 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b82c0 0x5616644b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 0x5616644c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644bde20 0x5616644b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616644ce920 con 0x5616644bde20 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616644ceff0 con 0x5616644b8cb0 2024-04-26T20:22:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616644cf6c0 con 0x5616644b82c0 2024-04-26T20:22:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644bde20 0x5616644b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 0x5616644c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d63400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b82c0 0x5616644b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 0x5616644c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37212/0 (socket says 172.21.15.82:37212) 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 -- 172.21.15.82:0/4066236134 learned_addr learned my addr 172.21.15.82:0/4066236134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644bde20 0x5616644b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44420/0 (socket says 172.21.15.82:44420) 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 -- 172.21.15.82:0/4066236134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b82c0 msgr2=0x5616644b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b82c0 0x5616644b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 -- 172.21.15.82:0/4066236134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644bde20 msgr2=0x5616644b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644bde20 0x5616644b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.412+0000 7f7d62a00640 1 -- 172.21.15.82:0/4066236134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616644af680 con 0x5616644b8cb0 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.413+0000 7f7d62a00640 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 0x5616644c9c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c6a0 tx=0x7f7d50009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fdd69dcc35576e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.413+0000 7f7d4f400640 1 -- 172.21.15.82:0/4066236134 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50087070 con 0x5616644b8cb0 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.413+0000 7f7d4f400640 1 -- 172.21.15.82:0/4066236134 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d50005680 con 0x5616644b8cb0 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.413+0000 7f7d4f400640 1 -- 172.21.15.82:0/4066236134 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500bd2b0 con 0x5616644b8cb0 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 -- 172.21.15.82:0/4066236134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 msgr2=0x5616644c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 0x5616644c9c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c6a0 tx=0x7f7d50009770 comp rx=0 tx=0).stop 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 -- 172.21.15.82:0/4066236134 shutdown_connections 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644bde20 0x5616644b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b8cb0 0x5616644c9c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/4066236134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644b82c0 0x5616644b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 -- 172.21.15.82:0/4066236134 >> 172.21.15.82:0/4066236134 conn(0x56166444cd10 msgr2=0x5616644aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 -- 172.21.15.82:0/4066236134 shutdown_connections 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 -- 172.21.15.82:0/4066236134 wait complete. 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 -- start start 2024-04-26T20:22:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.414+0000 7f7d6ce33740 1 Processor -- start 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616644d0460 con 0x5616644b8cb0 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616644cfd90 con 0x5616644b82c0 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616644d0b30 con 0x5616644bde20 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d6ce33740 10 client.0 _ll_register_callbacks cb 0x7f7d500096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44434/0 (socket says 172.21.15.82:44434) 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 -- 172.21.15.82:0/134155771 learned_addr learned my addr 172.21.15.82:0/134155771 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d63400640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d63e00640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 -- 172.21.15.82:0/134155771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 msgr2=0x5616644c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 -- 172.21.15.82:0/134155771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 msgr2=0x5616644c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d62a00640 1 -- 172.21.15.82:0/134155771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616644c97d0 con 0x5616644b8cb0 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.415+0000 7f7d63400640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d62a00640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c6230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005440 tx=0x7f7d50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1321edb1e4a6360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d4cc00640 1 -- 172.21.15.82:0/134155771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50067060 con 0x5616644b8cb0 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d4cc00640 1 -- 172.21.15.82:0/134155771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7d50061bb0 con 0x5616644b8cb0 2024-04-26T20:22:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d50005680 con 0x5616644b8cb0 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d4cc00640 1 -- 172.21.15.82:0/134155771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d50087050 con 0x5616644b8cb0 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 10 client.15102 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616644c97d0 con 0x5616644b8cb0 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d4cc00640 1 -- 172.21.15.82:0/134155771 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d50005680 con 0x5616644b8cb0 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d4cc00640 1 -- 172.21.15.82:0/134155771 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d50098930 con 0x5616644b8cb0 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 10 client.15102 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 10 client.15102 resolve_mds: resolved name 'g' to daemon mds.g 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 20 client.15102 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.416+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56166453a000 0x561664536b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.417+0000 7f7d6ce33740 4 client.15102 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.417+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "status"}) -- 0x561664424080 con 0x56166453a000 2024-04-26T20:22:06.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.417+0000 7f7d63400640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56166453a000 0x561664536b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.417+0000 7f7d63400640 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56166453a000 0x561664536b10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=492ad6e7125ba56c server_cookie=19109b2b3e347870 in_seq=0 out_seq=0 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.417+0000 7f7d4cc00640 10 client.15102 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.417+0000 7f7d4cc00640 1 -- 172.21.15.82:0/134155771 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561664424080 con 0x56166453a000 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d4cc00640 10 client.15102 handle_command_reply: tid=0 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 client.15102 shutdown 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 msgr2=0x5616644c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c6230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005440 tx=0x7f7d50017000 comp rx=0 tx=0).stop 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 shutdown_connections 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56166453a000 0x561664536b10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616644bde20 0x5616644c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616644b8cb0 0x5616644c6230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d4cc00640 0 client.15102 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 --2- 172.21.15.82:0/134155771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616644b82c0 0x5616644c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 >> 172.21.15.82:0/134155771 conn(0x56166444cd10 msgr2=0x5616644b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 shutdown_connections 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 1 -- 172.21.15.82:0/134155771 wait complete. 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.418+0000 7f7d6ce33740 20 client.15102 trim_cache size 0 max 16384 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:06.424 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24554, 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 109.712506182, 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 147.17268185200001 2024-04-26T20:22:06.425 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7d480a3c40 msgr2=0x7f7d480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7d480a3c40 0x7f7d480a6100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5616644b90b0 tx=0x7f7d54005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 msgr2=0x7f7d6419b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 0x7f7d6419b160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000e9f0 tx=0x7f7d5000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 shutdown_connections 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7d480a3c40 0x7f7d480a6100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d64108500 0x7f7d641a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64105bd0 0x7f7d6419b160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 --2- 172.21.15.82:0/426261422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d641032a0 0x7f7d6419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 >> 172.21.15.82:0/426261422 conn(0x7f7d640fcbb0 msgr2=0x7f7d64102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 shutdown_connections 2024-04-26T20:22:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.419+0000 7f7d68a00640 1 -- 172.21.15.82:0/426261422 wait complete. 2024-04-26T20:22:06.436 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:22:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 -- 172.21.15.82:0/1251945988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc103410 msgr2=0x7fb6dc105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/1251945988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc103410 0x7fb6dc105800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009900 tx=0x7fb6cc02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 -- 172.21.15.82:0/1251945988 shutdown_connections 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/1251945988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc108670 0x7fb6dc10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/1251945988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6dc105d40 0x7fb6dc108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/1251945988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc103410 0x7fb6dc105800 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 -- 172.21.15.82:0/1251945988 >> 172.21.15.82:0/1251945988 conn(0x7fb6dc0fce20 msgr2=0x7fb6dc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 -- 172.21.15.82:0/1251945988 shutdown_connections 2024-04-26T20:22:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.633+0000 7fb6e2a00640 1 -- 172.21.15.82:0/1251945988 wait complete. 2024-04-26T20:22:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 Processor -- start 2024-04-26T20:22:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 -- start start 2024-04-26T20:22:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6dc103410 0x7fb6dc19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc105d40 0x7fb6dc19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 0x7fb6dc1a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc10e4c0 con 0x7fb6dc108670 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc10e340 con 0x7fb6dc105d40 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.634+0000 7fb6e2a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc10e640 con 0x7fb6dc103410 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 0x7fb6dc1a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 0x7fb6dc1a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44466/0 (socket says 172.21.15.82:44466) 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6db400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc105d40 0x7fb6dc19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 -- 172.21.15.82:0/214506291 learned_addr learned my addr 172.21.15.82:0/214506291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6dc103410 0x7fb6dc19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 -- 172.21.15.82:0/214506291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6dc103410 msgr2=0x7fb6dc19ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6dc103410 0x7fb6dc19ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 -- 172.21.15.82:0/214506291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc105d40 msgr2=0x7fb6dc19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc105d40 0x7fb6dc19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 -- 172.21.15.82:0/214506291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc1a2aa0 con 0x7fb6dc108670 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6db400640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc105d40 0x7fb6dc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.635+0000 7fb6e0a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 0x7fb6dc1a2430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400eb10 tx=0x7fb6d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.636+0000 7fb6d8c00640 1 -- 172.21.15.82:0/214506291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4004b20 con 0x7fb6dc108670 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.636+0000 7fb6d8c00640 1 -- 172.21.15.82:0/214506291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6d4004cc0 con 0x7fb6dc108670 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.636+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc1a2d90 con 0x7fb6dc108670 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.636+0000 7fb6d8c00640 1 -- 172.21.15.82:0/214506291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4010670 con 0x7fb6dc108670 2024-04-26T20:22:06.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.636+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc1a3230 con 0x7fb6dc108670 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.639+0000 7fb6e5806740 1 Processor -- start 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.639+0000 7fb6d8c00640 1 -- 172.21.15.82:0/214506291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb6d4005020 con 0x7fb6dc108670 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.639+0000 7fb6e5806740 1 -- start start 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6e5806740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555b20549600 con 0x555b205eac50 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6e5806740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b204e6100 con 0x555b205e5ae0 2024-04-26T20:22:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6e5806740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555b205455c0 con 0x555b205e50f0 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44476/0 (socket says 172.21.15.82:44476) 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 -- 172.21.15.82:0/3446076332 learned_addr learned my addr 172.21.15.82:0/3446076332 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 -- 172.21.15.82:0/3446076332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 msgr2=0x555b205e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 -- 172.21.15.82:0/3446076332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 msgr2=0x555b205ea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205ea5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.640+0000 7fb6db400640 1 -- 172.21.15.82:0/3446076332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b2025b2d0 con 0x555b205eac50 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6db400640 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ed0e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8011b80 tx=0x7fb6c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f493791029bb1d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6d8c00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb6c00a3c40 0x7fb6c00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6d1200640 1 -- 172.21.15.82:0/3446076332 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c800fc50 con 0x555b205eac50 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6d1200640 1 -- 172.21.15.82:0/3446076332 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6c800fdf0 con 0x555b205eac50 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6d1200640 1 -- 172.21.15.82:0/3446076332 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80039b0 con 0x555b205eac50 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6d8c00640 1 -- 172.21.15.82:0/214506291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb6d40d0f00 con 0x7fb6dc108670 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.641+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb6c00a3c40 0x7fb6c00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 -- 172.21.15.82:0/3446076332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 msgr2=0x555b205ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ed0e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8011b80 tx=0x7fb6c8004730 comp rx=0 tx=0).stop 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 -- 172.21.15.82:0/3446076332 shutdown_connections 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ed0e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3446076332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 -- 172.21.15.82:0/3446076332 >> 172.21.15.82:0/3446076332 conn(0x555b20579d10 msgr2=0x555b205e0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 -- 172.21.15.82:0/3446076332 shutdown_connections 2024-04-26T20:22:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb6c00a3c40 0x7fb6c00a6100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000c00 tx=0x7fb6cc0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 -- 172.21.15.82:0/3446076332 wait complete. 2024-04-26T20:22:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.642+0000 7fb6e5806740 1 -- start start 2024-04-26T20:22:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 Processor -- start 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 0x555b205ef510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205efa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555b205edc00 con 0x555b205e50f0 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b204d0f70 con 0x555b205e5ae0 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555b205edd80 con 0x555b205eac50 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6e5806740 10 client.0 _ll_register_callbacks cb 0x555b2053f480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 0x555b205ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6dbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 0x555b205ef510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44488/0 (socket says 172.21.15.82:44488) 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.643+0000 7fb6dbe00640 1 -- 172.21.15.82:0/3994966062 learned_addr learned my addr 172.21.15.82:0/3994966062 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6e0a00640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6db400640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6dbe00640 1 -- 172.21.15.82:0/3994966062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 msgr2=0x555b205f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6dbe00640 1 -- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 msgr2=0x555b205efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6dbe00640 1 -- 172.21.15.82:0/3994966062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b203256b0 con 0x555b205e50f0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 0x555b205ef510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc033000 tx=0x7fb6cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffbf788ae841ed8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6c5600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6c5600640 1 -- 172.21.15.82:0/3994966062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc04d030 con 0x555b205e50f0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6c5600640 1 -- 172.21.15.82:0/3994966062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb6cc0035f0 con 0x555b205e50f0 2024-04-26T20:22:06.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.644+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6c800fdf0 con 0x555b205e50f0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6c5600640 1 -- 172.21.15.82:0/3994966062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6cc05a050 con 0x555b205e50f0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 10 client.15114 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555b205f9ae0 con 0x555b205e50f0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6c5600640 1 -- 172.21.15.82:0/3994966062 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6c800fdf0 con 0x555b205e50f0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6c5600640 1 -- 172.21.15.82:0/3994966062 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6cc03d970 con 0x555b205e50f0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 10 client.15114 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 20 client.15114 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b205fc220 0x555b205fd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 4 client.15114 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.645+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b20557210 con 0x555b205fc220 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.646+0000 7fb6db400640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b205fc220 0x555b205fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.646+0000 7fb6db400640 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b205fc220 0x555b205fd690 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e36cd7527287a2 server_cookie=d260bc1ad03b9917 in_seq=0 out_seq=0 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.646+0000 7fb6c5600640 10 client.15114 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:06.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6c5600640 1 -- 172.21.15.82:0/3994966062 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555b20557210 con 0x555b205fc220 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6c5600640 10 client.15114 handle_command_reply: tid=0 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 client.15114 shutdown 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 msgr2=0x555b205ef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 0x555b205ef510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc033000 tx=0x7fb6cc009260 comp rx=0 tx=0).stop 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 shutdown_connections 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b205fc220 0x555b205fd690 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6c5600640 0 client.15114 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 --2- 172.21.15.82:0/3994966062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e50f0 0x555b205ef510 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.647+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 >> 172.21.15.82:0/3994966062 conn(0x555b20579d10 msgr2=0x555b205dfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.648+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 shutdown_connections 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.648+0000 7fb6e5806740 1 -- 172.21.15.82:0/3994966062 wait complete. 2024-04-26T20:22:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.648+0000 7fb6e5806740 20 client.15114 trim_cache size 0 max 16384 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.667+0000 7fb6e5806740 1 Processor -- start 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.667+0000 7fb6e5806740 1 -- start start 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205ef120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ef660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e5806740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555b205fb9d0 con 0x555b205eac50 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e5806740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b205fc0a0 con 0x555b205e5ae0 2024-04-26T20:22:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e5806740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555b205fc770 con 0x555b205e50f0 2024-04-26T20:22:06.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6db400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6db400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37254/0 (socket says 172.21.15.82:37254) 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6db400640 1 -- 172.21.15.82:0/2462081054 learned_addr learned my addr 172.21.15.82:0/2462081054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6e0a00640 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.668+0000 7fb6db400640 1 -- 172.21.15.82:0/2462081054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 msgr2=0x555b205ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6db400640 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6db400640 1 -- 172.21.15.82:0/2462081054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 msgr2=0x555b205ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6db400640 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6db400640 1 -- 172.21.15.82:0/2462081054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b205e5ec0 con 0x555b205e5ae0 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6db400640 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205f6a50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8010010 tx=0x7fb6c800ffa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e43928513ab6f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6c7e00640 1 -- 172.21.15.82:0/2462081054 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c800fdf0 con 0x555b205e5ae0 2024-04-26T20:22:06.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6c7e00640 1 -- 172.21.15.82:0/2462081054 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6c8009e40 con 0x555b205e5ae0 2024-04-26T20:22:06.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.669+0000 7fb6c7e00640 1 -- 172.21.15.82:0/2462081054 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80055a0 con 0x555b205e5ae0 2024-04-26T20:22:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 -- 172.21.15.82:0/2462081054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 msgr2=0x555b205f6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205f6a50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8010010 tx=0x7fb6c800ffa0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 -- 172.21.15.82:0/2462081054 shutdown_connections 2024-04-26T20:22:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205eac50 0x555b205ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e5ae0 0x555b205f6a50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 --2- 172.21.15.82:0/2462081054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205e50f0 0x555b205ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 -- 172.21.15.82:0/2462081054 >> 172.21.15.82:0/2462081054 conn(0x555b20579d10 msgr2=0x555b205e6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 -- 172.21.15.82:0/2462081054 shutdown_connections 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 -- 172.21.15.82:0/2462081054 wait complete. 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 -- start start 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.670+0000 7fb6e5806740 1 Processor -- start 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e50f0 0x555b205f2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 0x555b205f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555b205fd510 con 0x555b205e5ae0 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b205fce40 con 0x555b205e50f0 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555b205fdbe0 con 0x555b205eac50 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e5806740 10 client.0 _ll_register_callbacks cb 0x7fb6cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 0x555b205f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 0x555b205f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44514/0 (socket says 172.21.15.82:44514) 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6db400640 1 -- 172.21.15.82:0/1741912119 learned_addr learned my addr 172.21.15.82:0/1741912119 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6e0a00640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.671+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e50f0 0x555b205f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6db400640 1 -- 172.21.15.82:0/1741912119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 msgr2=0x555b205f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6db400640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6db400640 1 -- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e50f0 msgr2=0x555b205f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6db400640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e50f0 0x555b205f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6db400640 1 -- 172.21.15.82:0/1741912119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b205f5cd0 con 0x555b205e5ae0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6db400640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 0x555b205f27c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009b70 tx=0x7fb6c80114f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec70c8720f51205 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6c5600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6c5600640 1 -- 172.21.15.82:0/1741912119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c800fd40 con 0x555b205e5ae0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6c5600640 1 -- 172.21.15.82:0/1741912119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb6c80052a0 con 0x555b205e5ae0 2024-04-26T20:22:06.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b20551080 con 0x555b205e5ae0 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6c5600640 1 -- 172.21.15.82:0/1741912119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6c80054c0 con 0x555b205e5ae0 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6e5806740 10 client.15120 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.672+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555b206621d0 con 0x555b205e5ae0 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6c5600640 1 -- 172.21.15.82:0/1741912119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555b20551080 con 0x555b205e5ae0 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6c5600640 1 -- 172.21.15.82:0/1741912119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb6c8028070 con 0x555b205e5ae0 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6e5806740 10 client.15120 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6e5806740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6e5806740 20 client.15120 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6e5806740 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b206667b0 0x555b206654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6e5806740 4 client.15120 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "status"}) -- 0x555b204cc860 con 0x555b206667b0 2024-04-26T20:22:06.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.673+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b206667b0 0x555b206654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6c5600640 10 client.15120 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6dbe00640 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b206667b0 0x555b206654c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6955b1874c9f1a50 server_cookie=6c3b6699aeadec22 in_seq=0 out_seq=0 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6c5600640 1 -- 172.21.15.82:0/1741912119 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555b204cc860 con 0x555b206667b0 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6c5600640 10 client.15120 handle_command_reply: tid=0 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 client.15120 shutdown 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 msgr2=0x555b205f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 0x555b205f27c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009b70 tx=0x7fb6c80114f0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 shutdown_connections 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555b206667b0 0x555b206654c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b205eac50 0x555b205f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555b205e5ae0 0x555b205f27c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 --2- 172.21.15.82:0/1741912119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b205e50f0 0x555b205f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6c5600640 0 client.15120 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:06.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 >> 172.21.15.82:0/1741912119 conn(0x555b20579d10 msgr2=0x555b205ef120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.674+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 shutdown_connections 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e5806740 1 -- 172.21.15.82:0/1741912119 wait complete. 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e5806740 20 client.15120 trim_cache size 0 max 16384 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24584, 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:06.680 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 133.98856859899999, 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 140.47822364199999 2024-04-26T20:22:06.681 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb6c00a3c40 msgr2=0x7fb6c00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb6c00a3c40 0x7fb6c00a6100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000c00 tx=0x7fb6cc0314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 msgr2=0x7fb6dc1a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 0x7fb6dc1a2430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400eb10 tx=0x7fb6d400c2d0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 shutdown_connections 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb6c00a3c40 0x7fb6c00a6100 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6dc108670 0x7fb6dc1a2430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc105d40 0x7fb6dc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 --2- 172.21.15.82:0/214506291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6dc103410 0x7fb6dc19ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.675+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 >> 172.21.15.82:0/214506291 conn(0x7fb6dc0fce20 msgr2=0x7fb6dc102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.676+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 shutdown_connections 2024-04-26T20:22:06.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:06.676+0000 7fb6e2a00640 1 -- 172.21.15.82:0/214506291 wait complete. 2024-04-26T20:22:06.693 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T20:22:06.693 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T20:22:06.703 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:22:06.704 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T20:22:07.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:06 smithi139 ceph-mon[32999]: pgmap v391: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:07.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:06 smithi135 ceph-mon[32816]: pgmap v391: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:07.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:06 smithi082 ceph-mon[28105]: pgmap v391: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:09.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 -- 172.21.15.82:0/3226060958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c103490 msgr2=0x7f333c1038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 --2- 172.21.15.82:0/3226060958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c103490 0x7f333c1038b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f332c0099c0 tx=0x7f332c009cd0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 -- 172.21.15.82:0/3226060958 shutdown_connections 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 --2- 172.21.15.82:0/3226060958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 0x7f333c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 --2- 172.21.15.82:0/3226060958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c103490 0x7f333c1038b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 --2- 172.21.15.82:0/3226060958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c104690 0x7f333c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 -- 172.21.15.82:0/3226060958 >> 172.21.15.82:0/3226060958 conn(0x7f333c0fe9f0 msgr2=0x7f333c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 -- 172.21.15.82:0/3226060958 shutdown_connections 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.447+0000 7f3342200700 1 -- 172.21.15.82:0/3226060958 wait complete. 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.448+0000 7f3342200700 1 Processor -- start 2024-04-26T20:22:09.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.448+0000 7f3342200700 1 -- start start 2024-04-26T20:22:09.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f3342200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 0x7f333c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f3342200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c104690 0x7f333c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f3342200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 0x7f333c1a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f3342200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f333c10ef70 con 0x7f333c104690 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f3342200700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f333c10edf0 con 0x7f333c105030 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f3342200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f333c10f0f0 con 0x7f333c103490 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f333b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 0x7f333c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f333aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c104690 0x7f333c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f333b400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 0x7f333c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46806/0 (socket says 172.21.15.82:46806) 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f333b400700 1 -- 172.21.15.82:0/2794241949 learned_addr learned my addr 172.21.15.82:0/2794241949 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.449+0000 7f333be00700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 0x7f333c1a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333b400700 1 -- 172.21.15.82:0/2794241949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 msgr2=0x7f333c1a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333b400700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 0x7f333c1a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333b400700 1 -- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c104690 msgr2=0x7f333c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333b400700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c104690 0x7f333c19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333b400700 1 -- 172.21.15.82:0/2794241949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c1a3480 con 0x7f333c103490 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333aa00700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c104690 0x7f333c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333be00700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 0x7f333c1a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f333b400700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 0x7f333c19b820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f332c0098e0 tx=0x7f332c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c009e60 con 0x7f333c103490 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.450+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c1a3710 con 0x7f333c103490 2024-04-26T20:22:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.451+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1a3bc0 con 0x7f333c103490 2024-04-26T20:22:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.451+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332c003d70 con 0x7f333c103490 2024-04-26T20:22:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.451+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c005690 con 0x7f333c103490 2024-04-26T20:22:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.452+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c005360 con 0x7f333c103490 2024-04-26T20:22:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.454+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f332c00fb70 con 0x7f333c103490 2024-04-26T20:22:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.455+0000 7f3333e00700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33200a3cd0 0x7f33200a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.455+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f332c0d1800 con 0x7f333c103490 2024-04-26T20:22:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.455+0000 7f333aa00700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33200a3cd0 0x7f33200a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.456+0000 7f333aa00700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33200a3cd0 0x7f33200a6190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3328011490 tx=0x7f3328009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.457+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f332c013070 con 0x7f333c103490 2024-04-26T20:22:09.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.704+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f331c000bf0 con 0x7f33200a3cd0 2024-04-26T20:22:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.706+0000 7f3333e00700 1 -- 172.21.15.82:0/2794241949 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f331c000bf0 con 0x7f33200a3cd0 2024-04-26T20:22:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-04-26T20:22:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-04-26T20:22:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-04-26T20:22:09.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33200a3cd0 msgr2=0x7f33200a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33200a3cd0 0x7f33200a6190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3328011490 tx=0x7f3328009260 comp rx=0 tx=0).stop 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 msgr2=0x7f333c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 0x7f333c19b820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f332c0098e0 tx=0x7f332c00f690 comp rx=0 tx=0).stop 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 shutdown_connections 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f33200a3cd0 0x7f33200a6190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c105030 0x7f333c1a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333c103490 0x7f333c19b820 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 --2- 172.21.15.82:0/2794241949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333c104690 0x7f333c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 >> 172.21.15.82:0/2794241949 conn(0x7f333c0fe9f0 msgr2=0x7f333c075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 shutdown_connections 2024-04-26T20:22:09.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:09.709+0000 7f3342200700 1 -- 172.21.15.82:0/2794241949 wait complete. 2024-04-26T20:22:10.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:09 smithi139 ceph-mon[32999]: pgmap v392: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:09 smithi135 ceph-mon[32816]: pgmap v392: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:10.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:09 smithi082 ceph-mon[28105]: pgmap v392: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:10.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T20:22:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:10 smithi082 ceph-mon[28105]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:11.007 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:11.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:10 smithi139 ceph-mon[32999]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:11.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:10 smithi135 ceph-mon[32816]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:11 smithi082 ceph-mon[28105]: pgmap v393: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:12.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:11 smithi139 ceph-mon[32999]: pgmap v393: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:11 smithi135 ceph-mon[32816]: pgmap v393: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 -- 172.21.15.82:0/976550126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac109160 msgr2=0x7effac10b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 --2- 172.21.15.82:0/976550126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac109160 0x7effac10b5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7effa400b0a0 tx=0x7effa400b3b0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 -- 172.21.15.82:0/976550126 shutdown_connections 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 --2- 172.21.15.82:0/976550126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac109160 0x7effac10b5d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 --2- 172.21.15.82:0/976550126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effac103f00 0x7effac1062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 --2- 172.21.15.82:0/976550126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effac106830 0x7effac108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 -- 172.21.15.82:0/976550126 >> 172.21.15.82:0/976550126 conn(0x7effac0fd910 msgr2=0x7effac0ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 -- 172.21.15.82:0/976550126 shutdown_connections 2024-04-26T20:22:13.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.304+0000 7effb2800700 1 -- 172.21.15.82:0/976550126 wait complete. 2024-04-26T20:22:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.305+0000 7effb2800700 1 Processor -- start 2024-04-26T20:22:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.305+0000 7effb2800700 1 -- start start 2024-04-26T20:22:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effb2800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 0x7effac1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effb2800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effac106830 0x7effac199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effb2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effac109160 0x7effac1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effb2800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7effac10eef0 con 0x7effac109160 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effb2800700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effac10ed70 con 0x7effac106830 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effb2800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effac10f070 con 0x7effac103f00 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 0x7effac1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 0x7effac1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:59336/0 (socket says 172.21.15.82:59336) 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 -- 172.21.15.82:0/133569965 learned_addr learned my addr 172.21.15.82:0/133569965 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effaaa00700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effac106830 0x7effac199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effabe00700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effac109160 0x7effac1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:13.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 -- 172.21.15.82:0/133569965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effac106830 msgr2=0x7effac199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:13.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effac106830 0x7effac199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 -- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effac109160 msgr2=0x7effac1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effac109160 0x7effac1a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.306+0000 7effab400700 1 -- 172.21.15.82:0/133569965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac101cf0 con 0x7effac103f00 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.307+0000 7effab400700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 0x7effac1995a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e9d0 tx=0x7eff9c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.307+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00cbd0 con 0x7effac103f00 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.307+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9c00ee70 con 0x7effac103f00 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.307+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac101fe0 con 0x7effac103f00 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.307+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c018680 con 0x7effac103f00 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.307+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac102570 con 0x7effac103f00 2024-04-26T20:22:13.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.308+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effac06a110 con 0x7effac103f00 2024-04-26T20:22:13.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.310+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7eff9c010430 con 0x7effac103f00 2024-04-26T20:22:13.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.312+0000 7effa3e00700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7eff900a3d50 0x7eff900a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:13.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.312+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7eff9c0d0e00 con 0x7effac103f00 2024-04-26T20:22:13.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.312+0000 7effaaa00700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7eff900a3d50 0x7eff900a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:13.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.313+0000 7effaaa00700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7eff900a3d50 0x7eff900a6210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff98009c60 tx=0x7eff98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:13.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.314+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7eff9c09d2c0 con 0x7effac103f00 2024-04-26T20:22:13.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.551+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7effac0ff080 con 0x7eff900a3d50 2024-04-26T20:22:13.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.569+0000 7effa3e00700 1 -- 172.21.15.82:0/133569965 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7effac0ff080 con 0x7eff900a3d50 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (2m) 41s ago 2m 12.4M - 19.0.0-3306-gbc612ffb 55dc54019ad8 00e1a778eff2 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi135 running (2m) 78s ago 2m 28.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 0e309e07d156 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi139 running (2m) 78s ago 2m 16.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 fbc65bf8a48e 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (2m) 41s ago 2m 12.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 f391d154f5e4 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi135 running (2m) 78s ago 2m 17.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 c276d3a6c065 2024-04-26T20:22:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi139 running (2m) 78s ago 2m 15.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 5d0aaa22b1a8 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (2m) 41s ago 2m 16.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1d60804847dd 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi135 running (2m) 78s ago 2m 17.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1c59e136782c 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi139 running (2m) 78s ago 2m 16.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 44a0369f22ab 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (2m) 41s ago 2m 15.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 4a8d2614b057 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi135 running (3m) 78s ago 3m 15.4M - 19.0.0-3306-gbc612ffb 55dc54019ad8 f1e9e05b8c3b 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi139 running (3m) 78s ago 3m 16.4M - 19.0.0-3306-gbc612ffb 55dc54019ad8 77f79c3cd69a 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (11m) 41s ago 11m 516M - 19.0.0-3306-gbc612ffb 55dc54019ad8 227107b519f5 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi135 *:8443,8765 running (9m) 78s ago 9m 455M - 19.0.0-3306-gbc612ffb 55dc54019ad8 56ae30959cbe 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi139 *:8443,8765 running (9m) 78s ago 9m 453M - 19.0.0-3306-gbc612ffb 55dc54019ad8 1c68a8317d4e 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (11m) 41s ago 11m 48.0M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 55db7b274722 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi135 running (9m) 78s ago 9m 41.5M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 c10f668c3850 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi139 running (9m) 78s ago 9m 40.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 b6f510e62caa 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (8m) 41s ago 8m 45.4M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 d24b4d6cc1da 2024-04-26T20:22:13.572 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi135 running (8m) 78s ago 8m 46.5M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 1650c2e598ec 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi139 running (7m) 78s ago 7m 58.5M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 9edac91fb9b5 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (7m) 41s ago 7m 44.2M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 963839e33d58 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi135 running (6m) 78s ago 6m 43.0M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 15256a9170d5 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi139 running (6m) 78s ago 6m 45.1M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 d5de4c07ef15 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (5m) 41s ago 5m 41.4M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 ed0b90c646b5 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi135 running (5m) 78s ago 5m 55.6M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 988008f51b82 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi139 running (4m) 78s ago 4m 45.4M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 78f4e29633c2 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (4m) 41s ago 4m 49.6M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 79bab2da6afd 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi135 running (3m) 78s ago 3m 51.2M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 776db2170f92 2024-04-26T20:22:13.573 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi139 running (3m) 78s ago 3m 48.7M 4272M 19.0.0-3306-gbc612ffb 55dc54019ad8 d4a98249330c 2024-04-26T20:22:13.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.572+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7eff900a3d50 msgr2=0x7eff900a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:13.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.572+0000 7effb2800700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7eff900a3d50 0x7eff900a6210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff98009c60 tx=0x7eff98009260 comp rx=0 tx=0).stop 2024-04-26T20:22:13.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.572+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 msgr2=0x7effac1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:13.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.572+0000 7effb2800700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 0x7effac1995a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e9d0 tx=0x7eff9c00ece0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 shutdown_connections 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effac109160 0x7effac1a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effac103f00 0x7effac1995a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7eff900a3d50 0x7eff900a6210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 --2- 172.21.15.82:0/133569965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effac106830 0x7effac199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 >> 172.21.15.82:0/133569965 conn(0x7effac0fd910 msgr2=0x7effac104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 shutdown_connections 2024-04-26T20:22:13.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:13.573+0000 7effb2800700 1 -- 172.21.15.82:0/133569965 wait complete. 2024-04-26T20:22:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:13 smithi082 ceph-mon[28105]: pgmap v394: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:13 smithi139 ceph-mon[32999]: pgmap v394: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:13 smithi135 ceph-mon[32816]: pgmap v394: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:14.427 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T20:22:14.873 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:15.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:14 smithi082 ceph-mon[28105]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:15.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:14 smithi139 ceph-mon[32999]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:15.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:14 smithi135 ceph-mon[32816]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:16.054 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:15 smithi082 ceph-mon[28105]: pgmap v395: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:16.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:15 smithi139 ceph-mon[32999]: pgmap v395: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:15 smithi135 ceph-mon[32816]: pgmap v395: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 -- 172.21.15.82:0/58941434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c103490 msgr2=0x7f681c1038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 --2- 172.21.15.82:0/58941434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c103490 0x7f681c1038b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f680c0099c0 tx=0x7f680c009cd0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 -- 172.21.15.82:0/58941434 shutdown_connections 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 --2- 172.21.15.82:0/58941434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c105030 0x7f681c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 --2- 172.21.15.82:0/58941434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c103490 0x7f681c1038b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 --2- 172.21.15.82:0/58941434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c104690 0x7f681c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 -- 172.21.15.82:0/58941434 >> 172.21.15.82:0/58941434 conn(0x7f681c0fe9f0 msgr2=0x7f681c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 -- 172.21.15.82:0/58941434 shutdown_connections 2024-04-26T20:22:17.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.197+0000 7f6820c00700 1 -- 172.21.15.82:0/58941434 wait complete. 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.198+0000 7f6820c00700 1 Processor -- start 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.198+0000 7f6820c00700 1 -- start start 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.198+0000 7f6820c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 0x7f681c199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.198+0000 7f6820c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c104690 0x7f681c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.198+0000 7f6820c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c105030 0x7f681c1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6820c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f681c10ef80 con 0x7f681c105030 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6820c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f681c10ee00 con 0x7f681c103490 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6820c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f681c10f100 con 0x7f681c104690 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 0x7f681c199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f681a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c105030 0x7f681c1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 0x7f681c199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56560/0 (socket says 172.21.15.82:56560) 2024-04-26T20:22:17.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 -- 172.21.15.82:0/1360687160 learned_addr learned my addr 172.21.15.82:0/1360687160 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6811400700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c104690 0x7f681c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 -- 172.21.15.82:0/1360687160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c104690 msgr2=0x7f681c199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c104690 0x7f681c199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 -- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c105030 msgr2=0x7f681c1a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c105030 0x7f681c1a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6819e00700 1 -- 172.21.15.82:0/1360687160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681c1a1280 con 0x7f681c103490 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.199+0000 7f6811400700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c104690 0x7f681c199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:17.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.200+0000 7f6819e00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 0x7f681c199620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f680c009f50 tx=0x7f680c0057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.200+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c027070 con 0x7f681c103490 2024-04-26T20:22:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.200+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681c1a1510 con 0x7f681c103490 2024-04-26T20:22:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.200+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f680c0040e0 con 0x7f681c103490 2024-04-26T20:22:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.200+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c00f460 con 0x7f681c103490 2024-04-26T20:22:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.200+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681c1a19c0 con 0x7f681c103490 2024-04-26T20:22:17.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.201+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681c06a110 con 0x7f681c103490 2024-04-26T20:22:17.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.203+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f680c02a070 con 0x7f681c103490 2024-04-26T20:22:17.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.205+0000 7f6813400700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68000a3cd0 0x7f68000a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:17.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.205+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f680c0d1f90 con 0x7f681c103490 2024-04-26T20:22:17.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.205+0000 7f6811400700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68000a3cd0 0x7f68000a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:17.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.206+0000 7f6811400700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68000a3cd0 0x7f68000a6190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6804005950 tx=0x7f68040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:17.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.207+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f680c031020 con 0x7f681c103490 2024-04-26T20:22:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.442+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f681c063860 con 0x7f68000a3cd0 2024-04-26T20:22:17.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.459+0000 7f6813400700 1 -- 172.21.15.82:0/1360687160 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f681c063860 con 0x7f68000a3cd0 2024-04-26T20:22:17.461 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T20:22:17.461 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 82s ago 3m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi139=c;smithi139=f;smithi139=i;smithi139=l;count:12 2024-04-26T20:22:17.461 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 82s ago 9m smithi082=x;smithi135=y;smithi139=z;count:3 2024-04-26T20:22:17.461 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 82s ago 9m smithi082:172.21.15.82=a;smithi135:172.21.15.135=b;smithi139:172.21.15.139=c;count:3 2024-04-26T20:22:17.461 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 82s ago - 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68000a3cd0 msgr2=0x7f68000a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68000a3cd0 0x7f68000a6190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6804005950 tx=0x7f68040058e0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 msgr2=0x7f681c199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 0x7f681c199620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f680c009f50 tx=0x7f680c0057a0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 shutdown_connections 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f681c105030 0x7f681c1a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68000a3cd0 0x7f68000a6190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f681c103490 0x7f681c199620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 --2- 172.21.15.82:0/1360687160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f681c104690 0x7f681c199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 >> 172.21.15.82:0/1360687160 conn(0x7f681c0fe9f0 msgr2=0x7f681c1079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:17.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 shutdown_connections 2024-04-26T20:22:17.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:17.462+0000 7f6820c00700 1 -- 172.21.15.82:0/1360687160 wait complete. 2024-04-26T20:22:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:17 smithi139 ceph-mon[32999]: pgmap v396: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:18.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:17 smithi135 ceph-mon[32816]: pgmap v396: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:18.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:17 smithi082 ceph-mon[28105]: pgmap v396: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:18.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T20:22:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:19.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:18 smithi082 ceph-mon[28105]: from='client.25235 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:19.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:18 smithi139 ceph-mon[32999]: from='client.25235 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:19.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:18 smithi135 ceph-mon[32816]: from='client.25235 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:20.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:19 smithi082 ceph-mon[28105]: pgmap v397: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:19 smithi139 ceph-mon[32999]: pgmap v397: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:20.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:19 smithi135 ceph-mon[32816]: pgmap v397: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:21.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 -- 172.21.15.82:0/3538130604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0079020 msgr2=0x7f68a00794a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 --2- 172.21.15.82:0/3538130604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0079020 0x7f68a00794a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f688c0098f0 tx=0x7f688c009c00 comp rx=0 tx=0).stop 2024-04-26T20:22:21.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 -- 172.21.15.82:0/3538130604 shutdown_connections 2024-04-26T20:22:21.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 --2- 172.21.15.82:0/3538130604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a00799e0 0x7f68a007a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 --2- 172.21.15.82:0/3538130604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a0077dd0 0x7f68a00781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 --2- 172.21.15.82:0/3538130604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0079020 0x7f68a00794a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 -- 172.21.15.82:0/3538130604 >> 172.21.15.82:0/3538130604 conn(0x7f68a0100b40 msgr2=0x7f68a0102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:21.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 -- 172.21.15.82:0/3538130604 shutdown_connections 2024-04-26T20:22:21.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.237+0000 7f68a6600700 1 -- 172.21.15.82:0/3538130604 wait complete. 2024-04-26T20:22:21.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.238+0000 7f68a6600700 1 Processor -- start 2024-04-26T20:22:21.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.238+0000 7f68a6600700 1 -- start start 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0077dd0 0x7f68a019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a6600700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0079020 0x7f68a019ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a6600700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a00799e0 0x7f68a01a7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a6600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0115490 con 0x7f68a0077dd0 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a6600700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0115310 con 0x7f68a0079020 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a6600700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0115610 con 0x7f68a00799e0 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0077dd0 0x7f68a019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f689fe00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0079020 0x7f68a019ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0077dd0 0x7f68a019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33986/0 (socket says 172.21.15.82:33986) 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a5200700 1 -- 172.21.15.82:0/2087899328 learned_addr learned my addr 172.21.15.82:0/2087899328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.239+0000 7f68a5c00700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a00799e0 0x7f68a01a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689fe00700 1 -- 172.21.15.82:0/2087899328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a00799e0 msgr2=0x7f68a01a7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689fe00700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a00799e0 0x7f68a01a7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689fe00700 1 -- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0077dd0 msgr2=0x7f68a019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689fe00700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0077dd0 0x7f68a019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689fe00700 1 -- 172.21.15.82:0/2087899328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a01a7700 con 0x7f68a0079020 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f68a5c00700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a00799e0 0x7f68a01a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689fe00700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0079020 0x7f68a019ffe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f688c009810 tx=0x7f688c005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c005510 con 0x7f68a0079020 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f688c0056b0 con 0x7f68a0079020 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a01a7990 con 0x7f68a0079020 2024-04-26T20:22:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c003b80 con 0x7f68a0079020 2024-04-26T20:22:21.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.240+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a01a7de0 con 0x7f68a0079020 2024-04-26T20:22:21.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.242+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a006a110 con 0x7f68a0079020 2024-04-26T20:22:21.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.244+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f688c00b560 con 0x7f68a0079020 2024-04-26T20:22:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.245+0000 7f689d600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68880a3cd0 0x7f68880a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.245+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f688c0d1860 con 0x7f68a0079020 2024-04-26T20:22:21.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.245+0000 7f68a5200700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68880a3cd0 0x7f68880a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.246+0000 7f68a5200700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68880a3cd0 0x7f68880a6190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6894009d20 tx=0x7f6894009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:21.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.250+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f688c013030 con 0x7f68a0079020 2024-04-26T20:22:21.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.482+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f68a0063860 con 0x7f68880a3cd0 2024-04-26T20:22:21.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.485+0000 7f689d600700 1 -- 172.21.15.82:0/2087899328 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f68a0063860 con 0x7f68880a3cd0 2024-04-26T20:22:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-04-26T20:22:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-04-26T20:22:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:smithi135 172.21.15.135 2024-04-26T20:22:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:smithi139 172.21.15.139 2024-04-26T20:22:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68880a3cd0 msgr2=0x7f68880a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68880a3cd0 0x7f68880a6190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6894009d20 tx=0x7f6894009260 comp rx=0 tx=0).stop 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0079020 msgr2=0x7f68a019ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0079020 0x7f68a019ffe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f688c009810 tx=0x7f688c005270 comp rx=0 tx=0).stop 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 shutdown_connections 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68a00799e0 0x7f68a01a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a0077dd0 0x7f68a019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68880a3cd0 0x7f68880a6190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 --2- 172.21.15.82:0/2087899328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68a0079020 0x7f68a019ffe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 >> 172.21.15.82:0/2087899328 conn(0x7f68a0100b40 msgr2=0x7f68a0102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 shutdown_connections 2024-04-26T20:22:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:21.488+0000 7f68a6600700 1 -- 172.21.15.82:0/2087899328 wait complete. 2024-04-26T20:22:21.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:21 smithi082 ceph-mon[28105]: pgmap v398: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:21 smithi139 ceph-mon[32999]: pgmap v398: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:22.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:21 smithi135 ceph-mon[32816]: pgmap v398: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:22.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T20:22:22.807 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:23.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:22 smithi082 ceph-mon[28105]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:23.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:22 smithi139 ceph-mon[32999]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:23.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:22 smithi135 ceph-mon[32816]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:24.031 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:23 smithi082 ceph-mon[28105]: pgmap v399: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:24.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:23 smithi139 ceph-mon[32999]: pgmap v399: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:24.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:23 smithi135 ceph-mon[32816]: pgmap v399: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:24.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:24 smithi082 ceph-mon[28105]: pgmap v400: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:24 smithi139 ceph-mon[32999]: pgmap v400: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:25.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:24 smithi135 ceph-mon[32816]: pgmap v400: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 -- 172.21.15.82:0/3433709727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 msgr2=0x7f6a8810db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 --2- 172.21.15.82:0/3433709727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 0x7f6a8810db10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000b0d0 tx=0x7f6a8000b3e0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 -- 172.21.15.82:0/3433709727 shutdown_connections 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 --2- 172.21.15.82:0/3433709727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 0x7f6a8810db10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 --2- 172.21.15.82:0/3433709727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881056c0 0x7f6a88105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 --2- 172.21.15.82:0/3433709727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881068c0 0x7f6a88106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 -- 172.21.15.82:0/3433709727 >> 172.21.15.82:0/3433709727 conn(0x7f6a88100c80 msgr2=0x7f6a881030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 -- 172.21.15.82:0/3433709727 shutdown_connections 2024-04-26T20:22:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.135+0000 7f6a90200700 1 -- 172.21.15.82:0/3433709727 wait complete. 2024-04-26T20:22:25.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.136+0000 7f6a90200700 1 Processor -- start 2024-04-26T20:22:25.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.136+0000 7f6a90200700 1 -- start start 2024-04-26T20:22:25.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a90200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 0x7f6a8819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a90200700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881068c0 0x7f6a8819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a90200700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 0x7f6a881a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a90200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88111140 con 0x7f6a881056c0 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a90200700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88110fc0 con 0x7f6a88107260 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a90200700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881112c0 con 0x7f6a881068c0 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 0x7f6a8819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 0x7f6a8819b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34010/0 (socket says 172.21.15.82:34010) 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 -- 172.21.15.82:0/3326907459 learned_addr learned my addr 172.21.15.82:0/3326907459 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8ce00700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881068c0 0x7f6a8819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8e200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 0x7f6a881a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:25.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 -- 172.21.15.82:0/3326907459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881068c0 msgr2=0x7f6a8819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:25.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881068c0 0x7f6a8819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 -- 172.21.15.82:0/3326907459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 msgr2=0x7f6a881a2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:25.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 0x7f6a881a2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8d800700 1 -- 172.21.15.82:0/3326907459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a881a3380 con 0x7f6a881056c0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.137+0000 7f6a8ce00700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881068c0 0x7f6a8819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.138+0000 7f6a8d800700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 0x7f6a8819b720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00e9a0 tx=0x7f6a7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.138+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c004220 con 0x7f6a881056c0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.138+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a881a3670 con 0x7f6a881056c0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.138+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a7c0043c0 con 0x7f6a881056c0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.138+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c003cc0 con 0x7f6a881056c0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.138+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a881a3bb0 con 0x7f6a881056c0 2024-04-26T20:22:25.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.139+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8806a110 con 0x7f6a881056c0 2024-04-26T20:22:25.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.141+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6a7c00c810 con 0x7f6a881056c0 2024-04-26T20:22:25.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.144+0000 7f6a86000700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6a700a3cd0 0x7f6a700a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:25.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.144+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6a7c0d0af0 con 0x7f6a881056c0 2024-04-26T20:22:25.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.144+0000 7f6a8ce00700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6a700a3cd0 0x7f6a700a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:25.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.145+0000 7f6a8ce00700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6a700a3cd0 0x7f6a700a6190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009680 tx=0x7f6a78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:25.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.148+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f6a7c09cfb0 con 0x7f6a881056c0 2024-04-26T20:22:25.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.384+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6a88063860 con 0x7f6a700a3cd0 2024-04-26T20:22:25.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.389+0000 7f6a86000700 1 -- 172.21.15.82:0/3326907459 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6a88063860 con 0x7f6a700a3cd0 2024-04-26T20:22:25.390 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T20:22:25.391 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-26T20:22:25.391 INFO:teuthology.orchestra.run.smithi082.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-26T20:22:25.391 INFO:teuthology.orchestra.run.smithi082.stdout:smithi139 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N6400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-26T20:22:25.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6a700a3cd0 msgr2=0x7f6a700a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:25.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6a700a3cd0 0x7f6a700a6190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009680 tx=0x7f6a78009260 comp rx=0 tx=0).stop 2024-04-26T20:22:25.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 msgr2=0x7f6a8819b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:25.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 0x7f6a8819b720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00e9a0 tx=0x7f6a7c00ecb0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 shutdown_connections 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6a700a3cd0 0x7f6a700a6190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a88107260 0x7f6a881a2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a881056c0 0x7f6a8819b720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 --2- 172.21.15.82:0/3326907459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a881068c0 0x7f6a8819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 >> 172.21.15.82:0/3326907459 conn(0x7f6a88100c80 msgr2=0x7f6a88109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 shutdown_connections 2024-04-26T20:22:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:25.392+0000 7f6a90200700 1 -- 172.21.15.82:0/3326907459 wait complete. 2024-04-26T20:22:26.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:25 smithi139 ceph-mon[32999]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:26.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:25 smithi135 ceph-mon[32816]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:25 smithi082 ceph-mon[28105]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:22:26.456 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T20:22:26.464 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:22:26.464 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T20:22:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:27.052 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:26 smithi082 ceph-mon[28105]: pgmap v401: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:26 smithi139 ceph-mon[32999]: pgmap v401: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:26 smithi135 ceph-mon[32816]: pgmap v401: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:29.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 -- 172.21.15.82:0/2531415343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a70109ac0 msgr2=0x7f1a70109ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2531415343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a70109ac0 0x7f1a70109ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1a600099c0 tx=0x7f1a60009cd0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 -- 172.21.15.82:0/2531415343 shutdown_connections 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2531415343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7010b660 0x7f1a70111f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2531415343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a70109ac0 0x7f1a70109ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2531415343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 0x7f1a7010b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 -- 172.21.15.82:0/2531415343 >> 172.21.15.82:0/2531415343 conn(0x7f1a70078a90 msgr2=0x7f1a7007aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 -- 172.21.15.82:0/2531415343 shutdown_connections 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.293+0000 7f1a77a00700 1 -- 172.21.15.82:0/2531415343 wait complete. 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.294+0000 7f1a77a00700 1 Processor -- start 2024-04-26T20:22:29.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.294+0000 7f1a77a00700 1 -- start start 2024-04-26T20:22:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.294+0000 7f1a77a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 0x7f1a7019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.294+0000 7f1a77a00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 0x7f1a701a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.294+0000 7f1a77a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7010b660 0x7f1a701a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a77a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701155a0 con 0x7f1a7010b660 2024-04-26T20:22:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a77a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70115420 con 0x7f1a70109ac0 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a77a00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70115720 con 0x7f1a7010acc0 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a75000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 0x7f1a7019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a67e00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 0x7f1a701a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a75000700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 0x7f1a7019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:48516/0 (socket says 172.21.15.82:48516) 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a75000700 1 -- 172.21.15.82:0/2841837311 learned_addr learned my addr 172.21.15.82:0/2841837311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a75a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7010b660 0x7f1a701a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a67e00700 1 -- 172.21.15.82:0/2841837311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 msgr2=0x7f1a7019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a67e00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 0x7f1a7019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a67e00700 1 -- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7010b660 msgr2=0x7f1a701a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a67e00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7010b660 0x7f1a701a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a67e00700 1 -- 172.21.15.82:0/2841837311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a701a7880 con 0x7f1a7010acc0 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a75000700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 0x7f1a7019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.295+0000 7f1a75a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7010b660 0x7f1a701a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.296+0000 7f1a67e00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 0x7f1a701a01c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800e9f0 tx=0x7f1a5800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.296+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58004220 con 0x7f1a7010acc0 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.296+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a701a7b70 con 0x7f1a7010acc0 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.296+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a580043c0 con 0x7f1a7010acc0 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.296+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58005020 con 0x7f1a7010acc0 2024-04-26T20:22:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.296+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a701a80b0 con 0x7f1a7010acc0 2024-04-26T20:22:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.297+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7006a110 con 0x7f1a7010acc0 2024-04-26T20:22:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.299+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1a58004750 con 0x7f1a7010acc0 2024-04-26T20:22:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.301+0000 7f1a6e000700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1a540a3cd0 0x7f1a540a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.301+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1a580d0a60 con 0x7f1a7010acc0 2024-04-26T20:22:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.301+0000 7f1a75000700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1a540a3cd0 0x7f1a540a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.302+0000 7f1a75000700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1a540a3cd0 0x7f1a540a6190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a60003820 tx=0x7f1a60005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:29.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.304+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1a5809cf20 con 0x7f1a7010acc0 2024-04-26T20:22:29.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.580+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1a7002e560 con 0x7f1a7010acc0 2024-04-26T20:22:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.581+0000 7f1a6e000700 1 -- 172.21.15.82:0/2841837311 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3104 (secure 0 0 0) 0x7f1a5809c820 con 0x7f1a7010acc0 2024-04-26T20:22:29.583 INFO:teuthology.orchestra.run.smithi082.stdout:e28 2024-04-26T20:22:29.583 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:22:29.583 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:22:29.583 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 28 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-26T20:19:52.134957+0000 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-26T20:20:20.191502+0000 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-26T20:22:29.584 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 5 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2,3,4 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=24584,1=24554,2=24550,3=24529,4=24454} 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3,4] 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-26T20:22:29.585 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 24584 members: 24554,24584,24454,24529,24550 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{0:24584} state up:active seq 3 addr [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{0:24527} state up:standby-replay seq 1 addr [v2:172.21.15.135:6836/1503486498,v1:172.21.15.135:6837/1503486498] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{1:24554} state up:active seq 11 addr [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{1:24517} state up:standby-replay seq 1 addr [v2:172.21.15.139:6834/2462659708,v1:172.21.15.139:6835/2462659708] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{2:24550} state up:active seq 12 addr [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{2:24497} state up:standby-replay seq 1 addr [v2:172.21.15.135:6834/1988909695,v1:172.21.15.135:6835/1988909695] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{3:24529} state up:active seq 14 addr [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{3:24467} state up:standby-replay seq 1 addr [v2:172.21.15.82:6834/3327585570,v1:172.21.15.82:6835/3327585570] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.586 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{4:24454} state up:active seq 19 addr [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{4:24449} state up:standby-replay seq 1 addr [v2:172.21.15.135:6832/3324936648,v1:172.21.15.135:6833/3324936648] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14400} state up:standby seq 1 addr [v2:172.21.15.82:6836/4285824325,v1:172.21.15.82:6837/4285824325] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.587 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{-1:14466} state up:standby seq 1 addr [v2:172.21.15.82:6840/1325720417,v1:172.21.15.82:6841/1325720417] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.583+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1a540a3cd0 msgr2=0x7f1a540a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.583+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1a540a3cd0 0x7f1a540a6190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a60003820 tx=0x7f1a60005fb0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.583+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 msgr2=0x7f1a701a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.583+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 0x7f1a701a01c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800e9f0 tx=0x7f1a5800ed00 comp rx=0 tx=0).stop 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 shutdown_connections 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7010b660 0x7f1a701a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1a540a3cd0 0x7f1a540a6190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a70109ac0 0x7f1a7019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 --2- 172.21.15.82:0/2841837311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7010acc0 0x7f1a701a01c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 >> 172.21.15.82:0/2841837311 conn(0x7f1a70078a90 msgr2=0x7f1a7010dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 shutdown_connections 2024-04-26T20:22:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:29.584+0000 7f1a77a00700 1 -- 172.21.15.82:0/2841837311 wait complete. 2024-04-26T20:22:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:22:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:29 smithi082 ceph-mon[28105]: pgmap v402: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:29 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2841837311' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T20:22:30.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:29 smithi139 ceph-mon[32999]: pgmap v402: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:29 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2841837311' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T20:22:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:29 smithi135 ceph-mon[32816]: pgmap v402: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:29 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2841837311' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T20:22:30.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-26T20:22:30.927 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:32.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:31 smithi082 ceph-mon[28105]: pgmap v403: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:31 smithi139 ceph-mon[32999]: pgmap v403: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:32.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:31 smithi135 ceph-mon[32816]: pgmap v403: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 -- 172.21.15.82:0/3602736995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 msgr2=0x7ff864106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 --2- 172.21.15.82:0/3602736995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864106300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff854009990 tx=0x7ff854009ca0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 -- 172.21.15.82:0/3602736995 shutdown_connections 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 --2- 172.21.15.82:0/3602736995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff864109170 0x7ff86410b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 --2- 172.21.15.82:0/3602736995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864106300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 --2- 172.21.15.82:0/3602736995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 0x7ff864108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 -- 172.21.15.82:0/3602736995 >> 172.21.15.82:0/3602736995 conn(0x7ff8640fd940 msgr2=0x7ff8640ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 -- 172.21.15.82:0/3602736995 shutdown_connections 2024-04-26T20:22:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.272+0000 7ff86a800700 1 -- 172.21.15.82:0/3602736995 wait complete. 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 Processor -- start 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 -- start start 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864103870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 0x7ff864101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff864109170 0x7ff864102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410ef50 con 0x7ff864103f10 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410edd0 con 0x7ff864109170 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff86a800700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410f0d0 con 0x7ff864106840 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.274+0000 7ff863400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864103870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864103870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52840/0 (socket says 172.21.15.82:52840) 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 -- 172.21.15.82:0/3439632208 learned_addr learned my addr 172.21.15.82:0/3439632208 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff85aa00700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 0x7ff864101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863e00700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff864109170 0x7ff864102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 -- 172.21.15.82:0/3439632208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 msgr2=0x7ff864101ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 0x7ff864101ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 -- 172.21.15.82:0/3439632208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff864109170 msgr2=0x7ff864102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff864109170 0x7ff864102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 -- 172.21.15.82:0/3439632208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff864102cb0 con 0x7ff864103f10 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff85aa00700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 0x7ff864101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.275+0000 7ff863400700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864103870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b760 tx=0x7ff8540047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.276+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854027070 con 0x7ff864103f10 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.276+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff854022470 con 0x7ff864103f10 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.276+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8641a3700 con 0x7ff864103f10 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.276+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854017650 con 0x7ff864103f10 2024-04-26T20:22:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.276+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8641a3b50 con 0x7ff864103f10 2024-04-26T20:22:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.277+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86406a110 con 0x7ff864103f10 2024-04-26T20:22:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.279+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff854009d10 con 0x7ff864103f10 2024-04-26T20:22:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.281+0000 7ff860c00700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8480a3cd0 0x7ff8480a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.281+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff8540d1480 con 0x7ff864103f10 2024-04-26T20:22:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.281+0000 7ff85aa00700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8480a3cd0 0x7ff8480a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.282+0000 7ff85aa00700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8480a3cd0 0x7ff8480a6190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009480 tx=0x7ff84c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:33.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.285+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff85405e060 con 0x7ff864103f10 2024-04-26T20:22:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.513+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ff864064030 con 0x7ff864103f10 2024-04-26T20:22:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.516+0000 7ff860c00700 1 -- 172.21.15.82:0/3439632208 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) ==== 56+0+5608 (secure 0 0 0) 0x7ff854013070 con 0x7ff864103f10 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 91 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:fsid da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-26T20:10:28.312875+0000 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-26T20:20:47.671770+0000 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 27 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2024-04-26T20:22:33.518 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release squid 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/4190226369,v1:172.21.15.82:6803/4190226369] [v2:172.21.15.82:6804/4190226369,v1:172.21.15.82:6805/4190226369] exists,up 80c3dc83-f48e-4004-88fb-6912e18b0f9d 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/3571001062,v1:172.21.15.135:6801/3571001062] [v2:172.21.15.135:6802/3571001062,v1:172.21.15.135:6803/3571001062] exists,up 385f5baf-d127-4e28-a50b-3bbfa29eb384 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/3051837314,v1:172.21.15.139:6801/3051837314] [v2:172.21.15.139:6802/3051837314,v1:172.21.15.139:6803/3051837314] exists,up 60c32ad5-c88e-4a60-a35b-2920afb27c89 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/825292228,v1:172.21.15.82:6811/825292228] [v2:172.21.15.82:6812/825292228,v1:172.21.15.82:6813/825292228] exists,up 8aac68fa-5146-49fd-9727-22515d9800c9 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/3619586985,v1:172.21.15.135:6809/3619586985] [v2:172.21.15.135:6810/3619586985,v1:172.21.15.135:6811/3619586985] exists,up baa87007-045a-47a3-ada4-cb7a97da2a4b 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 38 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6808/1412243105,v1:172.21.15.139:6809/1412243105] [v2:172.21.15.139:6810/1412243105,v1:172.21.15.139:6811/1412243105] exists,up c77f7c06-0d03-476c-bdba-b28ef21c18af 2024-04-26T20:22:33.519 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/3682218709,v1:172.21.15.82:6819/3682218709] [v2:172.21.15.82:6820/3682218709,v1:172.21.15.82:6821/3682218709] exists,up 16b52ba7-1d31-42b1-8491-22423e769d87 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/1349628889,v1:172.21.15.135:6817/1349628889] [v2:172.21.15.135:6818/1349628889,v1:172.21.15.135:6819/1349628889] exists,up b9989e74-b2cd-47cd-9919-608a028380dd 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 59 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6816/345848933,v1:172.21.15.139:6817/345848933] [v2:172.21.15.139:6818/345848933,v1:172.21.15.139:6819/345848933] exists,up 42d15fb2-bd22-4cd8-b05a-afea2784ddff 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 67 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/2126970869,v1:172.21.15.82:6827/2126970869] [v2:172.21.15.82:6828/2126970869,v1:172.21.15.82:6829/2126970869] exists,up f60f2ace-b710-46dc-b501-b76a51631621 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 72 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/2039734304,v1:172.21.15.135:6825/2039734304] [v2:172.21.15.135:6826/2039734304,v1:172.21.15.135:6827/2039734304] exists,up 1566c893-87e7-456b-8ef0-c9721c5e6a98 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 80 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6824/3441375254,v1:172.21.15.139:6825/3441375254] [v2:172.21.15.139:6826/3441375254,v1:172.21.15.139:6827/3441375254] exists,up df535157-a9a7-4de6-abb4-efe248039226 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.4 [2,11] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.10 [8,11] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.1 [4,9] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.1d [4,8] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.20 [5,9] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.24 [4,9] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.9 [5,8] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.10 [9,8] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.13 [9,10] 2024-04-26T20:22:33.520 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.18 [9,8] 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/3159671154 expires 2024-04-27T20:11:46.422113+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3236939866 expires 2024-04-27T20:11:46.422113+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/2488160347 expires 2024-04-27T20:11:11.001209+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/3159671154 expires 2024-04-27T20:11:46.422113+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1183753623 expires 2024-04-27T20:11:11.001209+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1310193659 expires 2024-04-27T20:11:46.422113+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3095457796 expires 2024-04-27T20:11:46.422113+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/2488160347 expires 2024-04-27T20:11:11.001209+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/539922460 expires 2024-04-27T20:11:11.001209+0000 2024-04-26T20:22:33.521 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1137290075 expires 2024-04-27T20:11:11.001209+0000 2024-04-26T20:22:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.519+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8480a3cd0 msgr2=0x7ff8480a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.519+0000 7ff86a800700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8480a3cd0 0x7ff8480a6190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009480 tx=0x7ff84c00b040 comp rx=0 tx=0).stop 2024-04-26T20:22:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.519+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 msgr2=0x7ff864103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.519+0000 7ff86a800700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864103870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b760 tx=0x7ff8540047b0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 shutdown_connections 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8480a3cd0 0x7ff8480a6190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff864109170 0x7ff864102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff864103f10 0x7ff864103870 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 --2- 172.21.15.82:0/3439632208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff864106840 0x7ff864101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 >> 172.21.15.82:0/3439632208 conn(0x7ff8640fd940 msgr2=0x7ff8641049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 shutdown_connections 2024-04-26T20:22:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:33.520+0000 7ff86a800700 1 -- 172.21.15.82:0/3439632208 wait complete. 2024-04-26T20:22:33.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:33 smithi082 ceph-mon[28105]: pgmap v404: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:33.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:33 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3439632208' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T20:22:34.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:33 smithi139 ceph-mon[32999]: pgmap v404: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:33 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3439632208' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T20:22:34.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:33 smithi135 ceph-mon[32816]: pgmap v404: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:34.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:33 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3439632208' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T20:22:34.348 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-26T20:22:34.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 -- 172.21.15.82:0/644239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 msgr2=0x7fd228102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 --2- 172.21.15.82:0/644239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd228102bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009900 tx=0x7fd21c02a410 comp rx=0 tx=0).stop 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 -- 172.21.15.82:0/644239574 shutdown_connections 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 --2- 172.21.15.82:0/644239574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228104340 0x7fd22810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 --2- 172.21.15.82:0/644239574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd228103980 0x7fd228103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 --2- 172.21.15.82:0/644239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd228102bb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 -- 172.21.15.82:0/644239574 >> 172.21.15.82:0/644239574 conn(0x7fd2280fdd00 msgr2=0x7fd228100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 -- 172.21.15.82:0/644239574 shutdown_connections 2024-04-26T20:22:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.567+0000 7fd22de00640 1 -- 172.21.15.82:0/644239574 wait complete. 2024-04-26T20:22:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 Processor -- start 2024-04-26T20:22:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 -- start start 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd22819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228103980 0x7fd22819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd228104340 0x7fd2281a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd22810e300 con 0x7fd228103980 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd22810e180 con 0x7fd228104340 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22de00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd22810e480 con 0x7fd228102790 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd22819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd228104340 0x7fd2281a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd22819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33728/0 (socket says 172.21.15.82:33728) 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd22ca00640 1 -- 172.21.15.82:0/2946026115 learned_addr learned my addr 172.21.15.82:0/2946026115 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.569+0000 7fd227e00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228103980 0x7fd22819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd22ca00640 1 -- 172.21.15.82:0/2946026115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd228104340 msgr2=0x7fd2281a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd22ca00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd228104340 0x7fd2281a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd22ca00640 1 -- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228103980 msgr2=0x7fd22819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd22ca00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228103980 0x7fd22819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd22ca00640 1 -- 172.21.15.82:0/2946026115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2281a2800 con 0x7fd228102790 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd227e00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228103980 0x7fd22819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.570+0000 7fd22ca00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd22819abe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd21c031500 tx=0x7fd21c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.574+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c03f070 con 0x7fd228102790 2024-04-26T20:22:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.574+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c031c50 con 0x7fd228102790 2024-04-26T20:22:34.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.574+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c035030 con 0x7fd228102790 2024-04-26T20:22:34.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.574+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2281a2a90 con 0x7fd228102790 2024-04-26T20:22:34.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.574+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2281a2f30 con 0x7fd228102790 2024-04-26T20:22:34.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.575+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2281a3100 con 0x7fd228102790 2024-04-26T20:22:34.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.577+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd21c042070 con 0x7fd228102790 2024-04-26T20:22:34.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.578+0000 7fd225600640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd2100a3cc0 0x7fd2100a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:34.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.578+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd21c0f1120 con 0x7fd228102790 2024-04-26T20:22:34.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.579+0000 7fd227e00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd2100a3cc0 0x7fd2100a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:34.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.579+0000 7fd227e00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd2100a3cc0 0x7fd2100a6180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd22819c0f0 tx=0x7fd214005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:34.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.583+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd21c0bd5e0 con 0x7fd228102790 2024-04-26T20:22:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.806+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2281a3490 con 0x7fd228102790 2024-04-26T20:22:34.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.808+0000 7fd225600640 1 -- 172.21.15.82:0/2946026115 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7fd21c0bcee0 con 0x7fd228102790 2024-04-26T20:22:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:34.809 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.810+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd2100a3cc0 msgr2=0x7fd2100a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.810+0000 7fd22de00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd2100a3cc0 0x7fd2100a6180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd22819c0f0 tx=0x7fd214005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.810+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 msgr2=0x7fd22819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.810+0000 7fd22de00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd22819abe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd21c031500 tx=0x7fd21c003c10 comp rx=0 tx=0).stop 2024-04-26T20:22:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 shutdown_connections 2024-04-26T20:22:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd2100a3cc0 0x7fd2100a6180 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd228104340 0x7fd2281a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd228103980 0x7fd22819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 --2- 172.21.15.82:0/2946026115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd228102790 0x7fd22819abe0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 >> 172.21.15.82:0/2946026115 conn(0x7fd2280fdd00 msgr2=0x7fd228074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 shutdown_connections 2024-04-26T20:22:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:34.811+0000 7fd22de00640 1 -- 172.21.15.82:0/2946026115 wait complete. 2024-04-26T20:22:34.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:22:34.832 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:22:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 -- 172.21.15.82:0/1120390943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0102980 msgr2=0x7f12e0102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 --2- 172.21.15.82:0/1120390943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0102980 0x7f12e0102da0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009900 tx=0x7f12d002a400 comp rx=0 tx=0).stop 2024-04-26T20:22:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 -- 172.21.15.82:0/1120390943 shutdown_connections 2024-04-26T20:22:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 --2- 172.21.15.82:0/1120390943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0104530 0x7f12e010adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 --2- 172.21.15.82:0/1120390943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0103b70 0x7f12e0103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 --2- 172.21.15.82:0/1120390943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0102980 0x7f12e0102da0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.017+0000 7f12e6600640 1 -- 172.21.15.82:0/1120390943 >> 172.21.15.82:0/1120390943 conn(0x7f12e00fdf10 msgr2=0x7f12e0100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.018+0000 7f12e6600640 1 -- 172.21.15.82:0/1120390943 shutdown_connections 2024-04-26T20:22:35.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.018+0000 7f12e6600640 1 -- 172.21.15.82:0/1120390943 wait complete. 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 Processor -- start 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 -- start start 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 0x7f12e00766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0103b70 0x7f12e0074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0104530 0x7f12e0075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12e010e4d0 con 0x7f12e0103b70 2024-04-26T20:22:35.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12e010e350 con 0x7f12e0102980 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12e6600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12e010e650 con 0x7f12e0104530 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12df400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 0x7f12e00766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.019+0000 7f12df400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 0x7f12e00766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45768/0 (socket says 172.21.15.82:45768) 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 -- 172.21.15.82:0/2058795728 learned_addr learned my addr 172.21.15.82:0/2058795728 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12dfe00640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0104530 0x7f12e0075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12dea00640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0103b70 0x7f12e0074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 -- 172.21.15.82:0/2058795728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0104530 msgr2=0x7f12e0075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0104530 0x7f12e0075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 -- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0103b70 msgr2=0x7f12e0074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0103b70 0x7f12e0074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 -- 172.21.15.82:0/2058795728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e0075af0 con 0x7f12e0102980 2024-04-26T20:22:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.020+0000 7f12df400640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 0x7f12e00766e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f12d0031500 tx=0x7f12d0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.021+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d003f070 con 0x7f12e0102980 2024-04-26T20:22:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.021+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d0031c50 con 0x7f12e0102980 2024-04-26T20:22:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.021+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0035030 con 0x7f12e0102980 2024-04-26T20:22:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.021+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e01a2c90 con 0x7f12e0102980 2024-04-26T20:22:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.021+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e01a3190 con 0x7f12e0102980 2024-04-26T20:22:35.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.022+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e0109d60 con 0x7f12e0102980 2024-04-26T20:22:35.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.024+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f12d0042070 con 0x7f12e0102980 2024-04-26T20:22:35.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.025+0000 7f12d7e00640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f12c40a3c40 0x7f12c40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.026+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f12d00f1700 con 0x7f12e0102980 2024-04-26T20:22:35.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.026+0000 7f12dea00640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f12c40a3c40 0x7f12c40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.027+0000 7f12dea00640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f12c40a3c40 0x7f12c40a6100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f12e0076450 tx=0x7f12cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:35.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.029+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f12d00bd570 con 0x7f12e0102980 2024-04-26T20:22:35.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:34 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:34 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:35.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:34 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:35.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.230+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f12e0063530 con 0x7f12e0102980 2024-04-26T20:22:35.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.231+0000 7f12d7e00640 1 -- 172.21.15.82:0/2058795728 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f12d00c1870 con 0x7f12e0102980 2024-04-26T20:22:35.232 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:35.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f12c40a3c40 msgr2=0x7f12c40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f12c40a3c40 0x7f12c40a6100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f12e0076450 tx=0x7f12cc005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 msgr2=0x7f12e00766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 0x7f12e00766e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f12d0031500 tx=0x7f12d0003c10 comp rx=0 tx=0).stop 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 shutdown_connections 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f12c40a3c40 0x7f12c40a6100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12e0104530 0x7f12e0075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0103b70 0x7f12e0074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 --2- 172.21.15.82:0/2058795728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12e0102980 0x7f12e00766e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 >> 172.21.15.82:0/2058795728 conn(0x7f12e00fdf10 msgr2=0x7f12e0106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 shutdown_connections 2024-04-26T20:22:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.235+0000 7f12e6600640 1 -- 172.21.15.82:0/2058795728 wait complete. 2024-04-26T20:22:35.264 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.462+0000 7f74ed400640 1 -- 172.21.15.82:0/3409970749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078ed0 msgr2=0x7f74e8079770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.462+0000 7f74ed400640 1 --2- 172.21.15.82:0/3409970749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078ed0 0x7f74e8079770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009ca0 tx=0x7f74e002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 -- 172.21.15.82:0/3409970749 shutdown_connections 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 --2- 172.21.15.82:0/3409970749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078ed0 0x7f74e8079770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 --2- 172.21.15.82:0/3409970749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078530 0x7f74e8078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 --2- 172.21.15.82:0/3409970749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 0x7f74e8077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 -- 172.21.15.82:0/3409970749 >> 172.21.15.82:0/3409970749 conn(0x7f74e8100120 msgr2=0x7f74e8102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 -- 172.21.15.82:0/3409970749 shutdown_connections 2024-04-26T20:22:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.463+0000 7f74ed400640 1 -- 172.21.15.82:0/3409970749 wait complete. 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 Processor -- start 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 -- start start 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 0x7f74e819f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078530 0x7f74e819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078ed0 0x7f74e81a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8114b30 con 0x7f74e8078ed0 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74e81149b0 con 0x7f74e8078530 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74ed400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8114cb0 con 0x7f74e80772f0 2024-04-26T20:22:35.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74e6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 0x7f74e819f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74e5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078530 0x7f74e819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74e7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078ed0 0x7f74e81a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74e6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 0x7f74e819f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33764/0 (socket says 172.21.15.82:33764) 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.464+0000 7f74e6800640 1 -- 172.21.15.82:0/3116777226 learned_addr learned my addr 172.21.15.82:0/3116777226 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e5e00640 1 -- 172.21.15.82:0/3116777226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 msgr2=0x7f74e819f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e5e00640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 0x7f74e819f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e5e00640 1 -- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078ed0 msgr2=0x7f74e81a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e5e00640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078ed0 0x7f74e81a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e5e00640 1 -- 172.21.15.82:0/3116777226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e81a6d70 con 0x7f74e8078530 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e7200640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078ed0 0x7f74e81a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.465+0000 7f74e5e00640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078530 0x7f74e819f690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74d400e9f0 tx=0x7f74d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.466+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d400ccc0 con 0x7f74e8078530 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.466+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d40108e0 con 0x7f74e8078530 2024-04-26T20:22:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.466+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4018880 con 0x7f74e8078530 2024-04-26T20:22:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.466+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e81a7060 con 0x7f74e8078530 2024-04-26T20:22:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.466+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e81a7560 con 0x7f74e8078530 2024-04-26T20:22:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.467+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e8111520 con 0x7f74e8078530 2024-04-26T20:22:35.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.470+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f74d4010430 con 0x7f74e8078530 2024-04-26T20:22:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.471+0000 7f74df400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f74cc0a3cc0 0x7f74cc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.471+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f74d40d0b60 con 0x7f74e8078530 2024-04-26T20:22:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.471+0000 7f74e6800640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f74cc0a3cc0 0x7f74cc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.472+0000 7f74e6800640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f74cc0a3cc0 0x7f74cc0a6180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009cd0 tx=0x7f74d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.475+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f74d409ca30 con 0x7f74e8078530 2024-04-26T20:22:35.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.686+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74e8063530 con 0x7f74e8078530 2024-04-26T20:22:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.686+0000 7f74df400640 1 -- 172.21.15.82:0/3116777226 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f74d40a0d30 con 0x7f74e8078530 2024-04-26T20:22:35.687 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f74cc0a3cc0 msgr2=0x7f74cc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f74cc0a3cc0 0x7f74cc0a6180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009cd0 tx=0x7f74d8005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078530 msgr2=0x7f74e819f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078530 0x7f74e819f690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74d400e9f0 tx=0x7f74d400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 shutdown_connections 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f74cc0a3cc0 0x7f74cc0a6180 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e8078ed0 0x7f74e81a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e8078530 0x7f74e819f690 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 --2- 172.21.15.82:0/3116777226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e80772f0 0x7f74e819f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 >> 172.21.15.82:0/3116777226 conn(0x7f74e8100120 msgr2=0x7f74e8101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 shutdown_connections 2024-04-26T20:22:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.689+0000 7f74ed400640 1 -- 172.21.15.82:0/3116777226 wait complete. 2024-04-26T20:22:35.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 -- 172.21.15.82:0/2159273208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60102770 msgr2=0x7fea60102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 --2- 172.21.15.82:0/2159273208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60102770 0x7fea60102b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fea58009900 tx=0x7fea5802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 -- 172.21.15.82:0/2159273208 shutdown_connections 2024-04-26T20:22:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 --2- 172.21.15.82:0/2159273208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60104320 0x7fea6010abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 --2- 172.21.15.82:0/2159273208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea60103960 0x7fea60103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 --2- 172.21.15.82:0/2159273208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60102770 0x7fea60102b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 -- 172.21.15.82:0/2159273208 >> 172.21.15.82:0/2159273208 conn(0x7fea600fdce0 msgr2=0x7fea60100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.887+0000 7fea67000640 1 -- 172.21.15.82:0/2159273208 shutdown_connections 2024-04-26T20:22:35.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.888+0000 7fea67000640 1 -- 172.21.15.82:0/2159273208 wait complete. 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.888+0000 7fea67000640 1 Processor -- start 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 -- start start 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 0x7fea6019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea60103960 0x7fea6019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60104320 0x7fea601a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea6010e2c0 con 0x7fea60103960 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea6010e140 con 0x7fea60102770 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea67000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea6010e440 con 0x7fea60104320 2024-04-26T20:22:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 0x7fea6019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 0x7fea6019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45806/0 (socket says 172.21.15.82:45806) 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 -- 172.21.15.82:0/3819810294 learned_addr learned my addr 172.21.15.82:0/3819810294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65200640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea60103960 0x7fea6019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea66600640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60104320 0x7fea601a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 -- 172.21.15.82:0/3819810294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60104320 msgr2=0x7fea601a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60104320 0x7fea601a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 -- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea60103960 msgr2=0x7fea6019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea60103960 0x7fea6019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.889+0000 7fea65c00640 1 -- 172.21.15.82:0/3819810294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea601a2830 con 0x7fea60102770 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.890+0000 7fea65c00640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 0x7fea6019ac20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea58031500 tx=0x7fea58003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.890+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5803f070 con 0x7fea60102770 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.890+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea601a2ac0 con 0x7fea60102770 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.890+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea58031c50 con 0x7fea60102770 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.890+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58035030 con 0x7fea60102770 2024-04-26T20:22:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.890+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea601a2fb0 con 0x7fea60102770 2024-04-26T20:22:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.891+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea601a3180 con 0x7fea60102770 2024-04-26T20:22:35.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.893+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fea58042070 con 0x7fea60102770 2024-04-26T20:22:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.894+0000 7fea5e000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea440a3c40 0x7fea440a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.895+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fea580f1790 con 0x7fea60102770 2024-04-26T20:22:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.895+0000 7fea65200640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea440a3c40 0x7fea440a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.895+0000 7fea65200640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea440a3c40 0x7fea440a6100 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fea4c005fd0 tx=0x7fea4c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:35.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:35.897+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fea580bd600 con 0x7fea60102770 2024-04-26T20:22:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:35 smithi139 ceph-mon[32999]: pgmap v405: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:35 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2946026115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:35 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:35 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2058795728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:35 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3116777226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.101+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fea601a3350 con 0x7fea60102770 2024-04-26T20:22:36.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.102+0000 7fea5e000640 1 -- 172.21.15.82:0/3819810294 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fea580c1900 con 0x7fea60102770 2024-04-26T20:22:36.103 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:36.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea440a3c40 msgr2=0x7fea440a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea440a3c40 0x7fea440a6100 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fea4c005fd0 tx=0x7fea4c009500 comp rx=0 tx=0).stop 2024-04-26T20:22:36.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 msgr2=0x7fea6019ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 0x7fea6019ac20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea58031500 tx=0x7fea58003c10 comp rx=0 tx=0).stop 2024-04-26T20:22:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 shutdown_connections 2024-04-26T20:22:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea440a3c40 0x7fea440a6100 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60104320 0x7fea601a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea60103960 0x7fea6019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 --2- 172.21.15.82:0/3819810294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea60102770 0x7fea6019ac20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.104+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 >> 172.21.15.82:0/3819810294 conn(0x7fea600fdce0 msgr2=0x7fea60074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.105+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 shutdown_connections 2024-04-26T20:22:36.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.105+0000 7fea67000640 1 -- 172.21.15.82:0/3819810294 wait complete. 2024-04-26T20:22:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:35 smithi135 ceph-mon[32816]: pgmap v405: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:35 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2946026115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:35 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:35 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2058795728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:35 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3116777226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:35 smithi082 ceph-mon[28105]: pgmap v405: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:36.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2946026115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:36.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:35 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2058795728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:35 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3116777226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.126 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:36.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.324+0000 7f7f9e800640 1 -- 172.21.15.82:0/1408526007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98104520 msgr2=0x7f7f9810adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.324+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1408526007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98104520 0x7f7f9810adb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009ca0 tx=0x7f7f9002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 -- 172.21.15.82:0/1408526007 shutdown_connections 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1408526007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98104520 0x7f7f9810adb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1408526007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98103b60 0x7f7f98103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1408526007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f98102970 0x7f7f98102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 -- 172.21.15.82:0/1408526007 >> 172.21.15.82:0/1408526007 conn(0x7f7f980fdee0 msgr2=0x7f7f98100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 -- 172.21.15.82:0/1408526007 shutdown_connections 2024-04-26T20:22:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.325+0000 7f7f9e800640 1 -- 172.21.15.82:0/1408526007 wait complete. 2024-04-26T20:22:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 Processor -- start 2024-04-26T20:22:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 -- start start 2024-04-26T20:22:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 0x7f7f9819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98103b60 0x7f7f9819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f98104520 0x7f7f981a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9810e4d0 con 0x7f7f98103b60 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.326+0000 7f7f9e800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9810e350 con 0x7f7f98104520 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f9e800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9810e650 con 0x7f7f98102970 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 0x7f7f9819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f96a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98103b60 0x7f7f9819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 0x7f7f9819adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33790/0 (socket says 172.21.15.82:33790) 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 -- 172.21.15.82:0/1778348365 learned_addr learned my addr 172.21.15.82:0/1778348365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97e00640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f98104520 0x7f7f981a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 -- 172.21.15.82:0/1778348365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f98104520 msgr2=0x7f7f981a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f98104520 0x7f7f981a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 -- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98103b60 msgr2=0x7f7f9819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98103b60 0x7f7f9819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.327+0000 7f7f97400640 1 -- 172.21.15.82:0/1778348365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f981a2980 con 0x7f7f98102970 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.328+0000 7f7f97400640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 0x7f7f9819adb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e9c0 tx=0x7f7f8800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.328+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800cd80 con 0x7f7f98102970 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.328+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f880035f0 con 0x7f7f98102970 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.328+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f981a2c70 con 0x7f7f98102970 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.328+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88010690 con 0x7f7f98102970 2024-04-26T20:22:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.328+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f981a31c0 con 0x7f7f98102970 2024-04-26T20:22:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.329+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f981a33f0 con 0x7f7f98102970 2024-04-26T20:22:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.331+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7f880037a0 con 0x7f7f98102970 2024-04-26T20:22:36.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.332+0000 7f7f8fe00640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f7c0a3c40 0x7f7f7c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.332+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7f880d0cb0 con 0x7f7f98102970 2024-04-26T20:22:36.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.333+0000 7f7f96a00640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f7c0a3c40 0x7f7f7c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.333+0000 7f7f96a00640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f7c0a3c40 0x7f7f7c0a6100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f840095f0 tx=0x7f7f84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:36.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.336+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7f8809d170 con 0x7f7f98102970 2024-04-26T20:22:36.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.540+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7f981a35c0 con 0x7f7f98102970 2024-04-26T20:22:36.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.541+0000 7f7f8fe00640 1 -- 172.21.15.82:0/1778348365 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f7f8809ca70 con 0x7f7f98102970 2024-04-26T20:22:36.541 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:36.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f7c0a3c40 msgr2=0x7f7f7c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f7c0a3c40 0x7f7f7c0a6100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f840095f0 tx=0x7f7f84005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:36.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 msgr2=0x7f7f9819adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 0x7f7f9819adb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e9c0 tx=0x7f7f8800ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 shutdown_connections 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7f7c0a3c40 0x7f7f7c0a6100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f98104520 0x7f7f981a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f98103b60 0x7f7f9819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 --2- 172.21.15.82:0/1778348365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f98102970 0x7f7f9819adb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 >> 172.21.15.82:0/1778348365 conn(0x7f7f980fdee0 msgr2=0x7f7f98109380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 shutdown_connections 2024-04-26T20:22:36.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.544+0000 7f7f9e800640 1 -- 172.21.15.82:0/1778348365 wait complete. 2024-04-26T20:22:36.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 -- 172.21.15.82:0/953853222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41019a0 msgr2=0x7f2ef4101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 --2- 172.21.15.82:0/953853222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41019a0 0x7f2ef4101e00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009860 tx=0x7f2ee002a340 comp rx=0 tx=0).stop 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 -- 172.21.15.82:0/953853222 shutdown_connections 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 --2- 172.21.15.82:0/953853222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef4102340 0x7f2ef41027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 --2- 172.21.15.82:0/953853222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef41019a0 0x7f2ef4101e00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 --2- 172.21.15.82:0/953853222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef4101040 0x7f2ef4101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 -- 172.21.15.82:0/953853222 >> 172.21.15.82:0/953853222 conn(0x7f2ef40fcbc0 msgr2=0x7f2ef40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 -- 172.21.15.82:0/953853222 shutdown_connections 2024-04-26T20:22:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.766+0000 7f2efac00640 1 -- 172.21.15.82:0/953853222 wait complete. 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.767+0000 7f2efac00640 1 Processor -- start 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 -- start start 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef4101040 0x7f2ef419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 0x7f2ef419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef4102340 0x7f2ef41a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef4110460 con 0x7f2ef4101040 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41102e0 con 0x7f2ef4102340 2024-04-26T20:22:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2efac00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41105e0 con 0x7f2ef41019a0 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2ef9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef4101040 0x7f2ef419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2ef8e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 0x7f2ef419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2ef8e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 0x7f2ef419b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33810/0 (socket says 172.21.15.82:33810) 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2ef9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef4101040 0x7f2ef419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52942/0 (socket says 172.21.15.82:52942) 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.768+0000 7f2ef8e00640 1 -- 172.21.15.82:0/3489381571 learned_addr learned my addr 172.21.15.82:0/3489381571 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2efa200640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef4102340 0x7f2ef41a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef8e00640 1 -- 172.21.15.82:0/3489381571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef4102340 msgr2=0x7f2ef41a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef8e00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef4102340 0x7f2ef41a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef8e00640 1 -- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef4101040 msgr2=0x7f2ef419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef8e00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef4101040 0x7f2ef419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef8e00640 1 -- 172.21.15.82:0/3489381571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef41a27c0 con 0x7f2ef41019a0 2024-04-26T20:22:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef8e00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 0x7f2ef419b130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00057c0 tx=0x7f2ee0032da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.769+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0037040 con 0x7f2ef41019a0 2024-04-26T20:22:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.770+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee0030bd0 con 0x7f2ef41019a0 2024-04-26T20:22:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.770+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef41a2a50 con 0x7f2ef41019a0 2024-04-26T20:22:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.770+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0005280 con 0x7f2ef41019a0 2024-04-26T20:22:36.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.770+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef41a2f30 con 0x7f2ef41019a0 2024-04-26T20:22:36.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.771+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef410bd90 con 0x7f2ef41019a0 2024-04-26T20:22:36.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.773+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2ee0043020 con 0x7f2ef41019a0 2024-04-26T20:22:36.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.774+0000 7f2ef2000640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2edc0a3cc0 0x7f2edc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:36.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.774+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2ee00efd40 con 0x7f2ef41019a0 2024-04-26T20:22:36.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.774+0000 7f2ef9800640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2edc0a3cc0 0x7f2edc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:36.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.775+0000 7f2ef9800640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2edc0a3cc0 0x7f2edc0a6180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80095f0 tx=0x7f2ee8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:36.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:36.778+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2ee00bc310 con 0x7f2ef41019a0 2024-04-26T20:22:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:36 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3819810294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:36 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:36 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:36 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:36 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:36 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1778348365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:37.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.032+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ef4063530 con 0x7f2ef41019a0 2024-04-26T20:22:37.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.033+0000 7f2ef2000640 1 -- 172.21.15.82:0/3489381571 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11951 (secure 0 0 0) 0x7f2ee00bbc10 con 0x7f2ef41019a0 2024-04-26T20:22:37.034 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:37.034 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:20:20.191502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:22:37.034 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:22:37.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2edc0a3cc0 msgr2=0x7f2edc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2edc0a3cc0 0x7f2edc0a6180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80095f0 tx=0x7f2ee8005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:37.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 msgr2=0x7f2ef419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 0x7f2ef419b130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00057c0 tx=0x7f2ee0032da0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 shutdown_connections 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2edc0a3cc0 0x7f2edc0a6180 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef4102340 0x7f2ef41a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef41019a0 0x7f2ef419b130 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 --2- 172.21.15.82:0/3489381571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ef4101040 0x7f2ef419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 >> 172.21.15.82:0/3489381571 conn(0x7f2ef40fcbc0 msgr2=0x7f2ef40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 shutdown_connections 2024-04-26T20:22:37.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.037+0000 7f2efac00640 1 -- 172.21.15.82:0/3489381571 wait complete. 2024-04-26T20:22:37.058 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:37.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:36 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3819810294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:36 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:36 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:36 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:36 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:36 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1778348365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:36 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3819810294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:36 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:36 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:36 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:36 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:36 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1778348365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:37.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 -- 172.21.15.82:0/2417565998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b4109f80 msgr2=0x7f67b410a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2417565998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b4109f80 0x7f67b410a400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009860 tx=0x7f67a002a340 comp rx=0 tx=0).stop 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 -- 172.21.15.82:0/2417565998 shutdown_connections 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2417565998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b410a940 0x7f67b41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2417565998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b4109f80 0x7f67b410a400 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2417565998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b41091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 -- 172.21.15.82:0/2417565998 >> 172.21.15.82:0/2417565998 conn(0x7f67b4077d30 msgr2=0x7f67b407a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 -- 172.21.15.82:0/2417565998 shutdown_connections 2024-04-26T20:22:37.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.236+0000 7f67b3e00640 1 -- 172.21.15.82:0/2417565998 wait complete. 2024-04-26T20:22:37.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.237+0000 7f67b3e00640 1 Processor -- start 2024-04-26T20:22:37.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 -- start start 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b4109f80 0x7f67b419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b410a940 0x7f67b41a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67b41148c0 con 0x7f67b4109f80 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67b4114740 con 0x7f67b410a940 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f67b4114a40 con 0x7f67b4108d90 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b4109f80 0x7f67b419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33828/0 (socket says 172.21.15.82:33828) 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b2a00640 1 -- 172.21.15.82:0/2763131043 learned_addr learned my addr 172.21.15.82:0/2763131043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.238+0000 7f67b3400640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b410a940 0x7f67b41a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b2a00640 1 -- 172.21.15.82:0/2763131043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b410a940 msgr2=0x7f67b41a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b2a00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b410a940 0x7f67b41a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b2a00640 1 -- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b4109f80 msgr2=0x7f67b419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b2a00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b4109f80 0x7f67b419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b2a00640 1 -- 172.21.15.82:0/2763131043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b41a6b90 con 0x7f67b4108d90 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b2a00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b419ef70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67a400e9c0 tx=0x7f67a400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a400cd80 con 0x7f67b4108d90 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a40035f0 con 0x7f67b4108d90 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4010690 con 0x7f67b4108d90 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.239+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b41a6e80 con 0x7f67b4108d90 2024-04-26T20:22:37.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.240+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b41a7290 con 0x7f67b4108d90 2024-04-26T20:22:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.241+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4110130 con 0x7f67b4108d90 2024-04-26T20:22:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.243+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f67a4004000 con 0x7f67b4108d90 2024-04-26T20:22:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.244+0000 7f67b8a00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f67980a3c40 0x7f67980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.245+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f67a40d0e30 con 0x7f67b4108d90 2024-04-26T20:22:37.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.245+0000 7f67b2000640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f67980a3c40 0x7f67980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.246+0000 7f67b2000640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f67980a3c40 0x7f67980a6100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f67a0000c00 tx=0x7f67a0030470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:37.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.248+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f67a409d2f0 con 0x7f67b4108d90 2024-04-26T20:22:37.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.460+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67b402dce0 con 0x7f67b4108d90 2024-04-26T20:22:37.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.463+0000 7f67b8a00640 1 -- 172.21.15.82:0/2763131043 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f67a409cbf0 con 0x7f67b4108d90 2024-04-26T20:22:37.464 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:37.464 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f67980a3c40 msgr2=0x7f67980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f67980a3c40 0x7f67980a6100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f67a0000c00 tx=0x7f67a0030470 comp rx=0 tx=0).stop 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 msgr2=0x7f67b419ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b419ef70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67a400e9c0 tx=0x7f67a400ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 shutdown_connections 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f67980a3c40 0x7f67980a6100 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67b410a940 0x7f67b41a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b4109f80 0x7f67b419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 --2- 172.21.15.82:0/2763131043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67b4108d90 0x7f67b419ef70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.465+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 >> 172.21.15.82:0/2763131043 conn(0x7f67b4077d30 msgr2=0x7f67b410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:37.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.466+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 shutdown_connections 2024-04-26T20:22:37.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.466+0000 7f67b3e00640 1 -- 172.21.15.82:0/2763131043 wait complete. 2024-04-26T20:22:37.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:22:37.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:22:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.664+0000 7fea56e00640 1 -- 172.21.15.82:0/885531915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50104b70 msgr2=0x7fea50104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.664+0000 7fea56e00640 1 --2- 172.21.15.82:0/885531915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50104b70 0x7fea50104f90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea40009900 tx=0x7fea4002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 -- 172.21.15.82:0/885531915 shutdown_connections 2024-04-26T20:22:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 --2- 172.21.15.82:0/885531915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50106720 0x7fea5010cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 --2- 172.21.15.82:0/885531915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea50105d60 0x7fea501061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 --2- 172.21.15.82:0/885531915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50104b70 0x7fea50104f90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 -- 172.21.15.82:0/885531915 >> 172.21.15.82:0/885531915 conn(0x7fea501000e0 msgr2=0x7fea50102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 -- 172.21.15.82:0/885531915 shutdown_connections 2024-04-26T20:22:37.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.665+0000 7fea56e00640 1 -- 172.21.15.82:0/885531915 wait complete. 2024-04-26T20:22:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 Processor -- start 2024-04-26T20:22:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 -- start start 2024-04-26T20:22:37.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea50104b70 0x7fea5019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 0x7fea5019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50106720 0x7fea501a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea501106a0 con 0x7fea50106720 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea50110520 con 0x7fea50104b70 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea56e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea50110820 con 0x7fea50105d60 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea4f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 0x7fea5019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea54e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50106720 0x7fea501a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea4f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 0x7fea5019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33854/0 (socket says 172.21.15.82:33854) 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea4f400640 1 -- 172.21.15.82:0/3036386929 learned_addr learned my addr 172.21.15.82:0/3036386929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.666+0000 7fea4fe00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea50104b70 0x7fea5019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.667+0000 7fea4f400640 1 -- 172.21.15.82:0/3036386929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea50104b70 msgr2=0x7fea5019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.667+0000 7fea4f400640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea50104b70 0x7fea5019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.667+0000 7fea4f400640 1 -- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50106720 msgr2=0x7fea501a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.667+0000 7fea4f400640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50106720 0x7fea501a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.667+0000 7fea4f400640 1 -- 172.21.15.82:0/3036386929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea501a2a20 con 0x7fea50105d60 2024-04-26T20:22:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.667+0000 7fea4f400640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 0x7fea5019b390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00e9f0 tx=0x7fea3c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:37.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.668+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00cd80 con 0x7fea50105d60 2024-04-26T20:22:37.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.668+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea3c0108e0 con 0x7fea50105d60 2024-04-26T20:22:37.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.668+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea501a2d10 con 0x7fea50105d60 2024-04-26T20:22:37.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.668+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c018980 con 0x7fea50105d60 2024-04-26T20:22:37.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.668+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea501a3250 con 0x7fea50105d60 2024-04-26T20:22:37.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.669+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5010bfb0 con 0x7fea50105d60 2024-04-26T20:22:37.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.671+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fea3c010430 con 0x7fea50105d60 2024-04-26T20:22:37.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.673+0000 7fea4cc00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea340a3cc0 0x7fea340a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:37.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.673+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fea3c0d0e20 con 0x7fea50105d60 2024-04-26T20:22:37.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.673+0000 7fea4fe00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea340a3cc0 0x7fea340a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:37.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.674+0000 7fea4fe00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea340a3cc0 0x7fea340a6180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fea40009230 tx=0x7fea400314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:37.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.674+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fea3c09cc90 con 0x7fea50105d60 2024-04-26T20:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.883+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea5002dd20 con 0x7fea50105d60 2024-04-26T20:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.884+0000 7fea4cc00640 1 -- 172.21.15.82:0/3036386929 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fea3c0a0f90 con 0x7fea50105d60 2024-04-26T20:22:37.885 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.886+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea340a3cc0 msgr2=0x7fea340a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.886+0000 7fea56e00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea340a3cc0 0x7fea340a6180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fea40009230 tx=0x7fea400314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.886+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 msgr2=0x7fea5019b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.886+0000 7fea56e00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 0x7fea5019b390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00e9f0 tx=0x7fea3c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.886+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 shutdown_connections 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea340a3cc0 0x7fea340a6180 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea50106720 0x7fea501a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea50105d60 0x7fea5019b390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 --2- 172.21.15.82:0/3036386929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea50104b70 0x7fea5019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 >> 172.21.15.82:0/3036386929 conn(0x7fea501000e0 msgr2=0x7fea50109180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 shutdown_connections 2024-04-26T20:22:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:37.887+0000 7fea56e00640 1 -- 172.21.15.82:0/3036386929 wait complete. 2024-04-26T20:22:37.907 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:37.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:37 smithi082 ceph-mon[28105]: pgmap v406: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:37.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:37 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3489381571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:37.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:37 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2763131043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:37.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:37.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:37 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:37 smithi139 ceph-mon[32999]: pgmap v406: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:37 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3489381571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:37 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2763131043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:37 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:37 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 -- 172.21.15.82:0/2465143864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00105c60 msgr2=0x7ffa001060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2465143864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00105c60 0x7ffa001060e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009860 tx=0x7ff9e802a340 comp rx=0 tx=0).stop 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 -- 172.21.15.82:0/2465143864 shutdown_connections 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2465143864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00106620 0x7ffa0010ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2465143864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00105c60 0x7ffa001060e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2465143864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00104a70 0x7ffa00104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 -- 172.21.15.82:0/2465143864 >> 172.21.15.82:0/2465143864 conn(0x7ffa000fffe0 msgr2=0x7ffa00102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 -- 172.21.15.82:0/2465143864 shutdown_connections 2024-04-26T20:22:38.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.091+0000 7ff9ff200640 1 -- 172.21.15.82:0/2465143864 wait complete. 2024-04-26T20:22:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.092+0000 7ff9ff200640 1 Processor -- start 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.092+0000 7ff9ff200640 1 -- start start 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.092+0000 7ff9ff200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00104a70 0x7ffa0019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9ff200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 0x7ffa0019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9ff200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00106620 0x7ffa001a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9ff200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001105a0 con 0x7ffa00104a70 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9ff200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00110420 con 0x7ffa00105c60 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9ff200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00110720 con 0x7ffa00106620 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 0x7ffa0019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9fde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00104a70 0x7ffa0019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 0x7ffa0019b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45916/0 (socket says 172.21.15.82:45916) 2024-04-26T20:22:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 -- 172.21.15.82:0/2894836315 learned_addr learned my addr 172.21.15.82:0/2894836315 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9fe800640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00106620 0x7ffa001a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 -- 172.21.15.82:0/2894836315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00106620 msgr2=0x7ffa001a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00106620 0x7ffa001a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 -- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00104a70 msgr2=0x7ffa0019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00104a70 0x7ffa0019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.093+0000 7ff9f7e00640 1 -- 172.21.15.82:0/2894836315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa001a28c0 con 0x7ffa00105c60 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.094+0000 7ff9f7e00640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 0x7ffa0019b1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005940 tx=0x7ff9e802ae20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.094+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8040020 con 0x7ffa00105c60 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.094+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa001a2b50 con 0x7ffa00105c60 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.094+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8030e50 con 0x7ffa00105c60 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.094+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8037040 con 0x7ffa00105c60 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.094+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa001a3090 con 0x7ffa00105c60 2024-04-26T20:22:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.096+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0010be10 con 0x7ffa00105c60 2024-04-26T20:22:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.098+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff9e8043020 con 0x7ffa00105c60 2024-04-26T20:22:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.099+0000 7ff9f6a00640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3cc0 0x7ff9e00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.099+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff9e80f0480 con 0x7ffa00105c60 2024-04-26T20:22:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.099+0000 7ff9fde00640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3cc0 0x7ff9e00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.100+0000 7ff9fde00640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3cc0 0x7ff9e00a6180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffa0019bb50 tx=0x7ff9f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.103+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff9e804a020 con 0x7ffa00105c60 2024-04-26T20:22:38.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:37 smithi135 ceph-mon[32816]: pgmap v406: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:38.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:37 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3489381571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:38.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:37 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2763131043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:38.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:37 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:38.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:37 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.303+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffa0002dcf0 con 0x7ffa00105c60 2024-04-26T20:22:38.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.304+0000 7ff9f6a00640 1 -- 172.21.15.82:0/2894836315 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7ff9e80bcab0 con 0x7ffa00105c60 2024-04-26T20:22:38.304 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3cc0 msgr2=0x7ff9e00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3cc0 0x7ff9e00a6180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffa0019bb50 tx=0x7ff9f0009260 comp rx=0 tx=0).stop 2024-04-26T20:22:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 msgr2=0x7ffa0019b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 0x7ffa0019b1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005940 tx=0x7ff9e802ae20 comp rx=0 tx=0).stop 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 shutdown_connections 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff9e00a3cc0 0x7ff9e00a6180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa00106620 0x7ffa001a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa00105c60 0x7ffa0019b1c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 --2- 172.21.15.82:0/2894836315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00104a70 0x7ffa0019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.306+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 >> 172.21.15.82:0/2894836315 conn(0x7ffa000fffe0 msgr2=0x7ffa00108fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.307+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 shutdown_connections 2024-04-26T20:22:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.307+0000 7ff9ff200640 1 -- 172.21.15.82:0/2894836315 wait complete. 2024-04-26T20:22:38.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 -- 172.21.15.82:0/4193492827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050102960 msgr2=0x7f9050102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 --2- 172.21.15.82:0/4193492827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050102960 0x7f9050102d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9044009860 tx=0x7f904402a340 comp rx=0 tx=0).stop 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 -- 172.21.15.82:0/4193492827 shutdown_connections 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 --2- 172.21.15.82:0/4193492827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9050104510 0x7f905010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 --2- 172.21.15.82:0/4193492827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050103b50 0x7f9050103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 --2- 172.21.15.82:0/4193492827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050102960 0x7f9050102d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 -- 172.21.15.82:0/4193492827 >> 172.21.15.82:0/4193492827 conn(0x7f90500fdef0 msgr2=0x7f9050100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 -- 172.21.15.82:0/4193492827 shutdown_connections 2024-04-26T20:22:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.495+0000 7f9057a00640 1 -- 172.21.15.82:0/4193492827 wait complete. 2024-04-26T20:22:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 Processor -- start 2024-04-26T20:22:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 -- start start 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 0x7f9050198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050103b50 0x7f9050199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9050104510 0x7f90501a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f905010e460 con 0x7f9050102960 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f905010e2e0 con 0x7f9050104510 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.496+0000 7f9057a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f905010e5e0 con 0x7f9050103b50 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 0x7f9050198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 0x7f9050198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53006/0 (socket says 172.21.15.82:53006) 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 -- 172.21.15.82:0/3906631402 learned_addr learned my addr 172.21.15.82:0/3906631402 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f904fe00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050103b50 0x7f9050199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9050104510 0x7f90501a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 -- 172.21.15.82:0/3906631402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050103b50 msgr2=0x7f9050199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050103b50 0x7f9050199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 -- 172.21.15.82:0/3906631402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9050104510 msgr2=0x7f90501a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9050104510 0x7f90501a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 -- 172.21.15.82:0/3906631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90501a07f0 con 0x7f9050102960 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.497+0000 7f9055000640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 0x7f9050198bd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f90440057c0 tx=0x7f9044032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.498+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044037040 con 0x7f9050102960 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.498+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9044030cd0 con 0x7f9050102960 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.498+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90501a0a80 con 0x7f9050102960 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.498+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044005310 con 0x7f9050102960 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.498+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90501a0f10 con 0x7f9050102960 2024-04-26T20:22:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.499+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9050109df0 con 0x7f9050102960 2024-04-26T20:22:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.501+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9044043020 con 0x7f9050102960 2024-04-26T20:22:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.502+0000 7f904d600640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90380a3c40 0x7f90380a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.503+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f90440effe0 con 0x7f9050102960 2024-04-26T20:22:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.503+0000 7f904fe00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90380a3c40 0x7f90380a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.504+0000 7f904fe00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90380a3c40 0x7f90380a6100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f905019a0e0 tx=0x7f903c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.511+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f90440bc5d0 con 0x7f9050102960 2024-04-26T20:22:38.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.709+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f905002dd20 con 0x7f9050102960 2024-04-26T20:22:38.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.709+0000 7f904d600640 1 -- 172.21.15.82:0/3906631402 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f90440bbed0 con 0x7f9050102960 2024-04-26T20:22:38.710 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90380a3c40 msgr2=0x7f90380a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90380a3c40 0x7f90380a6100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f905019a0e0 tx=0x7f903c009260 comp rx=0 tx=0).stop 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 msgr2=0x7f9050198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 0x7f9050198bd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f90440057c0 tx=0x7f9044032eb0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 shutdown_connections 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90380a3c40 0x7f90380a6100 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9050104510 0x7f90501a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9050103b50 0x7f9050199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 --2- 172.21.15.82:0/3906631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9050102960 0x7f9050198bd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 >> 172.21.15.82:0/3906631402 conn(0x7f90500fdef0 msgr2=0x7f9050106fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 shutdown_connections 2024-04-26T20:22:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.712+0000 7f9057a00640 1 -- 172.21.15.82:0/3906631402 wait complete. 2024-04-26T20:22:38.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 -- 172.21.15.82:0/213027817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098106740 msgr2=0x7fd09810cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 --2- 172.21.15.82:0/213027817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098106740 0x7fd09810cfd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd090009ca0 tx=0x7fd09002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 -- 172.21.15.82:0/213027817 shutdown_connections 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 --2- 172.21.15.82:0/213027817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098106740 0x7fd09810cfd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 --2- 172.21.15.82:0/213027817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd098105d80 0x7fd098106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 --2- 172.21.15.82:0/213027817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098104b90 0x7fd098104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 -- 172.21.15.82:0/213027817 >> 172.21.15.82:0/213027817 conn(0x7fd0981000e0 msgr2=0x7fd098102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 -- 172.21.15.82:0/213027817 shutdown_connections 2024-04-26T20:22:38.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.918+0000 7fd09da00640 1 -- 172.21.15.82:0/213027817 wait complete. 2024-04-26T20:22:38.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.919+0000 7fd09da00640 1 Processor -- start 2024-04-26T20:22:38.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.919+0000 7fd09da00640 1 -- start start 2024-04-26T20:22:38.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd09da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098104b90 0x7fd09819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd09da00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 0x7fd09819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd09da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd098106740 0x7fd0981a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd09da00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd0981106c0 con 0x7fd098106740 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd09da00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd098110540 con 0x7fd098104b90 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd09da00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd098110840 con 0x7fd098105d80 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd096000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 0x7fd09819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd097400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd098106740 0x7fd0981a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd096000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 0x7fd09819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33906/0 (socket says 172.21.15.82:33906) 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd096000640 1 -- 172.21.15.82:0/1074475580 learned_addr learned my addr 172.21.15.82:0/1074475580 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.920+0000 7fd096a00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098104b90 0x7fd09819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd096000640 1 -- 172.21.15.82:0/1074475580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098104b90 msgr2=0x7fd09819adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd096000640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098104b90 0x7fd09819adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd096000640 1 -- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd098106740 msgr2=0x7fd0981a2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd096000640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd098106740 0x7fd0981a2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd096000640 1 -- 172.21.15.82:0/1074475580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0981a29c0 con 0x7fd098105d80 2024-04-26T20:22:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd096000640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 0x7fd09819b2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd08400ea60 tx=0x7fd08400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08400cde0 con 0x7fd098105d80 2024-04-26T20:22:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0840035f0 con 0x7fd098105d80 2024-04-26T20:22:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0981a2cb0 con 0x7fd098105d80 2024-04-26T20:22:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084010690 con 0x7fd098105d80 2024-04-26T20:22:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.921+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0981a31b0 con 0x7fd098105d80 2024-04-26T20:22:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.923+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09810bf00 con 0x7fd098105d80 2024-04-26T20:22:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.925+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd0840037a0 con 0x7fd098105d80 2024-04-26T20:22:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.926+0000 7fd08f400640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd07c0a3c40 0x7fd07c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.927+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd0840d0e00 con 0x7fd098105d80 2024-04-26T20:22:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.927+0000 7fd096a00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd07c0a3c40 0x7fd07c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.928+0000 7fd096a00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd07c0a3c40 0x7fd07c0a6100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd09819c280 tx=0x7fd088005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:38.928+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fd08409d2c0 con 0x7fd098105d80 2024-04-26T20:22:39.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3036386929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2894836315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3906631402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3036386929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2894836315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3906631402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3036386929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2894836315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3906631402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.145+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd09802dad0 con 0x7fd098105d80 2024-04-26T20:22:39.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.146+0000 7fd08f400640 1 -- 172.21.15.82:0/1074475580 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fd08409cbc0 con 0x7fd098105d80 2024-04-26T20:22:39.146 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd07c0a3c40 msgr2=0x7fd07c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd07c0a3c40 0x7fd07c0a6100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd09819c280 tx=0x7fd088005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 msgr2=0x7fd09819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 0x7fd09819b2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd08400ea60 tx=0x7fd08400ef20 comp rx=0 tx=0).stop 2024-04-26T20:22:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 shutdown_connections 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd07c0a3c40 0x7fd07c0a6100 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd098106740 0x7fd0981a2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd098105d80 0x7fd09819b2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 --2- 172.21.15.82:0/1074475580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd098104b90 0x7fd09819adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 >> 172.21.15.82:0/1074475580 conn(0x7fd0981000e0 msgr2=0x7fd0981090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 shutdown_connections 2024-04-26T20:22:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.149+0000 7fd09da00640 1 -- 172.21.15.82:0/1074475580 wait complete. 2024-04-26T20:22:39.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:39.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 -- 172.21.15.82:0/3556079363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8104300 msgr2=0x7f2cd810ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 --2- 172.21.15.82:0/3556079363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8104300 0x7f2cd810ab90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009ca0 tx=0x7f2cd002a8b0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 -- 172.21.15.82:0/3556079363 shutdown_connections 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 --2- 172.21.15.82:0/3556079363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8104300 0x7f2cd810ab90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 --2- 172.21.15.82:0/3556079363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8103940 0x7f2cd8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 --2- 172.21.15.82:0/3556079363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd8102750 0x7f2cd8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 -- 172.21.15.82:0/3556079363 >> 172.21.15.82:0/3556079363 conn(0x7f2cd80fdcc0 msgr2=0x7f2cd8100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 -- 172.21.15.82:0/3556079363 shutdown_connections 2024-04-26T20:22:39.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.371+0000 7f2cde200640 1 -- 172.21.15.82:0/3556079363 wait complete. 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 Processor -- start 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 -- start start 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd8102750 0x7f2cd819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 0x7f2cd819b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8104300 0x7f2cd81a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd810e2b0 con 0x7f2cd8103940 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd810e130 con 0x7f2cd8102750 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.372+0000 7f2cde200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd810e430 con 0x7f2cd8104300 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 0x7f2cd819b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 0x7f2cd819b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53054/0 (socket says 172.21.15.82:53054) 2024-04-26T20:22:39.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 -- 172.21.15.82:0/3310316550 learned_addr learned my addr 172.21.15.82:0/3310316550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cdce00640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd8102750 0x7f2cd819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cdd800640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8104300 0x7f2cd81a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 -- 172.21.15.82:0/3310316550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8104300 msgr2=0x7f2cd81a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8104300 0x7f2cd81a20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 -- 172.21.15.82:0/3310316550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd8102750 msgr2=0x7f2cd819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd8102750 0x7f2cd819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 -- 172.21.15.82:0/3310316550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd81a2720 con 0x7f2cd8103940 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.373+0000 7f2cd7e00640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 0x7f2cd819b040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400ea60 tx=0x7f2cc400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.374+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400cde0 con 0x7f2cd8103940 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.374+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cc40035f0 con 0x7f2cd8103940 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.374+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4010690 con 0x7f2cd8103940 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.374+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd81a2a10 con 0x7f2cd8103940 2024-04-26T20:22:39.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.374+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd81a2f10 con 0x7f2cd8103940 2024-04-26T20:22:39.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.375+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd81a31a0 con 0x7f2cd8103940 2024-04-26T20:22:39.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.377+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2cc40037a0 con 0x7f2cd8103940 2024-04-26T20:22:39.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.379+0000 7f2cd5600640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cc00a3cc0 0x7f2cc00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.379+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2cc40d0b60 con 0x7f2cd8103940 2024-04-26T20:22:39.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.380+0000 7f2cdce00640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cc00a3cc0 0x7f2cc00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.380+0000 7f2cdce00640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cc00a3cc0 0x7f2cc00a6180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0095f0 tx=0x7f2ccc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:39.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.384+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2cc409d020 con 0x7f2cd8103940 2024-04-26T20:22:39.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.608+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cd81a34e0 con 0x7f2cd8103940 2024-04-26T20:22:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.611+0000 7f2cd5600640 1 -- 172.21.15.82:0/3310316550 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11951 (secure 0 0 0) 0x7f2cc409c920 con 0x7f2cd8103940 2024-04-26T20:22:39.611 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:39.611 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:20:20.191502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:22:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cc00a3cc0 msgr2=0x7f2cc00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cc00a3cc0 0x7f2cc00a6180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0095f0 tx=0x7f2ccc005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 msgr2=0x7f2cd819b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 0x7f2cd819b040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400ea60 tx=0x7f2cc400ef20 comp rx=0 tx=0).stop 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 shutdown_connections 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2cc00a3cc0 0x7f2cc00a6180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8104300 0x7f2cd81a20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cd8103940 0x7f2cd819b040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 --2- 172.21.15.82:0/3310316550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd8102750 0x7f2cd819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 >> 172.21.15.82:0/3310316550 conn(0x7f2cd80fdcc0 msgr2=0x7f2cd8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.613+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 shutdown_connections 2024-04-26T20:22:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.614+0000 7f2cde200640 1 -- 172.21.15.82:0/3310316550 wait complete. 2024-04-26T20:22:39.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.823+0000 7ff46b200640 1 -- 172.21.15.82:0/1597865453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078ed0 msgr2=0x7ff464079770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.823+0000 7ff46b200640 1 --2- 172.21.15.82:0/1597865453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078ed0 0x7ff464079770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff460009be0 tx=0x7ff46002a6c0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 -- 172.21.15.82:0/1597865453 shutdown_connections 2024-04-26T20:22:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 --2- 172.21.15.82:0/1597865453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078ed0 0x7ff464079770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 --2- 172.21.15.82:0/1597865453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078530 0x7ff464078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 --2- 172.21.15.82:0/1597865453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4640772f0 0x7ff464077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 -- 172.21.15.82:0/1597865453 >> 172.21.15.82:0/1597865453 conn(0x7ff4640fff00 msgr2=0x7ff464102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 -- 172.21.15.82:0/1597865453 shutdown_connections 2024-04-26T20:22:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.824+0000 7ff46b200640 1 -- 172.21.15.82:0/1597865453 wait complete. 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 Processor -- start 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 -- start start 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4640772f0 0x7ff46419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078530 0x7ff46419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 0x7ff4641a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641148d0 con 0x7ff464078ed0 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff464114750 con 0x7ff4640772f0 2024-04-26T20:22:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff464114a50 con 0x7ff464078530 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 0x7ff4641a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff469400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078530 0x7ff46419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 0x7ff4641a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53080/0 (socket says 172.21.15.82:53080) 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff46a800640 1 -- 172.21.15.82:0/1369943863 learned_addr learned my addr 172.21.15.82:0/1369943863 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.825+0000 7ff469e00640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4640772f0 0x7ff46419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46a800640 1 -- 172.21.15.82:0/1369943863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078530 msgr2=0x7ff46419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46a800640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078530 0x7ff46419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46a800640 1 -- 172.21.15.82:0/1369943863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4640772f0 msgr2=0x7ff46419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46a800640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4640772f0 0x7ff46419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46a800640 1 -- 172.21.15.82:0/1369943863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4641a6b40 con 0x7ff464078ed0 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46a800640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 0x7ff4641a64d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff460004af0 tx=0x7ff460030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460041020 con 0x7ff464078ed0 2024-04-26T20:22:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff460030ec0 con 0x7ff464078ed0 2024-04-26T20:22:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4641a6dd0 con 0x7ff464078ed0 2024-04-26T20:22:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.826+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460036040 con 0x7ff464078ed0 2024-04-26T20:22:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.827+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641a7260 con 0x7ff464078ed0 2024-04-26T20:22:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.828+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff464111300 con 0x7ff464078ed0 2024-04-26T20:22:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.830+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff460044020 con 0x7ff464078ed0 2024-04-26T20:22:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.831+0000 7ff45ea00640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff44c0a3c40 0x7ff44c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.831+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff4600f1a30 con 0x7ff464078ed0 2024-04-26T20:22:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.831+0000 7ff469e00640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff44c0a3c40 0x7ff44c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.832+0000 7ff469e00640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff44c0a3c40 0x7ff44c0a6100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff450009bd0 tx=0x7ff450005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:39.833+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff46004b030 con 0x7ff464078ed0 2024-04-26T20:22:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:39 smithi082 ceph-mon[28105]: pgmap v407: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:39 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1074475580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:39 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3310316550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:40.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.034+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff46402dca0 con 0x7ff464078ed0 2024-04-26T20:22:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.038+0000 7ff45ea00640 1 -- 172.21.15.82:0/1369943863 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7ff4600bdef0 con 0x7ff464078ed0 2024-04-26T20:22:40.039 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:40.040 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:40.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.040+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff44c0a3c40 msgr2=0x7ff44c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.040+0000 7ff46b200640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff44c0a3c40 0x7ff44c0a6100 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff450009bd0 tx=0x7ff450005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.040+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 msgr2=0x7ff4641a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.040+0000 7ff46b200640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 0x7ff4641a64d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff460004af0 tx=0x7ff460030d50 comp rx=0 tx=0).stop 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 shutdown_connections 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff44c0a3c40 0x7ff44c0a6100 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff464078ed0 0x7ff4641a64d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff464078530 0x7ff46419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 --2- 172.21.15.82:0/1369943863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4640772f0 0x7ff46419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 >> 172.21.15.82:0/1369943863 conn(0x7ff4640fff00 msgr2=0x7ff464101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 shutdown_connections 2024-04-26T20:22:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.041+0000 7ff46b200640 1 -- 172.21.15.82:0/1369943863 wait complete. 2024-04-26T20:22:40.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T20:19:52.134957+0000', 'modified': '2024-04-26T20:20:20.191502+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24584, 'mds_1': 24554, 'mds_2': 24550, 'mds_3': 24529, 'mds_4': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/3324936648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3324936648}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 3324936648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'l', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.139:6833/4280186600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 4280186600}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 4280186600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'j', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/3327585570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 3327585570}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 3327585570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/1988909695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 1988909695}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 1988909695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/2462659708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 2462659708}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 2462659708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/1503486498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 1503486498}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 1503486498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.139:6837/4255230594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 4255230594}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 4255230594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.139:6839/1238493959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 1238493959}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 1238493959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24554': {'gid': 24554, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.82:6839/1585592636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1585592636}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1585592636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24584': {'gid': 24584, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6839/1800754758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1800754758}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1800754758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24584, 'qdb_cluster': [24554, 24584, 24454, 24529, 24550]} 2024-04-26T20:22:40.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-26T20:22:40.062 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-04-26T20:22:40.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:39 smithi139 ceph-mon[32999]: pgmap v407: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:39 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1074475580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:39 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3310316550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:39 smithi135 ceph-mon[32816]: pgmap v407: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-26T20:22:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:22:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:39 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1074475580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:40.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:39 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3310316550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:40.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 -- 172.21.15.82:0/1396526578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918076910 msgr2=0x7f2918074d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 --2- 172.21.15.82:0/1396526578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918076910 0x7f2918074d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2908009900 tx=0x7f290802a480 comp rx=0 tx=0).stop 2024-04-26T20:22:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 -- 172.21.15.82:0/1396526578 shutdown_connections 2024-04-26T20:22:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 --2- 172.21.15.82:0/1396526578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f291810a600 0x7f291810caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 --2- 172.21.15.82:0/1396526578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2918075330 0x7f2918075790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 --2- 172.21.15.82:0/1396526578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918076910 0x7f2918074d60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 -- 172.21.15.82:0/1396526578 >> 172.21.15.82:0/1396526578 conn(0x7f29180fdce0 msgr2=0x7f2918100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 -- 172.21.15.82:0/1396526578 shutdown_connections 2024-04-26T20:22:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.263+0000 7f291de00640 1 -- 172.21.15.82:0/1396526578 wait complete. 2024-04-26T20:22:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 Processor -- start 2024-04-26T20:22:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 -- start start 2024-04-26T20:22:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 0x7f291819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2918076910 0x7f291819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f291810a600 0x7f29181a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29181104e0 con 0x7f2918075330 2024-04-26T20:22:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2918110360 con 0x7f2918076910 2024-04-26T20:22:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291de00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2918110660 con 0x7f291810a600 2024-04-26T20:22:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.264+0000 7f291ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 0x7f291819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 0x7f291819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53094/0 (socket says 172.21.15.82:53094) 2024-04-26T20:22:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 -- 172.21.15.82:0/837486988 learned_addr learned my addr 172.21.15.82:0/837486988 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f290fe00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2918076910 0x7f291819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291d400640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f291810a600 0x7f29181a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 -- 172.21.15.82:0/837486988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f291810a600 msgr2=0x7f29181a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f291810a600 0x7f29181a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 -- 172.21.15.82:0/837486988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2918076910 msgr2=0x7f291819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2918076910 0x7f291819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 -- 172.21.15.82:0/837486988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29181a2770 con 0x7f2918075330 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.265+0000 7f291ca00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 0x7f291819ab50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2908005ab0 tx=0x7f2908003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.266+0000 7f2916000640 1 -- 172.21.15.82:0/837486988 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290803f070 con 0x7f2918075330 2024-04-26T20:22:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.266+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29181a2a00 con 0x7f2918075330 2024-04-26T20:22:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.266+0000 7f2916000640 1 -- 172.21.15.82:0/837486988 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2908031c50 con 0x7f2918075330 2024-04-26T20:22:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.266+0000 7f2916000640 1 -- 172.21.15.82:0/837486988 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908035030 con 0x7f2918075330 2024-04-26T20:22:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.266+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181a2ef0 con 0x7f2918075330 2024-04-26T20:22:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.270+0000 7f29223cd740 1 Processor -- start 2024-04-26T20:22:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.270+0000 7f29223cd740 1 -- start start 2024-04-26T20:22:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.270+0000 7f2916000640 1 -- 172.21.15.82:0/837486988 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2908042070 con 0x7f2918075330 2024-04-26T20:22:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.270+0000 7f29223cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f4906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.270+0000 7f29223cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f29223cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4982b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f29223cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a58f3f4600 con 0x55a58f495e20 2024-04-26T20:22:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f29223cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a58f391100 con 0x55a58f4902c0 2024-04-26T20:22:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f29223cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a58f3f05c0 con 0x55a58f490cb0 2024-04-26T20:22:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f4906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f290fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f4906e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45972/0 (socket says 172.21.15.82:45972) 2024-04-26T20:22:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 -- 172.21.15.82:0/4073885184 learned_addr learned my addr 172.21.15.82:0/4073885184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 -- 172.21.15.82:0/4073885184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 msgr2=0x55a58f4957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 -- 172.21.15.82:0/4073885184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 msgr2=0x55a58f4982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.271+0000 7f291d400640 1 -- 172.21.15.82:0/4073885184 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58f1062d0 con 0x55a58f4902c0 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f291d400640 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f4906e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2910009fd0 tx=0x7f29100118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=266230e9d76a4aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f290dc00640 1 -- 172.21.15.82:0/4073885184 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910004d20 con 0x55a58f4902c0 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f290dc00640 1 -- 172.21.15.82:0/4073885184 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2910004050 con 0x55a58f4902c0 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f290dc00640 1 -- 172.21.15.82:0/4073885184 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910005280 con 0x55a58f4902c0 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f2916000640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f28fc0a3c40 0x7f28fc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f2916000640 1 -- 172.21.15.82:0/837486988 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f29080f1030 con 0x7f2918075330 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.272+0000 7f291ca00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f28fc0a3c40 0x7f28fc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 -- 172.21.15.82:0/4073885184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 msgr2=0x55a58f4906e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f4906e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2910009fd0 tx=0x7f29100118d0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 -- 172.21.15.82:0/4073885184 shutdown_connections 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 --2- 172.21.15.82:0/4073885184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f4906e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 -- 172.21.15.82:0/4073885184 >> 172.21.15.82:0/4073885184 conn(0x55a58f424d10 msgr2=0x55a58f48bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 -- 172.21.15.82:0/4073885184 shutdown_connections 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 -- 172.21.15.82:0/4073885184 wait complete. 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f291ca00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f28fc0a3c40 0x7f28fc0a6100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55a58f491720 tx=0x7f29080f4b80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.273+0000 7f29223cd740 1 -- start start 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 Processor -- start 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f4902c0 0x55a58f49a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 0x55a58f49ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f4a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a58f498dd0 con 0x55a58f490cb0 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a58f37bf70 con 0x55a58f495e20 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a58f498f50 con 0x55a58f4902c0 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f29223cd740 10 client.0 _ll_register_callbacks cb 0x55a58f3ea480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f290fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 0x55a58f49ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f290fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 0x55a58f49ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53104/0 (socket says 172.21.15.82:53104) 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f290fe00640 1 -- 172.21.15.82:0/2092998472 learned_addr learned my addr 172.21.15.82:0/2092998472 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.274+0000 7f291d400640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f4902c0 0x55a58f49a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f291d400640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f4a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f290fe00640 1 -- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f4902c0 msgr2=0x55a58f49a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f290fe00640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f4902c0 0x55a58f49a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f290fe00640 1 -- 172.21.15.82:0/2092998472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 msgr2=0x55a58f4a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f290fe00640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f4a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f290fe00640 1 -- 172.21.15.82:0/2092998472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58f1d06b0 con 0x55a58f490cb0 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f291d400640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f4902c0 0x55a58f49a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f290fe00640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 0x55a58f49ac00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2900012700 tx=0x7f2900012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749a8252455ba333 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f2906000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f2906000640 1 -- 172.21.15.82:0/2092998472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290000f8c0 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f2906000640 1 -- 172.21.15.82:0/2092998472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f290000fa60 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2910004050 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f2906000640 1 -- 172.21.15.82:0/2092998472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2900025050 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f29223cd740 10 client.15252 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.275+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a58f4a4cf0 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f2906000640 1 -- 172.21.15.82:0/2092998472 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2910004050 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f2906000640 1 -- 172.21.15.82:0/2092998472 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2900010430 con 0x55a58f490cb0 2024-04-26T20:22:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f29223cd740 10 client.15252 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f29223cd740 10 client.15252 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f29223cd740 20 client.15252 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f29223cd740 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f4a73a0 0x55a58f4a8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f29223cd740 4 client.15252 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a58f402210 con 0x55a58f4a73a0 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.276+0000 7f291d400640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f4a73a0 0x55a58f4a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.277+0000 7f291d400640 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f4a73a0 0x55a58f4a8810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c6bb3da742afa39c server_cookie=84c180e364e5be55 in_seq=0 out_seq=0 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.277+0000 7f2906000640 10 client.15252 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f2906000640 1 -- 172.21.15.82:0/2092998472 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a58f402210 con 0x55a58f4a73a0 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f2906000640 10 client.15252 handle_command_reply: tid=0 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 client.15252 shutdown 2024-04-26T20:22:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 msgr2=0x55a58f49ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 0x55a58f49ac00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2900012700 tx=0x7f2900012bc0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 shutdown_connections 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f4a73a0 0x55a58f4a8810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f4a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f490cb0 0x55a58f49ac00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 --2- 172.21.15.82:0/2092998472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f4902c0 0x55a58f49a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f2906000640 0 client.15252 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 >> 172.21.15.82:0/2092998472 conn(0x55a58f424d10 msgr2=0x55a58f48af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 shutdown_connections 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 1 -- 172.21.15.82:0/2092998472 wait complete. 2024-04-26T20:22:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.278+0000 7f29223cd740 20 client.15252 trim_cache size 0 max 16384 2024-04-26T20:22:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 Processor -- start 2024-04-26T20:22:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 -- start start 2024-04-26T20:22:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 0x55a58f486df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f48ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a58f4a6b50 con 0x55a58f4902c0 2024-04-26T20:22:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a58f4a7220 con 0x55a58f495e20 2024-04-26T20:22:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f29223cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a58f4a78f0 con 0x55a58f490cb0 2024-04-26T20:22:40.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.298+0000 7f291d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 0x55a58f486df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 0x55a58f486df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53116/0 (socket says 172.21.15.82:53116) 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 -- 172.21.15.82:0/977518235 learned_addr learned my addr 172.21.15.82:0/977518235 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f290fe00640 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f48ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 -- 172.21.15.82:0/977518235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 msgr2=0x55a58f4a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 -- 172.21.15.82:0/977518235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 msgr2=0x55a58f48ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f48ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 -- 172.21.15.82:0/977518235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58f487680 con 0x55a58f4902c0 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f290fe00640 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.299+0000 7f291d400640 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 0x55a58f486df0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2910005fd0 tx=0x7f2910014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c980d0372c6ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f290d200640 1 -- 172.21.15.82:0/977518235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910004b90 con 0x55a58f4902c0 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f290d200640 1 -- 172.21.15.82:0/977518235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291002d030 con 0x55a58f4902c0 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f290d200640 1 -- 172.21.15.82:0/977518235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100052a0 con 0x55a58f4902c0 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 -- 172.21.15.82:0/977518235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 msgr2=0x55a58f486df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 0x55a58f486df0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2910005fd0 tx=0x7f2910014000 comp rx=0 tx=0).stop 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 -- 172.21.15.82:0/977518235 shutdown_connections 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f495e20 0x55a58f48ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f4a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 --2- 172.21.15.82:0/977518235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f4902c0 0x55a58f486df0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 -- 172.21.15.82:0/977518235 >> 172.21.15.82:0/977518235 conn(0x55a58f424d10 msgr2=0x55a58f492070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 -- 172.21.15.82:0/977518235 shutdown_connections 2024-04-26T20:22:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.300+0000 7f29223cd740 1 -- 172.21.15.82:0/977518235 wait complete. 2024-04-26T20:22:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 -- start start 2024-04-26T20:22:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 Processor -- start 2024-04-26T20:22:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f49d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f49db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a58f4a8690 con 0x55a58f495e20 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a58f4a7fc0 con 0x55a58f4902c0 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.301+0000 7f29223cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a58f4a8d60 con 0x55a58f490cb0 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f29223cd740 10 client.0 _ll_register_callbacks cb 0x7f2900009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f291d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f49d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f291d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f290fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f49db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f291d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53118/0 (socket says 172.21.15.82:53118) 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f291d400640 1 -- 172.21.15.82:0/2428092320 learned_addr learned my addr 172.21.15.82:0/2428092320 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f290fe00640 1 -- 172.21.15.82:0/2428092320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 msgr2=0x55a58f49d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f290fe00640 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f49d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f290fe00640 1 -- 172.21.15.82:0/2428092320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 msgr2=0x55a58f4a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f290fe00640 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f290fe00640 1 -- 172.21.15.82:0/2428092320 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58f4a1100 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.302+0000 7f291d400640 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f290fe00640 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f49db40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2900009e00 tx=0x7f2900010cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76420f2e7cdef07d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f2906000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f2906000640 1 -- 172.21.15.82:0/2428092320 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900010640 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291002d030 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f2906000640 1 -- 172.21.15.82:0/2428092320 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2900022040 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f2906000640 1 -- 172.21.15.82:0/2428092320 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2900011f20 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f29223cd740 10 client.25381 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a58f50d600 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.303+0000 7f2906000640 1 -- 172.21.15.82:0/2428092320 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291002d030 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f2906000640 1 -- 172.21.15.82:0/2428092320 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f290000fba0 con 0x55a58f490cb0 2024-04-26T20:22:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f29223cd740 10 client.25381 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f29223cd740 10 client.25381 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f29223cd740 20 client.25381 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f29223cd740 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f512230 0x55a58f50ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f29223cd740 4 client.25381 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "status"}) -- 0x55a58f3fc080 con 0x55a58f512230 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f291d400640 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f512230 0x55a58f50ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f291d400640 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f512230 0x55a58f50ed40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fcb6e5d4a47e43ee server_cookie=3b641fb5672c903 in_seq=0 out_seq=0 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.304+0000 7f2906000640 10 client.25381 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f2906000640 1 -- 172.21.15.82:0/2428092320 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a58f3fc080 con 0x55a58f512230 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f2906000640 10 client.25381 handle_command_reply: tid=0 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 client.25381 shutdown 2024-04-26T20:22:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 msgr2=0x55a58f49db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f49db40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2900009e00 tx=0x7f2900010cf0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 shutdown_connections 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55a58f512230 0x55a58f50ed40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a58f495e20 0x55a58f4a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f2906000640 0 client.25381 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a58f490cb0 0x55a58f49db40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 --2- 172.21.15.82:0/2428092320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a58f4902c0 0x55a58f49d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 >> 172.21.15.82:0/2428092320 conn(0x55a58f424d10 msgr2=0x55a58f48a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 shutdown_connections 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 1 -- 172.21.15.82:0/2428092320 wait complete. 2024-04-26T20:22:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.305+0000 7f29223cd740 20 client.25381 trim_cache size 0 max 16384 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24454, 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 141.12211662199999, 2024-04-26T20:22:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 211.01902181899999 2024-04-26T20:22:40.312 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f28fc0a3c40 msgr2=0x7f28fc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f28fc0a3c40 0x7f28fc0a6100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55a58f491720 tx=0x7f29080f4b80 comp rx=0 tx=0).stop 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 msgr2=0x7f291819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 0x7f291819ab50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2908005ab0 tx=0x7f2908003b90 comp rx=0 tx=0).stop 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 shutdown_connections 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f28fc0a3c40 0x7f28fc0a6100 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f291810a600 0x7f29181a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2918076910 0x7f291819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 --2- 172.21.15.82:0/837486988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918075330 0x7f291819ab50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 >> 172.21.15.82:0/837486988 conn(0x7f29180fdce0 msgr2=0x7f2918106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 shutdown_connections 2024-04-26T20:22:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.306+0000 7f291de00640 1 -- 172.21.15.82:0/837486988 wait complete. 2024-04-26T20:22:40.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T20:22:40.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.525+0000 7f9f17c00640 1 -- 172.21.15.82:0/2947683396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 msgr2=0x7f9f10074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.525+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2947683396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f10074dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009cd0 tx=0x7f9f0002a8e0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 -- 172.21.15.82:0/2947683396 shutdown_connections 2024-04-26T20:22:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2947683396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f10111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2947683396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f10075390 0x7f9f10075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2947683396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f10074dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 -- 172.21.15.82:0/2947683396 >> 172.21.15.82:0/2947683396 conn(0x7f9f100fdee0 msgr2=0x7f9f10100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 -- 172.21.15.82:0/2947683396 shutdown_connections 2024-04-26T20:22:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.526+0000 7f9f17c00640 1 -- 172.21.15.82:0/2947683396 wait complete. 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 Processor -- start 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 -- start start 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f10075390 0x7f9f1019f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f1019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f101a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10114aa0 con 0x7f9f10076970 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10114920 con 0x7f9f10075390 2024-04-26T20:22:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f17c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10114c20 con 0x7f9f1010ef40 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f1019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f15c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f101a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f1019f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53132/0 (socket says 172.21.15.82:53132) 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f15c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f101a6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34028/0 (socket says 172.21.15.82:34028) 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f0fe00640 1 -- 172.21.15.82:0/2264176865 learned_addr learned my addr 172.21.15.82:0/2264176865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.527+0000 7f9f15200640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f10075390 0x7f9f1019f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f15c00640 1 -- 172.21.15.82:0/2264176865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f10075390 msgr2=0x7f9f1019f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f15c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f10075390 0x7f9f1019f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f15c00640 1 -- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 msgr2=0x7f9f1019f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f15c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f1019f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f15c00640 1 -- 172.21.15.82:0/2264176865 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f101a6de0 con 0x7f9f1010ef40 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f15c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f101a6770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800e970 tx=0x7f9f0800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f0d600640 1 -- 172.21.15.82:0/2264176865 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800ccc0 con 0x7f9f1010ef40 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f0d600640 1 -- 172.21.15.82:0/2264176865 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f08005020 con 0x7f9f1010ef40 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f0d600640 1 -- 172.21.15.82:0/2264176865 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08004a00 con 0x7f9f1010ef40 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f101a70d0 con 0x7f9f1010ef40 2024-04-26T20:22:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.528+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f101a75d0 con 0x7f9f1010ef40 2024-04-26T20:22:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.531+0000 7f9f1aa16740 1 Processor -- start 2024-04-26T20:22:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f0d600640 1 -- 172.21.15.82:0/2264176865 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9f08004ba0 con 0x7f9f1010ef40 2024-04-26T20:22:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 -- start start 2024-04-26T20:22:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc19510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc210e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bb2db7d600 con 0x55bb2dc1ec50 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb2db1a100 con 0x55bb2dc190f0 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.532+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bb2db795c0 con 0x55bb2dc19ae0 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc19510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc19510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46024/0 (socket says 172.21.15.82:46024) 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 -- 172.21.15.82:0/3438262202 learned_addr learned my addr 172.21.15.82:0/3438262202 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f15200640 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 -- 172.21.15.82:0/3438262202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 msgr2=0x55bb2dc1e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc1e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 -- 172.21.15.82:0/3438262202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc1ec50 msgr2=0x55bb2dc210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 -- 172.21.15.82:0/3438262202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2d88f2d0 con 0x55bb2dc190f0 2024-04-26T20:22:40.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc19510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8011910 tx=0x7f9ef8009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eed69c80dc3a5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.533+0000 7f9f0d600640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ef40a3c40 0x7f9ef40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f0d600640 1 -- 172.21.15.82:0/2264176865 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f9f080d0890 con 0x7f9f1010ef40 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f06000640 1 -- 172.21.15.82:0/3438262202 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800f7c0 con 0x55bb2dc190f0 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f06000640 1 -- 172.21.15.82:0/3438262202 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef800fe10 con 0x55bb2dc190f0 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f15200640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ef40a3c40 0x7f9ef40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f06000640 1 -- 172.21.15.82:0/3438262202 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef801fd70 con 0x55bb2dc190f0 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3438262202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 msgr2=0x55bb2dc19510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc19510 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8011910 tx=0x7f9ef8009540 comp rx=0 tx=0).stop 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3438262202 shutdown_connections 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f15200640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ef40a3c40 0x7f9ef40a6100 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9f00031780 tx=0x7f9f0003d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc1e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3438262202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc19510 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.534+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3438262202 >> 172.21.15.82:0/3438262202 conn(0x55bb2dbadd10 msgr2=0x55bb2dc14b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.535+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3438262202 shutdown_connections 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.535+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3438262202 wait complete. 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.535+0000 7f9f1aa16740 1 -- start start 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.535+0000 7f9f1aa16740 1 Processor -- start 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc23660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc23ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc21c00 con 0x55bb2dc190f0 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb2db04f70 con 0x55bb2dc1ec50 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc21d80 con 0x55bb2dc19ae0 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f1aa16740 10 client.0 _ll_register_callbacks cb 0x55bb2db73480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f15200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc23660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f0fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc23ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f15200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc23660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53136/0 (socket says 172.21.15.82:53136) 2024-04-26T20:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f15200640 1 -- 172.21.15.82:0/1811465306 learned_addr learned my addr 172.21.15.82:0/1811465306 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f15c00640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f0fe00640 1 -- 172.21.15.82:0/1811465306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc1ec50 msgr2=0x55bb2dc2abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f0fe00640 1 -- 172.21.15.82:0/1811465306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 msgr2=0x55bb2dc23660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc23660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f0fe00640 1 -- 172.21.15.82:0/1811465306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2d9596b0 con 0x55bb2dc19ae0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.536+0000 7f9f15200640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc23660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc23ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800a010 tx=0x7f9ef80097f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e99f71081f0337e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9efea00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9efea00640 1 -- 172.21.15.82:0/1811465306 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8004040 con 0x55bb2dc19ae0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9efea00640 1 -- 172.21.15.82:0/1811465306 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f9ef80041e0 con 0x55bb2dc19ae0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ef800fe10 con 0x55bb2dc19ae0 2024-04-26T20:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9efea00640 1 -- 172.21.15.82:0/1811465306 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ef80043e0 con 0x55bb2dc19ae0 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9f1aa16740 10 client.25393 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.537+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb2dc2dbc0 con 0x55bb2dc19ae0 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9efea00640 1 -- 172.21.15.82:0/1811465306 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef800fe10 con 0x55bb2dc19ae0 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9efea00640 1 -- 172.21.15.82:0/1811465306 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9ef801d020 con 0x55bb2dc19ae0 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f1aa16740 10 client.25393 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f1aa16740 10 client.25393 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f1aa16740 20 client.25393 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc2fee0 0x55bb2dc31350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f1aa16740 4 client.25393 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb2db8b210 con 0x55bb2dc2fee0 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.538+0000 7f9f15200640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc2fee0 0x55bb2dc31350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.539+0000 7f9f15200640 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc2fee0 0x55bb2dc31350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=191934bd274692ad server_cookie=a46104e7a9909738 in_seq=0 out_seq=0 2024-04-26T20:22:40.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.539+0000 7f9efea00640 10 client.25393 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9efea00640 1 -- 172.21.15.82:0/1811465306 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bb2db8b210 con 0x55bb2dc2fee0 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9efea00640 10 client.25393 handle_command_reply: tid=0 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 client.25393 shutdown 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 msgr2=0x55bb2dc23ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc23ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800a010 tx=0x7f9ef80097f0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 shutdown_connections 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc2fee0 0x55bb2dc31350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc23ba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/1811465306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc23660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 >> 172.21.15.82:0/1811465306 conn(0x55bb2dbadd10 msgr2=0x55bb2dc13eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9efea00640 0 client.25393 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:40.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 shutdown_connections 2024-04-26T20:22:40.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 1 -- 172.21.15.82:0/1811465306 wait complete. 2024-04-26T20:22:40.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.540+0000 7f9f1aa16740 20 client.25393 trim_cache size 0 max 16384 2024-04-26T20:22:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 Processor -- start 2024-04-26T20:22:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 -- start start 2024-04-26T20:22:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc39630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc39b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc2f690 con 0x55bb2dc190f0 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc2fd60 con 0x55bb2dc19ae0 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc30430 con 0x55bb2dc1ec50 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f15200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc39630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.560+0000 7f9f15200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc39630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53142/0 (socket says 172.21.15.82:53142) 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 -- 172.21.15.82:0/3498683020 learned_addr learned my addr 172.21.15.82:0/3498683020 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15c00640 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc39b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 -- 172.21.15.82:0/3498683020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 msgr2=0x55bb2dc2aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 -- 172.21.15.82:0/3498683020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc19ae0 msgr2=0x55bb2dc39b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc39b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 -- 172.21.15.82:0/3498683020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2dc15820 con 0x55bb2dc190f0 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f15200640 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc39630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f0002ae00 tx=0x7f9f00041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8ddc09589ce360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.561+0000 7f9f05600640 1 -- 172.21.15.82:0/3498683020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00004790 con 0x55bb2dc190f0 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f05600640 1 -- 172.21.15.82:0/3498683020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f00036040 con 0x55bb2dc190f0 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f05600640 1 -- 172.21.15.82:0/3498683020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00030a30 con 0x55bb2dc190f0 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3498683020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 msgr2=0x55bb2dc39630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc39630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f0002ae00 tx=0x7f9f00041000 comp rx=0 tx=0).stop 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3498683020 shutdown_connections 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc2aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc39b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/3498683020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc190f0 0x55bb2dc39630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3498683020 >> 172.21.15.82:0/3498683020 conn(0x55bb2dbadd10 msgr2=0x55bb2dc1b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3498683020 shutdown_connections 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.562+0000 7f9f1aa16740 1 -- 172.21.15.82:0/3498683020 wait complete. 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 -- start start 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 Processor -- start 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc13620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc13b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc29be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc311d0 con 0x55bb2dc19ae0 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc30b00 con 0x55bb2dc190f0 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bb2dc318a0 con 0x55bb2dc1ec50 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.563+0000 7f9f1aa16740 10 client.0 _ll_register_callbacks cb 0x7f9ef8011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc13620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc13b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc29be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc13620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46050/0 (socket says 172.21.15.82:46050) 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 -- 172.21.15.82:0/2735321520 learned_addr learned my addr 172.21.15.82:0/2735321520 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 -- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 msgr2=0x55bb2dc29be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc29be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 -- 172.21.15.82:0/2735321520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc19ae0 msgr2=0x55bb2dc13b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc13b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 -- 172.21.15.82:0/2735321520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2dc2a120 con 0x55bb2dc190f0 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9f15200640 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc13620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009600 tx=0x7f9f00004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52cc6685078d0cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.564+0000 7f9efea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9efea00640 1 -- 172.21.15.82:0/2735321520 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000307b0 con 0x55bb2dc190f0 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9efea00640 1 -- 172.21.15.82:0/2735321520 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f9f00030950 con 0x55bb2dc190f0 2024-04-26T20:22:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f00036040 con 0x55bb2dc190f0 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9efea00640 1 -- 172.21.15.82:0/2735321520 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f00030b50 con 0x55bb2dc190f0 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 10 client.25373 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb2dc96070 con 0x55bb2dc190f0 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9efea00640 1 -- 172.21.15.82:0/2735321520 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f00036040 con 0x55bb2dc190f0 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9efea00640 1 -- 172.21.15.82:0/2735321520 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f00030070 con 0x55bb2dc190f0 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 10 client.25373 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 10 client.25373 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 20 client.25373 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc9a810 0x55bb2dc99520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 4 client.25373 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.565+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "status"}) -- 0x55bb2db85080 con 0x55bb2dc9a810 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.566+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc9a810 0x55bb2dc99520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.566+0000 7f9f0fe00640 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc9a810 0x55bb2dc99520 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=499c56a6c78991bb server_cookie=961889fa71b5776a in_seq=0 out_seq=0 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.566+0000 7f9efea00640 10 client.25373 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.566+0000 7f9efea00640 1 -- 172.21.15.82:0/2735321520 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bb2db85080 con 0x55bb2dc9a810 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.566+0000 7f9efea00640 10 client.25373 handle_command_reply: tid=0 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.566+0000 7f9f1aa16740 1 client.25373 shutdown 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 msgr2=0x55bb2dc13620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc13620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009600 tx=0x7f9f00004a40 comp rx=0 tx=0).stop 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 shutdown_connections 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bb2dc1ec50 0x55bb2dc29be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb2dc19ae0 0x55bb2dc13b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55bb2dc9a810 0x55bb2dc99520 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 --2- 172.21.15.82:0/2735321520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bb2dc190f0 0x55bb2dc13620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9efea00640 0 client.25373 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 >> 172.21.15.82:0/2735321520 conn(0x55bb2dbadd10 msgr2=0x55bb2dc23620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 shutdown_connections 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 1 -- 172.21.15.82:0/2735321520 wait complete. 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.567+0000 7f9f1aa16740 20 client.25373 trim_cache size 0 max 16384 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24529, 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:40.573 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 141.83978846400001, 2024-04-26T20:22:40.574 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:40.574 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:40.574 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:40.574 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 191.29793333999999 2024-04-26T20:22:40.574 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ef40a3c40 msgr2=0x7f9ef40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ef40a3c40 0x7f9ef40a6100 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9f00031780 tx=0x7f9f0003d040 comp rx=0 tx=0).stop 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 msgr2=0x7f9f101a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f101a6770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800e970 tx=0x7f9f0800ee30 comp rx=0 tx=0).stop 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 shutdown_connections 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9ef40a3c40 0x7f9ef40a6100 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f1010ef40 0x7f9f101a6770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f10076970 0x7f9f1019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 --2- 172.21.15.82:0/2264176865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f10075390 0x7f9f1019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 >> 172.21.15.82:0/2264176865 conn(0x7f9f100fdee0 msgr2=0x7f9f101022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 shutdown_connections 2024-04-26T20:22:40.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.568+0000 7f9f17c00640 1 -- 172.21.15.82:0/2264176865 wait complete. 2024-04-26T20:22:40.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-26T20:22:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 -- 172.21.15.82:0/1500139966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 msgr2=0x7f1c4010a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 --2- 172.21.15.82:0/1500139966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4010a400 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009900 tx=0x7f1c3002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 -- 172.21.15.82:0/1500139966 shutdown_connections 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 --2- 172.21.15.82:0/1500139966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c4010a940 0x7f1c401111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 --2- 172.21.15.82:0/1500139966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4010a400 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 --2- 172.21.15.82:0/1500139966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c40108d90 0x7f1c401091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 -- 172.21.15.82:0/1500139966 >> 172.21.15.82:0/1500139966 conn(0x7f1c40077d30 msgr2=0x7f1c4007a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 -- 172.21.15.82:0/1500139966 shutdown_connections 2024-04-26T20:22:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.789+0000 7f1c45e00640 1 -- 172.21.15.82:0/1500139966 wait complete. 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 Processor -- start 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 -- start start 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c40108d90 0x7f1c4019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c4010a940 0x7f1c401a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c401148f0 con 0x7f1c40109f80 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c40114770 con 0x7f1c4010a940 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.790+0000 7f1c45e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1c40114a70 con 0x7f1c40108d90 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4019f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53170/0 (socket says 172.21.15.82:53170) 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 -- 172.21.15.82:0/3798043189 learned_addr learned my addr 172.21.15.82:0/3798043189 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c45400640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c4010a940 0x7f1c401a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c40108d90 0x7f1c4019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 -- 172.21.15.82:0/3798043189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c40108d90 msgr2=0x7f1c4019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c40108d90 0x7f1c4019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 -- 172.21.15.82:0/3798043189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c4010a940 msgr2=0x7f1c401a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c4010a940 0x7f1c401a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 -- 172.21.15.82:0/3798043189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c401a6b80 con 0x7f1c40109f80 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c45400640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c4010a940 0x7f1c401a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:40.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.791+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4019f4a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c30005ab0 tx=0x7f1c30003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.792+0000 7f1c3d600640 1 -- 172.21.15.82:0/3798043189 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3003f070 con 0x7f1c40109f80 2024-04-26T20:22:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.792+0000 7f1c3d600640 1 -- 172.21.15.82:0/3798043189 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c30031c50 con 0x7f1c40109f80 2024-04-26T20:22:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.792+0000 7f1c3d600640 1 -- 172.21.15.82:0/3798043189 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30035030 con 0x7f1c40109f80 2024-04-26T20:22:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.792+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c401a6e10 con 0x7f1c40109f80 2024-04-26T20:22:40.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.792+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c401a7270 con 0x7f1c40109f80 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.795+0000 7f1c4a391740 1 Processor -- start 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.795+0000 7f1c3d600640 1 -- 172.21.15.82:0/3798043189 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1c30042070 con 0x7f1c40109f80 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.795+0000 7f1c4a391740 1 -- start start 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.795+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6add66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 0x55bf6addb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6adde2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c4a391740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf6ad3a600 con 0x55bf6add62c0 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c4a391740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf6acd7100 con 0x55bf6addbe20 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c4a391740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf6ad365c0 con 0x55bf6add6cb0 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c45400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6add66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 0x55bf6addb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 0x55bf6addb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34106/0 (socket says 172.21.15.82:34106) 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 -- 172.21.15.82:0/2042349160 learned_addr learned my addr 172.21.15.82:0/2042349160 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6adde2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 -- 172.21.15.82:0/2042349160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 msgr2=0x55bf6adde2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6adde2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 -- 172.21.15.82:0/2042349160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 msgr2=0x55bf6add66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6add66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c44a00640 1 -- 172.21.15.82:0/2042349160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6aa4c2d0 con 0x55bf6add6cb0 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.796+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6adde2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c44a00640 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 0x55bf6addb7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009ca0 tx=0x7f1c28011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee33f03aeef56887 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c35c00640 1 -- 172.21.15.82:0/2042349160 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28004220 con 0x55bf6add6cb0 2024-04-26T20:22:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c3d600640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1c240a3c40 0x7f1c240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c35c00640 1 -- 172.21.15.82:0/2042349160 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c280043c0 con 0x55bf6add6cb0 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c35c00640 1 -- 172.21.15.82:0/2042349160 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28019830 con 0x55bf6add6cb0 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c3d600640 1 -- 172.21.15.82:0/3798043189 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1c300f0fd0 con 0x7f1c40109f80 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.797+0000 7f1c45400640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1c240a3c40 0x7f1c240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c45400640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1c240a3c40 0x7f1c240a6100 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55bf6add7510 tx=0x7f1c38009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 -- 172.21.15.82:0/2042349160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 msgr2=0x55bf6addb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 0x55bf6addb7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009ca0 tx=0x7f1c28011810 comp rx=0 tx=0).stop 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 -- 172.21.15.82:0/2042349160 shutdown_connections 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6adde2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add6cb0 0x55bf6addb7b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 --2- 172.21.15.82:0/2042349160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6add66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 -- 172.21.15.82:0/2042349160 >> 172.21.15.82:0/2042349160 conn(0x55bf6ad6ad10 msgr2=0x55bf6add1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 -- 172.21.15.82:0/2042349160 shutdown_connections 2024-04-26T20:22:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 -- 172.21.15.82:0/2042349160 wait complete. 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.798+0000 7f1c4a391740 1 -- start start 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 Processor -- start 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6ade07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add6cb0 0x55bf6ade0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6ade7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf6addedd0 con 0x55bf6add6cb0 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf6acc1f70 con 0x55bf6addbe20 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf6addef50 con 0x55bf6add62c0 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c4a391740 10 client.0 _ll_register_callbacks cb 0x55bf6ad30480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6ade07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6ade07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34110/0 (socket says 172.21.15.82:34110) 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c44a00640 1 -- 172.21.15.82:0/3838236643 learned_addr learned my addr 172.21.15.82:0/3838236643 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add6cb0 0x55bf6ade0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.799+0000 7f1c45400640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6ade7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c44a00640 1 -- 172.21.15.82:0/3838236643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 msgr2=0x55bf6ade7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6ade7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c44a00640 1 -- 172.21.15.82:0/3838236643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add6cb0 msgr2=0x55bf6ade0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add6cb0 0x55bf6ade0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c44a00640 1 -- 172.21.15.82:0/3838236643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6ab166b0 con 0x55bf6add62c0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add6cb0 0x55bf6ade0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6ade07d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c28000c00 tx=0x7f1c28003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2162456eeff042fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c2e000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c2e000640 1 -- 172.21.15.82:0/3838236643 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28028070 con 0x55bf6add62c0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c2e000640 1 -- 172.21.15.82:0/3838236643 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1c28005040 con 0x55bf6add62c0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.800+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c280043c0 con 0x55bf6add62c0 2024-04-26T20:22:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c2e000640 1 -- 172.21.15.82:0/3838236643 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c28034050 con 0x55bf6add62c0 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c4a391740 10 client.25411 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf6adeacc0 con 0x55bf6add62c0 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c2e000640 1 -- 172.21.15.82:0/3838236643 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c280043c0 con 0x55bf6add62c0 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c2e000640 1 -- 172.21.15.82:0/3838236643 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1c280049f0 con 0x55bf6add62c0 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c4a391740 10 client.25411 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.801+0000 7f1c4a391740 10 client.25411 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c4a391740 20 client.25411 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6aded100 0x55bf6adee570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c4a391740 4 client.25411 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf6ad48210 con 0x55bf6aded100 2024-04-26T20:22:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6aded100 0x55bf6adee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6aded100 0x55bf6adee570 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=562e286e080958cb server_cookie=eda4696fd37e9046 in_seq=0 out_seq=0 2024-04-26T20:22:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.802+0000 7f1c2e000640 10 client.25411 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c2e000640 1 -- 172.21.15.82:0/3838236643 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf6ad48210 con 0x55bf6aded100 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c2e000640 10 client.25411 handle_command_reply: tid=0 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 client.25411 shutdown 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 msgr2=0x55bf6ade07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6ade07d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c28000c00 tx=0x7f1c28003820 comp rx=0 tx=0).stop 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 shutdown_connections 2024-04-26T20:22:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6aded100 0x55bf6adee570 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6addbe20 0x55bf6ade7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add6cb0 0x55bf6ade0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3838236643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6ade07d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c2e000640 0 client.25411 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.803+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 >> 172.21.15.82:0/3838236643 conn(0x55bf6ad6ad10 msgr2=0x55bf6add0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.804+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 shutdown_connections 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.804+0000 7f1c4a391740 1 -- 172.21.15.82:0/3838236643 wait complete. 2024-04-26T20:22:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.804+0000 7f1c4a391740 20 client.25411 trim_cache size 0 max 16384 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.823+0000 7f1c4a391740 1 Processor -- start 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 -- start start 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6add0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 0x55bf6adf5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf6adec8b0 con 0x55bf6addbe20 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf6adecf80 con 0x55bf6add6cb0 2024-04-26T20:22:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c4a391740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf6aded650 con 0x55bf6add62c0 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c45400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 0x55bf6adf5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c45400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 0x55bf6adf5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47906/0 (socket says 172.21.15.82:47906) 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c45400640 1 -- 172.21.15.82:0/1586441742 learned_addr learned my addr 172.21.15.82:0/1586441742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.824+0000 7f1c44a00640 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6add0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c45400640 1 -- 172.21.15.82:0/1586441742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 msgr2=0x55bf6add0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c45400640 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6add0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c45400640 1 -- 172.21.15.82:0/1586441742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 msgr2=0x55bf6ade7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c45400640 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c45400640 1 -- 172.21.15.82:0/1586441742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6adcd460 con 0x55bf6addbe20 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c44a00640 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6add0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:40.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c45400640 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 0x55bf6adf5840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c380124f0 tx=0x7f1c38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d85d526e4c4eefc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c35200640 1 -- 172.21.15.82:0/1586441742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800fda0 con 0x55bf6addbe20 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c35200640 1 -- 172.21.15.82:0/1586441742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c38011940 con 0x55bf6addbe20 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.825+0000 7f1c35200640 1 -- 172.21.15.82:0/1586441742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38005360 con 0x55bf6addbe20 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 -- 172.21.15.82:0/1586441742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 msgr2=0x55bf6adf5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 0x55bf6adf5840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c380124f0 tx=0x7f1c38017000 comp rx=0 tx=0).stop 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 -- 172.21.15.82:0/1586441742 shutdown_connections 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6addbe20 0x55bf6adf5840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 --2- 172.21.15.82:0/1586441742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6add62c0 0x55bf6add0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 -- 172.21.15.82:0/1586441742 >> 172.21.15.82:0/1586441742 conn(0x55bf6ad6ad10 msgr2=0x55bf6add06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 -- 172.21.15.82:0/1586441742 shutdown_connections 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 -- 172.21.15.82:0/1586441742 wait complete. 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.826+0000 7f1c4a391740 1 -- start start 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 Processor -- start 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6ade3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6addbe20 0x55bf6ade6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf6adee3f0 con 0x55bf6add62c0 2024-04-26T20:22:40.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf6adedd20 con 0x55bf6add6cb0 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf6adeeac0 con 0x55bf6addbe20 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c4a391740 10 client.0 _ll_register_callbacks cb 0x7f1c38009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6ade3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c44a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6ade3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47920/0 (socket says 172.21.15.82:47920) 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c45400640 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6addbe20 0x55bf6ade6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.827+0000 7f1c44a00640 1 -- 172.21.15.82:0/3876082544 learned_addr learned my addr 172.21.15.82:0/3876082544 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c44a00640 1 -- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6addbe20 msgr2=0x55bf6ade6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6addbe20 0x55bf6ade6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c44a00640 1 -- 172.21.15.82:0/3876082544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 msgr2=0x55bf6ade3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c44a00640 1 -- 172.21.15.82:0/3876082544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6ade71d0 con 0x55bf6add62c0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c44a00640 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6ade3680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009f50 tx=0x7f1c280099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104042c214bce466 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c2e000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c2e000640 1 -- 172.21.15.82:0/3876082544 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28031020 con 0x55bf6add62c0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c2e000640 1 -- 172.21.15.82:0/3876082544 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1c28019630 con 0x55bf6add62c0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c38011940 con 0x55bf6add62c0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c2e000640 1 -- 172.21.15.82:0/3876082544 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c28028070 con 0x55bf6add62c0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c4a391740 10 client.15294 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.828+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf6ae53350 con 0x55bf6add62c0 2024-04-26T20:22:40.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c2e000640 1 -- 172.21.15.82:0/3876082544 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c38011940 con 0x55bf6add62c0 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c2e000640 1 -- 172.21.15.82:0/3876082544 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1c28005430 con 0x55bf6add62c0 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c4a391740 10 client.15294 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c4a391740 10 client.15294 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c4a391740 20 client.15294 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6ae57f80 0x55bf6ae543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c4a391740 4 client.15294 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "status"}) -- 0x55bf6ad42080 con 0x55bf6ae57f80 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.829+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6ae57f80 0x55bf6ae543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c3fe00640 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6ae57f80 0x55bf6ae543c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c45be3e84832f2f7 server_cookie=4dc727a6e4dd41a7 in_seq=0 out_seq=0 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c2e000640 10 client.15294 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c2e000640 1 -- 172.21.15.82:0/3876082544 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bf6ad42080 con 0x55bf6ae57f80 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c2e000640 10 client.15294 handle_command_reply: tid=0 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 client.15294 shutdown 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 msgr2=0x55bf6ade3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6ade3680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009f50 tx=0x7f1c280099d0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 shutdown_connections 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55bf6ae57f80 0x55bf6ae543c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf6addbe20 0x55bf6ade6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c2e000640 0 client.15294 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf6add6cb0 0x55bf6ade3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 --2- 172.21.15.82:0/3876082544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf6add62c0 0x55bf6ade3680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.830+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 >> 172.21.15.82:0/3876082544 conn(0x55bf6ad6ad10 msgr2=0x55bf6add5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 shutdown_connections 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c4a391740 1 -- 172.21.15.82:0/3876082544 wait complete. 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c4a391740 20 client.15294 trim_cache size 0 max 16384 2024-04-26T20:22:40.837 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24550, 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 143.113910371, 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 185.83476602100001 2024-04-26T20:22:40.838 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:40.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1c240a3c40 msgr2=0x7f1c240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1c240a3c40 0x7f1c240a6100 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55bf6add7510 tx=0x7f1c38009500 comp rx=0 tx=0).stop 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 msgr2=0x7f1c4019f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4019f4a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c30005ab0 tx=0x7f1c30003b90 comp rx=0 tx=0).stop 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 shutdown_connections 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1c240a3c40 0x7f1c240a6100 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c4010a940 0x7f1c401a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c40109f80 0x7f1c4019f4a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 --2- 172.21.15.82:0/3798043189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c40108d90 0x7f1c4019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:40.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.831+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 >> 172.21.15.82:0/3798043189 conn(0x7f1c40077d30 msgr2=0x7f1c4010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:40.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.832+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 shutdown_connections 2024-04-26T20:22:40.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:40.832+0000 7f1c45e00640 1 -- 172.21.15.82:0/3798043189 wait complete. 2024-04-26T20:22:40.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:40 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1369943863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:40.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 -- 172.21.15.82:0/996831311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8109f80 msgr2=0x7f99c810a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 --2- 172.21.15.82:0/996831311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8109f80 0x7f99c810a400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009900 tx=0x7f99b802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 -- 172.21.15.82:0/996831311 shutdown_connections 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 --2- 172.21.15.82:0/996831311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c810a940 0x7f99c81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 --2- 172.21.15.82:0/996831311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c8109f80 0x7f99c810a400 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 --2- 172.21.15.82:0/996831311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c8108d90 0x7f99c81091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 -- 172.21.15.82:0/996831311 >> 172.21.15.82:0/996831311 conn(0x7f99c8077d30 msgr2=0x7f99c807a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 -- 172.21.15.82:0/996831311 shutdown_connections 2024-04-26T20:22:41.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.047+0000 7f99cca00640 1 -- 172.21.15.82:0/996831311 wait complete. 2024-04-26T20:22:41.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.048+0000 7f99cca00640 1 Processor -- start 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 -- start start 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c8108d90 0x7f99c819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 0x7f99c819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c810a940 0x7f99c81a6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81148a0 con 0x7f99c8108d90 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8114720 con 0x7f99c810a940 2024-04-26T20:22:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99cca00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8114a20 con 0x7f99c8109f80 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99c7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c8108d90 0x7f99c819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 0x7f99c819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 0x7f99c819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45058/0 (socket says 172.21.15.82:45058) 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99c6a00640 1 -- 172.21.15.82:0/786406691 learned_addr learned my addr 172.21.15.82:0/786406691 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.049+0000 7f99c7e00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c810a940 0x7f99c81a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c6a00640 1 -- 172.21.15.82:0/786406691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c810a940 msgr2=0x7f99c81a6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c6a00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c810a940 0x7f99c81a6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c6a00640 1 -- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c8108d90 msgr2=0x7f99c819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c6a00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c8108d90 0x7f99c819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c6a00640 1 -- 172.21.15.82:0/786406691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c81a6bc0 con 0x7f99c8109f80 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c7e00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c810a940 0x7f99c81a6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.050+0000 7f99c6a00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 0x7f99c819f4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005940 tx=0x7f99b8031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.051+0000 7f99bfe00640 1 -- 172.21.15.82:0/786406691 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b803f030 con 0x7f99c8109f80 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.051+0000 7f99bfe00640 1 -- 172.21.15.82:0/786406691 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b8003aa0 con 0x7f99c8109f80 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.051+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c81a6e50 con 0x7f99c8109f80 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.051+0000 7f99bfe00640 1 -- 172.21.15.82:0/786406691 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8035070 con 0x7f99c8109f80 2024-04-26T20:22:41.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.051+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c81a72b0 con 0x7f99c8109f80 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 Processor -- start 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 -- start start 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 0x56514f6b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b8cb0 0x56514f6bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56514f61c600 con 0x56514f6b82c0 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99bfe00640 1 -- 172.21.15.82:0/786406691 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f99b8042030 con 0x7f99c8109f80 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56514f5b9100 con 0x56514f6b8cb0 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.054+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56514f6185c0 con 0x56514f6bde20 2024-04-26T20:22:41.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 0x56514f6b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 0x56514f6b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47950/0 (socket says 172.21.15.82:47950) 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 -- 172.21.15.82:0/935594679 learned_addr learned my addr 172.21.15.82:0/935594679 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7400640 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b8cb0 0x56514f6bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c6a00640 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 -- 172.21.15.82:0/935594679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 msgr2=0x56514f6c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 -- 172.21.15.82:0/935594679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b8cb0 msgr2=0x56514f6bd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b8cb0 0x56514f6bd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.055+0000 7f99c7e00640 1 -- 172.21.15.82:0/935594679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514f32e2d0 con 0x56514f6b82c0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99c7e00640 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 0x56514f6b86e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f99c0011790 tx=0x7f99c0011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e108057aa722fddf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99b7e00640 1 -- 172.21.15.82:0/935594679 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0004d20 con 0x56514f6b82c0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99b7e00640 1 -- 172.21.15.82:0/935594679 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c0003970 con 0x56514f6b82c0 2024-04-26T20:22:41.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99b7e00640 1 -- 172.21.15.82:0/935594679 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c00044c0 con 0x56514f6b82c0 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99bfe00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f99ac0a3c40 0x7f99ac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99bfe00640 1 -- 172.21.15.82:0/786406691 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f99b80f0f40 con 0x7f99c8109f80 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.056+0000 7f99c7400640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f99ac0a3c40 0x7f99ac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 -- 172.21.15.82:0/935594679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 msgr2=0x56514f6b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 0x56514f6b86e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f99c0011790 tx=0x7f99c0011c50 comp rx=0 tx=0).stop 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 -- 172.21.15.82:0/935594679 shutdown_connections 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b8cb0 0x56514f6bd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/935594679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b82c0 0x56514f6b86e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 -- 172.21.15.82:0/935594679 >> 172.21.15.82:0/935594679 conn(0x56514f64cd10 msgr2=0x56514f6b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 -- 172.21.15.82:0/935594679 shutdown_connections 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 -- 172.21.15.82:0/935594679 wait complete. 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99c7400640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f99ac0a3c40 0x7f99ac0a6100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56514f6b4bf0 tx=0x7f99b000d5a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.057+0000 7f99d0fa3740 1 -- start start 2024-04-26T20:22:41.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 Processor -- start 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b82c0 0x56514f6c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6bde20 0x56514f6c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56514f6c0dd0 con 0x56514f6b8cb0 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56514f5a3f70 con 0x56514f6bde20 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56514f6c0f50 con 0x56514f6b82c0 2024-04-26T20:22:41.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99d0fa3740 10 client.0 _ll_register_callbacks cb 0x56514f612480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6bde20 0x56514f6c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47956/0 (socket says 172.21.15.82:47956) 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99c7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b82c0 0x56514f6c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.058+0000 7f99c6a00640 1 -- 172.21.15.82:0/2248167352 learned_addr learned my addr 172.21.15.82:0/2248167352 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c6a00640 1 -- 172.21.15.82:0/2248167352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b82c0 msgr2=0x56514f6c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c6a00640 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b82c0 0x56514f6c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c6a00640 1 -- 172.21.15.82:0/2248167352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6bde20 msgr2=0x56514f6c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c6a00640 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6bde20 0x56514f6c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c6a00640 1 -- 172.21.15.82:0/2248167352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514f3f86b0 con 0x56514f6b8cb0 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c7e00640 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6bde20 0x56514f6c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99c6a00640 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c2c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b96d0 tx=0x7f99b80bcb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dabef9b8f517dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99b4c00640 1 -- 172.21.15.82:0/2248167352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8049040 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99b4c00640 1 -- 172.21.15.82:0/2248167352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f99b80ee780 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.059+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c0003970 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99b4c00640 1 -- 172.21.15.82:0/2248167352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99b803b460 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 10 client.15306 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56514f6ccc50 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99b4c00640 1 -- 172.21.15.82:0/2248167352 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99c0003970 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99b4c00640 1 -- 172.21.15.82:0/2248167352 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99b80d60f0 con 0x56514f6b8cb0 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 10 client.15306 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 10 client.15306 resolve_mds: resolved name 'g' to daemon mds.g 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 20 client.15306 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:41.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f6cf380 0x56514f6d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 4 client.15306 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.060+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56514f62a210 con 0x56514f6cf380 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.061+0000 7f99c7400640 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f6cf380 0x56514f6d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.061+0000 7f99c7400640 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f6cf380 0x56514f6d07f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae5212796330439f server_cookie=66b98440a04eedc2 in_seq=0 out_seq=0 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.061+0000 7f99b4c00640 10 client.15306 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99b4c00640 1 -- 172.21.15.82:0/2248167352 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56514f62a210 con 0x56514f6cf380 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99b4c00640 10 client.15306 handle_command_reply: tid=0 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 client.15306 shutdown 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 msgr2=0x56514f6c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c2c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b96d0 tx=0x7f99b80bcb90 comp rx=0 tx=0).stop 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 shutdown_connections 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f6cf380 0x56514f6d07f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6bde20 0x56514f6c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c2c30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/2248167352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b82c0 0x56514f6c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 >> 172.21.15.82:0/2248167352 conn(0x56514f64cd10 msgr2=0x56514f6b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.062+0000 7f99b4c00640 0 client.15306 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:41.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.063+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 shutdown_connections 2024-04-26T20:22:41.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.063+0000 7f99d0fa3740 1 -- 172.21.15.82:0/2248167352 wait complete. 2024-04-26T20:22:41.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.063+0000 7f99d0fa3740 20 client.15306 trim_cache size 0 max 16384 2024-04-26T20:22:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:40 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1369943863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.082+0000 7f99d0fa3740 1 Processor -- start 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.082+0000 7f99d0fa3740 1 -- start start 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b8cb0 0x56514f6c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6bde20 0x56514f6b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56514f6ceb30 con 0x56514f6bde20 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56514f6cf200 con 0x56514f6b82c0 2024-04-26T20:22:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56514f6cf8d0 con 0x56514f6b8cb0 2024-04-26T20:22:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6bde20 0x56514f6b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6bde20 0x56514f6b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47972/0 (socket says 172.21.15.82:47972) 2024-04-26T20:22:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99c7e00640 1 -- 172.21.15.82:0/1718548403 learned_addr learned my addr 172.21.15.82:0/1718548403 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99c6a00640 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b8cb0 0x56514f6c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.083+0000 7f99c7400640 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99c6a00640 1 -- 172.21.15.82:0/1718548403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 msgr2=0x56514f6aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99c6a00640 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99c6a00640 1 -- 172.21.15.82:0/1718548403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6bde20 msgr2=0x56514f6b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99c6a00640 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6bde20 0x56514f6b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99c6a00640 1 -- 172.21.15.82:0/1718548403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514f6b9090 con 0x56514f6b8cb0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99c6a00640 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b8cb0 0x56514f6c9c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f99b80c5500 tx=0x7f99b802a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12966004529a6385 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99b7400640 1 -- 172.21.15.82:0/1718548403 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8049070 con 0x56514f6b8cb0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99b7400640 1 -- 172.21.15.82:0/1718548403 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b80bcd00 con 0x56514f6b8cb0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.084+0000 7f99b7400640 1 -- 172.21.15.82:0/1718548403 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b80dd1c0 con 0x56514f6b8cb0 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 -- 172.21.15.82:0/1718548403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b8cb0 msgr2=0x56514f6c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b8cb0 0x56514f6c9c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f99b80c5500 tx=0x7f99b802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 -- 172.21.15.82:0/1718548403 shutdown_connections 2024-04-26T20:22:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6bde20 0x56514f6b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6b8cb0 0x56514f6c9c30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/1718548403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 -- 172.21.15.82:0/1718548403 >> 172.21.15.82:0/1718548403 conn(0x56514f64cd10 msgr2=0x56514f6cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 -- 172.21.15.82:0/1718548403 shutdown_connections 2024-04-26T20:22:41.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.085+0000 7f99d0fa3740 1 -- 172.21.15.82:0/1718548403 wait complete. 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 -- start start 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 Processor -- start 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56514f6d0670 con 0x56514f6b8cb0 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56514f6cffa0 con 0x56514f6b82c0 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56514f6d0d40 con 0x56514f6bde20 2024-04-26T20:22:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.086+0000 7f99d0fa3740 10 client.0 _ll_register_callbacks cb 0x7f99b8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46670/0 (socket says 172.21.15.82:46670) 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45100/0 (socket says 172.21.15.82:45100) 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 -- 172.21.15.82:0/4152601209 learned_addr learned my addr 172.21.15.82:0/4152601209 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 -- 172.21.15.82:0/4152601209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 msgr2=0x56514f6c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 -- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 msgr2=0x56514f6c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 -- 172.21.15.82:0/4152601209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514f6c8fa0 con 0x56514f6b82c0 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c6a00640 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99c7400640 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6c5450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005fd0 tx=0x7f99b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6ab5f11bf38c23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.087+0000 7f99b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99b4c00640 1 -- 172.21.15.82:0/4152601209 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0028790 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b80bcd00 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99b4c00640 1 -- 172.21.15.82:0/4152601209 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f99b001b8b0 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99b4c00640 1 -- 172.21.15.82:0/4152601209 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99b0038050 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99d0fa3740 10 client.25409 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56514f735400 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.088+0000 7f99b4c00640 1 -- 172.21.15.82:0/4152601209 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b80bcd00 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99b4c00640 1 -- 172.21.15.82:0/4152601209 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99b0019040 con 0x56514f6b82c0 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99d0fa3740 10 client.25409 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99d0fa3740 10 client.25409 resolve_mds: resolved name 'g' to daemon mds.g 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99d0fa3740 20 client.25409 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f73a070 0x56514f738d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99d0fa3740 4 client.25409 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "status"}) -- 0x56514f624080 con 0x56514f73a070 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.089+0000 7f99c6a00640 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f73a070 0x56514f738d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99c6a00640 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f73a070 0x56514f738d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e36f29b3a07ca3d0 server_cookie=31a1abef13b7b64b in_seq=0 out_seq=0 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99b4c00640 10 client.25409 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99b4c00640 1 -- 172.21.15.82:0/4152601209 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56514f624080 con 0x56514f73a070 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99b4c00640 10 client.25409 handle_command_reply: tid=0 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 client.25409 shutdown 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 msgr2=0x56514f6c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6c5450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005fd0 tx=0x7f99b00046c0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 shutdown_connections 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x56514f73a070 0x56514f738d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56514f6bde20 0x56514f6c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56514f6b8cb0 0x56514f6c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 --2- 172.21.15.82:0/4152601209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514f6b82c0 0x56514f6c5450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 >> 172.21.15.82:0/4152601209 conn(0x56514f64cd10 msgr2=0x56514f6b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99b4c00640 0 client.25409 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 shutdown_connections 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 1 -- 172.21.15.82:0/4152601209 wait complete. 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.090+0000 7f99d0fa3740 20 client.25409 trim_cache size 0 max 16384 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:41.095 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24554, 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 144.38483868, 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 181.84501616700001 2024-04-26T20:22:41.096 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f99ac0a3c40 msgr2=0x7f99ac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f99ac0a3c40 0x7f99ac0a6100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56514f6b4bf0 tx=0x7f99b000d5a0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 msgr2=0x7f99c819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 0x7f99c819f4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005940 tx=0x7f99b8031a50 comp rx=0 tx=0).stop 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 shutdown_connections 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f99ac0a3c40 0x7f99ac0a6100 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c810a940 0x7f99c81a6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99c8109f80 0x7f99c819f4e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 --2- 172.21.15.82:0/786406691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c8108d90 0x7f99c819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 >> 172.21.15.82:0/786406691 conn(0x7f99c8077d30 msgr2=0x7f99c810d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 shutdown_connections 2024-04-26T20:22:41.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.091+0000 7f99cca00640 1 -- 172.21.15.82:0/786406691 wait complete. 2024-04-26T20:22:41.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:22:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:40 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1369943863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 -- 172.21.15.82:0/2532583632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 msgr2=0x7fa420074d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 --2- 172.21.15.82:0/2532583632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa420074d60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa410009900 tx=0x7fa41002a480 comp rx=0 tx=0).stop 2024-04-26T20:22:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 -- 172.21.15.82:0/2532583632 shutdown_connections 2024-04-26T20:22:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 --2- 172.21.15.82:0/2532583632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa42010a5f0 0x7fa42010ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 --2- 172.21.15.82:0/2532583632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa420075330 0x7fa420075790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 --2- 172.21.15.82:0/2532583632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa420074d60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 -- 172.21.15.82:0/2532583632 >> 172.21.15.82:0/2532583632 conn(0x7fa4200fdcb0 msgr2=0x7fa420100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 -- 172.21.15.82:0/2532583632 shutdown_connections 2024-04-26T20:22:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.311+0000 7fa426400640 1 -- 172.21.15.82:0/2532583632 wait complete. 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.312+0000 7fa426400640 1 Processor -- start 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.312+0000 7fa426400640 1 -- start start 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa426400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa420075330 0x7fa42019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa426400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa42019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa426400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42010a5f0 0x7fa4201a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa426400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201104b0 con 0x7fa420076910 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa426400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110330 con 0x7fa420075330 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa426400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110630 con 0x7fa42010a5f0 2024-04-26T20:22:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa42019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa42019b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47990/0 (socket says 172.21.15.82:47990) 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 -- 172.21.15.82:0/151147058 learned_addr learned my addr 172.21.15.82:0/151147058 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa425000640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa420075330 0x7fa42019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa425a00640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42010a5f0 0x7fa4201a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 -- 172.21.15.82:0/151147058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42010a5f0 msgr2=0x7fa4201a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42010a5f0 0x7fa4201a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 -- 172.21.15.82:0/151147058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa420075330 msgr2=0x7fa42019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.313+0000 7fa41fe00640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa420075330 0x7fa42019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa41fe00640 1 -- 172.21.15.82:0/151147058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201a27a0 con 0x7fa420076910 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa41fe00640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa42019b110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa40800ea60 tx=0x7fa40800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa41d600640 1 -- 172.21.15.82:0/151147058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40800cde0 con 0x7fa420076910 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa41d600640 1 -- 172.21.15.82:0/151147058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4080035f0 con 0x7fa420076910 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4201a2a90 con 0x7fa420076910 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa41d600640 1 -- 172.21.15.82:0/151147058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408010690 con 0x7fa420076910 2024-04-26T20:22:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.314+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4201a2fe0 con 0x7fa420076910 2024-04-26T20:22:41.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.318+0000 7fa42a975740 1 Processor -- start 2024-04-26T20:22:41.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.318+0000 7fa41d600640 1 -- 172.21.15.82:0/151147058 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa4080037a0 con 0x7fa420076910 2024-04-26T20:22:41.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.318+0000 7fa42a975740 1 -- start start 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa42a975740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa42a975740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa42a975740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa42a975740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f2e0618600 con 0x55f2e06b42c0 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa42a975740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f2e05b5100 con 0x55f2e06b4cb0 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa42a975740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06145c0 con 0x55f2e06b9e20 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46706/0 (socket says 172.21.15.82:46706) 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425000640 1 -- 172.21.15.82:0/2804509898 learned_addr learned my addr 172.21.15.82:0/2804509898 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa41fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47996/0 (socket says 172.21.15.82:47996) 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 -- 172.21.15.82:0/2804509898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 msgr2=0x55f2e06bc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06bc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 -- 172.21.15.82:0/2804509898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 msgr2=0x55f2e06b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425a00640 1 -- 172.21.15.82:0/2804509898 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2e032a2d0 con 0x55f2e06b42c0 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.319+0000 7fa425000640 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa425a00640 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06b46e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa418009ed0 tx=0x7fa4180107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332390777b35a0cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa41d600640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4040a3c40 0x7fa4040a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa416000640 1 -- 172.21.15.82:0/2804509898 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418003b70 con 0x55f2e06b42c0 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa41d600640 1 -- 172.21.15.82:0/151147058 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa4080d0c30 con 0x7fa420076910 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa425000640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4040a3c40 0x7fa4040a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa416000640 1 -- 172.21.15.82:0/2804509898 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa418015070 con 0x55f2e06b42c0 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.320+0000 7fa416000640 1 -- 172.21.15.82:0/2804509898 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418011730 con 0x55f2e06b42c0 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 -- 172.21.15.82:0/2804509898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 msgr2=0x55f2e06b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa425000640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4040a3c40 0x7fa4040a6100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f2e06b50b0 tx=0x7fa410005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06b46e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa418009ed0 tx=0x7fa4180107a0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 -- 172.21.15.82:0/2804509898 shutdown_connections 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06bc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 --2- 172.21.15.82:0/2804509898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06b46e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 -- 172.21.15.82:0/2804509898 >> 172.21.15.82:0/2804509898 conn(0x55f2e0648d10 msgr2=0x55f2e06afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 -- 172.21.15.82:0/2804509898 shutdown_connections 2024-04-26T20:22:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.321+0000 7fa42a975740 1 -- 172.21.15.82:0/2804509898 wait complete. 2024-04-26T20:22:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 -- start start 2024-04-26T20:22:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 Processor -- start 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b42c0 0x55f2e06be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06bcdd0 con 0x55f2e06b4cb0 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f2e059ff70 con 0x55f2e06b42c0 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06bcf50 con 0x55f2e06b9e20 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.322+0000 7fa42a975740 10 client.0 _ll_register_callbacks cb 0x55f2e060e480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa425000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b42c0 0x55f2e06be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48012/0 (socket says 172.21.15.82:48012) 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 -- 172.21.15.82:0/1740822847 learned_addr learned my addr 172.21.15.82:0/1740822847 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa425a00640 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 -- 172.21.15.82:0/1740822847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 msgr2=0x55f2e06c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 -- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b42c0 msgr2=0x55f2e06be720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b42c0 0x55f2e06be720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 -- 172.21.15.82:0/1740822847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2e03f46b0 con 0x55f2e06b4cb0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06bec60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa40809c730 tx=0x7fa408009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67023913e9dc32b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.323+0000 7fa40ea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa40ea00640 1 -- 172.21.15.82:0/1740822847 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40809c570 con 0x55f2e06b4cb0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa40ea00640 1 -- 172.21.15.82:0/1740822847 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa4080990a0 con 0x55f2e06b4cb0 2024-04-26T20:22:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa418015070 con 0x55f2e06b4cb0 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa40ea00640 1 -- 172.21.15.82:0/1740822847 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa40809c390 con 0x55f2e06b4cb0 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa42a975740 10 client.15324 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2e06c8cf0 con 0x55f2e06b4cb0 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa40ea00640 1 -- 172.21.15.82:0/1740822847 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa418015070 con 0x55f2e06b4cb0 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa40ea00640 1 -- 172.21.15.82:0/1740822847 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa408004000 con 0x55f2e06b4cb0 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.324+0000 7fa42a975740 10 client.15324 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.325+0000 7fa42a975740 10 client.15324 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.325+0000 7fa42a975740 20 client.15324 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.325+0000 7fa42a975740 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e06cb370 0x55f2e06cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.325+0000 7fa42a975740 4 client.15324 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.325+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2e0626210 con 0x55f2e06cb370 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.325+0000 7fa425000640 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e06cb370 0x55f2e06cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.326+0000 7fa425000640 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e06cb370 0x55f2e06cc7e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5291e81c882d321 server_cookie=d296a63ef6a1b3b6 in_seq=0 out_seq=0 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.326+0000 7fa40ea00640 10 client.15324 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa40ea00640 1 -- 172.21.15.82:0/1740822847 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f2e0626210 con 0x55f2e06cb370 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa40ea00640 10 client.15324 handle_command_reply: tid=0 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 client.15324 shutdown 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 msgr2=0x55f2e06bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06bec60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa40809c730 tx=0x7fa408009490 comp rx=0 tx=0).stop 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 shutdown_connections 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e06cb370 0x55f2e06cc7e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06bec60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa40ea00640 0 client.15324 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 --2- 172.21.15.82:0/1740822847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b42c0 0x55f2e06be720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 >> 172.21.15.82:0/1740822847 conn(0x55f2e0648d10 msgr2=0x55f2e06aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 shutdown_connections 2024-04-26T20:22:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 1 -- 172.21.15.82:0/1740822847 wait complete. 2024-04-26T20:22:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.327+0000 7fa42a975740 20 client.15324 trim_cache size 0 max 16384 2024-04-26T20:22:41.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 Processor -- start 2024-04-26T20:22:41.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 -- start start 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b42c0 0x55f2e06b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06cab20 con 0x55f2e06b4cb0 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06cb1f0 con 0x55f2e06b9e20 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.347+0000 7fa42a975740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06cb8c0 con 0x55f2e06b42c0 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa41fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46730/0 (socket says 172.21.15.82:46730) 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 -- 172.21.15.82:0/1413641459 learned_addr learned my addr 172.21.15.82:0/1413641459 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425000640 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b42c0 0x55f2e06b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 -- 172.21.15.82:0/1413641459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b42c0 msgr2=0x55f2e06b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b42c0 0x55f2e06b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 -- 172.21.15.82:0/1413641459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 msgr2=0x55f2e06b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa425a00640 1 -- 172.21.15.82:0/1413641459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2e06ab460 con 0x55f2e06b9e20 2024-04-26T20:22:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.348+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.349+0000 7fa425a00640 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5c60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa418010ca0 tx=0x7fa418013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f37c7db917e9b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.349+0000 7fa415600640 1 -- 172.21.15.82:0/1413641459 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418003b70 con 0x55f2e06b9e20 2024-04-26T20:22:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.349+0000 7fa415600640 1 -- 172.21.15.82:0/1413641459 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa418015050 con 0x55f2e06b9e20 2024-04-26T20:22:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.349+0000 7fa415600640 1 -- 172.21.15.82:0/1413641459 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41801c760 con 0x55f2e06b9e20 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 -- 172.21.15.82:0/1413641459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 msgr2=0x55f2e06c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5c60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa418010ca0 tx=0x7fa418013040 comp rx=0 tx=0).stop 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 -- 172.21.15.82:0/1413641459 shutdown_connections 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c5c60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b4cb0 0x55f2e06b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 --2- 172.21.15.82:0/1413641459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b42c0 0x55f2e06b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 -- 172.21.15.82:0/1413641459 >> 172.21.15.82:0/1413641459 conn(0x55f2e0648d10 msgr2=0x55f2e06af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 -- 172.21.15.82:0/1413641459 shutdown_connections 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 -- 172.21.15.82:0/1413641459 wait complete. 2024-04-26T20:22:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 -- start start 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.350+0000 7fa42a975740 1 Processor -- start 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b4cb0 0x55f2e06c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06cc660 con 0x55f2e06b42c0 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06cbf90 con 0x55f2e06b9e20 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f2e06ccd30 con 0x55f2e06b4cb0 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa42a975740 10 client.0 _ll_register_callbacks cb 0x7fa40800ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa425000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa425000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06c19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48020/0 (socket says 172.21.15.82:48020) 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa425000640 1 -- 172.21.15.82:0/1732406410 learned_addr learned my addr 172.21.15.82:0/1732406410 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b4cb0 0x55f2e06c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.351+0000 7fa425a00640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa425000640 1 -- 172.21.15.82:0/1732406410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b4cb0 msgr2=0x55f2e06c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa425000640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b4cb0 0x55f2e06c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa425000640 1 -- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 msgr2=0x55f2e06c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa425000640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa425000640 1 -- 172.21.15.82:0/1732406410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2e06c54c0 con 0x55f2e06b42c0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa425000640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06c19c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa41002a9a0 tx=0x7fa41002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97613bc083eba5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa40ea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa40ea00640 1 -- 172.21.15.82:0/1732406410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410058070 con 0x55f2e06b42c0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa40ea00640 1 -- 172.21.15.82:0/1732406410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa4100317a0 con 0x55f2e06b42c0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa418015050 con 0x55f2e06b42c0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa40ea00640 1 -- 172.21.15.82:0/1732406410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa410061050 con 0x55f2e06b42c0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa42a975740 10 client.15330 fetch_fsmap learned FSMap version 28 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.352+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2e07318c0 con 0x55f2e06b42c0 2024-04-26T20:22:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa40ea00640 1 -- 172.21.15.82:0/1732406410 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa418015050 con 0x55f2e06b42c0 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa40ea00640 1 -- 172.21.15.82:0/1732406410 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa41005b020 con 0x55f2e06b42c0 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa42a975740 10 client.15330 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa42a975740 10 client.15330 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa42a975740 20 client.15330 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa42a975740 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e0736500 0x55f2e0732940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa42a975740 4 client.15330 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:22:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.353+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "status"}) -- 0x55f2e0620080 con 0x55f2e0736500 2024-04-26T20:22:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e0736500 0x55f2e0732940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa41fe00640 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e0736500 0x55f2e0732940 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5d18bd0a92907d server_cookie=f490de6a53b49749 in_seq=0 out_seq=0 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa40ea00640 10 client.15330 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa40ea00640 1 -- 172.21.15.82:0/1732406410 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f2e0620080 con 0x55f2e0736500 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa40ea00640 10 client.15330 handle_command_reply: tid=0 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa42a975740 1 client.15330 shutdown 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 msgr2=0x55f2e06c19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.354+0000 7fa42a975740 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06c19c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa41002a9a0 tx=0x7fa41002a480 comp rx=0 tx=0).stop 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 shutdown_connections 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f2e0736500 0x55f2e0732940 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2e06b9e20 0x55f2e06c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f2e06b4cb0 0x55f2e06c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 --2- 172.21.15.82:0/1732406410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2e06b42c0 0x55f2e06c19c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa40ea00640 0 client.15330 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 >> 172.21.15.82:0/1732406410 conn(0x55f2e0648d10 msgr2=0x55f2e06be330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 shutdown_connections 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 1 -- 172.21.15.82:0/1732406410 wait complete. 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa42a975740 20 client.15330 trim_cache size 0 max 16384 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "da6438ae-0408-11ef-bc93-c7b262605968", 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24584, 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-04-26T20:22:41.360 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 168.668798775, 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 91, 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 175.158453624 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4040a3c40 msgr2=0x7fa4040a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa426400640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4040a3c40 0x7fa4040a6100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f2e06b50b0 tx=0x7fa410005a20 comp rx=0 tx=0).stop 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 msgr2=0x7fa42019b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.355+0000 7fa426400640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa42019b110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa40800ea60 tx=0x7fa40800ef20 comp rx=0 tx=0).stop 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 shutdown_connections 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4040a3c40 0x7fa4040a6100 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa42010a5f0 0x7fa4201a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa420076910 0x7fa42019b110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 --2- 172.21.15.82:0/151147058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa420075330 0x7fa42019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 >> 172.21.15.82:0/151147058 conn(0x7fa4200fdcb0 msgr2=0x7fa420106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 shutdown_connections 2024-04-26T20:22:41.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:41.356+0000 7fa426400640 1 -- 172.21.15.82:0/151147058 wait complete. 2024-04-26T20:22:41.373 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T20:22:41.382 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T20:22:41.383 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T20:22:41.383 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T20:22:41.383 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T20:22:41.395 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T20:22:41.396 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T20:22:41.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:41.396 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-26T20:22:41.442 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T20:22:41.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:41.444 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:22:41.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:41.526 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-26T20:22:41.647 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-26T20:22:41.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:22:41.647 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:41.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T20:22:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:41 smithi082 ceph-mon[28105]: pgmap v408: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:42.067 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:22:42.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:41 smithi139 ceph-mon[32999]: pgmap v408: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:41 smithi135 ceph-mon[32816]: pgmap v408: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-26T20:22:43.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:43 smithi082 ceph-mon[28105]: pgmap v409: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:43 smithi139 ceph-mon[32999]: pgmap v409: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:44.264 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:43 smithi135 ceph-mon[32816]: pgmap v409: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-26T20:22:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 -- 172.21.15.82:0/2753786648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 msgr2=0x7fccc01059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 --2- 172.21.15.82:0/2753786648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01059d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccac009990 tx=0x7fccac009ca0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 -- 172.21.15.82:0/2753786648 shutdown_connections 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 --2- 172.21.15.82:0/2753786648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc0105f10 0x7fccc01123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 --2- 172.21.15.82:0/2753786648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc010b600 0x7fccc010b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 --2- 172.21.15.82:0/2753786648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01059d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.482+0000 7fccc5c00700 1 -- 172.21.15.82:0/2753786648 >> 172.21.15.82:0/2753786648 conn(0x7fccc0101000 msgr2=0x7fccc0103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.483+0000 7fccc5c00700 1 -- 172.21.15.82:0/2753786648 shutdown_connections 2024-04-26T20:22:44.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.483+0000 7fccc5c00700 1 -- 172.21.15.82:0/2753786648 wait complete. 2024-04-26T20:22:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.484+0000 7fccc5c00700 1 Processor -- start 2024-04-26T20:22:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.484+0000 7fccc5c00700 1 -- start start 2024-04-26T20:22:44.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5c00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5c00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc0105f10 0x7fccc01a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc010b600 0x7fccc019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0115760 con 0x7fccc010b600 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5c00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01155e0 con 0x7fccc0105f10 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5c00700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01158e0 con 0x7fccc0105550 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccbfe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccbfe00700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45168/0 (socket says 172.21.15.82:45168) 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccbfe00700 1 -- 172.21.15.82:0/3951254041 learned_addr learned my addr 172.21.15.82:0/3951254041 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccc5200700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc010b600 0x7fccc019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.485+0000 7fccbf400700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc0105f10 0x7fccc01a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbfe00700 1 -- 172.21.15.82:0/3951254041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc0105f10 msgr2=0x7fccc01a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbfe00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc0105f10 0x7fccc01a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbfe00700 1 -- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc010b600 msgr2=0x7fccc019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbfe00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc010b600 0x7fccc019ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbfe00700 1 -- 172.21.15.82:0/3951254041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc019c160 con 0x7fccc0105550 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbfe00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01a17f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fccb000e9c0 tx=0x7fccb000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000cbd0 con 0x7fccc0105550 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb000ee50 con 0x7fccc0105550 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.486+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0005550 con 0x7fccc0105550 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.487+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc019c450 con 0x7fccc0105550 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.487+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc01a86c0 con 0x7fccc0105550 2024-04-26T20:22:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.488+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc006a110 con 0x7fccc0105550 2024-04-26T20:22:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.490+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fccb0004750 con 0x7fccc0105550 2024-04-26T20:22:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.491+0000 7fccbcc00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcca40a3d50 0x7fcca40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.492+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fccb00d0cb0 con 0x7fccc0105550 2024-04-26T20:22:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.492+0000 7fccbf400700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcca40a3d50 0x7fcca40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.492+0000 7fccbf400700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcca40a3d50 0x7fcca40a6210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fccac0098e0 tx=0x7fccac005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.494+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fccb009d170 con 0x7fccc0105550 2024-04-26T20:22:44.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.775+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fccc019cee0 con 0x7fccc0105550 2024-04-26T20:22:44.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.776+0000 7fccbcc00700 1 -- 172.21.15.82:0/3951254041 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7fccb009ca70 con 0x7fccc0105550 2024-04-26T20:22:44.776 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:22:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.778+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcca40a3d50 msgr2=0x7fcca40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.778+0000 7fccc5c00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcca40a3d50 0x7fcca40a6210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fccac0098e0 tx=0x7fccac005960 comp rx=0 tx=0).stop 2024-04-26T20:22:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 msgr2=0x7fccc01a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01a17f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fccb000e9c0 tx=0x7fccb000ecd0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 shutdown_connections 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccc010b600 0x7fccc019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccc0105550 0x7fccc01a17f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcca40a3d50 0x7fcca40a6210 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 --2- 172.21.15.82:0/3951254041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc0105f10 0x7fccc01a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 >> 172.21.15.82:0/3951254041 conn(0x7fccc0101000 msgr2=0x7fccc0102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 shutdown_connections 2024-04-26T20:22:44.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:44.779+0000 7fccc5c00700 1 -- 172.21.15.82:0/3951254041 wait complete. 2024-04-26T20:22:45.731 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:22:45.732 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:22:45.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:45.732 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-04-26T20:22:45.782 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:22:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:22:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-04-26T20:22:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:22:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41896sec preferred_lft 41896sec 2024-04-26T20:22:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-04-26T20:22:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:22:45.785 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:22:45.786 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:22:45.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:22:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:45 smithi082 ceph-mon[28105]: pgmap v410: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:45 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3951254041' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:22:46.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:46.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:46.026 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:22:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:45 smithi139 ceph-mon[32999]: pgmap v410: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:45 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3951254041' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:22:46.093 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-04-26T20:22:46.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:46.097 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-04-26T20:22:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:45 smithi135 ceph-mon[32816]: pgmap v410: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:22:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:45 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3951254041' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T20:22:46.146 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-04-26T20:22:46.147 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:22:46.147 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:22:46.147 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:22:46.147 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:22:46.148 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:22:46.148 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:22:46.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:22:46.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:22:46.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:22:46.148 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:22:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:22:46.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:46.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:46.355 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-26T20:22:46.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:46.402 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-04-26T20:22:46.455 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:22:46.455 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:22:46.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:22:46.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T20:22:46.455 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:22:46.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:22:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:46.635 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T20:22:46.635 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:22:46.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:22:46.850 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:46 smithi082 ceph-mon[28105]: pgmap v411: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:46.899 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:22:46.899 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-26T20:22:46.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-04-26T20:22:46.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:22:46.900 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-26T20:22:46.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:22:47.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:46 smithi139 ceph-mon[32999]: pgmap v411: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:47.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:47.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:22:47.098 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:47.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:46 smithi135 ceph-mon[32816]: pgmap v411: 129 pgs: 129 active+clean; 637 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:22:47.142 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:22:47.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:22:47.142 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:47.239 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-26T20:22:47.239 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-26T20:22:47.239 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def 2024-04-26T20:22:47.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:47.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-04-26T20:22:47.365 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-04-26T20:22:47.366 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-04-26T20:22:47.366 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-26T20:22:48.085 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-04-26T20:22:48.085 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-04-26T20:22:48.085 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-26T20:22:48.085 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.135:3300,172.21.15.139:3300" 2024-04-26T20:22:48.085 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:3300,172.21.15.135:3300,172.21.15.139:3300:/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def 2024-04-26T20:22:48.086 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=da6438ae-0408-11ef-bc93-c7b262605968" will pass to kernel 2024-04-26T20:22:48.091 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T20:22:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-04-26T20:22:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T20:22:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T20:22:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T20:22:48.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:22:48.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:48.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:48.183 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:22:48.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:22:48.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:48.302 INFO:teuthology.orchestra.run.smithi082.stdout:client25436 2024-04-26T20:22:48.302 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:22:48.302 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:22:48.354 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:22:48.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:22:48.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:48.520 INFO:teuthology.orchestra.run.smithi082.stdout:client25436 2024-04-26T20:22:48.521 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:22:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:22:48.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:48.640 INFO:teuthology.orchestra.run.smithi082.stdout:client25436 2024-04-26T20:22:48.640 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/da6438ae-0408-11ef-bc93-c7b262605968.client25436/status') 2024-04-26T20:22:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:22:48.767 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.25436 (3)172.21.15.82:0/927268625 2024-04-26T20:22:48.768 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-04-26T20:22:48.768 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-04-26T20:22:48.768 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-04-26T20:22:48.768 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 6.8502e-05 s, 1.0 MB/s 2024-04-26T20:22:48.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:22:48.780 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T20:22:48.790 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T20:22:48.790 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:22:48.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-26T20:22:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 -- 172.21.15.82:0/4028988348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 msgr2=0x7ffa2c101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 --2- 172.21.15.82:0/4028988348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 0x7ffa2c101ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009900 tx=0x7ffa1c02a410 comp rx=0 tx=0).stop 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 -- 172.21.15.82:0/4028988348 shutdown_connections 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 --2- 172.21.15.82:0/4028988348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa2c103260 0x7ffa2c109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 --2- 172.21.15.82:0/4028988348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 --2- 172.21.15.82:0/4028988348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 0x7ffa2c101ad0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 -- 172.21.15.82:0/4028988348 >> 172.21.15.82:0/4028988348 conn(0x7ffa2c0fcc20 msgr2=0x7ffa2c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 -- 172.21.15.82:0/4028988348 shutdown_connections 2024-04-26T20:22:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.984+0000 7ffa31c00640 1 -- 172.21.15.82:0/4028988348 wait complete. 2024-04-26T20:22:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 Processor -- start 2024-04-26T20:22:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 -- start start 2024-04-26T20:22:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 0x7ffa2c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa2c103260 0x7ffa2c1a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c10e2e0 con 0x7ffa2c1016b0 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c10e160 con 0x7ffa2c1028a0 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.985+0000 7ffa31c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c10e460 con 0x7ffa2c103260 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa2be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 0x7ffa2c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46770/0 (socket says 172.21.15.82:46770) 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 -- 172.21.15.82:0/1692546477 learned_addr learned my addr 172.21.15.82:0/1692546477 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa31200640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa2c103260 0x7ffa2c1a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 -- 172.21.15.82:0/1692546477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa2c103260 msgr2=0x7ffa2c1a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa2c103260 0x7ffa2c1a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 -- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 msgr2=0x7ffa2c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 0x7ffa2c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 -- 172.21.15.82:0/1692546477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c1a2870 con 0x7ffa2c1028a0 2024-04-26T20:22:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.986+0000 7ffa23400640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c19b1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400ea60 tx=0x7ffa1400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.987+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400cde0 con 0x7ffa2c1028a0 2024-04-26T20:22:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.987+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa140035f0 con 0x7ffa2c1028a0 2024-04-26T20:22:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.987+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2c1a2b60 con 0x7ffa2c1028a0 2024-04-26T20:22:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.987+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14010690 con 0x7ffa2c1028a0 2024-04-26T20:22:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.987+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2c1a30b0 con 0x7ffa2c1028a0 2024-04-26T20:22:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.988+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2c1a32e0 con 0x7ffa2c1028a0 2024-04-26T20:22:48.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.990+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ffa140037a0 con 0x7ffa2c1028a0 2024-04-26T20:22:48.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.991+0000 7ffa29600640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa0c0a3c30 0x7ffa0c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.991+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ffa140d0c70 con 0x7ffa2c1028a0 2024-04-26T20:22:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.992+0000 7ffa2be00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa0c0a3c30 0x7ffa0c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.992+0000 7ffa2be00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa0c0a3c30 0x7ffa0c0a60f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c19c130 tx=0x7ffa1c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:48.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:48.996+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ffa1409d130 con 0x7ffa2c1028a0 2024-04-26T20:22:49.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.240+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7ffa2c1a36d0 con 0x7ffa2c1028a0 2024-04-26T20:22:49.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.709+0000 7ffa29600640 1 -- 172.21.15.82:0/1692546477 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7ffa1409ca30 con 0x7ffa2c1028a0 2024-04-26T20:22:49.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.712+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa0c0a3c30 msgr2=0x7ffa0c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.712+0000 7ffa31c00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa0c0a3c30 0x7ffa0c0a60f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c19c130 tx=0x7ffa1c0314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.712+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 msgr2=0x7ffa2c19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.712+0000 7ffa31c00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c19b1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400ea60 tx=0x7ffa1400ef20 comp rx=0 tx=0).stop 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 shutdown_connections 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffa0c0a3c30 0x7ffa0c0a60f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa2c103260 0x7ffa2c1a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa2c1028a0 0x7ffa2c19b1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 --2- 172.21.15.82:0/1692546477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa2c1016b0 0x7ffa2c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 >> 172.21.15.82:0/1692546477 conn(0x7ffa2c0fcc20 msgr2=0x7ffa2c1080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:49.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 shutdown_connections 2024-04-26T20:22:49.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.713+0000 7ffa31c00640 1 -- 172.21.15.82:0/1692546477 wait complete. 2024-04-26T20:22:49.735 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-26T20:22:49.746 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-26T20:22:49.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 -- 172.21.15.82:0/3834131252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378078ed0 msgr2=0x7f8378079770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 --2- 172.21.15.82:0/3834131252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378078ed0 0x7f8378079770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8370009ca0 tx=0x7f837002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 -- 172.21.15.82:0/3834131252 shutdown_connections 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 --2- 172.21.15.82:0/3834131252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8378078ed0 0x7f8378079770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 --2- 172.21.15.82:0/3834131252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8378078530 0x7f8378078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 --2- 172.21.15.82:0/3834131252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83780772f0 0x7f8378077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 -- 172.21.15.82:0/3834131252 >> 172.21.15.82:0/3834131252 conn(0x7f8378100120 msgr2=0x7f8378102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:49.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 -- 172.21.15.82:0/3834131252 shutdown_connections 2024-04-26T20:22:49.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.957+0000 7f837cc00640 1 -- 172.21.15.82:0/3834131252 wait complete. 2024-04-26T20:22:49.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.958+0000 7f837cc00640 1 Processor -- start 2024-04-26T20:22:49.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.958+0000 7f837cc00640 1 -- start start 2024-04-26T20:22:49.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f837cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 0x7f837819f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:49.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f837cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8378078530 0x7f837819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f837cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8378078ed0 0x7f83781a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f837cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8378114b10 con 0x7f83780772f0 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f837cc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8378114990 con 0x7f8378078ed0 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f837cc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8378114c90 con 0x7f8378078530 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 0x7f837819f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 0x7f837819f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48080/0 (socket says 172.21.15.82:48080) 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 -- 172.21.15.82:0/2111158638 learned_addr learned my addr 172.21.15.82:0/2111158638 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375400640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8378078530 0x7f837819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8376800640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8378078ed0 0x7f83781a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 -- 172.21.15.82:0/2111158638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8378078530 msgr2=0x7f837819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:49.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8378078530 0x7f837819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 -- 172.21.15.82:0/2111158638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8378078ed0 msgr2=0x7f83781a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8378078ed0 0x7f83781a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.959+0000 7f8375e00640 1 -- 172.21.15.82:0/2111158638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83781a6d20 con 0x7f83780772f0 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.960+0000 7f8375e00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 0x7f837819f100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f836800e9f0 tx=0x7f836800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.960+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836800cd80 con 0x7f83780772f0 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.960+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83680054d0 con 0x7f83780772f0 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.960+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368010690 con 0x7f83780772f0 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.960+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83781a6fb0 con 0x7f83780772f0 2024-04-26T20:22:49.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.960+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83781a7420 con 0x7f83780772f0 2024-04-26T20:22:49.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.962+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8378111640 con 0x7f83780772f0 2024-04-26T20:22:49.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.964+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8368004e90 con 0x7f83780772f0 2024-04-26T20:22:49.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.965+0000 7f836ea00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f835c0a3c40 0x7f835c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:49.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.965+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f83680d0de0 con 0x7f83780772f0 2024-04-26T20:22:49.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.965+0000 7f8375400640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f835c0a3c40 0x7f835c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:49.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.966+0000 7f8375400640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f835c0a3c40 0x7f835c0a6100 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f83600095f0 tx=0x7f8360005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:49.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:49.970+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f836809d2a0 con 0x7f83780772f0 2024-04-26T20:22:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:49 smithi139 ceph-mon[32999]: pgmap v412: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:22:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:49 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1692546477' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:22:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:49 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:22:50.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:49 smithi135 ceph-mon[32816]: pgmap v412: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:22:50.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:49 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1692546477' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:22:50.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:49 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:22:50.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.170+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83780635d0 con 0x7f83780772f0 2024-04-26T20:22:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.174+0000 7f836ea00640 1 -- 172.21.15.82:0/2111158638 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f836809cba0 con 0x7f83780772f0 2024-04-26T20:22:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:50.175 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f835c0a3c40 msgr2=0x7f835c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f835c0a3c40 0x7f835c0a6100 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f83600095f0 tx=0x7f8360005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 msgr2=0x7f837819f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 0x7f837819f100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f836800e9f0 tx=0x7f836800edf0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 shutdown_connections 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f835c0a3c40 0x7f835c0a6100 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8378078ed0 0x7f83781a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8378078530 0x7f837819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 --2- 172.21.15.82:0/2111158638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83780772f0 0x7f837819f100 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 >> 172.21.15.82:0/2111158638 conn(0x7f8378100120 msgr2=0x7f8378101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 shutdown_connections 2024-04-26T20:22:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.177+0000 7f837cc00640 1 -- 172.21.15.82:0/2111158638 wait complete. 2024-04-26T20:22:50.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:49 smithi082 ceph-mon[28105]: pgmap v412: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:22:50.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:49 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1692546477' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:22:50.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:49 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T20:22:50.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:22:50.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:22:50.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 -- 172.21.15.82:0/1789531917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c9810a980 msgr2=0x7f8c981112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 --2- 172.21.15.82:0/1789531917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c9810a980 0x7f8c981112a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009be0 tx=0x7f8c9002a6d0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 -- 172.21.15.82:0/1789531917 shutdown_connections 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 --2- 172.21.15.82:0/1789531917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c9810a980 0x7f8c981112a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 --2- 172.21.15.82:0/1789531917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 --2- 172.21.15.82:0/1789531917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c98108e70 0x7f8c98109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 -- 172.21.15.82:0/1789531917 >> 172.21.15.82:0/1789531917 conn(0x7f8c98077e00 msgr2=0x7f8c9807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 -- 172.21.15.82:0/1789531917 shutdown_connections 2024-04-26T20:22:50.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.402+0000 7f8c9e800640 1 -- 172.21.15.82:0/1789531917 wait complete. 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 Processor -- start 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 -- start start 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c98108e70 0x7f8c9819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c9810a980 0x7f8c981a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c981149a0 con 0x7f8c98108e70 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98114820 con 0x7f8c98109fc0 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.403+0000 7f8c9e800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8c98114b20 con 0x7f8c9810a980 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c98108e70 0x7f8c9819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9819f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:46800/0 (socket says 172.21.15.82:46800) 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 -- 172.21.15.82:0/2458022566 learned_addr learned my addr 172.21.15.82:0/2458022566 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9de00640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c9810a980 0x7f8c981a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 -- 172.21.15.82:0/2458022566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c9810a980 msgr2=0x7f8c981a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c9810a980 0x7f8c981a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 -- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c98108e70 msgr2=0x7f8c9819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c98108e70 0x7f8c9819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 -- 172.21.15.82:0/2458022566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c981a6c00 con 0x7f8c98109fc0 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.404+0000 7f8c9ca00640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9819f520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400e9f0 tx=0x7f8c8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.405+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400ccc0 con 0x7f8c98109fc0 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.405+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c840035f0 con 0x7f8c98109fc0 2024-04-26T20:22:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.405+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400ce60 con 0x7f8c98109fc0 2024-04-26T20:22:50.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.405+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c981a6ef0 con 0x7f8c98109fc0 2024-04-26T20:22:50.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.405+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c981a7400 con 0x7f8c98109fc0 2024-04-26T20:22:50.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.406+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c98110180 con 0x7f8c98109fc0 2024-04-26T20:22:50.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.408+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8c84004000 con 0x7f8c98109fc0 2024-04-26T20:22:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.409+0000 7f8c96000640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c800a3cc0 0x7f8c800a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.410+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8c840d0b80 con 0x7f8c98109fc0 2024-04-26T20:22:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.410+0000 7f8c9d400640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c800a3cc0 0x7f8c800a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.410+0000 7f8c9d400640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c800a3cc0 0x7f8c800a6180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009bd0 tx=0x7f8c8c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:50.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.412+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f8c8409d040 con 0x7f8c98109fc0 2024-04-26T20:22:50.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.618+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8c9802dd20 con 0x7f8c98109fc0 2024-04-26T20:22:50.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.619+0000 7f8c96000640 1 -- 172.21.15.82:0/2458022566 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f8c8409c940 con 0x7f8c98109fc0 2024-04-26T20:22:50.620 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c800a3cc0 msgr2=0x7f8c800a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c800a3cc0 0x7f8c800a6180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009bd0 tx=0x7f8c8c005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 msgr2=0x7f8c9819f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9819f520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400e9f0 tx=0x7f8c8400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 shutdown_connections 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c800a3cc0 0x7f8c800a6180 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c9810a980 0x7f8c981a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c98109fc0 0x7f8c9819f520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 --2- 172.21.15.82:0/2458022566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c98108e70 0x7f8c9819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 >> 172.21.15.82:0/2458022566 conn(0x7f8c98077e00 msgr2=0x7f8c9810d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:50.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 shutdown_connections 2024-04-26T20:22:50.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.623+0000 7f8c9e800640 1 -- 172.21.15.82:0/2458022566 wait complete. 2024-04-26T20:22:50.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 -- 172.21.15.82:0/3584429860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 msgr2=0x7fa4a0101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/3584429860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0101ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa490009900 tx=0x7fa49002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 -- 172.21.15.82:0/3584429860 shutdown_connections 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/3584429860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a0103430 0x7fa4a0109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/3584429860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0102a70 0x7fa4a0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/3584429860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0101ca0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 -- 172.21.15.82:0/3584429860 >> 172.21.15.82:0/3584429860 conn(0x7fa4a00fcdf0 msgr2=0x7fa4a00ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 -- 172.21.15.82:0/3584429860 shutdown_connections 2024-04-26T20:22:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.848+0000 7fa4a4a00640 1 -- 172.21.15.82:0/3584429860 wait complete. 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.849+0000 7fa4a4a00640 1 Processor -- start 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 -- start start 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0102a70 0x7fa4a01991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a0103430 0x7fa4a01a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010d380 con 0x7fa4a0101880 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010d200 con 0x7fa4a0103430 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa4a4a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010d500 con 0x7fa4a0102a70 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa49de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa49de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42510/0 (socket says 172.21.15.82:42510) 2024-04-26T20:22:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa49de00640 1 -- 172.21.15.82:0/394136220 learned_addr learned my addr 172.21.15.82:0/394136220 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa497e00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0102a70 0x7fa4a01991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.850+0000 7fa49e800640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a0103430 0x7fa4a01a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa49de00640 1 -- 172.21.15.82:0/394136220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0102a70 msgr2=0x7fa4a01991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa49de00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0102a70 0x7fa4a01991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa49de00640 1 -- 172.21.15.82:0/394136220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a0103430 msgr2=0x7fa4a01a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa49de00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a0103430 0x7fa4a01a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa49de00640 1 -- 172.21.15.82:0/394136220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a01a0870 con 0x7fa4a0101880 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa49de00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0198c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa490006010 tx=0x7fa4900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49003f030 con 0x7fa4a0101880 2024-04-26T20:22:50.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a01a0b00 con 0x7fa4a0101880 2024-04-26T20:22:50.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa490003cb0 con 0x7fa4a0101880 2024-04-26T20:22:50.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.851+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490035070 con 0x7fa4a0101880 2024-04-26T20:22:50.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.852+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01a1040 con 0x7fa4a0101880 2024-04-26T20:22:50.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.853+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a01a1210 con 0x7fa4a0101880 2024-04-26T20:22:50.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.854+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa490042030 con 0x7fa4a0101880 2024-04-26T20:22:50.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.856+0000 7fa496a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4840a3cc0 0x7fa4840a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:50.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.856+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa4900f0e80 con 0x7fa4a0101880 2024-04-26T20:22:50.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.856+0000 7fa497e00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4840a3cc0 0x7fa4840a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:50.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.857+0000 7fa497e00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4840a3cc0 0x7fa4840a6180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa48800bbe0 tx=0x7fa48800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:50.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:50.860+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa4900bccf0 con 0x7fa4a0101880 2024-04-26T20:22:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:50 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T20:22:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:50 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:22:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:50 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2111158638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:50 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2458022566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.060+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa4a01a13e0 con 0x7fa4a0101880 2024-04-26T20:22:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.061+0000 7fa496a00640 1 -- 172.21.15.82:0/394136220 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fa4900c0ff0 con 0x7fa4a0101880 2024-04-26T20:22:51.061 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4840a3cc0 msgr2=0x7fa4840a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4840a3cc0 0x7fa4840a6180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa48800bbe0 tx=0x7fa48800b390 comp rx=0 tx=0).stop 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 msgr2=0x7fa4a0198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0198c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa490006010 tx=0x7fa4900042f0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 shutdown_connections 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa4840a3cc0 0x7fa4840a6180 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4a0103430 0x7fa4a01a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4a0102a70 0x7fa4a01991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 --2- 172.21.15.82:0/394136220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0101880 0x7fa4a0198c60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 >> 172.21.15.82:0/394136220 conn(0x7fa4a00fcdf0 msgr2=0x7fa4a006ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.063+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 shutdown_connections 2024-04-26T20:22:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.064+0000 7fa4a4a00640 1 -- 172.21.15.82:0/394136220 wait complete. 2024-04-26T20:22:51.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:50 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T20:22:51.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:50 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:22:51.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:50 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2111158638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:51.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:50 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2458022566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:51.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:50 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T20:22:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:50 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:22:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:50 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2111158638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:51.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:50 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2458022566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 -- 172.21.15.82:0/2342834774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104109f80 msgr2=0x7f010410a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 --2- 172.21.15.82:0/2342834774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104109f80 0x7f010410a400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009900 tx=0x7f00ec02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 -- 172.21.15.82:0/2342834774 shutdown_connections 2024-04-26T20:22:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 --2- 172.21.15.82:0/2342834774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f010410a940 0x7f01041111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 --2- 172.21.15.82:0/2342834774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104109f80 0x7f010410a400 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 --2- 172.21.15.82:0/2342834774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0104108d90 0x7f01041091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 -- 172.21.15.82:0/2342834774 >> 172.21.15.82:0/2342834774 conn(0x7f0104077d30 msgr2=0x7f010407a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 -- 172.21.15.82:0/2342834774 shutdown_connections 2024-04-26T20:22:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.286+0000 7f0103e00640 1 -- 172.21.15.82:0/2342834774 wait complete. 2024-04-26T20:22:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.287+0000 7f0103e00640 1 Processor -- start 2024-04-26T20:22:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.287+0000 7f0103e00640 1 -- start start 2024-04-26T20:22:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 0x7f010419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0104109f80 0x7f010419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f010410a940 0x7f01041a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01041148c0 con 0x7f0104108d90 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114740 con 0x7f0104109f80 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0104114a40 con 0x7f010410a940 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 0x7f010419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 0x7f010419efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42536/0 (socket says 172.21.15.82:42536) 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 -- 172.21.15.82:0/3703047621 learned_addr learned my addr 172.21.15.82:0/3703047621 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f00fbe00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0104109f80 0x7f010419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0103400640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f010410a940 0x7f01041a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 -- 172.21.15.82:0/3703047621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f010410a940 msgr2=0x7f01041a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f010410a940 0x7f01041a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 -- 172.21.15.82:0/3703047621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0104109f80 msgr2=0x7f010419f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0104109f80 0x7f010419f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.288+0000 7f0102a00640 1 -- 172.21.15.82:0/3703047621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01041a6be0 con 0x7f0104108d90 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.289+0000 7f0102a00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 0x7f010419efc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00f400e9c0 tx=0x7f00f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.289+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f400cd80 con 0x7f0104108d90 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.289+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00f40035f0 con 0x7f0104108d90 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.289+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01041a6ed0 con 0x7f0104108d90 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.289+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4010690 con 0x7f0104108d90 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.289+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041a72e0 con 0x7f0104108d90 2024-04-26T20:22:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.290+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0104110180 con 0x7f0104108d90 2024-04-26T20:22:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.292+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f00f4004000 con 0x7f0104108d90 2024-04-26T20:22:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.293+0000 7f00fb400640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00e80a3c40 0x7f00e80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.293+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f00f40d0e30 con 0x7f0104108d90 2024-04-26T20:22:51.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.294+0000 7f00fbe00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00e80a3c40 0x7f00e80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.294+0000 7f00fbe00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00e80a3c40 0x7f00e80a6100 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000c00 tx=0x7f00ec0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.298+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f00f409d2f0 con 0x7f0104108d90 2024-04-26T20:22:51.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.488+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f010402dd80 con 0x7f0104108d90 2024-04-26T20:22:51.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.489+0000 7f00fb400640 1 -- 172.21.15.82:0/3703047621 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f00f409cbf0 con 0x7f0104108d90 2024-04-26T20:22:51.489 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:51.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00e80a3c40 msgr2=0x7f00e80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00e80a3c40 0x7f00e80a6100 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000c00 tx=0x7f00ec0314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 msgr2=0x7f010419efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 0x7f010419efc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00f400e9c0 tx=0x7f00f400ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 shutdown_connections 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f00e80a3c40 0x7f00e80a6100 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f010410a940 0x7f01041a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0104109f80 0x7f010419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 --2- 172.21.15.82:0/3703047621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104108d90 0x7f010419efc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 >> 172.21.15.82:0/3703047621 conn(0x7f0104077d30 msgr2=0x7f010410d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 shutdown_connections 2024-04-26T20:22:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.492+0000 7f0103e00640 1 -- 172.21.15.82:0/3703047621 wait complete. 2024-04-26T20:22:51.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 -- 172.21.15.82:0/272633314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa698108f90 msgr2=0x7fa6981093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 --2- 172.21.15.82:0/272633314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa698108f90 0x7fa6981093b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa688009900 tx=0x7fa68802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 -- 172.21.15.82:0/272633314 shutdown_connections 2024-04-26T20:22:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 --2- 172.21.15.82:0/272633314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69810ab40 0x7fa6981113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 --2- 172.21.15.82:0/272633314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69810a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 --2- 172.21.15.82:0/272633314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa698108f90 0x7fa6981093b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.708+0000 7fa69e400640 1 -- 172.21.15.82:0/272633314 >> 172.21.15.82:0/272633314 conn(0x7fa698077f30 msgr2=0x7fa69807a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:51.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.709+0000 7fa69e400640 1 -- 172.21.15.82:0/272633314 shutdown_connections 2024-04-26T20:22:51.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.709+0000 7fa69e400640 1 -- 172.21.15.82:0/272633314 wait complete. 2024-04-26T20:22:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 Processor -- start 2024-04-26T20:22:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 -- start start 2024-04-26T20:22:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa698108f90 0x7fa69819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69810ab40 0x7fa6981a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa698114b20 con 0x7fa698108f90 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981149a0 con 0x7fa69810a180 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.710+0000 7fa69e400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa698114ca0 con 0x7fa69810ab40 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa697400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa698108f90 0x7fa69819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69819f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34186/0 (socket says 172.21.15.82:34186) 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 -- 172.21.15.82:0/3290884980 learned_addr learned my addr 172.21.15.82:0/3290884980 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa697e00640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69810ab40 0x7fa6981a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 -- 172.21.15.82:0/3290884980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69810ab40 msgr2=0x7fa6981a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69810ab40 0x7fa6981a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 -- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa698108f90 msgr2=0x7fa69819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa698108f90 0x7fa69819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 -- 172.21.15.82:0/3290884980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6981a6e00 con 0x7fa69810a180 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.711+0000 7fa696a00640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69819f720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa68400db80 tx=0x7fa68400b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.712+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684017070 con 0x7fa69810a180 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.712+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa684003b70 con 0x7fa69810a180 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.712+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6981a70f0 con 0x7fa69810a180 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.712+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6840106c0 con 0x7fa69810a180 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.712+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6981a7640 con 0x7fa69810a180 2024-04-26T20:22:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.713+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa698110350 con 0x7fa69810a180 2024-04-26T20:22:51.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.716+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa684004020 con 0x7fa69810a180 2024-04-26T20:22:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.717+0000 7fa68fe00640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa67c0a3c40 0x7fa67c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.717+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa6840d0960 con 0x7fa69810a180 2024-04-26T20:22:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.717+0000 7fa697400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa67c0a3c40 0x7fa67c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:51.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.718+0000 7fa697400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa67c0a3c40 0x7fa67c0a6100 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa688005ab0 tx=0x7fa688005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.722+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa68409ce20 con 0x7fa69810a180 2024-04-26T20:22:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.925+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa69802dd20 con 0x7fa69810a180 2024-04-26T20:22:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.926+0000 7fa68fe00640 1 -- 172.21.15.82:0/3290884980 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fa68409c720 con 0x7fa69810a180 2024-04-26T20:22:51.926 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa67c0a3c40 msgr2=0x7fa67c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa67c0a3c40 0x7fa67c0a6100 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa688005ab0 tx=0x7fa688005a20 comp rx=0 tx=0).stop 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 msgr2=0x7fa69819f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69819f720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa68400db80 tx=0x7fa68400b630 comp rx=0 tx=0).stop 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 shutdown_connections 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa67c0a3c40 0x7fa67c0a6100 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69810ab40 0x7fa6981a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa69810a180 0x7fa69819f720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 --2- 172.21.15.82:0/3290884980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa698108f90 0x7fa69819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:51.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.928+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 >> 172.21.15.82:0/3290884980 conn(0x7fa698077f30 msgr2=0x7fa69810d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:51.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.929+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 shutdown_connections 2024-04-26T20:22:51.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:51.929+0000 7fa69e400640 1 -- 172.21.15.82:0/3290884980 wait complete. 2024-04-26T20:22:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:51 smithi082 ceph-mon[28105]: pgmap v413: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:22:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:51 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/394136220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:51 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3703047621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:51.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:51 smithi139 ceph-mon[32999]: pgmap v413: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:22:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:51 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/394136220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:51 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3703047621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:51 smithi135 ceph-mon[32816]: pgmap v413: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:22:52.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:51 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/394136220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:52.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:51 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3703047621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 -- 172.21.15.82:0/2134889402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574109f80 msgr2=0x7f957410a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 --2- 172.21.15.82:0/2134889402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574109f80 0x7f957410a400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f955c009900 tx=0x7f955c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 -- 172.21.15.82:0/2134889402 shutdown_connections 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 --2- 172.21.15.82:0/2134889402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f957410a940 0x7f95741111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 --2- 172.21.15.82:0/2134889402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574109f80 0x7f957410a400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 --2- 172.21.15.82:0/2134889402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9574108d90 0x7f95741091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 -- 172.21.15.82:0/2134889402 >> 172.21.15.82:0/2134889402 conn(0x7f9574077d30 msgr2=0x7f957407a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 -- 172.21.15.82:0/2134889402 shutdown_connections 2024-04-26T20:22:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.137+0000 7f9579800640 1 -- 172.21.15.82:0/2134889402 wait complete. 2024-04-26T20:22:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.138+0000 7f9579800640 1 Processor -- start 2024-04-26T20:22:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.138+0000 7f9579800640 1 -- start start 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.138+0000 7f9579800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 0x7f957419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9579800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9574109f80 0x7f957419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9579800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f957410a940 0x7f95741a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9579800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9574114910 con 0x7f9574108d90 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9579800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9574114790 con 0x7f957410a940 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9579800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9574114a90 con 0x7f9574109f80 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 0x7f957419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 0x7f957419ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42554/0 (socket says 172.21.15.82:42554) 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 -- 172.21.15.82:0/2394212311 learned_addr learned my addr 172.21.15.82:0/2394212311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9578e00640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f957410a940 0x7f95741a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f956b400640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9574109f80 0x7f957419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 -- 172.21.15.82:0/2394212311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9574109f80 msgr2=0x7f957419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9574109f80 0x7f957419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 -- 172.21.15.82:0/2394212311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f957410a940 msgr2=0x7f95741a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f957410a940 0x7f95741a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.139+0000 7f9573e00640 1 -- 172.21.15.82:0/2394212311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95741a6bb0 con 0x7f9574108d90 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.140+0000 7f9573e00640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 0x7f957419ef90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9564009d20 tx=0x7f956400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.140+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564010630 con 0x7f9574108d90 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.140+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9564010c80 con 0x7f9574108d90 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.140+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564018d50 con 0x7f9574108d90 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.140+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95741a6ea0 con 0x7f9574108d90 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.140+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95741a7300 con 0x7f9574108d90 2024-04-26T20:22:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.141+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95741100b0 con 0x7f9574108d90 2024-04-26T20:22:52.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.143+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f956401f020 con 0x7f9574108d90 2024-04-26T20:22:52.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.145+0000 7f9571600640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f95580a3c40 0x7f95580a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.146+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f95640d0da0 con 0x7f9574108d90 2024-04-26T20:22:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.146+0000 7f956b400640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f95580a3c40 0x7f95580a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.147+0000 7f956b400640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f95580a3c40 0x7f95580a6100 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f955c031500 tx=0x7f955c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.150+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f956409d260 con 0x7f9574108d90 2024-04-26T20:22:52.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.354+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f957402dd80 con 0x7f9574108d90 2024-04-26T20:22:52.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.357+0000 7f9571600640 1 -- 172.21.15.82:0/2394212311 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f956409cb60 con 0x7f9574108d90 2024-04-26T20:22:52.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f95580a3c40 msgr2=0x7f95580a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f95580a3c40 0x7f95580a6100 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f955c031500 tx=0x7f955c005a20 comp rx=0 tx=0).stop 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 msgr2=0x7f957419ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 0x7f957419ef90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9564009d20 tx=0x7f956400c6a0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 shutdown_connections 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f95580a3c40 0x7f95580a6100 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f957410a940 0x7f95741a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9574109f80 0x7f957419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 --2- 172.21.15.82:0/2394212311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574108d90 0x7f957419ef90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.360+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 >> 172.21.15.82:0/2394212311 conn(0x7f9574077d30 msgr2=0x7f957410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.361+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 shutdown_connections 2024-04-26T20:22:52.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.361+0000 7f9579800640 1 -- 172.21.15.82:0/2394212311 wait complete. 2024-04-26T20:22:52.381 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:22:52.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 -- 172.21.15.82:0/3902603398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f476410ee90 msgr2=0x7f4764111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 --2- 172.21.15.82:0/3902603398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f476410ee90 0x7f4764111280 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f475c009900 tx=0x7f475c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 -- 172.21.15.82:0/3902603398 shutdown_connections 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 --2- 172.21.15.82:0/3902603398 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f476410ee90 0x7f4764111280 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 --2- 172.21.15.82:0/3902603398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4764075390 0x7f4764075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 --2- 172.21.15.82:0/3902603398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4764076970 0x7f4764074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 -- 172.21.15.82:0/3902603398 >> 172.21.15.82:0/3902603398 conn(0x7f47640fde30 msgr2=0x7f4764100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 -- 172.21.15.82:0/3902603398 shutdown_connections 2024-04-26T20:22:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.592+0000 7f4768e00640 1 -- 172.21.15.82:0/3902603398 wait complete. 2024-04-26T20:22:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.593+0000 7f4768e00640 1 Processor -- start 2024-04-26T20:22:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.593+0000 7f4768e00640 1 -- start start 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4768e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4764075390 0x7f476419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4768e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 0x7f476419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4768e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476410ee90 0x7f47641a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4768e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47641149a0 con 0x7f476410ee90 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4768e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4764114820 con 0x7f4764075390 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4768e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4764114b20 con 0x7f4764076970 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f475aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 0x7f476419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f475aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 0x7f476419f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42274/0 (socket says 172.21.15.82:42274) 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f475aa00640 1 -- 172.21.15.82:0/787583144 learned_addr learned my addr 172.21.15.82:0/787583144 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4763e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476410ee90 0x7f47641a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.594+0000 7f4763400640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4764075390 0x7f476419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f475aa00640 1 -- 172.21.15.82:0/787583144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4764075390 msgr2=0x7f476419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f475aa00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4764075390 0x7f476419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f475aa00640 1 -- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476410ee90 msgr2=0x7f47641a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f475aa00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476410ee90 0x7f47641a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f475aa00640 1 -- 172.21.15.82:0/787583144 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47641a6c00 con 0x7f4764076970 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f475aa00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 0x7f476419f520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f474c00e9f0 tx=0x7f474c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00cd80 con 0x7f4764076970 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f474c0108e0 con 0x7f4764076970 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47641a6ef0 con 0x7f4764076970 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c018980 con 0x7f4764076970 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.595+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47641a73b0 con 0x7f4764076970 2024-04-26T20:22:52.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.596+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4764105060 con 0x7f4764076970 2024-04-26T20:22:52.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.599+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f474c010430 con 0x7f4764076970 2024-04-26T20:22:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.600+0000 7f4760c00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47480a3c40 0x7f47480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.600+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f474c0d0c00 con 0x7f4764076970 2024-04-26T20:22:52.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.600+0000 7f4763400640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47480a3c40 0x7f47480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.601+0000 7f4763400640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47480a3c40 0x7f47480a6100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4754005fd0 tx=0x7f4754009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.604+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f474c09ca70 con 0x7f4764076970 2024-04-26T20:22:52.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.817+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f476402dd20 con 0x7f4764076970 2024-04-26T20:22:52.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.818+0000 7f4760c00640 1 -- 172.21.15.82:0/787583144 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f474c0a0d70 con 0x7f4764076970 2024-04-26T20:22:52.818 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47480a3c40 msgr2=0x7f47480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47480a3c40 0x7f47480a6100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4754005fd0 tx=0x7f4754009500 comp rx=0 tx=0).stop 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 msgr2=0x7f476419f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 0x7f476419f520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f474c00e9f0 tx=0x7f474c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 shutdown_connections 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f47480a3c40 0x7f47480a6100 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476410ee90 0x7f47641a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4764076970 0x7f476419f520 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 --2- 172.21.15.82:0/787583144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4764075390 0x7f476419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 >> 172.21.15.82:0/787583144 conn(0x7f47640fde30 msgr2=0x7f4764102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 shutdown_connections 2024-04-26T20:22:52.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:52.821+0000 7f4768e00640 1 -- 172.21.15.82:0/787583144 wait complete. 2024-04-26T20:22:52.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 -- 172.21.15.82:0/660611100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78104a70 msgr2=0x7f2a78104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 --2- 172.21.15.82:0/660611100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78104a70 0x7f2a78104e90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009900 tx=0x7f2a6802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 -- 172.21.15.82:0/660611100 shutdown_connections 2024-04-26T20:22:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 --2- 172.21.15.82:0/660611100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a78106620 0x7f2a7810ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 --2- 172.21.15.82:0/660611100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78105c60 0x7f2a781060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 --2- 172.21.15.82:0/660611100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78104a70 0x7f2a78104e90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 -- 172.21.15.82:0/660611100 >> 172.21.15.82:0/660611100 conn(0x7f2a780fffe0 msgr2=0x7f2a78102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 -- 172.21.15.82:0/660611100 shutdown_connections 2024-04-26T20:22:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.043+0000 7f2a7d000640 1 -- 172.21.15.82:0/660611100 wait complete. 2024-04-26T20:22:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 Processor -- start 2024-04-26T20:22:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 -- start start 2024-04-26T20:22:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 0x7f2a7819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78105c60 0x7f2a7819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a78106620 0x7f2a781a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781105c0 con 0x7f2a78105c60 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a78110440 con 0x7f2a78104a70 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.045+0000 7f2a7d000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2a78110740 con 0x7f2a78106620 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 0x7f2a7819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 0x7f2a7819ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34236/0 (socket says 172.21.15.82:34236) 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 -- 172.21.15.82:0/3232096248 learned_addr learned my addr 172.21.15.82:0/3232096248 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a6fe00640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78105c60 0x7f2a7819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77e00640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a78106620 0x7f2a781a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 -- 172.21.15.82:0/3232096248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a78106620 msgr2=0x7f2a781a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a78106620 0x7f2a781a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 -- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78105c60 msgr2=0x7f2a7819b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78105c60 0x7f2a7819b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 -- 172.21.15.82:0/3232096248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a781a2910 con 0x7f2a78104a70 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.046+0000 7f2a77400640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 0x7f2a7819ad00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a68031500 tx=0x7f2a68003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.047+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6803f070 con 0x7f2a78104a70 2024-04-26T20:22:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.047+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a68031c50 con 0x7f2a78104a70 2024-04-26T20:22:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.047+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a781a2ba0 con 0x7f2a78104a70 2024-04-26T20:22:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.047+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68035030 con 0x7f2a78104a70 2024-04-26T20:22:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.047+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a781a30e0 con 0x7f2a78104a70 2024-04-26T20:22:53.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.048+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7810beb0 con 0x7f2a78104a70 2024-04-26T20:22:53.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.050+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2a68042070 con 0x7f2a78104a70 2024-04-26T20:22:53.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.051+0000 7f2a74c00640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2a5c0a3cc0 0x7f2a5c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.052+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2a680f1060 con 0x7f2a78104a70 2024-04-26T20:22:53.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.052+0000 7f2a6fe00640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2a5c0a3cc0 0x7f2a5c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.053+0000 7f2a6fe00640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2a5c0a3cc0 0x7f2a5c0a6180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009bd0 tx=0x7f2a60005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:53.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.056+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f2a680bced0 con 0x7f2a78104a70 2024-04-26T20:22:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:52 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3290884980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:52 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2394212311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:52 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3290884980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:52 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2394212311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:52 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3290884980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:52 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2394212311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.255+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a7802dd20 con 0x7f2a78104a70 2024-04-26T20:22:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.256+0000 7f2a74c00640 1 -- 172.21.15.82:0/3232096248 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f2a680c11d0 con 0x7f2a78104a70 2024-04-26T20:22:53.257 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:53.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2a5c0a3cc0 msgr2=0x7f2a5c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2a5c0a3cc0 0x7f2a5c0a6180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009bd0 tx=0x7f2a60005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 msgr2=0x7f2a7819ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 0x7f2a7819ad00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a68031500 tx=0x7f2a68003c10 comp rx=0 tx=0).stop 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 shutdown_connections 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2a5c0a3cc0 0x7f2a5c0a6180 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a78106620 0x7f2a781a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a78105c60 0x7f2a7819b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 --2- 172.21.15.82:0/3232096248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a78104a70 0x7f2a7819ad00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 >> 172.21.15.82:0/3232096248 conn(0x7f2a780fffe0 msgr2=0x7f2a78109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 shutdown_connections 2024-04-26T20:22:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.259+0000 7f2a7d000640 1 -- 172.21.15.82:0/3232096248 wait complete. 2024-04-26T20:22:53.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 -- 172.21.15.82:0/1421576303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08104970 msgr2=0x7fad08104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 --2- 172.21.15.82:0/1421576303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08104970 0x7fad08104d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7facf8009900 tx=0x7facf802a410 comp rx=0 tx=0).stop 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 -- 172.21.15.82:0/1421576303 shutdown_connections 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 --2- 172.21.15.82:0/1421576303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad08106520 0x7fad0810cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 --2- 172.21.15.82:0/1421576303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad08105b60 0x7fad08105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 --2- 172.21.15.82:0/1421576303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08104970 0x7fad08104d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 -- 172.21.15.82:0/1421576303 >> 172.21.15.82:0/1421576303 conn(0x7fad080fff00 msgr2=0x7fad08102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 -- 172.21.15.82:0/1421576303 shutdown_connections 2024-04-26T20:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.488+0000 7fad0ca00640 1 -- 172.21.15.82:0/1421576303 wait complete. 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 Processor -- start 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 -- start start 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad08104970 0x7fad0819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 0x7fad0819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad08106520 0x7fad081a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad081104c0 con 0x7fad08105b60 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad08110340 con 0x7fad08106520 2024-04-26T20:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.489+0000 7fad0ca00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fad08110640 con 0x7fad08104970 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 0x7fad0819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 0x7fad0819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42620/0 (socket says 172.21.15.82:42620) 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 -- 172.21.15.82:0/3271286300 learned_addr learned my addr 172.21.15.82:0/3271286300 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7fad06800640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad08104970 0x7fad0819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7fad07200640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad08106520 0x7fad081a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 -- 172.21.15.82:0/3271286300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad08104970 msgr2=0x7fad0819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad08104970 0x7fad0819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 -- 172.21.15.82:0/3271286300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad08106520 msgr2=0x7fad081a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad08106520 0x7fad081a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 -- 172.21.15.82:0/3271286300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad081a27c0 con 0x7fad08105b60 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.490+0000 7facfde00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 0x7fad0819b130 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7facf000ea60 tx=0x7facf000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.491+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf000cde0 con 0x7fad08105b60 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.491+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf00035f0 con 0x7fad08105b60 2024-04-26T20:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.491+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0010690 con 0x7fad08105b60 2024-04-26T20:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.491+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad081a2ab0 con 0x7fad08105b60 2024-04-26T20:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.491+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad081a2fb0 con 0x7fad08105b60 2024-04-26T20:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.492+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0810bd80 con 0x7fad08105b60 2024-04-26T20:22:53.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.494+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7facf00037a0 con 0x7fad08105b60 2024-04-26T20:22:53.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.495+0000 7facffe00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facec0a3cc0 0x7facec0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.495+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7facf00d0b90 con 0x7fad08105b60 2024-04-26T20:22:53.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.495+0000 7fad06800640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facec0a3cc0 0x7facec0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.496+0000 7fad06800640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facec0a3cc0 0x7facec0a6180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7facf8005ab0 tx=0x7facf8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:53.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.499+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7facf009d050 con 0x7fad08105b60 2024-04-26T20:22:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.700+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fad0802dcf0 con 0x7fad08105b60 2024-04-26T20:22:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.701+0000 7facffe00640 1 -- 172.21.15.82:0/3271286300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7facf009c950 con 0x7fad08105b60 2024-04-26T20:22:53.702 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:53.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facec0a3cc0 msgr2=0x7facec0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facec0a3cc0 0x7facec0a6180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7facf8005ab0 tx=0x7facf8005a20 comp rx=0 tx=0).stop 2024-04-26T20:22:53.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 msgr2=0x7fad0819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 0x7fad0819b130 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7facf000ea60 tx=0x7facf000ef20 comp rx=0 tx=0).stop 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 shutdown_connections 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facec0a3cc0 0x7facec0a6180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad08106520 0x7fad081a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad08105b60 0x7fad0819b130 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 --2- 172.21.15.82:0/3271286300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad08104970 0x7fad0819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 >> 172.21.15.82:0/3271286300 conn(0x7fad080fff00 msgr2=0x7fad08108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 shutdown_connections 2024-04-26T20:22:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.704+0000 7fad0ca00640 1 -- 172.21.15.82:0/3271286300 wait complete. 2024-04-26T20:22:53.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:53.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 -- 172.21.15.82:0/2474513517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 msgr2=0x7f89e010a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 --2- 172.21.15.82:0/2474513517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e010a440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009900 tx=0x7f89c802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 -- 172.21.15.82:0/2474513517 shutdown_connections 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 --2- 172.21.15.82:0/2474513517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89e010a980 0x7f89e01112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 --2- 172.21.15.82:0/2474513517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e010a440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 --2- 172.21.15.82:0/2474513517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e0109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 -- 172.21.15.82:0/2474513517 >> 172.21.15.82:0/2474513517 conn(0x7f89e0077e00 msgr2=0x7f89e007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 -- 172.21.15.82:0/2474513517 shutdown_connections 2024-04-26T20:22:53.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.912+0000 7f89df200640 1 -- 172.21.15.82:0/2474513517 wait complete. 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 Processor -- start 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 -- start start 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e019f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89e010a980 0x7f89e01a6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0114a10 con 0x7f89e0109fc0 2024-04-26T20:22:53.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0114890 con 0x7f89e010a980 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89df200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0114b90 con 0x7f89e0108e70 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89d7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e019f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89dde00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89d7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e019f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42640/0 (socket says 172.21.15.82:42640) 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89dde00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e019f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42316/0 (socket says 172.21.15.82:42316) 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.913+0000 7f89d7e00640 1 -- 172.21.15.82:0/1621603351 learned_addr learned my addr 172.21.15.82:0/1621603351 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89de800640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89e010a980 0x7f89e01a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89dde00640 1 -- 172.21.15.82:0/1621603351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89e010a980 msgr2=0x7f89e01a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89dde00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89e010a980 0x7f89e01a6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89dde00640 1 -- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 msgr2=0x7f89e019f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89dde00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e019f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89dde00640 1 -- 172.21.15.82:0/1621603351 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e01a6cb0 con 0x7f89e0108e70 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89d7e00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:53.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89dde00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e019f090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89d000e9f0 tx=0x7f89d000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d000ccc0 con 0x7f89e0108e70 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89d0005020 con 0x7f89e0108e70 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.914+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e01a6fa0 con 0x7f89e0108e70 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.915+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0004a00 con 0x7f89e0108e70 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.915+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e01a7400 con 0x7f89e0108e70 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.916+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e0110180 con 0x7f89e0108e70 2024-04-26T20:22:53.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.918+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f89d0004ba0 con 0x7f89e0108e70 2024-04-26T20:22:53.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.919+0000 7f89d6a00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89c40a3cc0 0x7f89c40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:53.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.919+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f89d00d0970 con 0x7f89e0108e70 2024-04-26T20:22:53.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.919+0000 7f89d7e00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89c40a3cc0 0x7f89c40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:53.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.920+0000 7f89d7e00640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89c40a3cc0 0x7f89c40a6180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f89c8000c00 tx=0x7f89c8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:53.921+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f89d009ce30 con 0x7f89e0108e70 2024-04-26T20:22:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:53 smithi139 ceph-mon[32999]: pgmap v414: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-26T20:22:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:53 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/787583144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:53 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3232096248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:53 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3271286300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:53 smithi135 ceph-mon[32816]: pgmap v414: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-26T20:22:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:53 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/787583144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:53 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3232096248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:53 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3271286300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.122+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f89e002dd40 con 0x7f89e0108e70 2024-04-26T20:22:54.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.123+0000 7f89d6a00640 1 -- 172.21.15.82:0/1621603351 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f89d009c730 con 0x7f89e0108e70 2024-04-26T20:22:54.123 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:54.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.125+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89c40a3cc0 msgr2=0x7f89c40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.125+0000 7f89df200640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89c40a3cc0 0x7f89c40a6180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f89c8000c00 tx=0x7f89c8005a20 comp rx=0 tx=0).stop 2024-04-26T20:22:54.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.125+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 msgr2=0x7f89e019f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.125+0000 7f89df200640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e019f090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89d000e9f0 tx=0x7f89d000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 shutdown_connections 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89c40a3cc0 0x7f89c40a6180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89e010a980 0x7f89e01a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e0109fc0 0x7f89e019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 --2- 172.21.15.82:0/1621603351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89e0108e70 0x7f89e019f090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 >> 172.21.15.82:0/1621603351 conn(0x7f89e0077e00 msgr2=0x7f89e010d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 shutdown_connections 2024-04-26T20:22:54.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.126+0000 7f89df200640 1 -- 172.21.15.82:0/1621603351 wait complete. 2024-04-26T20:22:54.142 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:53 smithi082 ceph-mon[28105]: pgmap v414: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-26T20:22:54.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:53 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/787583144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:53 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3232096248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:53 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3271286300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.146 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-26T20:22:54.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:54.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 -- 172.21.15.82:0/1471905106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644108d90 msgr2=0x7f36441091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 --2- 172.21.15.82:0/1471905106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644108d90 0x7f36441091b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3634009900 tx=0x7f363402a410 comp rx=0 tx=0).stop 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 -- 172.21.15.82:0/1471905106 shutdown_connections 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 --2- 172.21.15.82:0/1471905106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f364410a940 0x7f36441111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 --2- 172.21.15.82:0/1471905106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3644109f80 0x7f364410a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 --2- 172.21.15.82:0/1471905106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644108d90 0x7f36441091b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 -- 172.21.15.82:0/1471905106 >> 172.21.15.82:0/1471905106 conn(0x7f3644077d30 msgr2=0x7f364407a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 -- 172.21.15.82:0/1471905106 shutdown_connections 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.345+0000 7f3648c00640 1 -- 172.21.15.82:0/1471905106 wait complete. 2024-04-26T20:22:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.346+0000 7f3648c00640 1 Processor -- start 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.346+0000 7f3648c00640 1 -- start start 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3648c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 0x7f364419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3648c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644109f80 0x7f364419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3648c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f364410a940 0x7f36441a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3648c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36441148b0 con 0x7f3644108d90 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3648c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3644114730 con 0x7f3644109f80 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3648c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3644114a30 con 0x7f364410a940 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3643400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 0x7f364419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3643400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 0x7f364419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42656/0 (socket says 172.21.15.82:42656) 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3643400640 1 -- 172.21.15.82:0/2568490282 learned_addr learned my addr 172.21.15.82:0/2568490282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f363aa00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644109f80 0x7f364419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.347+0000 7f3643e00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f364410a940 0x7f36441a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3643400640 1 -- 172.21.15.82:0/2568490282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f364410a940 msgr2=0x7f36441a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3643400640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f364410a940 0x7f36441a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3643400640 1 -- 172.21.15.82:0/2568490282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644109f80 msgr2=0x7f364419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3643400640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644109f80 0x7f364419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3643400640 1 -- 172.21.15.82:0/2568490282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36441a6bf0 con 0x7f3644108d90 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f363aa00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644109f80 0x7f364419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3643400640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 0x7f364419efd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3634006010 tx=0x7f36340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363403f030 con 0x7f3644108d90 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441a6e80 con 0x7f3644108d90 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3634031910 con 0x7f3644108d90 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.348+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634035070 con 0x7f3644108d90 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.349+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a7290 con 0x7f3644108d90 2024-04-26T20:22:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.350+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36441101d0 con 0x7f3644108d90 2024-04-26T20:22:54.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.352+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3634042030 con 0x7f3644108d90 2024-04-26T20:22:54.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.353+0000 7f3640c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36280a3c40 0x7f36280a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.353+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f36340f0e60 con 0x7f3644108d90 2024-04-26T20:22:54.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.354+0000 7f363aa00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36280a3c40 0x7f36280a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.354+0000 7f363aa00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36280a3c40 0x7f36280a6100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36441a04e0 tx=0x7f362c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.358+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f36340bccd0 con 0x7f3644108d90 2024-04-26T20:22:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.606+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f364402dad0 con 0x7f3644108d90 2024-04-26T20:22:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.608+0000 7f3640c00640 1 -- 172.21.15.82:0/2568490282 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11951 (secure 0 0 0) 0x7f36340c0fd0 con 0x7f3644108d90 2024-04-26T20:22:54.609 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:54.609 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:22:49.242424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24550,24529,24454,24554,24584]},"id":1}]} 2024-04-26T20:22:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36280a3c40 msgr2=0x7f36280a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36280a3c40 0x7f36280a6100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36441a04e0 tx=0x7f362c005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 msgr2=0x7f364419efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 0x7f364419efd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3634006010 tx=0x7f36340042f0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 shutdown_connections 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36280a3c40 0x7f36280a6100 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f364410a940 0x7f36441a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3644109f80 0x7f364419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 --2- 172.21.15.82:0/2568490282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3644108d90 0x7f364419efd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.611+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 >> 172.21.15.82:0/2568490282 conn(0x7f3644077d30 msgr2=0x7f364410d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:54.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.612+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 shutdown_connections 2024-04-26T20:22:54.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.612+0000 7f3648c00640 1 -- 172.21.15.82:0/2568490282 wait complete. 2024-04-26T20:22:54.631 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-26T20:22:54.631 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-26T20:22:54.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 -- 172.21.15.82:0/768975915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c105d80 msgr2=0x7f754c106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 --2- 172.21.15.82:0/768975915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c105d80 0x7f754c106200 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7534009900 tx=0x7f753402a410 comp rx=0 tx=0).stop 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 -- 172.21.15.82:0/768975915 shutdown_connections 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 --2- 172.21.15.82:0/768975915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c106740 0x7f754c10cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 --2- 172.21.15.82:0/768975915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c105d80 0x7f754c106200 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 --2- 172.21.15.82:0/768975915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f754c104b90 0x7f754c104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 -- 172.21.15.82:0/768975915 >> 172.21.15.82:0/768975915 conn(0x7f754c100120 msgr2=0x7f754c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:54.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 -- 172.21.15.82:0/768975915 shutdown_connections 2024-04-26T20:22:54.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.825+0000 7f7550a00640 1 -- 172.21.15.82:0/768975915 wait complete. 2024-04-26T20:22:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.826+0000 7f7550a00640 1 Processor -- start 2024-04-26T20:22:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 -- start start 2024-04-26T20:22:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c104b90 0x7f754c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f754c105d80 0x7f754c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 0x7f754c1a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f754c110710 con 0x7f754c106740 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f754c110590 con 0x7f754c104b90 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7550a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f754c110890 con 0x7f754c105d80 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f754a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 0x7f754c1a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f754a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 0x7f754c1a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42674/0 (socket says 172.21.15.82:42674) 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f754a800640 1 -- 172.21.15.82:0/1459678257 learned_addr learned my addr 172.21.15.82:0/1459678257 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7549e00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c104b90 0x7f754c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.827+0000 7f7543e00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f754c105d80 0x7f754c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f754a800640 1 -- 172.21.15.82:0/1459678257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f754c105d80 msgr2=0x7f754c19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f754a800640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f754c105d80 0x7f754c19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f754a800640 1 -- 172.21.15.82:0/1459678257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c104b90 msgr2=0x7f754c19ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f754a800640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c104b90 0x7f754c19ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f754a800640 1 -- 172.21.15.82:0/1459678257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c1a29b0 con 0x7f754c106740 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f7549e00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c104b90 0x7f754c19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f754a800640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 0x7f754c1a2310 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f754400eb10 tx=0x7f754400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544004b20 con 0x7f754c106740 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7544004cc0 con 0x7f754c106740 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544010670 con 0x7f754c106740 2024-04-26T20:22:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c1a2ca0 con 0x7f754c106740 2024-04-26T20:22:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.828+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c1a31a0 con 0x7f754c106740 2024-04-26T20:22:54.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.830+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c10beb0 con 0x7f754c106740 2024-04-26T20:22:54.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.831+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7544005020 con 0x7f754c106740 2024-04-26T20:22:54.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.833+0000 7f7542a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f75300a3c40 0x7f75300a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:54.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.833+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f75440d0f40 con 0x7f754c106740 2024-04-26T20:22:54.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.833+0000 7f7549e00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f75300a3c40 0x7f75300a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:54.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.834+0000 7f7549e00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f75300a3c40 0x7f75300a6100 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f754c19c270 tx=0x7f753c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:54.837+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f754409d400 con 0x7f754c106740 2024-04-26T20:22:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:54 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1621603351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:54 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2568490282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.038+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f754c062d70 con 0x7f75300a3c40 2024-04-26T20:22:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.054+0000 7f7542a00640 1 -- 172.21.15.82:0/1459678257 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340420 (secure 0 0 0) 0x7f754c062d70 con 0x7f75300a3c40 2024-04-26T20:22:55.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f75300a3c40 msgr2=0x7f75300a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f75300a3c40 0x7f75300a6100 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f754c19c270 tx=0x7f753c005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 msgr2=0x7f754c1a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 0x7f754c1a2310 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f754400eb10 tx=0x7f754400c2d0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 shutdown_connections 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f75300a3c40 0x7f75300a6100 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f754c106740 0x7f754c1a2310 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f754c105d80 0x7f754c19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 --2- 172.21.15.82:0/1459678257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f754c104b90 0x7f754c19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 >> 172.21.15.82:0/1459678257 conn(0x7f754c100120 msgr2=0x7f754c109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:55.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 shutdown_connections 2024-04-26T20:22:55.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.063+0000 7f7550a00640 1 -- 172.21.15.82:0/1459678257 wait complete. 2024-04-26T20:22:55.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:54 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1621603351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:55.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:54 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2568490282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:55.083 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-04-26T20:22:54.650259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658625,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1698,"num_read_kb":970,"num_write":434,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375908,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565916,"statfs":{"total":1151940427776,"available":1151555497984,"internally_reserved":0,"allocated":14569472,"data_stored":7961585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":73,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004506"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683422+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:20:47.683422+0000","last_peered":"2024-04-26T20:20:47.683422+0000","last_clean":"2024-04-26T20:20:47.683422+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:20:47.683422+0000","last_undegraded":"2024-04-26T20:20:47.683422+0000","last_fullsized":"2024-04-26T20:20:47.683422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694676+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:20:47.694676+0000","last_peered":"2024-04-26T20:20:47.694676+0000","last_clean":"2024-04-26T20:20:47.694676+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:20:47.694676+0000","last_undegraded":"2024-04-26T20:20:47.694676+0000","last_fullsized":"2024-04-26T20:20:47.694676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693273+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:20:47.693273+0000","last_peered":"2024-04-26T20:20:47.693273+0000","last_clean":"2024-04-26T20:20:47.693273+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:20:47.693273+0000","last_undegraded":"2024-04-26T20:20:47.693273+0000","last_fullsized":"2024-04-26T20:20:47.693273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683615+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:20:47.683615+0000","last_peered":"2024-04-26T20:20:47.683615+0000","last_clean":"2024-04-26T20:20:47.683615+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:20:47.683615+0000","last_undegraded":"2024-04-26T20:20:47.683615+0000","last_fullsized":"2024-04-26T20:20:47.683615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682513+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:20:47.682513+0000","last_peered":"2024-04-26T20:20:47.682513+0000","last_clean":"2024-04-26T20:20:47.682513+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:20:47.682513+0000","last_undegraded":"2024-04-26T20:20:47.682513+0000","last_fullsized":"2024-04-26T20:20:47.682513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819785+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:20:47.819785+0000","last_peered":"2024-04-26T20:20:47.819785+0000","last_clean":"2024-04-26T20:20:47.819785+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:20:47.819785+0000","last_undegraded":"2024-04-26T20:20:47.819785+0000","last_fullsized":"2024-04-26T20:20:47.819785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818637+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:20:47.818637+0000","last_peered":"2024-04-26T20:20:47.818637+0000","last_clean":"2024-04-26T20:20:47.818637+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:20:47.818637+0000","last_undegraded":"2024-04-26T20:20:47.818637+0000","last_fullsized":"2024-04-26T20:20:47.818637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680946+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:20:47.680946+0000","last_peered":"2024-04-26T20:20:47.680946+0000","last_clean":"2024-04-26T20:20:47.680946+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:20:47.680946+0000","last_undegraded":"2024-04-26T20:20:47.680946+0000","last_fullsized":"2024-04-26T20:20:47.680946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820773+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:20:47.820773+0000","last_peered":"2024-04-26T20:20:47.820773+0000","last_clean":"2024-04-26T20:20:47.820773+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:20:47.820773+0000","last_undegraded":"2024-04-26T20:20:47.820773+0000","last_fullsized":"2024-04-26T20:20:47.820773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820347+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:20:47.820347+0000","last_peered":"2024-04-26T20:20:47.820347+0000","last_clean":"2024-04-26T20:20:47.820347+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:20:47.820347+0000","last_undegraded":"2024-04-26T20:20:47.820347+0000","last_fullsized":"2024-04-26T20:20:47.820347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819646+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:20:47.819646+0000","last_peered":"2024-04-26T20:20:47.819646+0000","last_clean":"2024-04-26T20:20:47.819646+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:20:47.819646+0000","last_undegraded":"2024-04-26T20:20:47.819646+0000","last_fullsized":"2024-04-26T20:20:47.819646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683478+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:20:47.683478+0000","last_peered":"2024-04-26T20:20:47.683478+0000","last_clean":"2024-04-26T20:20:47.683478+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:20:47.683478+0000","last_undegraded":"2024-04-26T20:20:47.683478+0000","last_fullsized":"2024-04-26T20:20:47.683478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693935+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:20:47.693935+0000","last_peered":"2024-04-26T20:20:47.693935+0000","last_clean":"2024-04-26T20:20:47.693935+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:20:47.693935+0000","last_undegraded":"2024-04-26T20:20:47.693935+0000","last_fullsized":"2024-04-26T20:20:47.693935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696784+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:20:47.696784+0000","last_peered":"2024-04-26T20:20:47.696784+0000","last_clean":"2024-04-26T20:20:47.696784+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:20:47.696784+0000","last_undegraded":"2024-04-26T20:20:47.696784+0000","last_fullsized":"2024-04-26T20:20:47.696784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692176+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:20:47.692176+0000","last_peered":"2024-04-26T20:20:47.692176+0000","last_clean":"2024-04-26T20:20:47.692176+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:20:47.692176+0000","last_undegraded":"2024-04-26T20:20:47.692176+0000","last_fullsized":"2024-04-26T20:20:47.692176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819551+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:20:47.819551+0000","last_peered":"2024-04-26T20:20:47.819551+0000","last_clean":"2024-04-26T20:20:47.819551+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:20:47.819551+0000","last_undegraded":"2024-04-26T20:20:47.819551+0000","last_fullsized":"2024-04-26T20:20:47.819551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683222+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:20:47.683222+0000","last_peered":"2024-04-26T20:20:47.683222+0000","last_clean":"2024-04-26T20:20:47.683222+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:20:47.683222+0000","last_undegraded":"2024-04-26T20:20:47.683222+0000","last_fullsized":"2024-04-26T20:20:47.683222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683408+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:20:47.683408+0000","last_peered":"2024-04-26T20:20:47.683408+0000","last_clean":"2024-04-26T20:20:47.683408+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:20:47.683408+0000","last_undegraded":"2024-04-26T20:20:47.683408+0000","last_fullsized":"2024-04-26T20:20:47.683408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680922+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:20:47.680922+0000","last_peered":"2024-04-26T20:20:47.680922+0000","last_clean":"2024-04-26T20:20:47.680922+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:20:47.680922+0000","last_undegraded":"2024-04-26T20:20:47.680922+0000","last_fullsized":"2024-04-26T20:20:47.680922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680488+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:20:47.680488+0000","last_peered":"2024-04-26T20:20:47.680488+0000","last_clean":"2024-04-26T20:20:47.680488+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:20:47.680488+0000","last_undegraded":"2024-04-26T20:20:47.680488+0000","last_fullsized":"2024-04-26T20:20:47.680488+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":192,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:49.469710+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:22:49.469710+0000","last_peered":"2024-04-26T20:22:49.469710+0000","last_clean":"2024-04-26T20:22:49.469710+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:22:49.469710+0000","last_undegraded":"2024-04-26T20:22:49.469710+0000","last_fullsized":"2024-04-26T20:22:49.469710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":152,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688540+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:20:47.688540+0000","last_peered":"2024-04-26T20:20:47.688540+0000","last_clean":"2024-04-26T20:20:47.688540+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:20:47.688540+0000","last_undegraded":"2024-04-26T20:20:47.688540+0000","last_fullsized":"2024-04-26T20:20:47.688540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695987+0000","last_change":"2024-04-26T20:20:47.695528+0000","last_active":"2024-04-26T20:20:47.695987+0000","last_peered":"2024-04-26T20:20:47.695987+0000","last_clean":"2024-04-26T20:20:47.695987+0000","last_became_active":"2024-04-26T20:20:47.695083+0000","last_became_peered":"2024-04-26T20:20:47.695083+0000","last_unstale":"2024-04-26T20:20:47.695987+0000","last_undegraded":"2024-04-26T20:20:47.695987+0000","last_fullsized":"2024-04-26T20:20:47.695987+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:14.240451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688726+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:20:47.688726+0000","last_peered":"2024-04-26T20:20:47.688726+0000","last_clean":"2024-04-26T20:20:47.688726+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:20:47.688726+0000","last_undegraded":"2024-04-26T20:20:47.688726+0000","last_fullsized":"2024-04-26T20:20:47.688726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696043+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:20:47.696043+0000","last_peered":"2024-04-26T20:20:47.696043+0000","last_clean":"2024-04-26T20:20:47.696043+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:20:47.696043+0000","last_undegraded":"2024-04-26T20:20:47.696043+0000","last_fullsized":"2024-04-26T20:20:47.696043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682858+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:20:47.682858+0000","last_peered":"2024-04-26T20:20:47.682858+0000","last_clean":"2024-04-26T20:20:47.682858+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:20:47.682858+0000","last_undegraded":"2024-04-26T20:20:47.682858+0000","last_fullsized":"2024-04-26T20:20:47.682858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682358+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:47.682358+0000","last_peered":"2024-04-26T20:20:47.682358+0000","last_clean":"2024-04-26T20:20:47.682358+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:47.682358+0000","last_undegraded":"2024-04-26T20:20:47.682358+0000","last_fullsized":"2024-04-26T20:20:47.682358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820522+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:20:47.820522+0000","last_peered":"2024-04-26T20:20:47.820522+0000","last_clean":"2024-04-26T20:20:47.820522+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:20:47.820522+0000","last_undegraded":"2024-04-26T20:20:47.820522+0000","last_fullsized":"2024-04-26T20:20:47.820522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682744+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:20:47.682744+0000","last_peered":"2024-04-26T20:20:47.682744+0000","last_clean":"2024-04-26T20:20:47.682744+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:20:47.682744+0000","last_undegraded":"2024-04-26T20:20:47.682744+0000","last_fullsized":"2024-04-26T20:20:47.682744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682711+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:47.682711+0000","last_peered":"2024-04-26T20:20:47.682711+0000","last_clean":"2024-04-26T20:20:47.682711+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:47.682711+0000","last_undegraded":"2024-04-26T20:20:47.682711+0000","last_fullsized":"2024-04-26T20:20:47.682711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822571+0000","last_change":"2024-04-26T20:20:47.821791+0000","last_active":"2024-04-26T20:20:47.822571+0000","last_peered":"2024-04-26T20:20:47.822571+0000","last_clean":"2024-04-26T20:20:47.822571+0000","last_became_active":"2024-04-26T20:20:47.821338+0000","last_became_peered":"2024-04-26T20:20:47.821338+0000","last_unstale":"2024-04-26T20:20:47.822571+0000","last_undegraded":"2024-04-26T20:20:47.822571+0000","last_fullsized":"2024-04-26T20:20:47.822571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:45.027699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680806+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:20:47.680806+0000","last_peered":"2024-04-26T20:20:47.680806+0000","last_clean":"2024-04-26T20:20:47.680806+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:20:47.680806+0000","last_undegraded":"2024-04-26T20:20:47.680806+0000","last_fullsized":"2024-04-26T20:20:47.680806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.390813+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:22:50.390813+0000","last_peered":"2024-04-26T20:22:50.390813+0000","last_clean":"2024-04-26T20:22:50.390813+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:22:50.390813+0000","last_undegraded":"2024-04-26T20:22:50.390813+0000","last_fullsized":"2024-04-26T20:22:50.390813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683410+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:20:47.683410+0000","last_peered":"2024-04-26T20:20:47.683410+0000","last_clean":"2024-04-26T20:20:47.683410+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:20:47.683410+0000","last_undegraded":"2024-04-26T20:20:47.683410+0000","last_fullsized":"2024-04-26T20:20:47.683410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680605+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:20:47.680605+0000","last_peered":"2024-04-26T20:20:47.680605+0000","last_clean":"2024-04-26T20:20:47.680605+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:20:47.680605+0000","last_undegraded":"2024-04-26T20:20:47.680605+0000","last_fullsized":"2024-04-26T20:20:47.680605+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819638+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:47.819638+0000","last_peered":"2024-04-26T20:20:47.819638+0000","last_clean":"2024-04-26T20:20:47.819638+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:47.819638+0000","last_undegraded":"2024-04-26T20:20:47.819638+0000","last_fullsized":"2024-04-26T20:20:47.819638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686770+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:20:47.686770+0000","last_peered":"2024-04-26T20:20:47.686770+0000","last_clean":"2024-04-26T20:20:47.686770+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:20:47.686770+0000","last_undegraded":"2024-04-26T20:20:47.686770+0000","last_fullsized":"2024-04-26T20:20:47.686770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683145+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:20:47.683145+0000","last_peered":"2024-04-26T20:20:47.683145+0000","last_clean":"2024-04-26T20:20:47.683145+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:20:47.683145+0000","last_undegraded":"2024-04-26T20:20:47.683145+0000","last_fullsized":"2024-04-26T20:20:47.683145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694418+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:47.694418+0000","last_peered":"2024-04-26T20:20:47.694418+0000","last_clean":"2024-04-26T20:20:47.694418+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:47.694418+0000","last_undegraded":"2024-04-26T20:20:47.694418+0000","last_fullsized":"2024-04-26T20:20:47.694418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681243+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:20:47.681243+0000","last_peered":"2024-04-26T20:20:47.681243+0000","last_clean":"2024-04-26T20:20:47.681243+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:20:47.681243+0000","last_undegraded":"2024-04-26T20:20:47.681243+0000","last_fullsized":"2024-04-26T20:20:47.681243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694179+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:20:47.694179+0000","last_peered":"2024-04-26T20:20:47.694179+0000","last_clean":"2024-04-26T20:20:47.694179+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:20:47.694179+0000","last_undegraded":"2024-04-26T20:20:47.694179+0000","last_fullsized":"2024-04-26T20:20:47.694179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686623+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:47.686623+0000","last_peered":"2024-04-26T20:20:47.686623+0000","last_clean":"2024-04-26T20:20:47.686623+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:47.686623+0000","last_undegraded":"2024-04-26T20:20:47.686623+0000","last_fullsized":"2024-04-26T20:20:47.686623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685554+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:20:47.685554+0000","last_peered":"2024-04-26T20:20:47.685554+0000","last_clean":"2024-04-26T20:20:47.685554+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:20:47.685554+0000","last_undegraded":"2024-04-26T20:20:47.685554+0000","last_fullsized":"2024-04-26T20:20:47.685554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681339+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:20:47.681339+0000","last_peered":"2024-04-26T20:20:47.681339+0000","last_clean":"2024-04-26T20:20:47.681339+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:20:47.681339+0000","last_undegraded":"2024-04-26T20:20:47.681339+0000","last_fullsized":"2024-04-26T20:20:47.681339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:52.393560+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:22:52.393560+0000","last_peered":"2024-04-26T20:22:52.393560+0000","last_clean":"2024-04-26T20:22:52.393560+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:22:52.393560+0000","last_undegraded":"2024-04-26T20:22:52.393560+0000","last_fullsized":"2024-04-26T20:22:52.393560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":308,"num_read_kb":308,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820405+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:20:47.820405+0000","last_peered":"2024-04-26T20:20:47.820405+0000","last_clean":"2024-04-26T20:20:47.820405+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:20:47.820405+0000","last_undegraded":"2024-04-26T20:20:47.820405+0000","last_fullsized":"2024-04-26T20:20:47.820405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.700943+0000","last_change":"2024-04-26T20:20:47.700375+0000","last_active":"2024-04-26T20:20:47.700943+0000","last_peered":"2024-04-26T20:20:47.700943+0000","last_clean":"2024-04-26T20:20:47.700943+0000","last_became_active":"2024-04-26T20:20:47.699843+0000","last_became_peered":"2024-04-26T20:20:47.699843+0000","last_unstale":"2024-04-26T20:20:47.700943+0000","last_undegraded":"2024-04-26T20:20:47.700943+0000","last_fullsized":"2024-04-26T20:20:47.700943+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:53.112700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819945+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:47.819945+0000","last_peered":"2024-04-26T20:20:47.819945+0000","last_clean":"2024-04-26T20:20:47.819945+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:47.819945+0000","last_undegraded":"2024-04-26T20:20:47.819945+0000","last_fullsized":"2024-04-26T20:20:47.819945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696288+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:20:47.696288+0000","last_peered":"2024-04-26T20:20:47.696288+0000","last_clean":"2024-04-26T20:20:47.696288+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:20:47.696288+0000","last_undegraded":"2024-04-26T20:20:47.696288+0000","last_fullsized":"2024-04-26T20:20:47.696288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822591+0000","last_change":"2024-04-26T20:20:47.821914+0000","last_active":"2024-04-26T20:20:47.822591+0000","last_peered":"2024-04-26T20:20:47.822591+0000","last_clean":"2024-04-26T20:20:47.822591+0000","last_became_active":"2024-04-26T20:20:47.821365+0000","last_became_peered":"2024-04-26T20:20:47.821365+0000","last_unstale":"2024-04-26T20:20:47.822591+0000","last_undegraded":"2024-04-26T20:20:47.822591+0000","last_fullsized":"2024-04-26T20:20:47.822591+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:12.969419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687647+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:47.687647+0000","last_peered":"2024-04-26T20:20:47.687647+0000","last_clean":"2024-04-26T20:20:47.687647+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:47.687647+0000","last_undegraded":"2024-04-26T20:20:47.687647+0000","last_fullsized":"2024-04-26T20:20:47.687647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820660+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:20:47.820660+0000","last_peered":"2024-04-26T20:20:47.820660+0000","last_clean":"2024-04-26T20:20:47.820660+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:20:47.820660+0000","last_undegraded":"2024-04-26T20:20:47.820660+0000","last_fullsized":"2024-04-26T20:20:47.820660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683798+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:20:47.683798+0000","last_peered":"2024-04-26T20:20:47.683798+0000","last_clean":"2024-04-26T20:20:47.683798+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:20:47.683798+0000","last_undegraded":"2024-04-26T20:20:47.683798+0000","last_fullsized":"2024-04-26T20:20:47.683798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":383,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:52.393743+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:22:52.393743+0000","last_peered":"2024-04-26T20:22:52.393743+0000","last_clean":"2024-04-26T20:22:52.393743+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:22:52.393743+0000","last_undegraded":"2024-04-26T20:22:52.393743+0000","last_fullsized":"2024-04-26T20:22:52.393743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60509,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":217,"num_write":40,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683244+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:20:47.683244+0000","last_peered":"2024-04-26T20:20:47.683244+0000","last_clean":"2024-04-26T20:20:47.683244+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:20:47.683244+0000","last_undegraded":"2024-04-26T20:20:47.683244+0000","last_fullsized":"2024-04-26T20:20:47.683244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687898+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:20:47.687898+0000","last_peered":"2024-04-26T20:20:47.687898+0000","last_clean":"2024-04-26T20:20:47.687898+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:20:47.687898+0000","last_undegraded":"2024-04-26T20:20:47.687898+0000","last_fullsized":"2024-04-26T20:20:47.687898+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681061+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:47.681061+0000","last_peered":"2024-04-26T20:20:47.681061+0000","last_clean":"2024-04-26T20:20:47.681061+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:47.681061+0000","last_undegraded":"2024-04-26T20:20:47.681061+0000","last_fullsized":"2024-04-26T20:20:47.681061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693858+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:20:47.693858+0000","last_peered":"2024-04-26T20:20:47.693858+0000","last_clean":"2024-04-26T20:20:47.693858+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:20:47.693858+0000","last_undegraded":"2024-04-26T20:20:47.693858+0000","last_fullsized":"2024-04-26T20:20:47.693858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682773+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:20:47.682773+0000","last_peered":"2024-04-26T20:20:47.682773+0000","last_clean":"2024-04-26T20:20:47.682773+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:20:47.682773+0000","last_undegraded":"2024-04-26T20:20:47.682773+0000","last_fullsized":"2024-04-26T20:20:47.682773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686940+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:47.686940+0000","last_peered":"2024-04-26T20:20:47.686940+0000","last_clean":"2024-04-26T20:20:47.686940+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:47.686940+0000","last_undegraded":"2024-04-26T20:20:47.686940+0000","last_fullsized":"2024-04-26T20:20:47.686940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819117+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:20:47.819117+0000","last_peered":"2024-04-26T20:20:47.819117+0000","last_clean":"2024-04-26T20:20:47.819117+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:20:47.819117+0000","last_undegraded":"2024-04-26T20:20:47.819117+0000","last_fullsized":"2024-04-26T20:20:47.819117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682539+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:20:47.682539+0000","last_peered":"2024-04-26T20:20:47.682539+0000","last_clean":"2024-04-26T20:20:47.682539+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:20:47.682539+0000","last_undegraded":"2024-04-26T20:20:47.682539+0000","last_fullsized":"2024-04-26T20:20:47.682539+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:49.451243+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:22:49.451243+0000","last_peered":"2024-04-26T20:22:49.451243+0000","last_clean":"2024-04-26T20:22:49.451243+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:22:49.451243+0000","last_undegraded":"2024-04-26T20:22:49.451243+0000","last_fullsized":"2024-04-26T20:22:49.451243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818523+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:20:47.818523+0000","last_peered":"2024-04-26T20:20:47.818523+0000","last_clean":"2024-04-26T20:20:47.818523+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:20:47.818523+0000","last_undegraded":"2024-04-26T20:20:47.818523+0000","last_fullsized":"2024-04-26T20:20:47.818523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694465+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:20:47.694465+0000","last_peered":"2024-04-26T20:20:47.694465+0000","last_clean":"2024-04-26T20:20:47.694465+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:20:47.694465+0000","last_undegraded":"2024-04-26T20:20:47.694465+0000","last_fullsized":"2024-04-26T20:20:47.694465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.715108+0000","last_change":"2024-04-26T20:20:47.714651+0000","last_active":"2024-04-26T20:20:47.715108+0000","last_peered":"2024-04-26T20:20:47.715108+0000","last_clean":"2024-04-26T20:20:47.715108+0000","last_became_active":"2024-04-26T20:20:47.700320+0000","last_became_peered":"2024-04-26T20:20:47.700320+0000","last_unstale":"2024-04-26T20:20:47.715108+0000","last_undegraded":"2024-04-26T20:20:47.715108+0000","last_fullsized":"2024-04-26T20:20:47.715108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:19.935988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686320+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:20:47.686320+0000","last_peered":"2024-04-26T20:20:47.686320+0000","last_clean":"2024-04-26T20:20:47.686320+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:20:47.686320+0000","last_undegraded":"2024-04-26T20:20:47.686320+0000","last_fullsized":"2024-04-26T20:20:47.686320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822518+0000","last_change":"2024-04-26T20:20:47.821839+0000","last_active":"2024-04-26T20:20:47.822518+0000","last_peered":"2024-04-26T20:20:47.822518+0000","last_clean":"2024-04-26T20:20:47.822518+0000","last_became_active":"2024-04-26T20:20:47.821302+0000","last_became_peered":"2024-04-26T20:20:47.821302+0000","last_unstale":"2024-04-26T20:20:47.822518+0000","last_undegraded":"2024-04-26T20:20:47.822518+0000","last_fullsized":"2024-04-26T20:20:47.822518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:38.771597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683371+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:47.683371+0000","last_peered":"2024-04-26T20:20:47.683371+0000","last_clean":"2024-04-26T20:20:47.683371+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:47.683371+0000","last_undegraded":"2024-04-26T20:20:47.683371+0000","last_fullsized":"2024-04-26T20:20:47.683371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683167+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:20:47.683167+0000","last_peered":"2024-04-26T20:20:47.683167+0000","last_clean":"2024-04-26T20:20:47.683167+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:20:47.683167+0000","last_undegraded":"2024-04-26T20:20:47.683167+0000","last_fullsized":"2024-04-26T20:20:47.683167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682750+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:20:47.682750+0000","last_peered":"2024-04-26T20:20:47.682750+0000","last_clean":"2024-04-26T20:20:47.682750+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:20:47.682750+0000","last_undegraded":"2024-04-26T20:20:47.682750+0000","last_fullsized":"2024-04-26T20:20:47.682750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.703750+0000","last_change":"2024-04-26T20:20:47.701523+0000","last_active":"2024-04-26T20:20:47.703750+0000","last_peered":"2024-04-26T20:20:47.703750+0000","last_clean":"2024-04-26T20:20:47.703750+0000","last_became_active":"2024-04-26T20:20:47.700711+0000","last_became_peered":"2024-04-26T20:20:47.700711+0000","last_unstale":"2024-04-26T20:20:47.703750+0000","last_undegraded":"2024-04-26T20:20:47.703750+0000","last_fullsized":"2024-04-26T20:20:47.703750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:37.623094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820170+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:20:47.820170+0000","last_peered":"2024-04-26T20:20:47.820170+0000","last_clean":"2024-04-26T20:20:47.820170+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:20:47.820170+0000","last_undegraded":"2024-04-26T20:20:47.820170+0000","last_fullsized":"2024-04-26T20:20:47.820170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697662+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:20:47.697662+0000","last_peered":"2024-04-26T20:20:47.697662+0000","last_clean":"2024-04-26T20:20:47.697662+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:20:47.697662+0000","last_undegraded":"2024-04-26T20:20:47.697662+0000","last_fullsized":"2024-04-26T20:20:47.697662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":186,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:51.473972+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:22:51.473972+0000","last_peered":"2024-04-26T20:22:51.473972+0000","last_clean":"2024-04-26T20:22:51.473972+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:22:51.473972+0000","last_undegraded":"2024-04-26T20:22:51.473972+0000","last_fullsized":"2024-04-26T20:22:51.473972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819807+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:20:47.819807+0000","last_peered":"2024-04-26T20:20:47.819807+0000","last_clean":"2024-04-26T20:20:47.819807+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:20:47.819807+0000","last_undegraded":"2024-04-26T20:20:47.819807+0000","last_fullsized":"2024-04-26T20:20:47.819807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694851+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:20:47.694851+0000","last_peered":"2024-04-26T20:20:47.694851+0000","last_clean":"2024-04-26T20:20:47.694851+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:20:47.694851+0000","last_undegraded":"2024-04-26T20:20:47.694851+0000","last_fullsized":"2024-04-26T20:20:47.694851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686846+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:20:47.686846+0000","last_peered":"2024-04-26T20:20:47.686846+0000","last_clean":"2024-04-26T20:20:47.686846+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:20:47.686846+0000","last_undegraded":"2024-04-26T20:20:47.686846+0000","last_fullsized":"2024-04-26T20:20:47.686846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":187,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.452316+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:22:50.452316+0000","last_peered":"2024-04-26T20:22:50.452316+0000","last_clean":"2024-04-26T20:22:50.452316+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:22:50.452316+0000","last_undegraded":"2024-04-26T20:22:50.452316+0000","last_fullsized":"2024-04-26T20:22:50.452316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819441+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:20:47.819441+0000","last_peered":"2024-04-26T20:20:47.819441+0000","last_clean":"2024-04-26T20:20:47.819441+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:20:47.819441+0000","last_undegraded":"2024-04-26T20:20:47.819441+0000","last_fullsized":"2024-04-26T20:20:47.819441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684241+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:20:47.684241+0000","last_peered":"2024-04-26T20:20:47.684241+0000","last_clean":"2024-04-26T20:20:47.684241+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:20:47.684241+0000","last_undegraded":"2024-04-26T20:20:47.684241+0000","last_fullsized":"2024-04-26T20:20:47.684241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683079+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:47.683079+0000","last_peered":"2024-04-26T20:20:47.683079+0000","last_clean":"2024-04-26T20:20:47.683079+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:47.683079+0000","last_undegraded":"2024-04-26T20:20:47.683079+0000","last_fullsized":"2024-04-26T20:20:47.683079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820401+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:20:47.820401+0000","last_peered":"2024-04-26T20:20:47.820401+0000","last_clean":"2024-04-26T20:20:47.820401+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:20:47.820401+0000","last_undegraded":"2024-04-26T20:20:47.820401+0000","last_fullsized":"2024-04-26T20:20:47.820401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687206+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:20:47.687206+0000","last_peered":"2024-04-26T20:20:47.687206+0000","last_clean":"2024-04-26T20:20:47.687206+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:20:47.687206+0000","last_undegraded":"2024-04-26T20:20:47.687206+0000","last_fullsized":"2024-04-26T20:20:47.687206+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.699521+0000","last_change":"2024-04-26T20:20:47.697300+0000","last_active":"2024-04-26T20:20:47.699521+0000","last_peered":"2024-04-26T20:20:47.699521+0000","last_clean":"2024-04-26T20:20:47.699521+0000","last_became_active":"2024-04-26T20:20:47.696809+0000","last_became_peered":"2024-04-26T20:20:47.696809+0000","last_unstale":"2024-04-26T20:20:47.699521+0000","last_undegraded":"2024-04-26T20:20:47.699521+0000","last_fullsized":"2024-04-26T20:20:47.699521+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:01.540485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818395+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:47.818395+0000","last_peered":"2024-04-26T20:20:47.818395+0000","last_clean":"2024-04-26T20:20:47.818395+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:47.818395+0000","last_undegraded":"2024-04-26T20:20:47.818395+0000","last_fullsized":"2024-04-26T20:20:47.818395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682745+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:20:47.682745+0000","last_peered":"2024-04-26T20:20:47.682745+0000","last_clean":"2024-04-26T20:20:47.682745+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:20:47.682745+0000","last_undegraded":"2024-04-26T20:20:47.682745+0000","last_fullsized":"2024-04-26T20:20:47.682745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683136+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:47.683136+0000","last_peered":"2024-04-26T20:20:47.683136+0000","last_clean":"2024-04-26T20:20:47.683136+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:47.683136+0000","last_undegraded":"2024-04-26T20:20:47.683136+0000","last_fullsized":"2024-04-26T20:20:47.683136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697874+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:20:47.697874+0000","last_peered":"2024-04-26T20:20:47.697874+0000","last_clean":"2024-04-26T20:20:47.697874+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:20:47.697874+0000","last_undegraded":"2024-04-26T20:20:47.697874+0000","last_fullsized":"2024-04-26T20:20:47.697874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681290+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:20:47.681290+0000","last_peered":"2024-04-26T20:20:47.681290+0000","last_clean":"2024-04-26T20:20:47.681290+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:20:47.681290+0000","last_undegraded":"2024-04-26T20:20:47.681290+0000","last_fullsized":"2024-04-26T20:20:47.681290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.709280+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:21:47.709280+0000","last_peered":"2024-04-26T20:21:47.709280+0000","last_clean":"2024-04-26T20:21:47.709280+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:21:47.709280+0000","last_undegraded":"2024-04-26T20:21:47.709280+0000","last_fullsized":"2024-04-26T20:21:47.709280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684046+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:20:47.684046+0000","last_peered":"2024-04-26T20:20:47.684046+0000","last_clean":"2024-04-26T20:20:47.684046+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:20:47.684046+0000","last_undegraded":"2024-04-26T20:20:47.684046+0000","last_fullsized":"2024-04-26T20:20:47.684046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680245+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:20:47.680245+0000","last_peered":"2024-04-26T20:20:47.680245+0000","last_clean":"2024-04-26T20:20:47.680245+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:20:47.680245+0000","last_undegraded":"2024-04-26T20:20:47.680245+0000","last_fullsized":"2024-04-26T20:20:47.680245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683319+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:47.683319+0000","last_peered":"2024-04-26T20:20:47.683319+0000","last_clean":"2024-04-26T20:20:47.683319+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:47.683319+0000","last_undegraded":"2024-04-26T20:20:47.683319+0000","last_fullsized":"2024-04-26T20:20:47.683319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694787+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:20:47.694787+0000","last_peered":"2024-04-26T20:20:47.694787+0000","last_clean":"2024-04-26T20:20:47.694787+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:20:47.694787+0000","last_undegraded":"2024-04-26T20:20:47.694787+0000","last_fullsized":"2024-04-26T20:20:47.694787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683161+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:20:47.683161+0000","last_peered":"2024-04-26T20:20:47.683161+0000","last_clean":"2024-04-26T20:20:47.683161+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:20:47.683161+0000","last_undegraded":"2024-04-26T20:20:47.683161+0000","last_fullsized":"2024-04-26T20:20:47.683161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819561+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:47.819561+0000","last_peered":"2024-04-26T20:20:47.819561+0000","last_clean":"2024-04-26T20:20:47.819561+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:47.819561+0000","last_undegraded":"2024-04-26T20:20:47.819561+0000","last_fullsized":"2024-04-26T20:20:47.819561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682262+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:20:47.682262+0000","last_peered":"2024-04-26T20:20:47.682262+0000","last_clean":"2024-04-26T20:20:47.682262+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:20:47.682262+0000","last_undegraded":"2024-04-26T20:20:47.682262+0000","last_fullsized":"2024-04-26T20:20:47.682262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683010+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:20:47.683010+0000","last_peered":"2024-04-26T20:20:47.683010+0000","last_clean":"2024-04-26T20:20:47.683010+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:20:47.683010+0000","last_undegraded":"2024-04-26T20:20:47.683010+0000","last_fullsized":"2024-04-26T20:20:47.683010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680319+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:47.680319+0000","last_peered":"2024-04-26T20:20:47.680319+0000","last_clean":"2024-04-26T20:20:47.680319+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:47.680319+0000","last_undegraded":"2024-04-26T20:20:47.680319+0000","last_fullsized":"2024-04-26T20:20:47.680319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683622+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:20:47.683622+0000","last_peered":"2024-04-26T20:20:47.683622+0000","last_clean":"2024-04-26T20:20:47.683622+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:20:47.683622+0000","last_undegraded":"2024-04-26T20:20:47.683622+0000","last_fullsized":"2024-04-26T20:20:47.683622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682900+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:20:47.682900+0000","last_peered":"2024-04-26T20:20:47.682900+0000","last_clean":"2024-04-26T20:20:47.682900+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:20:47.682900+0000","last_undegraded":"2024-04-26T20:20:47.682900+0000","last_fullsized":"2024-04-26T20:20:47.682900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680352+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:47.680352+0000","last_peered":"2024-04-26T20:20:47.680352+0000","last_clean":"2024-04-26T20:20:47.680352+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:47.680352+0000","last_undegraded":"2024-04-26T20:20:47.680352+0000","last_fullsized":"2024-04-26T20:20:47.680352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685745+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:20:47.685745+0000","last_peered":"2024-04-26T20:20:47.685745+0000","last_clean":"2024-04-26T20:20:47.685745+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:20:47.685745+0000","last_undegraded":"2024-04-26T20:20:47.685745+0000","last_fullsized":"2024-04-26T20:20:47.685745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683135+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:20:47.683135+0000","last_peered":"2024-04-26T20:20:47.683135+0000","last_clean":"2024-04-26T20:20:47.683135+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:20:47.683135+0000","last_undegraded":"2024-04-26T20:20:47.683135+0000","last_fullsized":"2024-04-26T20:20:47.683135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682630+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:47.682630+0000","last_peered":"2024-04-26T20:20:47.682630+0000","last_clean":"2024-04-26T20:20:47.682630+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:47.682630+0000","last_undegraded":"2024-04-26T20:20:47.682630+0000","last_fullsized":"2024-04-26T20:20:47.682630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819064+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:20:47.819064+0000","last_peered":"2024-04-26T20:20:47.819064+0000","last_clean":"2024-04-26T20:20:47.819064+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:20:47.819064+0000","last_undegraded":"2024-04-26T20:20:47.819064+0000","last_fullsized":"2024-04-26T20:20:47.819064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818873+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:20:47.818873+0000","last_peered":"2024-04-26T20:20:47.818873+0000","last_clean":"2024-04-26T20:20:47.818873+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:20:47.818873+0000","last_undegraded":"2024-04-26T20:20:47.818873+0000","last_fullsized":"2024-04-26T20:20:47.818873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.488922+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:22:50.488922+0000","last_peered":"2024-04-26T20:22:50.488922+0000","last_clean":"2024-04-26T20:22:50.488922+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:22:50.488922+0000","last_undegraded":"2024-04-26T20:22:50.488922+0000","last_fullsized":"2024-04-26T20:22:50.488922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819674+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:20:47.819674+0000","last_peered":"2024-04-26T20:20:47.819674+0000","last_clean":"2024-04-26T20:20:47.819674+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:20:47.819674+0000","last_undegraded":"2024-04-26T20:20:47.819674+0000","last_fullsized":"2024-04-26T20:20:47.819674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692735+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:20:47.692735+0000","last_peered":"2024-04-26T20:20:47.692735+0000","last_clean":"2024-04-26T20:20:47.692735+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:20:47.692735+0000","last_undegraded":"2024-04-26T20:20:47.692735+0000","last_fullsized":"2024-04-26T20:20:47.692735+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687748+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:47.687748+0000","last_peered":"2024-04-26T20:20:47.687748+0000","last_clean":"2024-04-26T20:20:47.687748+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:47.687748+0000","last_undegraded":"2024-04-26T20:20:47.687748+0000","last_fullsized":"2024-04-26T20:20:47.687748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819410+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:20:47.819410+0000","last_peered":"2024-04-26T20:20:47.819410+0000","last_clean":"2024-04-26T20:20:47.819410+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:20:47.819410+0000","last_undegraded":"2024-04-26T20:20:47.819410+0000","last_fullsized":"2024-04-26T20:20:47.819410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685972+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:20:47.685972+0000","last_peered":"2024-04-26T20:20:47.685972+0000","last_clean":"2024-04-26T20:20:47.685972+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:20:47.685972+0000","last_undegraded":"2024-04-26T20:20:47.685972+0000","last_fullsized":"2024-04-26T20:20:47.685972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692893+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:47.692893+0000","last_peered":"2024-04-26T20:20:47.692893+0000","last_clean":"2024-04-26T20:20:47.692893+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:47.692893+0000","last_undegraded":"2024-04-26T20:20:47.692893+0000","last_fullsized":"2024-04-26T20:20:47.692893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820005+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:20:47.820005+0000","last_peered":"2024-04-26T20:20:47.820005+0000","last_clean":"2024-04-26T20:20:47.820005+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:20:47.820005+0000","last_undegraded":"2024-04-26T20:20:47.820005+0000","last_fullsized":"2024-04-26T20:20:47.820005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692256+0000","last_change":"2024-04-26T20:20:47.691705+0000","last_active":"2024-04-26T20:20:47.692256+0000","last_peered":"2024-04-26T20:20:47.692256+0000","last_clean":"2024-04-26T20:20:47.692256+0000","last_became_active":"2024-04-26T20:20:47.691330+0000","last_became_peered":"2024-04-26T20:20:47.691330+0000","last_unstale":"2024-04-26T20:20:47.692256+0000","last_undegraded":"2024-04-26T20:20:47.692256+0000","last_fullsized":"2024-04-26T20:20:47.692256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:36.045725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680627+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:20:47.680627+0000","last_peered":"2024-04-26T20:20:47.680627+0000","last_clean":"2024-04-26T20:20:47.680627+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:20:47.680627+0000","last_undegraded":"2024-04-26T20:20:47.680627+0000","last_fullsized":"2024-04-26T20:20:47.680627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680310+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:20:47.680310+0000","last_peered":"2024-04-26T20:20:47.680310+0000","last_clean":"2024-04-26T20:20:47.680310+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:20:47.680310+0000","last_undegraded":"2024-04-26T20:20:47.680310+0000","last_fullsized":"2024-04-26T20:20:47.680310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692934+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:20:47.692934+0000","last_peered":"2024-04-26T20:20:47.692934+0000","last_clean":"2024-04-26T20:20:47.692934+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:20:47.692934+0000","last_undegraded":"2024-04-26T20:20:47.692934+0000","last_fullsized":"2024-04-26T20:20:47.692934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.703472+0000","last_change":"2024-04-26T20:20:47.701792+0000","last_active":"2024-04-26T20:20:47.703472+0000","last_peered":"2024-04-26T20:20:47.703472+0000","last_clean":"2024-04-26T20:20:47.703472+0000","last_became_active":"2024-04-26T20:20:47.701226+0000","last_became_peered":"2024-04-26T20:20:47.701226+0000","last_unstale":"2024-04-26T20:20:47.703472+0000","last_undegraded":"2024-04-26T20:20:47.703472+0000","last_fullsized":"2024-04-26T20:20:47.703472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:56.095557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682954+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:20:47.682954+0000","last_peered":"2024-04-26T20:20:47.682954+0000","last_clean":"2024-04-26T20:20:47.682954+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:20:47.682954+0000","last_undegraded":"2024-04-26T20:20:47.682954+0000","last_fullsized":"2024-04-26T20:20:47.682954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681033+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:20:47.681033+0000","last_peered":"2024-04-26T20:20:47.681033+0000","last_clean":"2024-04-26T20:20:47.681033+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:20:47.681033+0000","last_undegraded":"2024-04-26T20:20:47.681033+0000","last_fullsized":"2024-04-26T20:20:47.681033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684509+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:20:47.684509+0000","last_peered":"2024-04-26T20:20:47.684509+0000","last_clean":"2024-04-26T20:20:47.684509+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:20:47.684509+0000","last_undegraded":"2024-04-26T20:20:47.684509+0000","last_fullsized":"2024-04-26T20:20:47.684509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686737+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:20:47.686737+0000","last_peered":"2024-04-26T20:20:47.686737+0000","last_clean":"2024-04-26T20:20:47.686737+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:20:47.686737+0000","last_undegraded":"2024-04-26T20:20:47.686737+0000","last_fullsized":"2024-04-26T20:20:47.686737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681623+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:20:47.681623+0000","last_peered":"2024-04-26T20:20:47.681623+0000","last_clean":"2024-04-26T20:20:47.681623+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:20:47.681623+0000","last_undegraded":"2024-04-26T20:20:47.681623+0000","last_fullsized":"2024-04-26T20:20:47.681623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819257+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:20:47.819257+0000","last_peered":"2024-04-26T20:20:47.819257+0000","last_clean":"2024-04-26T20:20:47.819257+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:20:47.819257+0000","last_undegraded":"2024-04-26T20:20:47.819257+0000","last_fullsized":"2024-04-26T20:20:47.819257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693840+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:20:47.693840+0000","last_peered":"2024-04-26T20:20:47.693840+0000","last_clean":"2024-04-26T20:20:47.693840+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:20:47.693840+0000","last_undegraded":"2024-04-26T20:20:47.693840+0000","last_fullsized":"2024-04-26T20:20:47.693840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682964+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:20:47.682964+0000","last_peered":"2024-04-26T20:20:47.682964+0000","last_clean":"2024-04-26T20:20:47.682964+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:20:47.682964+0000","last_undegraded":"2024-04-26T20:20:47.682964+0000","last_fullsized":"2024-04-26T20:20:47.682964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68023,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1572,"num_read_kb":861,"num_write":251,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383731,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645367,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37020,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708132,"statfs":{"total":95995035648,"available":95957127168,"internally_reserved":0,"allocated":1724416,"data_stored":1149141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808894,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1060864,"data_stored":505451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070532,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":501621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332170,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1650688,"data_stored":1098540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495696,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":496859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":558398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":498706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1118208,"data_stored":559319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182498,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":501324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757333,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1093731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:22:55.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:22:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:54 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1621603351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:54 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2568490282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:55.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 -- 172.21.15.82:0/1029117610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378106510 msgr2=0x7f537810cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 --2- 172.21.15.82:0/1029117610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378106510 0x7f537810cda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5370009be0 tx=0x7f537002a6d0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 -- 172.21.15.82:0/1029117610 shutdown_connections 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 --2- 172.21.15.82:0/1029117610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378106510 0x7f537810cda0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 --2- 172.21.15.82:0/1029117610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378105b50 0x7f5378105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 --2- 172.21.15.82:0/1029117610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5378104960 0x7f5378104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 -- 172.21.15.82:0/1029117610 >> 172.21.15.82:0/1029117610 conn(0x7f53780ffeb0 msgr2=0x7f5378102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 -- 172.21.15.82:0/1029117610 shutdown_connections 2024-04-26T20:22:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.333+0000 7f5377200640 1 -- 172.21.15.82:0/1029117610 wait complete. 2024-04-26T20:22:55.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 Processor -- start 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 -- start start 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378104960 0x7f537819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5378105b50 0x7f537819b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 0x7f53781a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5378110490 con 0x7f5378106510 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5378110310 con 0x7f5378104960 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.334+0000 7f5377200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5378110610 con 0x7f5378105b50 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 0x7f53781a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 0x7f53781a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42702/0 (socket says 172.21.15.82:42702) 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 -- 172.21.15.82:0/3262343212 learned_addr learned my addr 172.21.15.82:0/3262343212 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f536fe00640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5378105b50 0x7f537819b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5375e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378104960 0x7f537819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 -- 172.21.15.82:0/3262343212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5378105b50 msgr2=0x7f537819b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5378105b50 0x7f537819b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 -- 172.21.15.82:0/3262343212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378104960 msgr2=0x7f537819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378104960 0x7f537819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 -- 172.21.15.82:0/3262343212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53781a2720 con 0x7f5378106510 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5375e00640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378104960 0x7f537819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.335+0000 7f5376800640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 0x7f53781a20b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5370034040 tx=0x7f5370030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.336+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370041020 con 0x7f5378106510 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.336+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53700318f0 con 0x7f5378106510 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.336+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53781a29b0 con 0x7f5378106510 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.336+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370036040 con 0x7f5378106510 2024-04-26T20:22:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.336+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53781a2ea0 con 0x7f5378106510 2024-04-26T20:22:55.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.337+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537810bc80 con 0x7f5378106510 2024-04-26T20:22:55.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.339+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5370044020 con 0x7f5378106510 2024-04-26T20:22:55.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.340+0000 7f536ea00640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f535c0a3c40 0x7f535c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.341+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f53700f1640 con 0x7f5378106510 2024-04-26T20:22:55.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.341+0000 7f5375e00640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f535c0a3c40 0x7f535c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.341+0000 7f5375e00640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f535c0a3c40 0x7f535c0a6100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f53781059b0 tx=0x7f5368005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:55.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.344+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f537004b020 con 0x7f5378106510 2024-04-26T20:22:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.543+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5378062d70 con 0x7f535c0a3c40 2024-04-26T20:22:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.572+0000 7f536ea00640 1 -- 172.21.15.82:0/3262343212 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340420 (secure 0 0 0) 0x7f5378062d70 con 0x7f535c0a3c40 2024-04-26T20:22:55.578 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:55.580 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:22:55.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f535c0a3c40 msgr2=0x7f535c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f535c0a3c40 0x7f535c0a6100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f53781059b0 tx=0x7f5368005f90 comp rx=0 tx=0).stop 2024-04-26T20:22:55.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 msgr2=0x7f53781a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 0x7f53781a20b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5370034040 tx=0x7f5370030d70 comp rx=0 tx=0).stop 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 shutdown_connections 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f535c0a3c40 0x7f535c0a6100 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5378106510 0x7f53781a20b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5378105b50 0x7f537819b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 --2- 172.21.15.82:0/3262343212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5378104960 0x7f537819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.580+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 >> 172.21.15.82:0/3262343212 conn(0x7f53780ffeb0 msgr2=0x7f5378108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.581+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 shutdown_connections 2024-04-26T20:22:55.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.581+0000 7f5377200640 1 -- 172.21.15.82:0/3262343212 wait complete. 2024-04-26T20:22:55.601 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-04-26T20:22:54.650259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658625,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1698,"num_read_kb":970,"num_write":434,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375908,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565916,"statfs":{"total":1151940427776,"available":1151555497984,"internally_reserved":0,"allocated":14569472,"data_stored":7961585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":73,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004506"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683422+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:20:47.683422+0000","last_peered":"2024-04-26T20:20:47.683422+0000","last_clean":"2024-04-26T20:20:47.683422+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:20:47.683422+0000","last_undegraded":"2024-04-26T20:20:47.683422+0000","last_fullsized":"2024-04-26T20:20:47.683422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694676+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:20:47.694676+0000","last_peered":"2024-04-26T20:20:47.694676+0000","last_clean":"2024-04-26T20:20:47.694676+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:20:47.694676+0000","last_undegraded":"2024-04-26T20:20:47.694676+0000","last_fullsized":"2024-04-26T20:20:47.694676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693273+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:20:47.693273+0000","last_peered":"2024-04-26T20:20:47.693273+0000","last_clean":"2024-04-26T20:20:47.693273+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:20:47.693273+0000","last_undegraded":"2024-04-26T20:20:47.693273+0000","last_fullsized":"2024-04-26T20:20:47.693273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683615+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:20:47.683615+0000","last_peered":"2024-04-26T20:20:47.683615+0000","last_clean":"2024-04-26T20:20:47.683615+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:20:47.683615+0000","last_undegraded":"2024-04-26T20:20:47.683615+0000","last_fullsized":"2024-04-26T20:20:47.683615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682513+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:20:47.682513+0000","last_peered":"2024-04-26T20:20:47.682513+0000","last_clean":"2024-04-26T20:20:47.682513+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:20:47.682513+0000","last_undegraded":"2024-04-26T20:20:47.682513+0000","last_fullsized":"2024-04-26T20:20:47.682513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819785+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:20:47.819785+0000","last_peered":"2024-04-26T20:20:47.819785+0000","last_clean":"2024-04-26T20:20:47.819785+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:20:47.819785+0000","last_undegraded":"2024-04-26T20:20:47.819785+0000","last_fullsized":"2024-04-26T20:20:47.819785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818637+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:20:47.818637+0000","last_peered":"2024-04-26T20:20:47.818637+0000","last_clean":"2024-04-26T20:20:47.818637+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:20:47.818637+0000","last_undegraded":"2024-04-26T20:20:47.818637+0000","last_fullsized":"2024-04-26T20:20:47.818637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680946+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:20:47.680946+0000","last_peered":"2024-04-26T20:20:47.680946+0000","last_clean":"2024-04-26T20:20:47.680946+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:20:47.680946+0000","last_undegraded":"2024-04-26T20:20:47.680946+0000","last_fullsized":"2024-04-26T20:20:47.680946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820773+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:20:47.820773+0000","last_peered":"2024-04-26T20:20:47.820773+0000","last_clean":"2024-04-26T20:20:47.820773+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:20:47.820773+0000","last_undegraded":"2024-04-26T20:20:47.820773+0000","last_fullsized":"2024-04-26T20:20:47.820773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820347+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:20:47.820347+0000","last_peered":"2024-04-26T20:20:47.820347+0000","last_clean":"2024-04-26T20:20:47.820347+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:20:47.820347+0000","last_undegraded":"2024-04-26T20:20:47.820347+0000","last_fullsized":"2024-04-26T20:20:47.820347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819646+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:20:47.819646+0000","last_peered":"2024-04-26T20:20:47.819646+0000","last_clean":"2024-04-26T20:20:47.819646+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:20:47.819646+0000","last_undegraded":"2024-04-26T20:20:47.819646+0000","last_fullsized":"2024-04-26T20:20:47.819646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683478+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:20:47.683478+0000","last_peered":"2024-04-26T20:20:47.683478+0000","last_clean":"2024-04-26T20:20:47.683478+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:20:47.683478+0000","last_undegraded":"2024-04-26T20:20:47.683478+0000","last_fullsized":"2024-04-26T20:20:47.683478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693935+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:20:47.693935+0000","last_peered":"2024-04-26T20:20:47.693935+0000","last_clean":"2024-04-26T20:20:47.693935+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:20:47.693935+0000","last_undegraded":"2024-04-26T20:20:47.693935+0000","last_fullsized":"2024-04-26T20:20:47.693935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696784+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:20:47.696784+0000","last_peered":"2024-04-26T20:20:47.696784+0000","last_clean":"2024-04-26T20:20:47.696784+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:20:47.696784+0000","last_undegraded":"2024-04-26T20:20:47.696784+0000","last_fullsized":"2024-04-26T20:20:47.696784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692176+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:20:47.692176+0000","last_peered":"2024-04-26T20:20:47.692176+0000","last_clean":"2024-04-26T20:20:47.692176+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:20:47.692176+0000","last_undegraded":"2024-04-26T20:20:47.692176+0000","last_fullsized":"2024-04-26T20:20:47.692176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819551+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:20:47.819551+0000","last_peered":"2024-04-26T20:20:47.819551+0000","last_clean":"2024-04-26T20:20:47.819551+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:20:47.819551+0000","last_undegraded":"2024-04-26T20:20:47.819551+0000","last_fullsized":"2024-04-26T20:20:47.819551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683222+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:20:47.683222+0000","last_peered":"2024-04-26T20:20:47.683222+0000","last_clean":"2024-04-26T20:20:47.683222+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:20:47.683222+0000","last_undegraded":"2024-04-26T20:20:47.683222+0000","last_fullsized":"2024-04-26T20:20:47.683222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683408+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:20:47.683408+0000","last_peered":"2024-04-26T20:20:47.683408+0000","last_clean":"2024-04-26T20:20:47.683408+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:20:47.683408+0000","last_undegraded":"2024-04-26T20:20:47.683408+0000","last_fullsized":"2024-04-26T20:20:47.683408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680922+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:20:47.680922+0000","last_peered":"2024-04-26T20:20:47.680922+0000","last_clean":"2024-04-26T20:20:47.680922+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:20:47.680922+0000","last_undegraded":"2024-04-26T20:20:47.680922+0000","last_fullsized":"2024-04-26T20:20:47.680922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680488+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:20:47.680488+0000","last_peered":"2024-04-26T20:20:47.680488+0000","last_clean":"2024-04-26T20:20:47.680488+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:20:47.680488+0000","last_undegraded":"2024-04-26T20:20:47.680488+0000","last_fullsized":"2024-04-26T20:20:47.680488+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":192,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:49.469710+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:22:49.469710+0000","last_peered":"2024-04-26T20:22:49.469710+0000","last_clean":"2024-04-26T20:22:49.469710+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:22:49.469710+0000","last_undegraded":"2024-04-26T20:22:49.469710+0000","last_fullsized":"2024-04-26T20:22:49.469710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":152,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688540+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:20:47.688540+0000","last_peered":"2024-04-26T20:20:47.688540+0000","last_clean":"2024-04-26T20:20:47.688540+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:20:47.688540+0000","last_undegraded":"2024-04-26T20:20:47.688540+0000","last_fullsized":"2024-04-26T20:20:47.688540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695987+0000","last_change":"2024-04-26T20:20:47.695528+0000","last_active":"2024-04-26T20:20:47.695987+0000","last_peered":"2024-04-26T20:20:47.695987+0000","last_clean":"2024-04-26T20:20:47.695987+0000","last_became_active":"2024-04-26T20:20:47.695083+0000","last_became_peered":"2024-04-26T20:20:47.695083+0000","last_unstale":"2024-04-26T20:20:47.695987+0000","last_undegraded":"2024-04-26T20:20:47.695987+0000","last_fullsized":"2024-04-26T20:20:47.695987+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:14.240451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688726+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:20:47.688726+0000","last_peered":"2024-04-26T20:20:47.688726+0000","last_clean":"2024-04-26T20:20:47.688726+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:20:47.688726+0000","last_undegraded":"2024-04-26T20:20:47.688726+0000","last_fullsized":"2024-04-26T20:20:47.688726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696043+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:20:47.696043+0000","last_peered":"2024-04-26T20:20:47.696043+0000","last_clean":"2024-04-26T20:20:47.696043+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:20:47.696043+0000","last_undegraded":"2024-04-26T20:20:47.696043+0000","last_fullsized":"2024-04-26T20:20:47.696043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682858+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:20:47.682858+0000","last_peered":"2024-04-26T20:20:47.682858+0000","last_clean":"2024-04-26T20:20:47.682858+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:20:47.682858+0000","last_undegraded":"2024-04-26T20:20:47.682858+0000","last_fullsized":"2024-04-26T20:20:47.682858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682358+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:47.682358+0000","last_peered":"2024-04-26T20:20:47.682358+0000","last_clean":"2024-04-26T20:20:47.682358+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:47.682358+0000","last_undegraded":"2024-04-26T20:20:47.682358+0000","last_fullsized":"2024-04-26T20:20:47.682358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820522+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:20:47.820522+0000","last_peered":"2024-04-26T20:20:47.820522+0000","last_clean":"2024-04-26T20:20:47.820522+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:20:47.820522+0000","last_undegraded":"2024-04-26T20:20:47.820522+0000","last_fullsized":"2024-04-26T20:20:47.820522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682744+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:20:47.682744+0000","last_peered":"2024-04-26T20:20:47.682744+0000","last_clean":"2024-04-26T20:20:47.682744+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:20:47.682744+0000","last_undegraded":"2024-04-26T20:20:47.682744+0000","last_fullsized":"2024-04-26T20:20:47.682744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682711+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:47.682711+0000","last_peered":"2024-04-26T20:20:47.682711+0000","last_clean":"2024-04-26T20:20:47.682711+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:47.682711+0000","last_undegraded":"2024-04-26T20:20:47.682711+0000","last_fullsized":"2024-04-26T20:20:47.682711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822571+0000","last_change":"2024-04-26T20:20:47.821791+0000","last_active":"2024-04-26T20:20:47.822571+0000","last_peered":"2024-04-26T20:20:47.822571+0000","last_clean":"2024-04-26T20:20:47.822571+0000","last_became_active":"2024-04-26T20:20:47.821338+0000","last_became_peered":"2024-04-26T20:20:47.821338+0000","last_unstale":"2024-04-26T20:20:47.822571+0000","last_undegraded":"2024-04-26T20:20:47.822571+0000","last_fullsized":"2024-04-26T20:20:47.822571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:45.027699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680806+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:20:47.680806+0000","last_peered":"2024-04-26T20:20:47.680806+0000","last_clean":"2024-04-26T20:20:47.680806+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:20:47.680806+0000","last_undegraded":"2024-04-26T20:20:47.680806+0000","last_fullsized":"2024-04-26T20:20:47.680806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.390813+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:22:50.390813+0000","last_peered":"2024-04-26T20:22:50.390813+0000","last_clean":"2024-04-26T20:22:50.390813+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:22:50.390813+0000","last_undegraded":"2024-04-26T20:22:50.390813+0000","last_fullsized":"2024-04-26T20:22:50.390813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683410+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:20:47.683410+0000","last_peered":"2024-04-26T20:20:47.683410+0000","last_clean":"2024-04-26T20:20:47.683410+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:20:47.683410+0000","last_undegraded":"2024-04-26T20:20:47.683410+0000","last_fullsized":"2024-04-26T20:20:47.683410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680605+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:20:47.680605+0000","last_peered":"2024-04-26T20:20:47.680605+0000","last_clean":"2024-04-26T20:20:47.680605+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:20:47.680605+0000","last_undegraded":"2024-04-26T20:20:47.680605+0000","last_fullsized":"2024-04-26T20:20:47.680605+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819638+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:47.819638+0000","last_peered":"2024-04-26T20:20:47.819638+0000","last_clean":"2024-04-26T20:20:47.819638+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:47.819638+0000","last_undegraded":"2024-04-26T20:20:47.819638+0000","last_fullsized":"2024-04-26T20:20:47.819638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686770+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:20:47.686770+0000","last_peered":"2024-04-26T20:20:47.686770+0000","last_clean":"2024-04-26T20:20:47.686770+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:20:47.686770+0000","last_undegraded":"2024-04-26T20:20:47.686770+0000","last_fullsized":"2024-04-26T20:20:47.686770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683145+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:20:47.683145+0000","last_peered":"2024-04-26T20:20:47.683145+0000","last_clean":"2024-04-26T20:20:47.683145+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:20:47.683145+0000","last_undegraded":"2024-04-26T20:20:47.683145+0000","last_fullsized":"2024-04-26T20:20:47.683145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694418+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:47.694418+0000","last_peered":"2024-04-26T20:20:47.694418+0000","last_clean":"2024-04-26T20:20:47.694418+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:47.694418+0000","last_undegraded":"2024-04-26T20:20:47.694418+0000","last_fullsized":"2024-04-26T20:20:47.694418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681243+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:20:47.681243+0000","last_peered":"2024-04-26T20:20:47.681243+0000","last_clean":"2024-04-26T20:20:47.681243+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:20:47.681243+0000","last_undegraded":"2024-04-26T20:20:47.681243+0000","last_fullsized":"2024-04-26T20:20:47.681243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694179+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:20:47.694179+0000","last_peered":"2024-04-26T20:20:47.694179+0000","last_clean":"2024-04-26T20:20:47.694179+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:20:47.694179+0000","last_undegraded":"2024-04-26T20:20:47.694179+0000","last_fullsized":"2024-04-26T20:20:47.694179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686623+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:47.686623+0000","last_peered":"2024-04-26T20:20:47.686623+0000","last_clean":"2024-04-26T20:20:47.686623+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:47.686623+0000","last_undegraded":"2024-04-26T20:20:47.686623+0000","last_fullsized":"2024-04-26T20:20:47.686623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685554+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:20:47.685554+0000","last_peered":"2024-04-26T20:20:47.685554+0000","last_clean":"2024-04-26T20:20:47.685554+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:20:47.685554+0000","last_undegraded":"2024-04-26T20:20:47.685554+0000","last_fullsized":"2024-04-26T20:20:47.685554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681339+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:20:47.681339+0000","last_peered":"2024-04-26T20:20:47.681339+0000","last_clean":"2024-04-26T20:20:47.681339+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:20:47.681339+0000","last_undegraded":"2024-04-26T20:20:47.681339+0000","last_fullsized":"2024-04-26T20:20:47.681339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:52.393560+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:22:52.393560+0000","last_peered":"2024-04-26T20:22:52.393560+0000","last_clean":"2024-04-26T20:22:52.393560+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:22:52.393560+0000","last_undegraded":"2024-04-26T20:22:52.393560+0000","last_fullsized":"2024-04-26T20:22:52.393560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":308,"num_read_kb":308,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820405+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:20:47.820405+0000","last_peered":"2024-04-26T20:20:47.820405+0000","last_clean":"2024-04-26T20:20:47.820405+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:20:47.820405+0000","last_undegraded":"2024-04-26T20:20:47.820405+0000","last_fullsized":"2024-04-26T20:20:47.820405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.700943+0000","last_change":"2024-04-26T20:20:47.700375+0000","last_active":"2024-04-26T20:20:47.700943+0000","last_peered":"2024-04-26T20:20:47.700943+0000","last_clean":"2024-04-26T20:20:47.700943+0000","last_became_active":"2024-04-26T20:20:47.699843+0000","last_became_peered":"2024-04-26T20:20:47.699843+0000","last_unstale":"2024-04-26T20:20:47.700943+0000","last_undegraded":"2024-04-26T20:20:47.700943+0000","last_fullsized":"2024-04-26T20:20:47.700943+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:53.112700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819945+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:47.819945+0000","last_peered":"2024-04-26T20:20:47.819945+0000","last_clean":"2024-04-26T20:20:47.819945+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:47.819945+0000","last_undegraded":"2024-04-26T20:20:47.819945+0000","last_fullsized":"2024-04-26T20:20:47.819945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696288+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:20:47.696288+0000","last_peered":"2024-04-26T20:20:47.696288+0000","last_clean":"2024-04-26T20:20:47.696288+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:20:47.696288+0000","last_undegraded":"2024-04-26T20:20:47.696288+0000","last_fullsized":"2024-04-26T20:20:47.696288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822591+0000","last_change":"2024-04-26T20:20:47.821914+0000","last_active":"2024-04-26T20:20:47.822591+0000","last_peered":"2024-04-26T20:20:47.822591+0000","last_clean":"2024-04-26T20:20:47.822591+0000","last_became_active":"2024-04-26T20:20:47.821365+0000","last_became_peered":"2024-04-26T20:20:47.821365+0000","last_unstale":"2024-04-26T20:20:47.822591+0000","last_undegraded":"2024-04-26T20:20:47.822591+0000","last_fullsized":"2024-04-26T20:20:47.822591+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:12.969419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687647+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:47.687647+0000","last_peered":"2024-04-26T20:20:47.687647+0000","last_clean":"2024-04-26T20:20:47.687647+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:47.687647+0000","last_undegraded":"2024-04-26T20:20:47.687647+0000","last_fullsized":"2024-04-26T20:20:47.687647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820660+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:20:47.820660+0000","last_peered":"2024-04-26T20:20:47.820660+0000","last_clean":"2024-04-26T20:20:47.820660+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:20:47.820660+0000","last_undegraded":"2024-04-26T20:20:47.820660+0000","last_fullsized":"2024-04-26T20:20:47.820660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683798+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:20:47.683798+0000","last_peered":"2024-04-26T20:20:47.683798+0000","last_clean":"2024-04-26T20:20:47.683798+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:20:47.683798+0000","last_undegraded":"2024-04-26T20:20:47.683798+0000","last_fullsized":"2024-04-26T20:20:47.683798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":383,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:52.393743+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:22:52.393743+0000","last_peered":"2024-04-26T20:22:52.393743+0000","last_clean":"2024-04-26T20:22:52.393743+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:22:52.393743+0000","last_undegraded":"2024-04-26T20:22:52.393743+0000","last_fullsized":"2024-04-26T20:22:52.393743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60509,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":217,"num_write":40,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683244+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:20:47.683244+0000","last_peered":"2024-04-26T20:20:47.683244+0000","last_clean":"2024-04-26T20:20:47.683244+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:20:47.683244+0000","last_undegraded":"2024-04-26T20:20:47.683244+0000","last_fullsized":"2024-04-26T20:20:47.683244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687898+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:20:47.687898+0000","last_peered":"2024-04-26T20:20:47.687898+0000","last_clean":"2024-04-26T20:20:47.687898+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:20:47.687898+0000","last_undegraded":"2024-04-26T20:20:47.687898+0000","last_fullsized":"2024-04-26T20:20:47.687898+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681061+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:47.681061+0000","last_peered":"2024-04-26T20:20:47.681061+0000","last_clean":"2024-04-26T20:20:47.681061+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:47.681061+0000","last_undegraded":"2024-04-26T20:20:47.681061+0000","last_fullsized":"2024-04-26T20:20:47.681061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693858+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:20:47.693858+0000","last_peered":"2024-04-26T20:20:47.693858+0000","last_clean":"2024-04-26T20:20:47.693858+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:20:47.693858+0000","last_undegraded":"2024-04-26T20:20:47.693858+0000","last_fullsized":"2024-04-26T20:20:47.693858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682773+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:20:47.682773+0000","last_peered":"2024-04-26T20:20:47.682773+0000","last_clean":"2024-04-26T20:20:47.682773+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:20:47.682773+0000","last_undegraded":"2024-04-26T20:20:47.682773+0000","last_fullsized":"2024-04-26T20:20:47.682773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686940+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:47.686940+0000","last_peered":"2024-04-26T20:20:47.686940+0000","last_clean":"2024-04-26T20:20:47.686940+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:47.686940+0000","last_undegraded":"2024-04-26T20:20:47.686940+0000","last_fullsized":"2024-04-26T20:20:47.686940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819117+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:20:47.819117+0000","last_peered":"2024-04-26T20:20:47.819117+0000","last_clean":"2024-04-26T20:20:47.819117+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:20:47.819117+0000","last_undegraded":"2024-04-26T20:20:47.819117+0000","last_fullsized":"2024-04-26T20:20:47.819117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682539+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:20:47.682539+0000","last_peered":"2024-04-26T20:20:47.682539+0000","last_clean":"2024-04-26T20:20:47.682539+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:20:47.682539+0000","last_undegraded":"2024-04-26T20:20:47.682539+0000","last_fullsized":"2024-04-26T20:20:47.682539+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:49.451243+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:22:49.451243+0000","last_peered":"2024-04-26T20:22:49.451243+0000","last_clean":"2024-04-26T20:22:49.451243+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:22:49.451243+0000","last_undegraded":"2024-04-26T20:22:49.451243+0000","last_fullsized":"2024-04-26T20:22:49.451243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818523+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:20:47.818523+0000","last_peered":"2024-04-26T20:20:47.818523+0000","last_clean":"2024-04-26T20:20:47.818523+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:20:47.818523+0000","last_undegraded":"2024-04-26T20:20:47.818523+0000","last_fullsized":"2024-04-26T20:20:47.818523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694465+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:20:47.694465+0000","last_peered":"2024-04-26T20:20:47.694465+0000","last_clean":"2024-04-26T20:20:47.694465+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:20:47.694465+0000","last_undegraded":"2024-04-26T20:20:47.694465+0000","last_fullsized":"2024-04-26T20:20:47.694465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.715108+0000","last_change":"2024-04-26T20:20:47.714651+0000","last_active":"2024-04-26T20:20:47.715108+0000","last_peered":"2024-04-26T20:20:47.715108+0000","last_clean":"2024-04-26T20:20:47.715108+0000","last_became_active":"2024-04-26T20:20:47.700320+0000","last_became_peered":"2024-04-26T20:20:47.700320+0000","last_unstale":"2024-04-26T20:20:47.715108+0000","last_undegraded":"2024-04-26T20:20:47.715108+0000","last_fullsized":"2024-04-26T20:20:47.715108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:19.935988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686320+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:20:47.686320+0000","last_peered":"2024-04-26T20:20:47.686320+0000","last_clean":"2024-04-26T20:20:47.686320+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:20:47.686320+0000","last_undegraded":"2024-04-26T20:20:47.686320+0000","last_fullsized":"2024-04-26T20:20:47.686320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822518+0000","last_change":"2024-04-26T20:20:47.821839+0000","last_active":"2024-04-26T20:20:47.822518+0000","last_peered":"2024-04-26T20:20:47.822518+0000","last_clean":"2024-04-26T20:20:47.822518+0000","last_became_active":"2024-04-26T20:20:47.821302+0000","last_became_peered":"2024-04-26T20:20:47.821302+0000","last_unstale":"2024-04-26T20:20:47.822518+0000","last_undegraded":"2024-04-26T20:20:47.822518+0000","last_fullsized":"2024-04-26T20:20:47.822518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:38.771597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683371+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:47.683371+0000","last_peered":"2024-04-26T20:20:47.683371+0000","last_clean":"2024-04-26T20:20:47.683371+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:47.683371+0000","last_undegraded":"2024-04-26T20:20:47.683371+0000","last_fullsized":"2024-04-26T20:20:47.683371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683167+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:20:47.683167+0000","last_peered":"2024-04-26T20:20:47.683167+0000","last_clean":"2024-04-26T20:20:47.683167+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:20:47.683167+0000","last_undegraded":"2024-04-26T20:20:47.683167+0000","last_fullsized":"2024-04-26T20:20:47.683167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682750+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:20:47.682750+0000","last_peered":"2024-04-26T20:20:47.682750+0000","last_clean":"2024-04-26T20:20:47.682750+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:20:47.682750+0000","last_undegraded":"2024-04-26T20:20:47.682750+0000","last_fullsized":"2024-04-26T20:20:47.682750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.703750+0000","last_change":"2024-04-26T20:20:47.701523+0000","last_active":"2024-04-26T20:20:47.703750+0000","last_peered":"2024-04-26T20:20:47.703750+0000","last_clean":"2024-04-26T20:20:47.703750+0000","last_became_active":"2024-04-26T20:20:47.700711+0000","last_became_peered":"2024-04-26T20:20:47.700711+0000","last_unstale":"2024-04-26T20:20:47.703750+0000","last_undegraded":"2024-04-26T20:20:47.703750+0000","last_fullsized":"2024-04-26T20:20:47.703750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:37.623094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820170+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:20:47.820170+0000","last_peered":"2024-04-26T20:20:47.820170+0000","last_clean":"2024-04-26T20:20:47.820170+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:20:47.820170+0000","last_undegraded":"2024-04-26T20:20:47.820170+0000","last_fullsized":"2024-04-26T20:20:47.820170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697662+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:20:47.697662+0000","last_peered":"2024-04-26T20:20:47.697662+0000","last_clean":"2024-04-26T20:20:47.697662+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:20:47.697662+0000","last_undegraded":"2024-04-26T20:20:47.697662+0000","last_fullsized":"2024-04-26T20:20:47.697662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":186,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:51.473972+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:22:51.473972+0000","last_peered":"2024-04-26T20:22:51.473972+0000","last_clean":"2024-04-26T20:22:51.473972+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:22:51.473972+0000","last_undegraded":"2024-04-26T20:22:51.473972+0000","last_fullsized":"2024-04-26T20:22:51.473972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819807+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:20:47.819807+0000","last_peered":"2024-04-26T20:20:47.819807+0000","last_clean":"2024-04-26T20:20:47.819807+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:20:47.819807+0000","last_undegraded":"2024-04-26T20:20:47.819807+0000","last_fullsized":"2024-04-26T20:20:47.819807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694851+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:20:47.694851+0000","last_peered":"2024-04-26T20:20:47.694851+0000","last_clean":"2024-04-26T20:20:47.694851+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:20:47.694851+0000","last_undegraded":"2024-04-26T20:20:47.694851+0000","last_fullsized":"2024-04-26T20:20:47.694851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686846+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:20:47.686846+0000","last_peered":"2024-04-26T20:20:47.686846+0000","last_clean":"2024-04-26T20:20:47.686846+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:20:47.686846+0000","last_undegraded":"2024-04-26T20:20:47.686846+0000","last_fullsized":"2024-04-26T20:20:47.686846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":187,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.452316+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:22:50.452316+0000","last_peered":"2024-04-26T20:22:50.452316+0000","last_clean":"2024-04-26T20:22:50.452316+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:22:50.452316+0000","last_undegraded":"2024-04-26T20:22:50.452316+0000","last_fullsized":"2024-04-26T20:22:50.452316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819441+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:20:47.819441+0000","last_peered":"2024-04-26T20:20:47.819441+0000","last_clean":"2024-04-26T20:20:47.819441+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:20:47.819441+0000","last_undegraded":"2024-04-26T20:20:47.819441+0000","last_fullsized":"2024-04-26T20:20:47.819441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684241+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:20:47.684241+0000","last_peered":"2024-04-26T20:20:47.684241+0000","last_clean":"2024-04-26T20:20:47.684241+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:20:47.684241+0000","last_undegraded":"2024-04-26T20:20:47.684241+0000","last_fullsized":"2024-04-26T20:20:47.684241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683079+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:47.683079+0000","last_peered":"2024-04-26T20:20:47.683079+0000","last_clean":"2024-04-26T20:20:47.683079+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:47.683079+0000","last_undegraded":"2024-04-26T20:20:47.683079+0000","last_fullsized":"2024-04-26T20:20:47.683079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820401+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:20:47.820401+0000","last_peered":"2024-04-26T20:20:47.820401+0000","last_clean":"2024-04-26T20:20:47.820401+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:20:47.820401+0000","last_undegraded":"2024-04-26T20:20:47.820401+0000","last_fullsized":"2024-04-26T20:20:47.820401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687206+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:20:47.687206+0000","last_peered":"2024-04-26T20:20:47.687206+0000","last_clean":"2024-04-26T20:20:47.687206+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:20:47.687206+0000","last_undegraded":"2024-04-26T20:20:47.687206+0000","last_fullsized":"2024-04-26T20:20:47.687206+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.699521+0000","last_change":"2024-04-26T20:20:47.697300+0000","last_active":"2024-04-26T20:20:47.699521+0000","last_peered":"2024-04-26T20:20:47.699521+0000","last_clean":"2024-04-26T20:20:47.699521+0000","last_became_active":"2024-04-26T20:20:47.696809+0000","last_became_peered":"2024-04-26T20:20:47.696809+0000","last_unstale":"2024-04-26T20:20:47.699521+0000","last_undegraded":"2024-04-26T20:20:47.699521+0000","last_fullsized":"2024-04-26T20:20:47.699521+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:01.540485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818395+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:47.818395+0000","last_peered":"2024-04-26T20:20:47.818395+0000","last_clean":"2024-04-26T20:20:47.818395+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:47.818395+0000","last_undegraded":"2024-04-26T20:20:47.818395+0000","last_fullsized":"2024-04-26T20:20:47.818395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682745+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:20:47.682745+0000","last_peered":"2024-04-26T20:20:47.682745+0000","last_clean":"2024-04-26T20:20:47.682745+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:20:47.682745+0000","last_undegraded":"2024-04-26T20:20:47.682745+0000","last_fullsized":"2024-04-26T20:20:47.682745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683136+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:47.683136+0000","last_peered":"2024-04-26T20:20:47.683136+0000","last_clean":"2024-04-26T20:20:47.683136+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:47.683136+0000","last_undegraded":"2024-04-26T20:20:47.683136+0000","last_fullsized":"2024-04-26T20:20:47.683136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697874+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:20:47.697874+0000","last_peered":"2024-04-26T20:20:47.697874+0000","last_clean":"2024-04-26T20:20:47.697874+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:20:47.697874+0000","last_undegraded":"2024-04-26T20:20:47.697874+0000","last_fullsized":"2024-04-26T20:20:47.697874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681290+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:20:47.681290+0000","last_peered":"2024-04-26T20:20:47.681290+0000","last_clean":"2024-04-26T20:20:47.681290+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:20:47.681290+0000","last_undegraded":"2024-04-26T20:20:47.681290+0000","last_fullsized":"2024-04-26T20:20:47.681290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.709280+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:21:47.709280+0000","last_peered":"2024-04-26T20:21:47.709280+0000","last_clean":"2024-04-26T20:21:47.709280+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:21:47.709280+0000","last_undegraded":"2024-04-26T20:21:47.709280+0000","last_fullsized":"2024-04-26T20:21:47.709280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684046+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:20:47.684046+0000","last_peered":"2024-04-26T20:20:47.684046+0000","last_clean":"2024-04-26T20:20:47.684046+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:20:47.684046+0000","last_undegraded":"2024-04-26T20:20:47.684046+0000","last_fullsized":"2024-04-26T20:20:47.684046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680245+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:20:47.680245+0000","last_peered":"2024-04-26T20:20:47.680245+0000","last_clean":"2024-04-26T20:20:47.680245+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:20:47.680245+0000","last_undegraded":"2024-04-26T20:20:47.680245+0000","last_fullsized":"2024-04-26T20:20:47.680245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683319+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:47.683319+0000","last_peered":"2024-04-26T20:20:47.683319+0000","last_clean":"2024-04-26T20:20:47.683319+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:47.683319+0000","last_undegraded":"2024-04-26T20:20:47.683319+0000","last_fullsized":"2024-04-26T20:20:47.683319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694787+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:20:47.694787+0000","last_peered":"2024-04-26T20:20:47.694787+0000","last_clean":"2024-04-26T20:20:47.694787+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:20:47.694787+0000","last_undegraded":"2024-04-26T20:20:47.694787+0000","last_fullsized":"2024-04-26T20:20:47.694787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683161+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:20:47.683161+0000","last_peered":"2024-04-26T20:20:47.683161+0000","last_clean":"2024-04-26T20:20:47.683161+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:20:47.683161+0000","last_undegraded":"2024-04-26T20:20:47.683161+0000","last_fullsized":"2024-04-26T20:20:47.683161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819561+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:47.819561+0000","last_peered":"2024-04-26T20:20:47.819561+0000","last_clean":"2024-04-26T20:20:47.819561+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:47.819561+0000","last_undegraded":"2024-04-26T20:20:47.819561+0000","last_fullsized":"2024-04-26T20:20:47.819561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682262+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:20:47.682262+0000","last_peered":"2024-04-26T20:20:47.682262+0000","last_clean":"2024-04-26T20:20:47.682262+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:20:47.682262+0000","last_undegraded":"2024-04-26T20:20:47.682262+0000","last_fullsized":"2024-04-26T20:20:47.682262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683010+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:20:47.683010+0000","last_peered":"2024-04-26T20:20:47.683010+0000","last_clean":"2024-04-26T20:20:47.683010+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:20:47.683010+0000","last_undegraded":"2024-04-26T20:20:47.683010+0000","last_fullsized":"2024-04-26T20:20:47.683010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680319+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:47.680319+0000","last_peered":"2024-04-26T20:20:47.680319+0000","last_clean":"2024-04-26T20:20:47.680319+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:47.680319+0000","last_undegraded":"2024-04-26T20:20:47.680319+0000","last_fullsized":"2024-04-26T20:20:47.680319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683622+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:20:47.683622+0000","last_peered":"2024-04-26T20:20:47.683622+0000","last_clean":"2024-04-26T20:20:47.683622+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:20:47.683622+0000","last_undegraded":"2024-04-26T20:20:47.683622+0000","last_fullsized":"2024-04-26T20:20:47.683622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682900+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:20:47.682900+0000","last_peered":"2024-04-26T20:20:47.682900+0000","last_clean":"2024-04-26T20:20:47.682900+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:20:47.682900+0000","last_undegraded":"2024-04-26T20:20:47.682900+0000","last_fullsized":"2024-04-26T20:20:47.682900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680352+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:47.680352+0000","last_peered":"2024-04-26T20:20:47.680352+0000","last_clean":"2024-04-26T20:20:47.680352+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:47.680352+0000","last_undegraded":"2024-04-26T20:20:47.680352+0000","last_fullsized":"2024-04-26T20:20:47.680352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685745+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:20:47.685745+0000","last_peered":"2024-04-26T20:20:47.685745+0000","last_clean":"2024-04-26T20:20:47.685745+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:20:47.685745+0000","last_undegraded":"2024-04-26T20:20:47.685745+0000","last_fullsized":"2024-04-26T20:20:47.685745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683135+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:20:47.683135+0000","last_peered":"2024-04-26T20:20:47.683135+0000","last_clean":"2024-04-26T20:20:47.683135+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:20:47.683135+0000","last_undegraded":"2024-04-26T20:20:47.683135+0000","last_fullsized":"2024-04-26T20:20:47.683135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682630+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:47.682630+0000","last_peered":"2024-04-26T20:20:47.682630+0000","last_clean":"2024-04-26T20:20:47.682630+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:47.682630+0000","last_undegraded":"2024-04-26T20:20:47.682630+0000","last_fullsized":"2024-04-26T20:20:47.682630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819064+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:20:47.819064+0000","last_peered":"2024-04-26T20:20:47.819064+0000","last_clean":"2024-04-26T20:20:47.819064+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:20:47.819064+0000","last_undegraded":"2024-04-26T20:20:47.819064+0000","last_fullsized":"2024-04-26T20:20:47.819064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818873+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:20:47.818873+0000","last_peered":"2024-04-26T20:20:47.818873+0000","last_clean":"2024-04-26T20:20:47.818873+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:20:47.818873+0000","last_undegraded":"2024-04-26T20:20:47.818873+0000","last_fullsized":"2024-04-26T20:20:47.818873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.488922+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:22:50.488922+0000","last_peered":"2024-04-26T20:22:50.488922+0000","last_clean":"2024-04-26T20:22:50.488922+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:22:50.488922+0000","last_undegraded":"2024-04-26T20:22:50.488922+0000","last_fullsized":"2024-04-26T20:22:50.488922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819674+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:20:47.819674+0000","last_peered":"2024-04-26T20:20:47.819674+0000","last_clean":"2024-04-26T20:20:47.819674+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:20:47.819674+0000","last_undegraded":"2024-04-26T20:20:47.819674+0000","last_fullsized":"2024-04-26T20:20:47.819674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692735+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:20:47.692735+0000","last_peered":"2024-04-26T20:20:47.692735+0000","last_clean":"2024-04-26T20:20:47.692735+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:20:47.692735+0000","last_undegraded":"2024-04-26T20:20:47.692735+0000","last_fullsized":"2024-04-26T20:20:47.692735+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687748+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:47.687748+0000","last_peered":"2024-04-26T20:20:47.687748+0000","last_clean":"2024-04-26T20:20:47.687748+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:47.687748+0000","last_undegraded":"2024-04-26T20:20:47.687748+0000","last_fullsized":"2024-04-26T20:20:47.687748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819410+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:20:47.819410+0000","last_peered":"2024-04-26T20:20:47.819410+0000","last_clean":"2024-04-26T20:20:47.819410+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:20:47.819410+0000","last_undegraded":"2024-04-26T20:20:47.819410+0000","last_fullsized":"2024-04-26T20:20:47.819410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685972+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:20:47.685972+0000","last_peered":"2024-04-26T20:20:47.685972+0000","last_clean":"2024-04-26T20:20:47.685972+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:20:47.685972+0000","last_undegraded":"2024-04-26T20:20:47.685972+0000","last_fullsized":"2024-04-26T20:20:47.685972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692893+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:47.692893+0000","last_peered":"2024-04-26T20:20:47.692893+0000","last_clean":"2024-04-26T20:20:47.692893+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:47.692893+0000","last_undegraded":"2024-04-26T20:20:47.692893+0000","last_fullsized":"2024-04-26T20:20:47.692893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820005+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:20:47.820005+0000","last_peered":"2024-04-26T20:20:47.820005+0000","last_clean":"2024-04-26T20:20:47.820005+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:20:47.820005+0000","last_undegraded":"2024-04-26T20:20:47.820005+0000","last_fullsized":"2024-04-26T20:20:47.820005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692256+0000","last_change":"2024-04-26T20:20:47.691705+0000","last_active":"2024-04-26T20:20:47.692256+0000","last_peered":"2024-04-26T20:20:47.692256+0000","last_clean":"2024-04-26T20:20:47.692256+0000","last_became_active":"2024-04-26T20:20:47.691330+0000","last_became_peered":"2024-04-26T20:20:47.691330+0000","last_unstale":"2024-04-26T20:20:47.692256+0000","last_undegraded":"2024-04-26T20:20:47.692256+0000","last_fullsized":"2024-04-26T20:20:47.692256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:36.045725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680627+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:20:47.680627+0000","last_peered":"2024-04-26T20:20:47.680627+0000","last_clean":"2024-04-26T20:20:47.680627+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:20:47.680627+0000","last_undegraded":"2024-04-26T20:20:47.680627+0000","last_fullsized":"2024-04-26T20:20:47.680627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680310+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:20:47.680310+0000","last_peered":"2024-04-26T20:20:47.680310+0000","last_clean":"2024-04-26T20:20:47.680310+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:20:47.680310+0000","last_undegraded":"2024-04-26T20:20:47.680310+0000","last_fullsized":"2024-04-26T20:20:47.680310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692934+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:20:47.692934+0000","last_peered":"2024-04-26T20:20:47.692934+0000","last_clean":"2024-04-26T20:20:47.692934+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:20:47.692934+0000","last_undegraded":"2024-04-26T20:20:47.692934+0000","last_fullsized":"2024-04-26T20:20:47.692934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.703472+0000","last_change":"2024-04-26T20:20:47.701792+0000","last_active":"2024-04-26T20:20:47.703472+0000","last_peered":"2024-04-26T20:20:47.703472+0000","last_clean":"2024-04-26T20:20:47.703472+0000","last_became_active":"2024-04-26T20:20:47.701226+0000","last_became_peered":"2024-04-26T20:20:47.701226+0000","last_unstale":"2024-04-26T20:20:47.703472+0000","last_undegraded":"2024-04-26T20:20:47.703472+0000","last_fullsized":"2024-04-26T20:20:47.703472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:56.095557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682954+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:20:47.682954+0000","last_peered":"2024-04-26T20:20:47.682954+0000","last_clean":"2024-04-26T20:20:47.682954+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:20:47.682954+0000","last_undegraded":"2024-04-26T20:20:47.682954+0000","last_fullsized":"2024-04-26T20:20:47.682954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681033+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:20:47.681033+0000","last_peered":"2024-04-26T20:20:47.681033+0000","last_clean":"2024-04-26T20:20:47.681033+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:20:47.681033+0000","last_undegraded":"2024-04-26T20:20:47.681033+0000","last_fullsized":"2024-04-26T20:20:47.681033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684509+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:20:47.684509+0000","last_peered":"2024-04-26T20:20:47.684509+0000","last_clean":"2024-04-26T20:20:47.684509+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:20:47.684509+0000","last_undegraded":"2024-04-26T20:20:47.684509+0000","last_fullsized":"2024-04-26T20:20:47.684509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686737+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:20:47.686737+0000","last_peered":"2024-04-26T20:20:47.686737+0000","last_clean":"2024-04-26T20:20:47.686737+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:20:47.686737+0000","last_undegraded":"2024-04-26T20:20:47.686737+0000","last_fullsized":"2024-04-26T20:20:47.686737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681623+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:20:47.681623+0000","last_peered":"2024-04-26T20:20:47.681623+0000","last_clean":"2024-04-26T20:20:47.681623+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:20:47.681623+0000","last_undegraded":"2024-04-26T20:20:47.681623+0000","last_fullsized":"2024-04-26T20:20:47.681623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819257+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:20:47.819257+0000","last_peered":"2024-04-26T20:20:47.819257+0000","last_clean":"2024-04-26T20:20:47.819257+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:20:47.819257+0000","last_undegraded":"2024-04-26T20:20:47.819257+0000","last_fullsized":"2024-04-26T20:20:47.819257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693840+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:20:47.693840+0000","last_peered":"2024-04-26T20:20:47.693840+0000","last_clean":"2024-04-26T20:20:47.693840+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:20:47.693840+0000","last_undegraded":"2024-04-26T20:20:47.693840+0000","last_fullsized":"2024-04-26T20:20:47.693840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682964+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:20:47.682964+0000","last_peered":"2024-04-26T20:20:47.682964+0000","last_clean":"2024-04-26T20:20:47.682964+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:20:47.682964+0000","last_undegraded":"2024-04-26T20:20:47.682964+0000","last_fullsized":"2024-04-26T20:20:47.682964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68023,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1572,"num_read_kb":861,"num_write":251,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383731,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645367,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37020,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708132,"statfs":{"total":95995035648,"available":95957127168,"internally_reserved":0,"allocated":1724416,"data_stored":1149141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808894,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1060864,"data_stored":505451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070532,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":501621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332170,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1650688,"data_stored":1098540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495696,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":496859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":558398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":498706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1118208,"data_stored":559319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182498,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":501324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757333,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1093731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:22:55.607 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-26T20:22:55.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:22:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 -- 172.21.15.82:0/1071571629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 msgr2=0x7ff57c10a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 --2- 172.21.15.82:0/1071571629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 0x7ff57c10a400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff568009900 tx=0x7ff56802a410 comp rx=0 tx=0).stop 2024-04-26T20:22:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 -- 172.21.15.82:0/1071571629 shutdown_connections 2024-04-26T20:22:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 --2- 172.21.15.82:0/1071571629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff57c10a940 0x7ff57c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 --2- 172.21.15.82:0/1071571629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 0x7ff57c10a400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 --2- 172.21.15.82:0/1071571629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 -- 172.21.15.82:0/1071571629 >> 172.21.15.82:0/1071571629 conn(0x7ff57c077d30 msgr2=0x7ff57c07a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:55.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 -- 172.21.15.82:0/1071571629 shutdown_connections 2024-04-26T20:22:55.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.854+0000 7ff57be00640 1 -- 172.21.15.82:0/1071571629 wait complete. 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.855+0000 7ff57be00640 1 Processor -- start 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 -- start start 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 0x7ff57c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff57c10a940 0x7ff57c1a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c1148a0 con 0x7ff57c108d90 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c114720 con 0x7ff57c10a940 2024-04-26T20:22:55.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c114a20 con 0x7ff57c109f80 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42724/0 (socket says 172.21.15.82:42724) 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57aa00640 1 -- 172.21.15.82:0/1312430992 learned_addr learned my addr 172.21.15.82:0/1312430992 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57a000640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 0x7ff57c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.856+0000 7ff57b400640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff57c10a940 0x7ff57c1a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57aa00640 1 -- 172.21.15.82:0/1312430992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 msgr2=0x7ff57c19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57aa00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 0x7ff57c19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57aa00640 1 -- 172.21.15.82:0/1312430992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff57c10a940 msgr2=0x7ff57c1a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57aa00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff57c10a940 0x7ff57c1a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57aa00640 1 -- 172.21.15.82:0/1312430992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c1a6ba0 con 0x7ff57c108d90 2024-04-26T20:22:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57aa00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c19ef80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00e9c0 tx=0x7ff56c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00cd80 con 0x7ff57c108d90 2024-04-26T20:22:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff56c0035f0 con 0x7ff57c108d90 2024-04-26T20:22:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c1a6e90 con 0x7ff57c108d90 2024-04-26T20:22:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.857+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c010690 con 0x7ff57c108d90 2024-04-26T20:22:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.858+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c1a72f0 con 0x7ff57c108d90 2024-04-26T20:22:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.859+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c1100d0 con 0x7ff57c108d90 2024-04-26T20:22:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.861+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff56c0037a0 con 0x7ff57c108d90 2024-04-26T20:22:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.862+0000 7ff573400640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff5600a3c40 0x7ff5600a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.862+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff56c0d0c90 con 0x7ff57c108d90 2024-04-26T20:22:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.862+0000 7ff57a000640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff5600a3c40 0x7ff5600a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.863+0000 7ff57a000640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff5600a3c40 0x7ff5600a6100 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff568000c00 tx=0x7ff5680314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:55.866+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff56c09d150 con 0x7ff57c108d90 2024-04-26T20:22:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:55 smithi082 ceph-mon[28105]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:22:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:55 smithi082 ceph-mon[28105]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:55 smithi082 ceph-mon[28105]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:56.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.063+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 --> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff57c062d70 con 0x7ff5600a3c40 2024-04-26T20:22:56.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:55 smithi139 ceph-mon[32999]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:22:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:55 smithi139 ceph-mon[32999]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:55 smithi139 ceph-mon[32999]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:56.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.093+0000 7ff573400640 1 -- 172.21.15.82:0/1312430992 <== mgr.14152 v2:172.21.15.82:6800/893198693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340420 (secure 0 0 0) 0x7ff57c062d70 con 0x7ff5600a3c40 2024-04-26T20:22:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff5600a3c40 msgr2=0x7ff5600a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff5600a3c40 0x7ff5600a6100 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff568000c00 tx=0x7ff5680314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 msgr2=0x7ff57c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c19ef80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00e9c0 tx=0x7ff56c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 shutdown_connections 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff5600a3c40 0x7ff5600a6100 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff57c10a940 0x7ff57c1a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff57c109f80 0x7ff57c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 --2- 172.21.15.82:0/1312430992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff57c108d90 0x7ff57c19ef80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.100+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 >> 172.21.15.82:0/1312430992 conn(0x7ff57c077d30 msgr2=0x7ff57c10d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.101+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 shutdown_connections 2024-04-26T20:22:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.101+0000 7ff57be00640 1 -- 172.21.15.82:0/1312430992 wait complete. 2024-04-26T20:22:56.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:55 smithi135 ceph-mon[32816]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:22:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:55 smithi135 ceph-mon[32816]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:55 smithi135 ceph-mon[32816]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:56.121 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-04-26T20:22:54.650259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658625,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1698,"num_read_kb":970,"num_write":434,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375908,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565916,"statfs":{"total":1151940427776,"available":1151555497984,"internally_reserved":0,"allocated":14569472,"data_stored":7961585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":73,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004506"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683422+0000","last_change":"2024-04-26T20:19:52.670447+0000","last_active":"2024-04-26T20:20:47.683422+0000","last_peered":"2024-04-26T20:20:47.683422+0000","last_clean":"2024-04-26T20:20:47.683422+0000","last_became_active":"2024-04-26T20:19:52.670114+0000","last_became_peered":"2024-04-26T20:19:52.670114+0000","last_unstale":"2024-04-26T20:20:47.683422+0000","last_undegraded":"2024-04-26T20:20:47.683422+0000","last_fullsized":"2024-04-26T20:20:47.683422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:38.766407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694676+0000","last_change":"2024-04-26T20:19:52.663773+0000","last_active":"2024-04-26T20:20:47.694676+0000","last_peered":"2024-04-26T20:20:47.694676+0000","last_clean":"2024-04-26T20:20:47.694676+0000","last_became_active":"2024-04-26T20:19:52.662794+0000","last_became_peered":"2024-04-26T20:19:52.662794+0000","last_unstale":"2024-04-26T20:20:47.694676+0000","last_undegraded":"2024-04-26T20:20:47.694676+0000","last_fullsized":"2024-04-26T20:20:47.694676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:51.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693273+0000","last_change":"2024-04-26T20:19:52.657097+0000","last_active":"2024-04-26T20:20:47.693273+0000","last_peered":"2024-04-26T20:20:47.693273+0000","last_clean":"2024-04-26T20:20:47.693273+0000","last_became_active":"2024-04-26T20:19:52.656764+0000","last_became_peered":"2024-04-26T20:19:52.656764+0000","last_unstale":"2024-04-26T20:20:47.693273+0000","last_undegraded":"2024-04-26T20:20:47.693273+0000","last_fullsized":"2024-04-26T20:20:47.693273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:44.643626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683615+0000","last_change":"2024-04-26T20:19:52.652050+0000","last_active":"2024-04-26T20:20:47.683615+0000","last_peered":"2024-04-26T20:20:47.683615+0000","last_clean":"2024-04-26T20:20:47.683615+0000","last_became_active":"2024-04-26T20:19:52.651528+0000","last_became_peered":"2024-04-26T20:19:52.651528+0000","last_unstale":"2024-04-26T20:20:47.683615+0000","last_undegraded":"2024-04-26T20:20:47.683615+0000","last_fullsized":"2024-04-26T20:20:47.683615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:11.157452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682513+0000","last_change":"2024-04-26T20:19:52.664940+0000","last_active":"2024-04-26T20:20:47.682513+0000","last_peered":"2024-04-26T20:20:47.682513+0000","last_clean":"2024-04-26T20:20:47.682513+0000","last_became_active":"2024-04-26T20:19:52.664678+0000","last_became_peered":"2024-04-26T20:19:52.664678+0000","last_unstale":"2024-04-26T20:20:47.682513+0000","last_undegraded":"2024-04-26T20:20:47.682513+0000","last_fullsized":"2024-04-26T20:20:47.682513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:05.321227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819785+0000","last_change":"2024-04-26T20:19:52.660101+0000","last_active":"2024-04-26T20:20:47.819785+0000","last_peered":"2024-04-26T20:20:47.819785+0000","last_clean":"2024-04-26T20:20:47.819785+0000","last_became_active":"2024-04-26T20:19:52.659778+0000","last_became_peered":"2024-04-26T20:19:52.659778+0000","last_unstale":"2024-04-26T20:20:47.819785+0000","last_undegraded":"2024-04-26T20:20:47.819785+0000","last_fullsized":"2024-04-26T20:20:47.819785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:48.420703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818637+0000","last_change":"2024-04-26T20:19:52.660182+0000","last_active":"2024-04-26T20:20:47.818637+0000","last_peered":"2024-04-26T20:20:47.818637+0000","last_clean":"2024-04-26T20:20:47.818637+0000","last_became_active":"2024-04-26T20:19:52.659808+0000","last_became_peered":"2024-04-26T20:19:52.659808+0000","last_unstale":"2024-04-26T20:20:47.818637+0000","last_undegraded":"2024-04-26T20:20:47.818637+0000","last_fullsized":"2024-04-26T20:20:47.818637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:06.465476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680946+0000","last_change":"2024-04-26T20:19:52.673797+0000","last_active":"2024-04-26T20:20:47.680946+0000","last_peered":"2024-04-26T20:20:47.680946+0000","last_clean":"2024-04-26T20:20:47.680946+0000","last_became_active":"2024-04-26T20:19:52.670101+0000","last_became_peered":"2024-04-26T20:19:52.670101+0000","last_unstale":"2024-04-26T20:20:47.680946+0000","last_undegraded":"2024-04-26T20:20:47.680946+0000","last_fullsized":"2024-04-26T20:20:47.680946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:51:57.315653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820773+0000","last_change":"2024-04-26T20:19:52.645592+0000","last_active":"2024-04-26T20:20:47.820773+0000","last_peered":"2024-04-26T20:20:47.820773+0000","last_clean":"2024-04-26T20:20:47.820773+0000","last_became_active":"2024-04-26T20:19:52.645153+0000","last_became_peered":"2024-04-26T20:19:52.645153+0000","last_unstale":"2024-04-26T20:20:47.820773+0000","last_undegraded":"2024-04-26T20:20:47.820773+0000","last_fullsized":"2024-04-26T20:20:47.820773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:40.378404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820347+0000","last_change":"2024-04-26T20:19:52.650706+0000","last_active":"2024-04-26T20:20:47.820347+0000","last_peered":"2024-04-26T20:20:47.820347+0000","last_clean":"2024-04-26T20:20:47.820347+0000","last_became_active":"2024-04-26T20:19:52.650383+0000","last_became_peered":"2024-04-26T20:19:52.650383+0000","last_unstale":"2024-04-26T20:20:47.820347+0000","last_undegraded":"2024-04-26T20:20:47.820347+0000","last_fullsized":"2024-04-26T20:20:47.820347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:53.886023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819646+0000","last_change":"2024-04-26T20:19:52.649515+0000","last_active":"2024-04-26T20:20:47.819646+0000","last_peered":"2024-04-26T20:20:47.819646+0000","last_clean":"2024-04-26T20:20:47.819646+0000","last_became_active":"2024-04-26T20:19:52.649128+0000","last_became_peered":"2024-04-26T20:19:52.649128+0000","last_unstale":"2024-04-26T20:20:47.819646+0000","last_undegraded":"2024-04-26T20:20:47.819646+0000","last_fullsized":"2024-04-26T20:20:47.819646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:57.540251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683478+0000","last_change":"2024-04-26T20:19:52.651131+0000","last_active":"2024-04-26T20:20:47.683478+0000","last_peered":"2024-04-26T20:20:47.683478+0000","last_clean":"2024-04-26T20:20:47.683478+0000","last_became_active":"2024-04-26T20:19:52.650462+0000","last_became_peered":"2024-04-26T20:19:52.650462+0000","last_unstale":"2024-04-26T20:20:47.683478+0000","last_undegraded":"2024-04-26T20:20:47.683478+0000","last_fullsized":"2024-04-26T20:20:47.683478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:32.496159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693935+0000","last_change":"2024-04-26T20:19:52.645963+0000","last_active":"2024-04-26T20:20:47.693935+0000","last_peered":"2024-04-26T20:20:47.693935+0000","last_clean":"2024-04-26T20:20:47.693935+0000","last_became_active":"2024-04-26T20:19:52.645269+0000","last_became_peered":"2024-04-26T20:19:52.645269+0000","last_unstale":"2024-04-26T20:20:47.693935+0000","last_undegraded":"2024-04-26T20:20:47.693935+0000","last_fullsized":"2024-04-26T20:20:47.693935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:35.767699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696784+0000","last_change":"2024-04-26T20:19:52.658474+0000","last_active":"2024-04-26T20:20:47.696784+0000","last_peered":"2024-04-26T20:20:47.696784+0000","last_clean":"2024-04-26T20:20:47.696784+0000","last_became_active":"2024-04-26T20:19:52.657314+0000","last_became_peered":"2024-04-26T20:19:52.657314+0000","last_unstale":"2024-04-26T20:20:47.696784+0000","last_undegraded":"2024-04-26T20:20:47.696784+0000","last_fullsized":"2024-04-26T20:20:47.696784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:03.923533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692176+0000","last_change":"2024-04-26T20:19:52.659036+0000","last_active":"2024-04-26T20:20:47.692176+0000","last_peered":"2024-04-26T20:20:47.692176+0000","last_clean":"2024-04-26T20:20:47.692176+0000","last_became_active":"2024-04-26T20:19:52.657876+0000","last_became_peered":"2024-04-26T20:19:52.657876+0000","last_unstale":"2024-04-26T20:20:47.692176+0000","last_undegraded":"2024-04-26T20:20:47.692176+0000","last_fullsized":"2024-04-26T20:20:47.692176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:34.890351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819551+0000","last_change":"2024-04-26T20:19:52.659767+0000","last_active":"2024-04-26T20:20:47.819551+0000","last_peered":"2024-04-26T20:20:47.819551+0000","last_clean":"2024-04-26T20:20:47.819551+0000","last_became_active":"2024-04-26T20:19:52.659368+0000","last_became_peered":"2024-04-26T20:19:52.659368+0000","last_unstale":"2024-04-26T20:20:47.819551+0000","last_undegraded":"2024-04-26T20:20:47.819551+0000","last_fullsized":"2024-04-26T20:20:47.819551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:46.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683222+0000","last_change":"2024-04-26T20:19:52.670450+0000","last_active":"2024-04-26T20:20:47.683222+0000","last_peered":"2024-04-26T20:20:47.683222+0000","last_clean":"2024-04-26T20:20:47.683222+0000","last_became_active":"2024-04-26T20:19:52.670112+0000","last_became_peered":"2024-04-26T20:19:52.670112+0000","last_unstale":"2024-04-26T20:20:47.683222+0000","last_undegraded":"2024-04-26T20:20:47.683222+0000","last_fullsized":"2024-04-26T20:20:47.683222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:09.706627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683408+0000","last_change":"2024-04-26T20:19:52.660131+0000","last_active":"2024-04-26T20:20:47.683408+0000","last_peered":"2024-04-26T20:20:47.683408+0000","last_clean":"2024-04-26T20:20:47.683408+0000","last_became_active":"2024-04-26T20:19:52.658698+0000","last_became_peered":"2024-04-26T20:19:52.658698+0000","last_unstale":"2024-04-26T20:20:47.683408+0000","last_undegraded":"2024-04-26T20:20:47.683408+0000","last_fullsized":"2024-04-26T20:20:47.683408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:40.908808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680922+0000","last_change":"2024-04-26T20:19:52.667011+0000","last_active":"2024-04-26T20:20:47.680922+0000","last_peered":"2024-04-26T20:20:47.680922+0000","last_clean":"2024-04-26T20:20:47.680922+0000","last_became_active":"2024-04-26T20:19:52.666691+0000","last_became_peered":"2024-04-26T20:19:52.666691+0000","last_unstale":"2024-04-26T20:20:47.680922+0000","last_undegraded":"2024-04-26T20:20:47.680922+0000","last_fullsized":"2024-04-26T20:20:47.680922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:57.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680488+0000","last_change":"2024-04-26T20:19:56.751963+0000","last_active":"2024-04-26T20:20:47.680488+0000","last_peered":"2024-04-26T20:20:47.680488+0000","last_clean":"2024-04-26T20:20:47.680488+0000","last_became_active":"2024-04-26T20:19:56.751525+0000","last_became_peered":"2024-04-26T20:19:56.751525+0000","last_unstale":"2024-04-26T20:20:47.680488+0000","last_undegraded":"2024-04-26T20:20:47.680488+0000","last_fullsized":"2024-04-26T20:20:47.680488+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:00.852476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":192,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:49.469710+0000","last_change":"2024-04-26T20:19:51.658962+0000","last_active":"2024-04-26T20:22:49.469710+0000","last_peered":"2024-04-26T20:22:49.469710+0000","last_clean":"2024-04-26T20:22:49.469710+0000","last_became_active":"2024-04-26T20:19:51.658525+0000","last_became_peered":"2024-04-26T20:19:51.658525+0000","last_unstale":"2024-04-26T20:22:49.469710+0000","last_undegraded":"2024-04-26T20:22:49.469710+0000","last_fullsized":"2024-04-26T20:22:49.469710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:11.866354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":152,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688540+0000","last_change":"2024-04-26T20:19:52.655308+0000","last_active":"2024-04-26T20:20:47.688540+0000","last_peered":"2024-04-26T20:20:47.688540+0000","last_clean":"2024-04-26T20:20:47.688540+0000","last_became_active":"2024-04-26T20:19:52.654751+0000","last_became_peered":"2024-04-26T20:19:52.654751+0000","last_unstale":"2024-04-26T20:20:47.688540+0000","last_undegraded":"2024-04-26T20:20:47.688540+0000","last_fullsized":"2024-04-26T20:20:47.688540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:51.145857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.695987+0000","last_change":"2024-04-26T20:20:47.695528+0000","last_active":"2024-04-26T20:20:47.695987+0000","last_peered":"2024-04-26T20:20:47.695987+0000","last_clean":"2024-04-26T20:20:47.695987+0000","last_became_active":"2024-04-26T20:20:47.695083+0000","last_became_peered":"2024-04-26T20:20:47.695083+0000","last_unstale":"2024-04-26T20:20:47.695987+0000","last_undegraded":"2024-04-26T20:20:47.695987+0000","last_fullsized":"2024-04-26T20:20:47.695987+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:14.240451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.688726+0000","last_change":"2024-04-26T20:19:51.672833+0000","last_active":"2024-04-26T20:20:47.688726+0000","last_peered":"2024-04-26T20:20:47.688726+0000","last_clean":"2024-04-26T20:20:47.688726+0000","last_became_active":"2024-04-26T20:19:51.672443+0000","last_became_peered":"2024-04-26T20:19:51.672443+0000","last_unstale":"2024-04-26T20:20:47.688726+0000","last_undegraded":"2024-04-26T20:20:47.688726+0000","last_fullsized":"2024-04-26T20:20:47.688726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:31.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696043+0000","last_change":"2024-04-26T20:19:52.668352+0000","last_active":"2024-04-26T20:20:47.696043+0000","last_peered":"2024-04-26T20:20:47.696043+0000","last_clean":"2024-04-26T20:20:47.696043+0000","last_became_active":"2024-04-26T20:19:52.662789+0000","last_became_peered":"2024-04-26T20:19:52.662789+0000","last_unstale":"2024-04-26T20:20:47.696043+0000","last_undegraded":"2024-04-26T20:20:47.696043+0000","last_fullsized":"2024-04-26T20:20:47.696043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:29.139561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682858+0000","last_change":"2024-04-26T20:19:56.750353+0000","last_active":"2024-04-26T20:20:47.682858+0000","last_peered":"2024-04-26T20:20:47.682858+0000","last_clean":"2024-04-26T20:20:47.682858+0000","last_became_active":"2024-04-26T20:19:56.750028+0000","last_became_peered":"2024-04-26T20:19:56.750028+0000","last_unstale":"2024-04-26T20:20:47.682858+0000","last_undegraded":"2024-04-26T20:20:47.682858+0000","last_fullsized":"2024-04-26T20:20:47.682858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:06.030498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682358+0000","last_change":"2024-04-26T20:19:51.649703+0000","last_active":"2024-04-26T20:20:47.682358+0000","last_peered":"2024-04-26T20:20:47.682358+0000","last_clean":"2024-04-26T20:20:47.682358+0000","last_became_active":"2024-04-26T20:19:51.649394+0000","last_became_peered":"2024-04-26T20:19:51.649394+0000","last_unstale":"2024-04-26T20:20:47.682358+0000","last_undegraded":"2024-04-26T20:20:47.682358+0000","last_fullsized":"2024-04-26T20:20:47.682358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:12.103140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820522+0000","last_change":"2024-04-26T20:19:52.656151+0000","last_active":"2024-04-26T20:20:47.820522+0000","last_peered":"2024-04-26T20:20:47.820522+0000","last_clean":"2024-04-26T20:20:47.820522+0000","last_became_active":"2024-04-26T20:19:52.654832+0000","last_became_peered":"2024-04-26T20:19:52.654832+0000","last_unstale":"2024-04-26T20:20:47.820522+0000","last_undegraded":"2024-04-26T20:20:47.820522+0000","last_fullsized":"2024-04-26T20:20:47.820522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:56.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682744+0000","last_change":"2024-04-26T20:19:56.742320+0000","last_active":"2024-04-26T20:20:47.682744+0000","last_peered":"2024-04-26T20:20:47.682744+0000","last_clean":"2024-04-26T20:20:47.682744+0000","last_became_active":"2024-04-26T20:19:56.741884+0000","last_became_peered":"2024-04-26T20:19:56.741884+0000","last_unstale":"2024-04-26T20:20:47.682744+0000","last_undegraded":"2024-04-26T20:20:47.682744+0000","last_fullsized":"2024-04-26T20:20:47.682744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:03.585159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682711+0000","last_change":"2024-04-26T20:19:51.646100+0000","last_active":"2024-04-26T20:20:47.682711+0000","last_peered":"2024-04-26T20:20:47.682711+0000","last_clean":"2024-04-26T20:20:47.682711+0000","last_became_active":"2024-04-26T20:19:51.645778+0000","last_became_peered":"2024-04-26T20:19:51.645778+0000","last_unstale":"2024-04-26T20:20:47.682711+0000","last_undegraded":"2024-04-26T20:20:47.682711+0000","last_fullsized":"2024-04-26T20:20:47.682711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:34.083294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822571+0000","last_change":"2024-04-26T20:20:47.821791+0000","last_active":"2024-04-26T20:20:47.822571+0000","last_peered":"2024-04-26T20:20:47.822571+0000","last_clean":"2024-04-26T20:20:47.822571+0000","last_became_active":"2024-04-26T20:20:47.821338+0000","last_became_peered":"2024-04-26T20:20:47.821338+0000","last_unstale":"2024-04-26T20:20:47.822571+0000","last_undegraded":"2024-04-26T20:20:47.822571+0000","last_fullsized":"2024-04-26T20:20:47.822571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:45.027699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680806+0000","last_change":"2024-04-26T20:19:56.732350+0000","last_active":"2024-04-26T20:20:47.680806+0000","last_peered":"2024-04-26T20:20:47.680806+0000","last_clean":"2024-04-26T20:20:47.680806+0000","last_became_active":"2024-04-26T20:19:56.731947+0000","last_became_peered":"2024-04-26T20:19:56.731947+0000","last_unstale":"2024-04-26T20:20:47.680806+0000","last_undegraded":"2024-04-26T20:20:47.680806+0000","last_fullsized":"2024-04-26T20:20:47.680806+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:11.690409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.390813+0000","last_change":"2024-04-26T20:19:51.648316+0000","last_active":"2024-04-26T20:22:50.390813+0000","last_peered":"2024-04-26T20:22:50.390813+0000","last_clean":"2024-04-26T20:22:50.390813+0000","last_became_active":"2024-04-26T20:19:51.648006+0000","last_became_peered":"2024-04-26T20:19:51.648006+0000","last_unstale":"2024-04-26T20:22:50.390813+0000","last_undegraded":"2024-04-26T20:22:50.390813+0000","last_fullsized":"2024-04-26T20:22:50.390813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:02.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683410+0000","last_change":"2024-04-26T20:19:52.660173+0000","last_active":"2024-04-26T20:20:47.683410+0000","last_peered":"2024-04-26T20:20:47.683410+0000","last_clean":"2024-04-26T20:20:47.683410+0000","last_became_active":"2024-04-26T20:19:52.659810+0000","last_became_peered":"2024-04-26T20:19:52.659810+0000","last_unstale":"2024-04-26T20:20:47.683410+0000","last_undegraded":"2024-04-26T20:20:47.683410+0000","last_fullsized":"2024-04-26T20:20:47.683410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:08.860537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680605+0000","last_change":"2024-04-26T20:19:56.755674+0000","last_active":"2024-04-26T20:20:47.680605+0000","last_peered":"2024-04-26T20:20:47.680605+0000","last_clean":"2024-04-26T20:20:47.680605+0000","last_became_active":"2024-04-26T20:19:56.755282+0000","last_became_peered":"2024-04-26T20:19:56.755282+0000","last_unstale":"2024-04-26T20:20:47.680605+0000","last_undegraded":"2024-04-26T20:20:47.680605+0000","last_fullsized":"2024-04-26T20:20:47.680605+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:45.331158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819638+0000","last_change":"2024-04-26T20:19:51.669207+0000","last_active":"2024-04-26T20:20:47.819638+0000","last_peered":"2024-04-26T20:20:47.819638+0000","last_clean":"2024-04-26T20:20:47.819638+0000","last_became_active":"2024-04-26T20:19:51.668855+0000","last_became_peered":"2024-04-26T20:19:51.668855+0000","last_unstale":"2024-04-26T20:20:47.819638+0000","last_undegraded":"2024-04-26T20:20:47.819638+0000","last_fullsized":"2024-04-26T20:20:47.819638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:18.180601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686770+0000","last_change":"2024-04-26T20:19:52.664257+0000","last_active":"2024-04-26T20:20:47.686770+0000","last_peered":"2024-04-26T20:20:47.686770+0000","last_clean":"2024-04-26T20:20:47.686770+0000","last_became_active":"2024-04-26T20:19:52.664014+0000","last_became_peered":"2024-04-26T20:19:52.664014+0000","last_unstale":"2024-04-26T20:20:47.686770+0000","last_undegraded":"2024-04-26T20:20:47.686770+0000","last_fullsized":"2024-04-26T20:20:47.686770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:15.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683145+0000","last_change":"2024-04-26T20:19:56.744297+0000","last_active":"2024-04-26T20:20:47.683145+0000","last_peered":"2024-04-26T20:20:47.683145+0000","last_clean":"2024-04-26T20:20:47.683145+0000","last_became_active":"2024-04-26T20:19:56.743796+0000","last_became_peered":"2024-04-26T20:19:56.743796+0000","last_unstale":"2024-04-26T20:20:47.683145+0000","last_undegraded":"2024-04-26T20:20:47.683145+0000","last_fullsized":"2024-04-26T20:20:47.683145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:34:39.201732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694418+0000","last_change":"2024-04-26T20:19:51.670514+0000","last_active":"2024-04-26T20:20:47.694418+0000","last_peered":"2024-04-26T20:20:47.694418+0000","last_clean":"2024-04-26T20:20:47.694418+0000","last_became_active":"2024-04-26T20:19:51.670137+0000","last_became_peered":"2024-04-26T20:19:51.670137+0000","last_unstale":"2024-04-26T20:20:47.694418+0000","last_undegraded":"2024-04-26T20:20:47.694418+0000","last_fullsized":"2024-04-26T20:20:47.694418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:18.758213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681243+0000","last_change":"2024-04-26T20:19:52.672404+0000","last_active":"2024-04-26T20:20:47.681243+0000","last_peered":"2024-04-26T20:20:47.681243+0000","last_clean":"2024-04-26T20:20:47.681243+0000","last_became_active":"2024-04-26T20:19:52.667298+0000","last_became_peered":"2024-04-26T20:19:52.667298+0000","last_unstale":"2024-04-26T20:20:47.681243+0000","last_undegraded":"2024-04-26T20:20:47.681243+0000","last_fullsized":"2024-04-26T20:20:47.681243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:24.914495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694179+0000","last_change":"2024-04-26T20:19:56.742985+0000","last_active":"2024-04-26T20:20:47.694179+0000","last_peered":"2024-04-26T20:20:47.694179+0000","last_clean":"2024-04-26T20:20:47.694179+0000","last_became_active":"2024-04-26T20:19:56.742474+0000","last_became_peered":"2024-04-26T20:19:56.742474+0000","last_unstale":"2024-04-26T20:20:47.694179+0000","last_undegraded":"2024-04-26T20:20:47.694179+0000","last_fullsized":"2024-04-26T20:20:47.694179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:32.308268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686623+0000","last_change":"2024-04-26T20:19:51.649243+0000","last_active":"2024-04-26T20:20:47.686623+0000","last_peered":"2024-04-26T20:20:47.686623+0000","last_clean":"2024-04-26T20:20:47.686623+0000","last_became_active":"2024-04-26T20:19:51.648852+0000","last_became_peered":"2024-04-26T20:19:51.648852+0000","last_unstale":"2024-04-26T20:20:47.686623+0000","last_undegraded":"2024-04-26T20:20:47.686623+0000","last_fullsized":"2024-04-26T20:20:47.686623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:10.937451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685554+0000","last_change":"2024-04-26T20:19:52.674680+0000","last_active":"2024-04-26T20:20:47.685554+0000","last_peered":"2024-04-26T20:20:47.685554+0000","last_clean":"2024-04-26T20:20:47.685554+0000","last_became_active":"2024-04-26T20:19:52.674074+0000","last_became_peered":"2024-04-26T20:19:52.674074+0000","last_unstale":"2024-04-26T20:20:47.685554+0000","last_undegraded":"2024-04-26T20:20:47.685554+0000","last_fullsized":"2024-04-26T20:20:47.685554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:52.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681339+0000","last_change":"2024-04-26T20:19:56.743140+0000","last_active":"2024-04-26T20:20:47.681339+0000","last_peered":"2024-04-26T20:20:47.681339+0000","last_clean":"2024-04-26T20:20:47.681339+0000","last_became_active":"2024-04-26T20:19:56.742524+0000","last_became_peered":"2024-04-26T20:19:56.742524+0000","last_unstale":"2024-04-26T20:20:47.681339+0000","last_undegraded":"2024-04-26T20:20:47.681339+0000","last_fullsized":"2024-04-26T20:20:47.681339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:24.105301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:52.393560+0000","last_change":"2024-04-26T20:19:51.659823+0000","last_active":"2024-04-26T20:22:52.393560+0000","last_peered":"2024-04-26T20:22:52.393560+0000","last_clean":"2024-04-26T20:22:52.393560+0000","last_became_active":"2024-04-26T20:19:51.659437+0000","last_became_peered":"2024-04-26T20:19:51.659437+0000","last_unstale":"2024-04-26T20:22:52.393560+0000","last_undegraded":"2024-04-26T20:22:52.393560+0000","last_fullsized":"2024-04-26T20:22:52.393560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:55.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":308,"num_read_kb":308,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820405+0000","last_change":"2024-04-26T20:19:52.661940+0000","last_active":"2024-04-26T20:20:47.820405+0000","last_peered":"2024-04-26T20:20:47.820405+0000","last_clean":"2024-04-26T20:20:47.820405+0000","last_became_active":"2024-04-26T20:19:52.661346+0000","last_became_peered":"2024-04-26T20:19:52.661346+0000","last_unstale":"2024-04-26T20:20:47.820405+0000","last_undegraded":"2024-04-26T20:20:47.820405+0000","last_fullsized":"2024-04-26T20:20:47.820405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:12.433790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.700943+0000","last_change":"2024-04-26T20:20:47.700375+0000","last_active":"2024-04-26T20:20:47.700943+0000","last_peered":"2024-04-26T20:20:47.700943+0000","last_clean":"2024-04-26T20:20:47.700943+0000","last_became_active":"2024-04-26T20:20:47.699843+0000","last_became_peered":"2024-04-26T20:20:47.699843+0000","last_unstale":"2024-04-26T20:20:47.700943+0000","last_undegraded":"2024-04-26T20:20:47.700943+0000","last_fullsized":"2024-04-26T20:20:47.700943+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:53.112700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819945+0000","last_change":"2024-04-26T20:19:51.649182+0000","last_active":"2024-04-26T20:20:47.819945+0000","last_peered":"2024-04-26T20:20:47.819945+0000","last_clean":"2024-04-26T20:20:47.819945+0000","last_became_active":"2024-04-26T20:19:51.648857+0000","last_became_peered":"2024-04-26T20:19:51.648857+0000","last_unstale":"2024-04-26T20:20:47.819945+0000","last_undegraded":"2024-04-26T20:20:47.819945+0000","last_fullsized":"2024-04-26T20:20:47.819945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:16.075729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.696288+0000","last_change":"2024-04-26T20:19:52.662988+0000","last_active":"2024-04-26T20:20:47.696288+0000","last_peered":"2024-04-26T20:20:47.696288+0000","last_clean":"2024-04-26T20:20:47.696288+0000","last_became_active":"2024-04-26T20:19:52.662640+0000","last_became_peered":"2024-04-26T20:19:52.662640+0000","last_unstale":"2024-04-26T20:20:47.696288+0000","last_undegraded":"2024-04-26T20:20:47.696288+0000","last_fullsized":"2024-04-26T20:20:47.696288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:35.109346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822591+0000","last_change":"2024-04-26T20:20:47.821914+0000","last_active":"2024-04-26T20:20:47.822591+0000","last_peered":"2024-04-26T20:20:47.822591+0000","last_clean":"2024-04-26T20:20:47.822591+0000","last_became_active":"2024-04-26T20:20:47.821365+0000","last_became_peered":"2024-04-26T20:20:47.821365+0000","last_unstale":"2024-04-26T20:20:47.822591+0000","last_undegraded":"2024-04-26T20:20:47.822591+0000","last_fullsized":"2024-04-26T20:20:47.822591+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:12.969419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687647+0000","last_change":"2024-04-26T20:19:51.663992+0000","last_active":"2024-04-26T20:20:47.687647+0000","last_peered":"2024-04-26T20:20:47.687647+0000","last_clean":"2024-04-26T20:20:47.687647+0000","last_became_active":"2024-04-26T20:19:51.663694+0000","last_became_peered":"2024-04-26T20:19:51.663694+0000","last_unstale":"2024-04-26T20:20:47.687647+0000","last_undegraded":"2024-04-26T20:20:47.687647+0000","last_fullsized":"2024-04-26T20:20:47.687647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:38.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820660+0000","last_change":"2024-04-26T20:19:52.653986+0000","last_active":"2024-04-26T20:20:47.820660+0000","last_peered":"2024-04-26T20:20:47.820660+0000","last_clean":"2024-04-26T20:20:47.820660+0000","last_became_active":"2024-04-26T20:19:52.653663+0000","last_became_peered":"2024-04-26T20:19:52.653663+0000","last_unstale":"2024-04-26T20:20:47.820660+0000","last_undegraded":"2024-04-26T20:20:47.820660+0000","last_fullsized":"2024-04-26T20:20:47.820660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:16.891622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683798+0000","last_change":"2024-04-26T20:19:56.751487+0000","last_active":"2024-04-26T20:20:47.683798+0000","last_peered":"2024-04-26T20:20:47.683798+0000","last_clean":"2024-04-26T20:20:47.683798+0000","last_became_active":"2024-04-26T20:19:56.750956+0000","last_became_peered":"2024-04-26T20:19:56.750956+0000","last_unstale":"2024-04-26T20:20:47.683798+0000","last_undegraded":"2024-04-26T20:20:47.683798+0000","last_fullsized":"2024-04-26T20:20:47.683798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:40.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":383,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:52.393743+0000","last_change":"2024-04-26T20:19:51.648842+0000","last_active":"2024-04-26T20:22:52.393743+0000","last_peered":"2024-04-26T20:22:52.393743+0000","last_clean":"2024-04-26T20:22:52.393743+0000","last_became_active":"2024-04-26T20:19:51.648610+0000","last_became_peered":"2024-04-26T20:19:51.648610+0000","last_unstale":"2024-04-26T20:22:52.393743+0000","last_undegraded":"2024-04-26T20:22:52.393743+0000","last_fullsized":"2024-04-26T20:22:52.393743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60509,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":217,"num_write":40,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683244+0000","last_change":"2024-04-26T20:19:52.648992+0000","last_active":"2024-04-26T20:20:47.683244+0000","last_peered":"2024-04-26T20:20:47.683244+0000","last_clean":"2024-04-26T20:20:47.683244+0000","last_became_active":"2024-04-26T20:19:52.648462+0000","last_became_peered":"2024-04-26T20:19:52.648462+0000","last_unstale":"2024-04-26T20:20:47.683244+0000","last_undegraded":"2024-04-26T20:20:47.683244+0000","last_fullsized":"2024-04-26T20:20:47.683244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:37.103496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687898+0000","last_change":"2024-04-26T20:19:56.742838+0000","last_active":"2024-04-26T20:20:47.687898+0000","last_peered":"2024-04-26T20:20:47.687898+0000","last_clean":"2024-04-26T20:20:47.687898+0000","last_became_active":"2024-04-26T20:19:56.742465+0000","last_became_peered":"2024-04-26T20:19:56.742465+0000","last_unstale":"2024-04-26T20:20:47.687898+0000","last_undegraded":"2024-04-26T20:20:47.687898+0000","last_fullsized":"2024-04-26T20:20:47.687898+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:31.046864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681061+0000","last_change":"2024-04-26T20:19:51.667696+0000","last_active":"2024-04-26T20:20:47.681061+0000","last_peered":"2024-04-26T20:20:47.681061+0000","last_clean":"2024-04-26T20:20:47.681061+0000","last_became_active":"2024-04-26T20:19:51.667369+0000","last_became_peered":"2024-04-26T20:19:51.667369+0000","last_unstale":"2024-04-26T20:20:47.681061+0000","last_undegraded":"2024-04-26T20:20:47.681061+0000","last_fullsized":"2024-04-26T20:20:47.681061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:10.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693858+0000","last_change":"2024-04-26T20:19:52.660203+0000","last_active":"2024-04-26T20:20:47.693858+0000","last_peered":"2024-04-26T20:20:47.693858+0000","last_clean":"2024-04-26T20:20:47.693858+0000","last_became_active":"2024-04-26T20:19:52.659637+0000","last_became_peered":"2024-04-26T20:19:52.659637+0000","last_unstale":"2024-04-26T20:20:47.693858+0000","last_undegraded":"2024-04-26T20:20:47.693858+0000","last_fullsized":"2024-04-26T20:20:47.693858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:14.378294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682773+0000","last_change":"2024-04-26T20:19:56.752311+0000","last_active":"2024-04-26T20:20:47.682773+0000","last_peered":"2024-04-26T20:20:47.682773+0000","last_clean":"2024-04-26T20:20:47.682773+0000","last_became_active":"2024-04-26T20:19:56.751778+0000","last_became_peered":"2024-04-26T20:19:56.751778+0000","last_unstale":"2024-04-26T20:20:47.682773+0000","last_undegraded":"2024-04-26T20:20:47.682773+0000","last_fullsized":"2024-04-26T20:20:47.682773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:36.279920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686940+0000","last_change":"2024-04-26T20:19:51.667832+0000","last_active":"2024-04-26T20:20:47.686940+0000","last_peered":"2024-04-26T20:20:47.686940+0000","last_clean":"2024-04-26T20:20:47.686940+0000","last_became_active":"2024-04-26T20:19:51.667322+0000","last_became_peered":"2024-04-26T20:19:51.667322+0000","last_unstale":"2024-04-26T20:20:47.686940+0000","last_undegraded":"2024-04-26T20:20:47.686940+0000","last_fullsized":"2024-04-26T20:20:47.686940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:47.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819117+0000","last_change":"2024-04-26T20:19:52.652647+0000","last_active":"2024-04-26T20:20:47.819117+0000","last_peered":"2024-04-26T20:20:47.819117+0000","last_clean":"2024-04-26T20:20:47.819117+0000","last_became_active":"2024-04-26T20:19:52.652295+0000","last_became_peered":"2024-04-26T20:19:52.652295+0000","last_unstale":"2024-04-26T20:20:47.819117+0000","last_undegraded":"2024-04-26T20:20:47.819117+0000","last_fullsized":"2024-04-26T20:20:47.819117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:54.711100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682539+0000","last_change":"2024-04-26T20:19:56.752887+0000","last_active":"2024-04-26T20:20:47.682539+0000","last_peered":"2024-04-26T20:20:47.682539+0000","last_clean":"2024-04-26T20:20:47.682539+0000","last_became_active":"2024-04-26T20:19:56.752438+0000","last_became_peered":"2024-04-26T20:19:56.752438+0000","last_unstale":"2024-04-26T20:20:47.682539+0000","last_undegraded":"2024-04-26T20:20:47.682539+0000","last_fullsized":"2024-04-26T20:20:47.682539+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:12.629208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:49.451243+0000","last_change":"2024-04-26T20:19:51.647628+0000","last_active":"2024-04-26T20:22:49.451243+0000","last_peered":"2024-04-26T20:22:49.451243+0000","last_clean":"2024-04-26T20:22:49.451243+0000","last_became_active":"2024-04-26T20:19:51.647258+0000","last_became_peered":"2024-04-26T20:19:51.647258+0000","last_unstale":"2024-04-26T20:22:49.451243+0000","last_undegraded":"2024-04-26T20:22:49.451243+0000","last_fullsized":"2024-04-26T20:22:49.451243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:22.772659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818523+0000","last_change":"2024-04-26T20:19:52.643868+0000","last_active":"2024-04-26T20:20:47.818523+0000","last_peered":"2024-04-26T20:20:47.818523+0000","last_clean":"2024-04-26T20:20:47.818523+0000","last_became_active":"2024-04-26T20:19:52.643558+0000","last_became_peered":"2024-04-26T20:19:52.643558+0000","last_unstale":"2024-04-26T20:20:47.818523+0000","last_undegraded":"2024-04-26T20:20:47.818523+0000","last_fullsized":"2024-04-26T20:20:47.818523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:14.876034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694465+0000","last_change":"2024-04-26T20:19:56.744099+0000","last_active":"2024-04-26T20:20:47.694465+0000","last_peered":"2024-04-26T20:20:47.694465+0000","last_clean":"2024-04-26T20:20:47.694465+0000","last_became_active":"2024-04-26T20:19:56.743728+0000","last_became_peered":"2024-04-26T20:19:56.743728+0000","last_unstale":"2024-04-26T20:20:47.694465+0000","last_undegraded":"2024-04-26T20:20:47.694465+0000","last_fullsized":"2024-04-26T20:20:47.694465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:07.265819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.715108+0000","last_change":"2024-04-26T20:20:47.714651+0000","last_active":"2024-04-26T20:20:47.715108+0000","last_peered":"2024-04-26T20:20:47.715108+0000","last_clean":"2024-04-26T20:20:47.715108+0000","last_became_active":"2024-04-26T20:20:47.700320+0000","last_became_peered":"2024-04-26T20:20:47.700320+0000","last_unstale":"2024-04-26T20:20:47.715108+0000","last_undegraded":"2024-04-26T20:20:47.715108+0000","last_fullsized":"2024-04-26T20:20:47.715108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:56:19.935988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686320+0000","last_change":"2024-04-26T20:19:52.655955+0000","last_active":"2024-04-26T20:20:47.686320+0000","last_peered":"2024-04-26T20:20:47.686320+0000","last_clean":"2024-04-26T20:20:47.686320+0000","last_became_active":"2024-04-26T20:19:52.655631+0000","last_became_peered":"2024-04-26T20:19:52.655631+0000","last_unstale":"2024-04-26T20:20:47.686320+0000","last_undegraded":"2024-04-26T20:20:47.686320+0000","last_fullsized":"2024-04-26T20:20:47.686320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:03.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.822518+0000","last_change":"2024-04-26T20:20:47.821839+0000","last_active":"2024-04-26T20:20:47.822518+0000","last_peered":"2024-04-26T20:20:47.822518+0000","last_clean":"2024-04-26T20:20:47.822518+0000","last_became_active":"2024-04-26T20:20:47.821302+0000","last_became_peered":"2024-04-26T20:20:47.821302+0000","last_unstale":"2024-04-26T20:20:47.822518+0000","last_undegraded":"2024-04-26T20:20:47.822518+0000","last_fullsized":"2024-04-26T20:20:47.822518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:38.771597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683371+0000","last_change":"2024-04-26T20:19:51.645135+0000","last_active":"2024-04-26T20:20:47.683371+0000","last_peered":"2024-04-26T20:20:47.683371+0000","last_clean":"2024-04-26T20:20:47.683371+0000","last_became_active":"2024-04-26T20:19:51.644806+0000","last_became_peered":"2024-04-26T20:19:51.644806+0000","last_unstale":"2024-04-26T20:20:47.683371+0000","last_undegraded":"2024-04-26T20:20:47.683371+0000","last_fullsized":"2024-04-26T20:20:47.683371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:39.684924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683167+0000","last_change":"2024-04-26T20:19:52.646800+0000","last_active":"2024-04-26T20:20:47.683167+0000","last_peered":"2024-04-26T20:20:47.683167+0000","last_clean":"2024-04-26T20:20:47.683167+0000","last_became_active":"2024-04-26T20:19:52.646453+0000","last_became_peered":"2024-04-26T20:19:52.646453+0000","last_unstale":"2024-04-26T20:20:47.683167+0000","last_undegraded":"2024-04-26T20:20:47.683167+0000","last_fullsized":"2024-04-26T20:20:47.683167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:14.446802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682750+0000","last_change":"2024-04-26T20:19:56.828909+0000","last_active":"2024-04-26T20:20:47.682750+0000","last_peered":"2024-04-26T20:20:47.682750+0000","last_clean":"2024-04-26T20:20:47.682750+0000","last_became_active":"2024-04-26T20:19:56.828326+0000","last_became_peered":"2024-04-26T20:19:56.828326+0000","last_unstale":"2024-04-26T20:20:47.682750+0000","last_undegraded":"2024-04-26T20:20:47.682750+0000","last_fullsized":"2024-04-26T20:20:47.682750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:16.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.703750+0000","last_change":"2024-04-26T20:20:47.701523+0000","last_active":"2024-04-26T20:20:47.703750+0000","last_peered":"2024-04-26T20:20:47.703750+0000","last_clean":"2024-04-26T20:20:47.703750+0000","last_became_active":"2024-04-26T20:20:47.700711+0000","last_became_peered":"2024-04-26T20:20:47.700711+0000","last_unstale":"2024-04-26T20:20:47.703750+0000","last_undegraded":"2024-04-26T20:20:47.703750+0000","last_fullsized":"2024-04-26T20:20:47.703750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:37.623094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820170+0000","last_change":"2024-04-26T20:19:52.668643+0000","last_active":"2024-04-26T20:20:47.820170+0000","last_peered":"2024-04-26T20:20:47.820170+0000","last_clean":"2024-04-26T20:20:47.820170+0000","last_became_active":"2024-04-26T20:19:52.668242+0000","last_became_peered":"2024-04-26T20:19:52.668242+0000","last_unstale":"2024-04-26T20:20:47.820170+0000","last_undegraded":"2024-04-26T20:20:47.820170+0000","last_fullsized":"2024-04-26T20:20:47.820170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:21.097878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697662+0000","last_change":"2024-04-26T20:19:56.736251+0000","last_active":"2024-04-26T20:20:47.697662+0000","last_peered":"2024-04-26T20:20:47.697662+0000","last_clean":"2024-04-26T20:20:47.697662+0000","last_became_active":"2024-04-26T20:19:56.735821+0000","last_became_peered":"2024-04-26T20:19:56.735821+0000","last_unstale":"2024-04-26T20:20:47.697662+0000","last_undegraded":"2024-04-26T20:20:47.697662+0000","last_fullsized":"2024-04-26T20:20:47.697662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:06.329164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'5","reported_seq":186,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:51.473972+0000","last_change":"2024-04-26T20:19:51.662325+0000","last_active":"2024-04-26T20:22:51.473972+0000","last_peered":"2024-04-26T20:22:51.473972+0000","last_clean":"2024-04-26T20:22:51.473972+0000","last_became_active":"2024-04-26T20:19:51.662013+0000","last_became_peered":"2024-04-26T20:19:51.662013+0000","last_unstale":"2024-04-26T20:22:51.473972+0000","last_undegraded":"2024-04-26T20:22:51.473972+0000","last_fullsized":"2024-04-26T20:22:51.473972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:29.455098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819807+0000","last_change":"2024-04-26T20:19:52.662053+0000","last_active":"2024-04-26T20:20:47.819807+0000","last_peered":"2024-04-26T20:20:47.819807+0000","last_clean":"2024-04-26T20:20:47.819807+0000","last_became_active":"2024-04-26T20:19:52.661705+0000","last_became_peered":"2024-04-26T20:19:52.661705+0000","last_unstale":"2024-04-26T20:20:47.819807+0000","last_undegraded":"2024-04-26T20:20:47.819807+0000","last_fullsized":"2024-04-26T20:20:47.819807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:13.068446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694851+0000","last_change":"2024-04-26T20:19:56.828976+0000","last_active":"2024-04-26T20:20:47.694851+0000","last_peered":"2024-04-26T20:20:47.694851+0000","last_clean":"2024-04-26T20:20:47.694851+0000","last_became_active":"2024-04-26T20:19:56.828180+0000","last_became_peered":"2024-04-26T20:19:56.828180+0000","last_unstale":"2024-04-26T20:20:47.694851+0000","last_undegraded":"2024-04-26T20:20:47.694851+0000","last_fullsized":"2024-04-26T20:20:47.694851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:32.419366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686846+0000","last_change":"2024-04-26T20:19:52.649261+0000","last_active":"2024-04-26T20:20:47.686846+0000","last_peered":"2024-04-26T20:20:47.686846+0000","last_clean":"2024-04-26T20:20:47.686846+0000","last_became_active":"2024-04-26T20:19:52.648894+0000","last_became_peered":"2024-04-26T20:19:52.648894+0000","last_unstale":"2024-04-26T20:20:47.686846+0000","last_undegraded":"2024-04-26T20:20:47.686846+0000","last_fullsized":"2024-04-26T20:20:47.686846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:07.025744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":187,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.452316+0000","last_change":"2024-04-26T20:19:51.677763+0000","last_active":"2024-04-26T20:22:50.452316+0000","last_peered":"2024-04-26T20:22:50.452316+0000","last_clean":"2024-04-26T20:22:50.452316+0000","last_became_active":"2024-04-26T20:19:51.677401+0000","last_became_peered":"2024-04-26T20:19:51.677401+0000","last_unstale":"2024-04-26T20:22:50.452316+0000","last_undegraded":"2024-04-26T20:22:50.452316+0000","last_fullsized":"2024-04-26T20:22:50.452316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:02.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819441+0000","last_change":"2024-04-26T20:19:56.743199+0000","last_active":"2024-04-26T20:20:47.819441+0000","last_peered":"2024-04-26T20:20:47.819441+0000","last_clean":"2024-04-26T20:20:47.819441+0000","last_became_active":"2024-04-26T20:19:56.742700+0000","last_became_peered":"2024-04-26T20:19:56.742700+0000","last_unstale":"2024-04-26T20:20:47.819441+0000","last_undegraded":"2024-04-26T20:20:47.819441+0000","last_fullsized":"2024-04-26T20:20:47.819441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:14.511741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684241+0000","last_change":"2024-04-26T20:19:52.660642+0000","last_active":"2024-04-26T20:20:47.684241+0000","last_peered":"2024-04-26T20:20:47.684241+0000","last_clean":"2024-04-26T20:20:47.684241+0000","last_became_active":"2024-04-26T20:19:52.658880+0000","last_became_peered":"2024-04-26T20:19:52.658880+0000","last_unstale":"2024-04-26T20:20:47.684241+0000","last_undegraded":"2024-04-26T20:20:47.684241+0000","last_fullsized":"2024-04-26T20:20:47.684241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:11.134387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683079+0000","last_change":"2024-04-26T20:19:51.657779+0000","last_active":"2024-04-26T20:20:47.683079+0000","last_peered":"2024-04-26T20:20:47.683079+0000","last_clean":"2024-04-26T20:20:47.683079+0000","last_became_active":"2024-04-26T20:19:51.657426+0000","last_became_peered":"2024-04-26T20:19:51.657426+0000","last_unstale":"2024-04-26T20:20:47.683079+0000","last_undegraded":"2024-04-26T20:20:47.683079+0000","last_fullsized":"2024-04-26T20:20:47.683079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:53.181715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820401+0000","last_change":"2024-04-26T20:18:31.334561+0000","last_active":"2024-04-26T20:20:47.820401+0000","last_peered":"2024-04-26T20:20:47.820401+0000","last_clean":"2024-04-26T20:20:47.820401+0000","last_became_active":"2024-04-26T20:18:31.334040+0000","last_became_peered":"2024-04-26T20:18:31.334040+0000","last_unstale":"2024-04-26T20:20:47.820401+0000","last_undegraded":"2024-04-26T20:20:47.820401+0000","last_fullsized":"2024-04-26T20:20:47.820401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:32.731539+0000","last_clean_scrub_stamp":"2024-04-26T20:14:32.731539+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:25.181205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687206+0000","last_change":"2024-04-26T20:19:56.828991+0000","last_active":"2024-04-26T20:20:47.687206+0000","last_peered":"2024-04-26T20:20:47.687206+0000","last_clean":"2024-04-26T20:20:47.687206+0000","last_became_active":"2024-04-26T20:19:56.828426+0000","last_became_peered":"2024-04-26T20:19:56.828426+0000","last_unstale":"2024-04-26T20:20:47.687206+0000","last_undegraded":"2024-04-26T20:20:47.687206+0000","last_fullsized":"2024-04-26T20:20:47.687206+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:09.711958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.699521+0000","last_change":"2024-04-26T20:20:47.697300+0000","last_active":"2024-04-26T20:20:47.699521+0000","last_peered":"2024-04-26T20:20:47.699521+0000","last_clean":"2024-04-26T20:20:47.699521+0000","last_became_active":"2024-04-26T20:20:47.696809+0000","last_became_peered":"2024-04-26T20:20:47.696809+0000","last_unstale":"2024-04-26T20:20:47.699521+0000","last_undegraded":"2024-04-26T20:20:47.699521+0000","last_fullsized":"2024-04-26T20:20:47.699521+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:01.540485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818395+0000","last_change":"2024-04-26T20:19:51.651654+0000","last_active":"2024-04-26T20:20:47.818395+0000","last_peered":"2024-04-26T20:20:47.818395+0000","last_clean":"2024-04-26T20:20:47.818395+0000","last_became_active":"2024-04-26T20:19:51.651348+0000","last_became_peered":"2024-04-26T20:19:51.651348+0000","last_unstale":"2024-04-26T20:20:47.818395+0000","last_undegraded":"2024-04-26T20:20:47.818395+0000","last_fullsized":"2024-04-26T20:20:47.818395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:43.995748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682745+0000","last_change":"2024-04-26T20:19:56.730102+0000","last_active":"2024-04-26T20:20:47.682745+0000","last_peered":"2024-04-26T20:20:47.682745+0000","last_clean":"2024-04-26T20:20:47.682745+0000","last_became_active":"2024-04-26T20:19:56.729650+0000","last_became_peered":"2024-04-26T20:19:56.729650+0000","last_unstale":"2024-04-26T20:20:47.682745+0000","last_undegraded":"2024-04-26T20:20:47.682745+0000","last_fullsized":"2024-04-26T20:20:47.682745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:34.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683136+0000","last_change":"2024-04-26T20:19:51.670400+0000","last_active":"2024-04-26T20:20:47.683136+0000","last_peered":"2024-04-26T20:20:47.683136+0000","last_clean":"2024-04-26T20:20:47.683136+0000","last_became_active":"2024-04-26T20:19:51.670163+0000","last_became_peered":"2024-04-26T20:19:51.670163+0000","last_unstale":"2024-04-26T20:20:47.683136+0000","last_undegraded":"2024-04-26T20:20:47.683136+0000","last_fullsized":"2024-04-26T20:20:47.683136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:49.303858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.697874+0000","last_change":"2024-04-26T20:19:52.660999+0000","last_active":"2024-04-26T20:20:47.697874+0000","last_peered":"2024-04-26T20:20:47.697874+0000","last_clean":"2024-04-26T20:20:47.697874+0000","last_became_active":"2024-04-26T20:19:52.660169+0000","last_became_peered":"2024-04-26T20:19:52.660169+0000","last_unstale":"2024-04-26T20:20:47.697874+0000","last_undegraded":"2024-04-26T20:20:47.697874+0000","last_fullsized":"2024-04-26T20:20:47.697874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:54.859636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681290+0000","last_change":"2024-04-26T20:19:56.828340+0000","last_active":"2024-04-26T20:20:47.681290+0000","last_peered":"2024-04-26T20:20:47.681290+0000","last_clean":"2024-04-26T20:20:47.681290+0000","last_became_active":"2024-04-26T20:19:56.827767+0000","last_became_peered":"2024-04-26T20:19:56.827767+0000","last_unstale":"2024-04-26T20:20:47.681290+0000","last_undegraded":"2024-04-26T20:20:47.681290+0000","last_fullsized":"2024-04-26T20:20:47.681290+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:12.078343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:21:47.709280+0000","last_change":"2024-04-26T20:19:51.680899+0000","last_active":"2024-04-26T20:21:47.709280+0000","last_peered":"2024-04-26T20:21:47.709280+0000","last_clean":"2024-04-26T20:21:47.709280+0000","last_became_active":"2024-04-26T20:19:51.680313+0000","last_became_peered":"2024-04-26T20:19:51.680313+0000","last_unstale":"2024-04-26T20:21:47.709280+0000","last_undegraded":"2024-04-26T20:21:47.709280+0000","last_fullsized":"2024-04-26T20:21:47.709280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:23.509405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684046+0000","last_change":"2024-04-26T20:19:52.665365+0000","last_active":"2024-04-26T20:20:47.684046+0000","last_peered":"2024-04-26T20:20:47.684046+0000","last_clean":"2024-04-26T20:20:47.684046+0000","last_became_active":"2024-04-26T20:19:52.664975+0000","last_became_peered":"2024-04-26T20:19:52.664975+0000","last_unstale":"2024-04-26T20:20:47.684046+0000","last_undegraded":"2024-04-26T20:20:47.684046+0000","last_fullsized":"2024-04-26T20:20:47.684046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:31.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680245+0000","last_change":"2024-04-26T20:19:56.732139+0000","last_active":"2024-04-26T20:20:47.680245+0000","last_peered":"2024-04-26T20:20:47.680245+0000","last_clean":"2024-04-26T20:20:47.680245+0000","last_became_active":"2024-04-26T20:19:56.731602+0000","last_became_peered":"2024-04-26T20:19:56.731602+0000","last_unstale":"2024-04-26T20:20:47.680245+0000","last_undegraded":"2024-04-26T20:20:47.680245+0000","last_fullsized":"2024-04-26T20:20:47.680245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:55.894906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683319+0000","last_change":"2024-04-26T20:19:51.663546+0000","last_active":"2024-04-26T20:20:47.683319+0000","last_peered":"2024-04-26T20:20:47.683319+0000","last_clean":"2024-04-26T20:20:47.683319+0000","last_became_active":"2024-04-26T20:19:51.663229+0000","last_became_peered":"2024-04-26T20:19:51.663229+0000","last_unstale":"2024-04-26T20:20:47.683319+0000","last_undegraded":"2024-04-26T20:20:47.683319+0000","last_fullsized":"2024-04-26T20:20:47.683319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:51.353764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.694787+0000","last_change":"2024-04-26T20:19:52.667038+0000","last_active":"2024-04-26T20:20:47.694787+0000","last_peered":"2024-04-26T20:20:47.694787+0000","last_clean":"2024-04-26T20:20:47.694787+0000","last_became_active":"2024-04-26T20:19:52.663513+0000","last_became_peered":"2024-04-26T20:19:52.663513+0000","last_unstale":"2024-04-26T20:20:47.694787+0000","last_undegraded":"2024-04-26T20:20:47.694787+0000","last_fullsized":"2024-04-26T20:20:47.694787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:00.437047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683161+0000","last_change":"2024-04-26T20:19:56.829193+0000","last_active":"2024-04-26T20:20:47.683161+0000","last_peered":"2024-04-26T20:20:47.683161+0000","last_clean":"2024-04-26T20:20:47.683161+0000","last_became_active":"2024-04-26T20:19:56.828449+0000","last_became_peered":"2024-04-26T20:19:56.828449+0000","last_unstale":"2024-04-26T20:20:47.683161+0000","last_undegraded":"2024-04-26T20:20:47.683161+0000","last_fullsized":"2024-04-26T20:20:47.683161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:51.099169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819561+0000","last_change":"2024-04-26T20:19:51.658095+0000","last_active":"2024-04-26T20:20:47.819561+0000","last_peered":"2024-04-26T20:20:47.819561+0000","last_clean":"2024-04-26T20:20:47.819561+0000","last_became_active":"2024-04-26T20:19:51.657749+0000","last_became_peered":"2024-04-26T20:19:51.657749+0000","last_unstale":"2024-04-26T20:20:47.819561+0000","last_undegraded":"2024-04-26T20:20:47.819561+0000","last_fullsized":"2024-04-26T20:20:47.819561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682262+0000","last_change":"2024-04-26T20:19:52.647518+0000","last_active":"2024-04-26T20:20:47.682262+0000","last_peered":"2024-04-26T20:20:47.682262+0000","last_clean":"2024-04-26T20:20:47.682262+0000","last_became_active":"2024-04-26T20:19:52.647188+0000","last_became_peered":"2024-04-26T20:19:52.647188+0000","last_unstale":"2024-04-26T20:20:47.682262+0000","last_undegraded":"2024-04-26T20:20:47.682262+0000","last_fullsized":"2024-04-26T20:20:47.682262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:18:46.356262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683010+0000","last_change":"2024-04-26T20:19:56.743993+0000","last_active":"2024-04-26T20:20:47.683010+0000","last_peered":"2024-04-26T20:20:47.683010+0000","last_clean":"2024-04-26T20:20:47.683010+0000","last_became_active":"2024-04-26T20:19:56.743595+0000","last_became_peered":"2024-04-26T20:19:56.743595+0000","last_unstale":"2024-04-26T20:20:47.683010+0000","last_undegraded":"2024-04-26T20:20:47.683010+0000","last_fullsized":"2024-04-26T20:20:47.683010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:00.312527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680319+0000","last_change":"2024-04-26T20:19:51.676477+0000","last_active":"2024-04-26T20:20:47.680319+0000","last_peered":"2024-04-26T20:20:47.680319+0000","last_clean":"2024-04-26T20:20:47.680319+0000","last_became_active":"2024-04-26T20:19:51.676105+0000","last_became_peered":"2024-04-26T20:19:51.676105+0000","last_unstale":"2024-04-26T20:20:47.680319+0000","last_undegraded":"2024-04-26T20:20:47.680319+0000","last_fullsized":"2024-04-26T20:20:47.680319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:36.029153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683622+0000","last_change":"2024-04-26T20:19:52.661864+0000","last_active":"2024-04-26T20:20:47.683622+0000","last_peered":"2024-04-26T20:20:47.683622+0000","last_clean":"2024-04-26T20:20:47.683622+0000","last_became_active":"2024-04-26T20:19:52.661492+0000","last_became_peered":"2024-04-26T20:19:52.661492+0000","last_unstale":"2024-04-26T20:20:47.683622+0000","last_undegraded":"2024-04-26T20:20:47.683622+0000","last_fullsized":"2024-04-26T20:20:47.683622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:32.899446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682900+0000","last_change":"2024-04-26T20:19:56.753524+0000","last_active":"2024-04-26T20:20:47.682900+0000","last_peered":"2024-04-26T20:20:47.682900+0000","last_clean":"2024-04-26T20:20:47.682900+0000","last_became_active":"2024-04-26T20:19:56.753057+0000","last_became_peered":"2024-04-26T20:19:56.753057+0000","last_unstale":"2024-04-26T20:20:47.682900+0000","last_undegraded":"2024-04-26T20:20:47.682900+0000","last_fullsized":"2024-04-26T20:20:47.682900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:24.335116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680352+0000","last_change":"2024-04-26T20:19:51.667827+0000","last_active":"2024-04-26T20:20:47.680352+0000","last_peered":"2024-04-26T20:20:47.680352+0000","last_clean":"2024-04-26T20:20:47.680352+0000","last_became_active":"2024-04-26T20:19:51.667310+0000","last_became_peered":"2024-04-26T20:19:51.667310+0000","last_unstale":"2024-04-26T20:20:47.680352+0000","last_undegraded":"2024-04-26T20:20:47.680352+0000","last_fullsized":"2024-04-26T20:20:47.680352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:25.296968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685745+0000","last_change":"2024-04-26T20:19:52.673387+0000","last_active":"2024-04-26T20:20:47.685745+0000","last_peered":"2024-04-26T20:20:47.685745+0000","last_clean":"2024-04-26T20:20:47.685745+0000","last_became_active":"2024-04-26T20:19:52.672499+0000","last_became_peered":"2024-04-26T20:19:52.672499+0000","last_unstale":"2024-04-26T20:20:47.685745+0000","last_undegraded":"2024-04-26T20:20:47.685745+0000","last_fullsized":"2024-04-26T20:20:47.685745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:57.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.683135+0000","last_change":"2024-04-26T20:19:56.829113+0000","last_active":"2024-04-26T20:20:47.683135+0000","last_peered":"2024-04-26T20:20:47.683135+0000","last_clean":"2024-04-26T20:20:47.683135+0000","last_became_active":"2024-04-26T20:19:56.828054+0000","last_became_peered":"2024-04-26T20:19:56.828054+0000","last_unstale":"2024-04-26T20:20:47.683135+0000","last_undegraded":"2024-04-26T20:20:47.683135+0000","last_fullsized":"2024-04-26T20:20:47.683135+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:30.205505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682630+0000","last_change":"2024-04-26T20:19:51.648858+0000","last_active":"2024-04-26T20:20:47.682630+0000","last_peered":"2024-04-26T20:20:47.682630+0000","last_clean":"2024-04-26T20:20:47.682630+0000","last_became_active":"2024-04-26T20:19:51.648528+0000","last_became_peered":"2024-04-26T20:19:51.648528+0000","last_unstale":"2024-04-26T20:20:47.682630+0000","last_undegraded":"2024-04-26T20:20:47.682630+0000","last_fullsized":"2024-04-26T20:20:47.682630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:43.448379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819064+0000","last_change":"2024-04-26T20:19:52.648536+0000","last_active":"2024-04-26T20:20:47.819064+0000","last_peered":"2024-04-26T20:20:47.819064+0000","last_clean":"2024-04-26T20:20:47.819064+0000","last_became_active":"2024-04-26T20:19:52.648058+0000","last_became_peered":"2024-04-26T20:19:52.648058+0000","last_unstale":"2024-04-26T20:20:47.819064+0000","last_undegraded":"2024-04-26T20:20:47.819064+0000","last_fullsized":"2024-04-26T20:20:47.819064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:16.831372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.818873+0000","last_change":"2024-04-26T20:19:56.737941+0000","last_active":"2024-04-26T20:20:47.818873+0000","last_peered":"2024-04-26T20:20:47.818873+0000","last_clean":"2024-04-26T20:20:47.818873+0000","last_became_active":"2024-04-26T20:19:56.737507+0000","last_became_peered":"2024-04-26T20:19:56.737507+0000","last_unstale":"2024-04-26T20:20:47.818873+0000","last_undegraded":"2024-04-26T20:20:47.818873+0000","last_fullsized":"2024-04-26T20:20:47.818873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:20.053022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:22:50.488922+0000","last_change":"2024-04-26T20:19:51.658240+0000","last_active":"2024-04-26T20:22:50.488922+0000","last_peered":"2024-04-26T20:22:50.488922+0000","last_clean":"2024-04-26T20:22:50.488922+0000","last_became_active":"2024-04-26T20:19:51.657925+0000","last_became_peered":"2024-04-26T20:19:51.657925+0000","last_unstale":"2024-04-26T20:22:50.488922+0000","last_undegraded":"2024-04-26T20:22:50.488922+0000","last_fullsized":"2024-04-26T20:22:50.488922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:38.387542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819674+0000","last_change":"2024-04-26T20:19:52.649306+0000","last_active":"2024-04-26T20:20:47.819674+0000","last_peered":"2024-04-26T20:20:47.819674+0000","last_clean":"2024-04-26T20:20:47.819674+0000","last_became_active":"2024-04-26T20:19:52.648925+0000","last_became_peered":"2024-04-26T20:19:52.648925+0000","last_unstale":"2024-04-26T20:20:47.819674+0000","last_undegraded":"2024-04-26T20:20:47.819674+0000","last_fullsized":"2024-04-26T20:20:47.819674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:51.828430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692735+0000","last_change":"2024-04-26T20:19:56.746544+0000","last_active":"2024-04-26T20:20:47.692735+0000","last_peered":"2024-04-26T20:20:47.692735+0000","last_clean":"2024-04-26T20:20:47.692735+0000","last_became_active":"2024-04-26T20:19:56.746158+0000","last_became_peered":"2024-04-26T20:19:56.746158+0000","last_unstale":"2024-04-26T20:20:47.692735+0000","last_undegraded":"2024-04-26T20:20:47.692735+0000","last_fullsized":"2024-04-26T20:20:47.692735+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:28.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.687748+0000","last_change":"2024-04-26T20:19:51.654080+0000","last_active":"2024-04-26T20:20:47.687748+0000","last_peered":"2024-04-26T20:20:47.687748+0000","last_clean":"2024-04-26T20:20:47.687748+0000","last_became_active":"2024-04-26T20:19:51.653519+0000","last_became_peered":"2024-04-26T20:19:51.653519+0000","last_unstale":"2024-04-26T20:20:47.687748+0000","last_undegraded":"2024-04-26T20:20:47.687748+0000","last_fullsized":"2024-04-26T20:20:47.687748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:46.637170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819410+0000","last_change":"2024-04-26T20:19:52.658599+0000","last_active":"2024-04-26T20:20:47.819410+0000","last_peered":"2024-04-26T20:20:47.819410+0000","last_clean":"2024-04-26T20:20:47.819410+0000","last_became_active":"2024-04-26T20:19:52.658203+0000","last_became_peered":"2024-04-26T20:19:52.658203+0000","last_unstale":"2024-04-26T20:20:47.819410+0000","last_undegraded":"2024-04-26T20:20:47.819410+0000","last_fullsized":"2024-04-26T20:20:47.819410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:27.513064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.685972+0000","last_change":"2024-04-26T20:19:56.732563+0000","last_active":"2024-04-26T20:20:47.685972+0000","last_peered":"2024-04-26T20:20:47.685972+0000","last_clean":"2024-04-26T20:20:47.685972+0000","last_became_active":"2024-04-26T20:19:56.732133+0000","last_became_peered":"2024-04-26T20:19:56.732133+0000","last_unstale":"2024-04-26T20:20:47.685972+0000","last_undegraded":"2024-04-26T20:20:47.685972+0000","last_fullsized":"2024-04-26T20:20:47.685972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:55.705535+0000","last_clean_scrub_stamp":"2024-04-26T20:19:55.705535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:52.492244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692893+0000","last_change":"2024-04-26T20:19:51.679209+0000","last_active":"2024-04-26T20:20:47.692893+0000","last_peered":"2024-04-26T20:20:47.692893+0000","last_clean":"2024-04-26T20:20:47.692893+0000","last_became_active":"2024-04-26T20:19:51.678727+0000","last_became_peered":"2024-04-26T20:19:51.678727+0000","last_unstale":"2024-04-26T20:20:47.692893+0000","last_undegraded":"2024-04-26T20:20:47.692893+0000","last_fullsized":"2024-04-26T20:20:47.692893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:50.603369+0000","last_clean_scrub_stamp":"2024-04-26T20:19:50.603369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:17.566319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.820005+0000","last_change":"2024-04-26T20:19:52.651203+0000","last_active":"2024-04-26T20:20:47.820005+0000","last_peered":"2024-04-26T20:20:47.820005+0000","last_clean":"2024-04-26T20:20:47.820005+0000","last_became_active":"2024-04-26T20:19:52.650803+0000","last_became_peered":"2024-04-26T20:19:52.650803+0000","last_unstale":"2024-04-26T20:20:47.820005+0000","last_undegraded":"2024-04-26T20:20:47.820005+0000","last_fullsized":"2024-04-26T20:20:47.820005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:54.599683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692256+0000","last_change":"2024-04-26T20:20:47.691705+0000","last_active":"2024-04-26T20:20:47.692256+0000","last_peered":"2024-04-26T20:20:47.692256+0000","last_clean":"2024-04-26T20:20:47.692256+0000","last_became_active":"2024-04-26T20:20:47.691330+0000","last_became_peered":"2024-04-26T20:20:47.691330+0000","last_unstale":"2024-04-26T20:20:47.692256+0000","last_undegraded":"2024-04-26T20:20:47.692256+0000","last_fullsized":"2024-04-26T20:20:47.692256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:36.045725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680627+0000","last_change":"2024-04-26T20:19:52.651080+0000","last_active":"2024-04-26T20:20:47.680627+0000","last_peered":"2024-04-26T20:20:47.680627+0000","last_clean":"2024-04-26T20:20:47.680627+0000","last_became_active":"2024-04-26T20:19:52.650326+0000","last_became_peered":"2024-04-26T20:19:52.650326+0000","last_unstale":"2024-04-26T20:20:47.680627+0000","last_undegraded":"2024-04-26T20:20:47.680627+0000","last_fullsized":"2024-04-26T20:20:47.680627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:44.534079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.680310+0000","last_change":"2024-04-26T20:19:52.659144+0000","last_active":"2024-04-26T20:20:47.680310+0000","last_peered":"2024-04-26T20:20:47.680310+0000","last_clean":"2024-04-26T20:20:47.680310+0000","last_became_active":"2024-04-26T20:19:52.658817+0000","last_became_peered":"2024-04-26T20:19:52.658817+0000","last_unstale":"2024-04-26T20:20:47.680310+0000","last_undegraded":"2024-04-26T20:20:47.680310+0000","last_fullsized":"2024-04-26T20:20:47.680310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:36.145678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.692934+0000","last_change":"2024-04-26T20:19:52.671969+0000","last_active":"2024-04-26T20:20:47.692934+0000","last_peered":"2024-04-26T20:20:47.692934+0000","last_clean":"2024-04-26T20:20:47.692934+0000","last_became_active":"2024-04-26T20:19:52.670891+0000","last_became_peered":"2024-04-26T20:19:52.670891+0000","last_unstale":"2024-04-26T20:20:47.692934+0000","last_undegraded":"2024-04-26T20:20:47.692934+0000","last_fullsized":"2024-04-26T20:20:47.692934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.754822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.703472+0000","last_change":"2024-04-26T20:20:47.701792+0000","last_active":"2024-04-26T20:20:47.703472+0000","last_peered":"2024-04-26T20:20:47.703472+0000","last_clean":"2024-04-26T20:20:47.703472+0000","last_became_active":"2024-04-26T20:20:47.701226+0000","last_became_peered":"2024-04-26T20:20:47.701226+0000","last_unstale":"2024-04-26T20:20:47.703472+0000","last_undegraded":"2024-04-26T20:20:47.703472+0000","last_fullsized":"2024-04-26T20:20:47.703472+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:56.095557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682954+0000","last_change":"2024-04-26T20:19:52.647572+0000","last_active":"2024-04-26T20:20:47.682954+0000","last_peered":"2024-04-26T20:20:47.682954+0000","last_clean":"2024-04-26T20:20:47.682954+0000","last_became_active":"2024-04-26T20:19:52.647244+0000","last_became_peered":"2024-04-26T20:19:52.647244+0000","last_unstale":"2024-04-26T20:20:47.682954+0000","last_undegraded":"2024-04-26T20:20:47.682954+0000","last_fullsized":"2024-04-26T20:20:47.682954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:12.135103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681033+0000","last_change":"2024-04-26T20:19:52.646370+0000","last_active":"2024-04-26T20:20:47.681033+0000","last_peered":"2024-04-26T20:20:47.681033+0000","last_clean":"2024-04-26T20:20:47.681033+0000","last_became_active":"2024-04-26T20:19:52.645999+0000","last_became_peered":"2024-04-26T20:19:52.645999+0000","last_unstale":"2024-04-26T20:20:47.681033+0000","last_undegraded":"2024-04-26T20:20:47.681033+0000","last_fullsized":"2024-04-26T20:20:47.681033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:24.412575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.684509+0000","last_change":"2024-04-26T20:19:52.666861+0000","last_active":"2024-04-26T20:20:47.684509+0000","last_peered":"2024-04-26T20:20:47.684509+0000","last_clean":"2024-04-26T20:20:47.684509+0000","last_became_active":"2024-04-26T20:19:52.666473+0000","last_became_peered":"2024-04-26T20:19:52.666473+0000","last_unstale":"2024-04-26T20:20:47.684509+0000","last_undegraded":"2024-04-26T20:20:47.684509+0000","last_fullsized":"2024-04-26T20:20:47.684509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:33.878227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.686737+0000","last_change":"2024-04-26T20:19:52.660140+0000","last_active":"2024-04-26T20:20:47.686737+0000","last_peered":"2024-04-26T20:20:47.686737+0000","last_clean":"2024-04-26T20:20:47.686737+0000","last_became_active":"2024-04-26T20:19:52.659804+0000","last_became_peered":"2024-04-26T20:19:52.659804+0000","last_unstale":"2024-04-26T20:20:47.686737+0000","last_undegraded":"2024-04-26T20:20:47.686737+0000","last_fullsized":"2024-04-26T20:20:47.686737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:59.089862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.681623+0000","last_change":"2024-04-26T20:19:52.665694+0000","last_active":"2024-04-26T20:20:47.681623+0000","last_peered":"2024-04-26T20:20:47.681623+0000","last_clean":"2024-04-26T20:20:47.681623+0000","last_became_active":"2024-04-26T20:19:52.664998+0000","last_became_peered":"2024-04-26T20:19:52.664998+0000","last_unstale":"2024-04-26T20:20:47.681623+0000","last_undegraded":"2024-04-26T20:20:47.681623+0000","last_fullsized":"2024-04-26T20:20:47.681623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:34.761604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.819257+0000","last_change":"2024-04-26T20:19:52.667637+0000","last_active":"2024-04-26T20:20:47.819257+0000","last_peered":"2024-04-26T20:20:47.819257+0000","last_clean":"2024-04-26T20:20:47.819257+0000","last_became_active":"2024-04-26T20:19:52.667257+0000","last_became_peered":"2024-04-26T20:19:52.667257+0000","last_unstale":"2024-04-26T20:20:47.819257+0000","last_undegraded":"2024-04-26T20:20:47.819257+0000","last_fullsized":"2024-04-26T20:20:47.819257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:37.396160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.693840+0000","last_change":"2024-04-26T20:19:52.670934+0000","last_active":"2024-04-26T20:20:47.693840+0000","last_peered":"2024-04-26T20:20:47.693840+0000","last_clean":"2024-04-26T20:20:47.693840+0000","last_became_active":"2024-04-26T20:19:52.670420+0000","last_became_peered":"2024-04-26T20:19:52.670420+0000","last_unstale":"2024-04-26T20:20:47.693840+0000","last_undegraded":"2024-04-26T20:20:47.693840+0000","last_fullsized":"2024-04-26T20:20:47.693840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T20:20:47.682964+0000","last_change":"2024-04-26T20:19:52.653365+0000","last_active":"2024-04-26T20:20:47.682964+0000","last_peered":"2024-04-26T20:20:47.682964+0000","last_clean":"2024-04-26T20:20:47.682964+0000","last_became_active":"2024-04-26T20:19:52.652964+0000","last_became_peered":"2024-04-26T20:19:52.652964+0000","last_unstale":"2024-04-26T20:20:47.682964+0000","last_undegraded":"2024-04-26T20:20:47.682964+0000","last_fullsized":"2024-04-26T20:20:47.682964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:19:51.617556+0000","last_clean_scrub_stamp":"2024-04-26T20:19:51.617556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:55.415020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68023,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1572,"num_read_kb":861,"num_write":251,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383731,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":501928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645367,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37020,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708132,"statfs":{"total":95995035648,"available":95957127168,"internally_reserved":0,"allocated":1724416,"data_stored":1149141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808894,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1060864,"data_stored":505451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070532,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":501621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332170,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1650688,"data_stored":1098540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495696,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":496859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":558398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":498706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1118208,"data_stored":559319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182498,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":496567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":501324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757333,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1093731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:22:56.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 -- 172.21.15.82:0/3661833315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 msgr2=0x7f10c4105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 --2- 172.21.15.82:0/3661833315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c4105ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009900 tx=0x7f10ac02a410 comp rx=0 tx=0).stop 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 -- 172.21.15.82:0/3661833315 shutdown_connections 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 --2- 172.21.15.82:0/3661833315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4106530 0x7f10c410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 --2- 172.21.15.82:0/3661833315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c4105ff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 --2- 172.21.15.82:0/3661833315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10c4104980 0x7f10c4104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 -- 172.21.15.82:0/3661833315 >> 172.21.15.82:0/3661833315 conn(0x7f10c40fff10 msgr2=0x7f10c4102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 -- 172.21.15.82:0/3661833315 shutdown_connections 2024-04-26T20:22:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.370+0000 7f10c3200640 1 -- 172.21.15.82:0/3661833315 wait complete. 2024-04-26T20:22:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 Processor -- start 2024-04-26T20:22:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 -- start start 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 0x7f10c419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10c4106530 0x7f10c41a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41104b0 con 0x7f10c4105b70 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4110330 con 0x7f10c4106530 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.371+0000 7f10c3200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4110630 con 0x7f10c4104980 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 0x7f10c419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10b9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 0x7f10c419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42420/0 (socket says 172.21.15.82:42420) 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 -- 172.21.15.82:0/3207101591 learned_addr learned my addr 172.21.15.82:0/3207101591 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c2800640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10c4106530 0x7f10c41a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 -- 172.21.15.82:0/3207101591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10c4106530 msgr2=0x7f10c41a2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10c4106530 0x7f10c41a2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 -- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 msgr2=0x7f10c419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 -- 172.21.15.82:0/3207101591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c41a2790 con 0x7f10c4104980 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10b9400640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.372+0000 7f10c1e00640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 0x7f10c419ab70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f10b400e9c0 tx=0x7f10b400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.373+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b400cde0 con 0x7f10c4104980 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.373+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c41a2a80 con 0x7f10c4104980 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.373+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10b40108e0 con 0x7f10c4104980 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.373+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b40188d0 con 0x7f10c4104980 2024-04-26T20:22:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.373+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c41a2fa0 con 0x7f10c4104980 2024-04-26T20:22:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.374+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c410bca0 con 0x7f10c4104980 2024-04-26T20:22:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.376+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f10b401f020 con 0x7f10c4104980 2024-04-26T20:22:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.377+0000 7f10bb400640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f10a40a3c40 0x7f10a40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.378+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f10b40d0cf0 con 0x7f10c4104980 2024-04-26T20:22:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.378+0000 7f10b9400640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f10a40a3c40 0x7f10a40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.378+0000 7f10b9400640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f10a40a3c40 0x7f10a40a6100 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10ac000c00 tx=0x7f10ac0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.380+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f10b409d1b0 con 0x7f10c4104980 2024-04-26T20:22:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.586+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10c402dad0 con 0x7f10c4104980 2024-04-26T20:22:56.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.588+0000 7f10bb400640 1 -- 172.21.15.82:0/3207101591 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f10b409cab0 con 0x7f10c4104980 2024-04-26T20:22:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:56.589 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f10a40a3c40 msgr2=0x7f10a40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f10a40a3c40 0x7f10a40a6100 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10ac000c00 tx=0x7f10ac0314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 msgr2=0x7f10c419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 0x7f10c419ab70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f10b400e9c0 tx=0x7f10b400ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 shutdown_connections 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f10a40a3c40 0x7f10a40a6100 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10c4106530 0x7f10c41a2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c4105b70 0x7f10c419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 --2- 172.21.15.82:0/3207101591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10c4104980 0x7f10c419ab70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.591+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 >> 172.21.15.82:0/3207101591 conn(0x7f10c40fff10 msgr2=0x7f10c4108e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.592+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 shutdown_connections 2024-04-26T20:22:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.592+0000 7f10c3200640 1 -- 172.21.15.82:0/3207101591 wait complete. 2024-04-26T20:22:56.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:22:56.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:22:56.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 -- 172.21.15.82:0/3049246486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 msgr2=0x7f7c00104fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 --2- 172.21.15.82:0/3049246486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c00104fd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0009860 tx=0x7f7bf002a340 comp rx=0 tx=0).stop 2024-04-26T20:22:56.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 -- 172.21.15.82:0/3049246486 shutdown_connections 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 --2- 172.21.15.82:0/3049246486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00106760 0x7f7c0010cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 --2- 172.21.15.82:0/3049246486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c00105da0 0x7f7c00106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 --2- 172.21.15.82:0/3049246486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c00104fd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.829+0000 7f7c06a00640 1 -- 172.21.15.82:0/3049246486 >> 172.21.15.82:0/3049246486 conn(0x7f7c00100120 msgr2=0x7f7c00102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.830+0000 7f7c06a00640 1 -- 172.21.15.82:0/3049246486 shutdown_connections 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.830+0000 7f7c06a00640 1 -- 172.21.15.82:0/3049246486 wait complete. 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.831+0000 7f7c06a00640 1 Processor -- start 2024-04-26T20:22:56.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.831+0000 7f7c06a00640 1 -- start start 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.831+0000 7f7c06a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c0019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7c06a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c00105da0 0x7f7c0019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7c06a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00106760 0x7f7c001a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7c06a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001106e0 con 0x7f7c00105da0 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7c06a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00110560 con 0x7f7c00106760 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7c06a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00110860 con 0x7f7c00104bb0 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c0019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c0019adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42432/0 (socket says 172.21.15.82:42432) 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 -- 172.21.15.82:0/2516900323 learned_addr learned my addr 172.21.15.82:0/2516900323 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7c04a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00106760 0x7f7c001a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bf7e00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c00105da0 0x7f7c0019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 -- 172.21.15.82:0/2516900323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00106760 msgr2=0x7f7c001a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00106760 0x7f7c001a2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 -- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c00105da0 msgr2=0x7f7c0019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:56.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c00105da0 0x7f7c0019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:56.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.832+0000 7f7bffe00640 1 -- 172.21.15.82:0/2516900323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c001a29e0 con 0x7f7c00104bb0 2024-04-26T20:22:56.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.833+0000 7f7bffe00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c0019adc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00057c0 tx=0x7f7bf0032da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.833+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0037040 con 0x7f7c00104bb0 2024-04-26T20:22:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.833+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c001a2c70 con 0x7f7c00104bb0 2024-04-26T20:22:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.833+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bf0030bd0 con 0x7f7c00104bb0 2024-04-26T20:22:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.833+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0005280 con 0x7f7c00104bb0 2024-04-26T20:22:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.833+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c001a3150 con 0x7f7c00104bb0 2024-04-26T20:22:56.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.834+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0010bf50 con 0x7f7c00104bb0 2024-04-26T20:22:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.836+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7bf0043020 con 0x7f7c00104bb0 2024-04-26T20:22:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.838+0000 7f7bfd600640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7be40a3c40 0x7f7be40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.838+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7bf00efdb0 con 0x7f7c00104bb0 2024-04-26T20:22:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.838+0000 7f7bf7e00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7be40a3c40 0x7f7be40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.839+0000 7f7bf7e00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7be40a3c40 0x7f7be40a6100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7c0019c2d0 tx=0x7f7be8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:56.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:56.842+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7bf00f4070 con 0x7f7c00104bb0 2024-04-26T20:22:56.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:56 smithi082 ceph-mon[28105]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:56 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3207101591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:56 smithi082 ceph-mon[28105]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-26T20:22:57.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.045+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7c0002dcf0 con 0x7f7c00104bb0 2024-04-26T20:22:57.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.046+0000 7f7bfd600640 1 -- 172.21.15.82:0/2516900323 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f7bf00bc380 con 0x7f7c00104bb0 2024-04-26T20:22:57.046 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7be40a3c40 msgr2=0x7f7be40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7be40a3c40 0x7f7be40a6100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7c0019c2d0 tx=0x7f7be8009260 comp rx=0 tx=0).stop 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 msgr2=0x7f7c0019adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c0019adc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00057c0 tx=0x7f7bf0032da0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 shutdown_connections 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7be40a3c40 0x7f7be40a6100 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c00106760 0x7f7c001a2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c00105da0 0x7f7c0019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 --2- 172.21.15.82:0/2516900323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c00104bb0 0x7f7c0019adc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.048+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 >> 172.21.15.82:0/2516900323 conn(0x7f7c00100120 msgr2=0x7f7c00109120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.049+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 shutdown_connections 2024-04-26T20:22:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.049+0000 7f7c06a00640 1 -- 172.21.15.82:0/2516900323 wait complete. 2024-04-26T20:22:57.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:22:57.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:56 smithi139 ceph-mon[32999]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:57.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:56 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3207101591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:57.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:56 smithi139 ceph-mon[32999]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-26T20:22:57.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:56 smithi135 ceph-mon[32816]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:22:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:56 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3207101591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:56 smithi135 ceph-mon[32816]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-26T20:22:57.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.269+0000 7f1557e00640 1 -- 172.21.15.82:0/2021933254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15580772f0 msgr2=0x7f1558077710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.269+0000 7f1557e00640 1 --2- 172.21.15.82:0/2021933254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15580772f0 0x7f1558077710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1548009860 tx=0x7f154802a340 comp rx=0 tx=0).stop 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 -- 172.21.15.82:0/2021933254 shutdown_connections 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 --2- 172.21.15.82:0/2021933254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 0x7f1558079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 --2- 172.21.15.82:0/2021933254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1558078530 0x7f1558078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 --2- 172.21.15.82:0/2021933254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15580772f0 0x7f1558077710 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 -- 172.21.15.82:0/2021933254 >> 172.21.15.82:0/2021933254 conn(0x7f15580fffe0 msgr2=0x7f1558102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 -- 172.21.15.82:0/2021933254 shutdown_connections 2024-04-26T20:22:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.270+0000 7f1557e00640 1 -- 172.21.15.82:0/2021933254 wait complete. 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 Processor -- start 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 -- start start 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 0x7f155819f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1558078530 0x7f155819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 0x7f15581a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15581149b0 con 0x7f15580772f0 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1558114830 con 0x7f1558078ed0 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.271+0000 7f1557e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1558114b30 con 0x7f1558078530 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 0x7f155819f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 0x7f155819f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42788/0 (socket says 172.21.15.82:42788) 2024-04-26T20:22:57.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 -- 172.21.15.82:0/717928087 learned_addr learned my addr 172.21.15.82:0/717928087 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f154e000640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1558078530 0x7f155819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1557400640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 0x7f15581a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 -- 172.21.15.82:0/717928087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1558078530 msgr2=0x7f155819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1558078530 0x7f155819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 -- 172.21.15.82:0/717928087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 msgr2=0x7f15581a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 0x7f15581a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1556a00640 1 -- 172.21.15.82:0/717928087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15581a6ce0 con 0x7f15580772f0 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f154e000640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1558078530 0x7f155819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.272+0000 7f1557400640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 0x7f15581a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.273+0000 7f1556a00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 0x7f155819f110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f15480057c0 tx=0x7f1548032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.273+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548037040 con 0x7f15580772f0 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.273+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1548030bd0 con 0x7f15580772f0 2024-04-26T20:22:57.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.273+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548005280 con 0x7f15580772f0 2024-04-26T20:22:57.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.273+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15581a6f70 con 0x7f15580772f0 2024-04-26T20:22:57.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.273+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15581a7320 con 0x7f15580772f0 2024-04-26T20:22:57.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.274+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15581113e0 con 0x7f15580772f0 2024-04-26T20:22:57.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.276+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1548043020 con 0x7f15580772f0 2024-04-26T20:22:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.278+0000 7f154fe00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f153c0a3c40 0x7f153c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.278+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f15480efe00 con 0x7f15580772f0 2024-04-26T20:22:57.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.278+0000 7f154e000640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f153c0a3c40 0x7f153c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.279+0000 7f154e000640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f153c0a3c40 0x7f153c0a6100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f15581a05d0 tx=0x7f1540009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.282+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f15480bc430 con 0x7f15580772f0 2024-04-26T20:22:57.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.483+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f155802dd20 con 0x7f15580772f0 2024-04-26T20:22:57.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.484+0000 7f154fe00640 1 -- 172.21.15.82:0/717928087 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f15480328c0 con 0x7f15580772f0 2024-04-26T20:22:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f153c0a3c40 msgr2=0x7f153c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f153c0a3c40 0x7f153c0a6100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f15581a05d0 tx=0x7f1540009260 comp rx=0 tx=0).stop 2024-04-26T20:22:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 msgr2=0x7f155819f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 0x7f155819f110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f15480057c0 tx=0x7f1548032da0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 shutdown_connections 2024-04-26T20:22:57.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f153c0a3c40 0x7f153c0a6100 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1558078ed0 0x7f15581a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1558078530 0x7f155819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 --2- 172.21.15.82:0/717928087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15580772f0 0x7f155819f110 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.487+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 >> 172.21.15.82:0/717928087 conn(0x7f15580fffe0 msgr2=0x7f1558101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.488+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 shutdown_connections 2024-04-26T20:22:57.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.488+0000 7f1557e00640 1 -- 172.21.15.82:0/717928087 wait complete. 2024-04-26T20:22:57.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:22:57.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.715+0000 7f981f200640 1 -- 172.21.15.82:0/2943837271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 msgr2=0x7f9820078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.715+0000 7f981f200640 1 --2- 172.21.15.82:0/2943837271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f9820078990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f980c009860 tx=0x7f980c02a340 comp rx=0 tx=0).stop 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 -- 172.21.15.82:0/2943837271 shutdown_connections 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 --2- 172.21.15.82:0/2943837271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820078ed0 0x7f9820079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 --2- 172.21.15.82:0/2943837271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f9820078990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 --2- 172.21.15.82:0/2943837271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98200772f0 0x7f9820077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 -- 172.21.15.82:0/2943837271 >> 172.21.15.82:0/2943837271 conn(0x7f98200fff00 msgr2=0x7f9820102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 -- 172.21.15.82:0/2943837271 shutdown_connections 2024-04-26T20:22:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.716+0000 7f981f200640 1 -- 172.21.15.82:0/2943837271 wait complete. 2024-04-26T20:22:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 Processor -- start 2024-04-26T20:22:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 -- start start 2024-04-26T20:22:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200772f0 0x7f982019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f982019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9820078ed0 0x7f98201a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9820114870 con 0x7f9820078ed0 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98201146f0 con 0x7f9820078530 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f98201149f0 con 0x7f98200772f0 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f982019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9820078ed0 0x7f98201a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f982019f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34420/0 (socket says 172.21.15.82:34420) 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981d400640 1 -- 172.21.15.82:0/2146434489 learned_addr learned my addr 172.21.15.82:0/2146434489 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.717+0000 7f981de00640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200772f0 0x7f982019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981e800640 1 -- 172.21.15.82:0/2146434489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200772f0 msgr2=0x7f982019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981e800640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200772f0 0x7f982019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981e800640 1 -- 172.21.15.82:0/2146434489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 msgr2=0x7f982019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981e800640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f982019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981e800640 1 -- 172.21.15.82:0/2146434489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98201a6bd0 con 0x7f9820078ed0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981d400640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f982019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981de00640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200772f0 0x7f982019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981e800640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9820078ed0 0x7f98201a6560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f981800ec50 tx=0x7f981800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818003b70 con 0x7f9820078ed0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f981800ee90 con 0x7f9820078ed0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.718+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98201a6ec0 con 0x7f9820078ed0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.719+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818010690 con 0x7f9820078ed0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.719+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98201a7330 con 0x7f9820078ed0 2024-04-26T20:22:57.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.720+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98201112e0 con 0x7f9820078ed0 2024-04-26T20:22:57.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.722+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9818004020 con 0x7f9820078ed0 2024-04-26T20:22:57.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.724+0000 7f9816a00640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f98040a3c40 0x7f98040a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:57.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.724+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f98180d0e50 con 0x7f9820078ed0 2024-04-26T20:22:57.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.724+0000 7f981de00640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f98040a3c40 0x7f98040a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:57.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.725+0000 7f981de00640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f98040a3c40 0x7f98040a6100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9810005fd0 tx=0x7f9810009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:57.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.728+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f981809d310 con 0x7f9820078ed0 2024-04-26T20:22:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.933+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f982002dca0 con 0x7f9820078ed0 2024-04-26T20:22:57.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.934+0000 7f9816a00640 1 -- 172.21.15.82:0/2146434489 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f981809cc10 con 0x7f9820078ed0 2024-04-26T20:22:57.935 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:22:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f98040a3c40 msgr2=0x7f98040a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f98040a3c40 0x7f98040a6100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9810005fd0 tx=0x7f9810009260 comp rx=0 tx=0).stop 2024-04-26T20:22:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9820078ed0 msgr2=0x7f98201a6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9820078ed0 0x7f98201a6560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f981800ec50 tx=0x7f981800c6a0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 shutdown_connections 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f98040a3c40 0x7f98040a6100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9820078ed0 0x7f98201a6560 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9820078530 0x7f982019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 --2- 172.21.15.82:0/2146434489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200772f0 0x7f982019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 >> 172.21.15.82:0/2146434489 conn(0x7f98200fff00 msgr2=0x7f9820101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 shutdown_connections 2024-04-26T20:22:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:57.937+0000 7f981f200640 1 -- 172.21.15.82:0/2146434489 wait complete. 2024-04-26T20:22:57.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:22:58.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:57 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2516900323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:58.030 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:57 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/717928087' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:57 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2516900323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:57 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/717928087' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:57 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2516900323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:22:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:57 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/717928087' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:22:58.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 -- 172.21.15.82:0/33792447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264103a30 msgr2=0x7fa264103eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 --2- 172.21.15.82:0/33792447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264103a30 0x7fa264103eb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa250009900 tx=0x7fa25002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 -- 172.21.15.82:0/33792447 shutdown_connections 2024-04-26T20:22:58.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 --2- 172.21.15.82:0/33792447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2641043f0 0x7fa26410ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 --2- 172.21.15.82:0/33792447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264103a30 0x7fa264103eb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 --2- 172.21.15.82:0/33792447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa264102840 0x7fa264102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 -- 172.21.15.82:0/33792447 >> 172.21.15.82:0/33792447 conn(0x7fa2640fddd0 msgr2=0x7fa2641001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:58.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 -- 172.21.15.82:0/33792447 shutdown_connections 2024-04-26T20:22:58.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.169+0000 7fa26ac00640 1 -- 172.21.15.82:0/33792447 wait complete. 2024-04-26T20:22:58.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 Processor -- start 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 -- start start 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 0x7fa26419acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa264103a30 0x7fa26419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2641043f0 0x7fa2641a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa26410e370 con 0x7fa264102840 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa26410e1f0 con 0x7fa2641043f0 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.170+0000 7fa26ac00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa26410e4f0 con 0x7fa264103a30 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 0x7fa26419acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa26a200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2641043f0 0x7fa2641a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 0x7fa26419acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42838/0 (socket says 172.21.15.82:42838) 2024-04-26T20:22:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 -- 172.21.15.82:0/656946979 learned_addr learned my addr 172.21.15.82:0/656946979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa268e00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa264103a30 0x7fa26419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 -- 172.21.15.82:0/656946979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa264103a30 msgr2=0x7fa26419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa264103a30 0x7fa26419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 -- 172.21.15.82:0/656946979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2641043f0 msgr2=0x7fa2641a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2641043f0 0x7fa2641a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 -- 172.21.15.82:0/656946979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2641a2900 con 0x7fa264102840 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa268e00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa264103a30 0x7fa26419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa26a200640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2641043f0 0x7fa2641a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:58.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.171+0000 7fa269800640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 0x7fa26419acc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa25800e9c0 tx=0x7fa25800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.172+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25800cd80 con 0x7fa264102840 2024-04-26T20:22:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.172+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2580035f0 con 0x7fa264102840 2024-04-26T20:22:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.172+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2641a2bf0 con 0x7fa264102840 2024-04-26T20:22:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.172+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258010690 con 0x7fa264102840 2024-04-26T20:22:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.172+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2641a3140 con 0x7fa264102840 2024-04-26T20:22:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.173+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2641a3310 con 0x7fa264102840 2024-04-26T20:22:58.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.175+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa2580037a0 con 0x7fa264102840 2024-04-26T20:22:58.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.177+0000 7fa262000640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa24c0a3c40 0x7fa24c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.177+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa2580d0d40 con 0x7fa264102840 2024-04-26T20:22:58.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.177+0000 7fa268e00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa24c0a3c40 0x7fa24c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.178+0000 7fa268e00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa24c0a3c40 0x7fa24c0a6100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa26419c1c0 tx=0x7fa2500314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.181+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa25809d200 con 0x7fa264102840 2024-04-26T20:22:58.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.377+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa2641a34e0 con 0x7fa264102840 2024-04-26T20:22:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.377+0000 7fa262000640 1 -- 172.21.15.82:0/656946979 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fa25809cb00 con 0x7fa264102840 2024-04-26T20:22:58.378 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa24c0a3c40 msgr2=0x7fa24c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa24c0a3c40 0x7fa24c0a6100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa26419c1c0 tx=0x7fa2500314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 msgr2=0x7fa26419acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 0x7fa26419acc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa25800e9c0 tx=0x7fa25800ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 shutdown_connections 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa24c0a3c40 0x7fa24c0a6100 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2641043f0 0x7fa2641a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa264103a30 0x7fa26419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 --2- 172.21.15.82:0/656946979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264102840 0x7fa26419acc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 >> 172.21.15.82:0/656946979 conn(0x7fa2640fddd0 msgr2=0x7fa264074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 shutdown_connections 2024-04-26T20:22:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.380+0000 7fa26ac00640 1 -- 172.21.15.82:0/656946979 wait complete. 2024-04-26T20:22:58.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 -- 172.21.15.82:0/3821231266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 msgr2=0x7ff088106000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 --2- 172.21.15.82:0/3821231266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 0x7ff088106000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff074009900 tx=0x7ff07402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 -- 172.21.15.82:0/3821231266 shutdown_connections 2024-04-26T20:22:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 --2- 172.21.15.82:0/3821231266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff088106540 0x7ff08810cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 --2- 172.21.15.82:0/3821231266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 0x7ff088106000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 --2- 172.21.15.82:0/3821231266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff088104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.590+0000 7ff08f200640 1 -- 172.21.15.82:0/3821231266 >> 172.21.15.82:0/3821231266 conn(0x7ff0880fff00 msgr2=0x7ff088102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.591+0000 7ff08f200640 1 -- 172.21.15.82:0/3821231266 shutdown_connections 2024-04-26T20:22:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.591+0000 7ff08f200640 1 -- 172.21.15.82:0/3821231266 wait complete. 2024-04-26T20:22:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.592+0000 7ff08f200640 1 Processor -- start 2024-04-26T20:22:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.592+0000 7ff08f200640 1 -- start start 2024-04-26T20:22:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.592+0000 7ff08f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff08819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.592+0000 7ff08f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 0x7ff08819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.592+0000 7ff08f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff088106540 0x7ff0881a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff088110510 con 0x7ff088104990 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff088110390 con 0x7ff088106540 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff088110690 con 0x7ff088105b80 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff08819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff08819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42858/0 (socket says 172.21.15.82:42858) 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 -- 172.21.15.82:0/3470346846 learned_addr learned my addr 172.21.15.82:0/3470346846 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08e800640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff088106540 0x7ff0881a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08d400640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 0x7ff08819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 -- 172.21.15.82:0/3470346846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 msgr2=0x7ff08819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 0x7ff08819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 -- 172.21.15.82:0/3470346846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff088106540 msgr2=0x7ff0881a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff088106540 0x7ff0881a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 -- 172.21.15.82:0/3470346846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0881a2780 con 0x7ff088104990 2024-04-26T20:22:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.593+0000 7ff08de00640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff08819ab60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e9c0 tx=0x7ff07c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.594+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00cd80 con 0x7ff088104990 2024-04-26T20:22:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.594+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff07c0035f0 con 0x7ff088104990 2024-04-26T20:22:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.594+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0881a2a70 con 0x7ff088104990 2024-04-26T20:22:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.594+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c018630 con 0x7ff088104990 2024-04-26T20:22:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.594+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881a2f90 con 0x7ff088104990 2024-04-26T20:22:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.595+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08810bcb0 con 0x7ff088104990 2024-04-26T20:22:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.597+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff07c0037a0 con 0x7ff088104990 2024-04-26T20:22:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.598+0000 7ff082a00640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0700a3c40 0x7ff0700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.598+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff07c0d0d60 con 0x7ff088104990 2024-04-26T20:22:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.599+0000 7ff08d400640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0700a3c40 0x7ff0700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.599+0000 7ff08d400640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0700a3c40 0x7ff0700a6100 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff074000c00 tx=0x7ff0740314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.603+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff07c09d220 con 0x7ff088104990 2024-04-26T20:22:58.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.853+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff08802db90 con 0x7ff088104990 2024-04-26T20:22:58.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.854+0000 7ff082a00640 1 -- 172.21.15.82:0/3470346846 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11951 (secure 0 0 0) 0x7ff07c09cb20 con 0x7ff088104990 2024-04-26T20:22:58.854 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:58.855 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:22:49.242424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24550,24529,24454,24554,24584]},"id":1}]} 2024-04-26T20:22:58.855 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-04-26T20:22:58.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0700a3c40 msgr2=0x7ff0700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0700a3c40 0x7ff0700a6100 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff074000c00 tx=0x7ff0740314a0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 msgr2=0x7ff08819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:58.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff08819ab60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e9c0 tx=0x7ff07c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:22:58.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 shutdown_connections 2024-04-26T20:22:58.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff0700a3c40 0x7ff0700a6100 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff088106540 0x7ff0881a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff088105b80 0x7ff08819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 --2- 172.21.15.82:0/3470346846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088104990 0x7ff08819ab60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.856+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 >> 172.21.15.82:0/3470346846 conn(0x7ff0880fff00 msgr2=0x7ff088108e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.857+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 shutdown_connections 2024-04-26T20:22:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:58.857+0000 7ff08f200640 1 -- 172.21.15.82:0/3470346846 wait complete. 2024-04-26T20:22:58.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:22:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2146434489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:58 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/656946979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:58 smithi139 ceph-mon[32999]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 -- 172.21.15.82:0/3519726175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee8109f80 msgr2=0x7f7ee810a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3519726175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee8109f80 0x7f7ee810a400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009860 tx=0x7f7ed402a340 comp rx=0 tx=0).stop 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 -- 172.21.15.82:0/3519726175 shutdown_connections 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3519726175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ee810a940 0x7f7ee81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3519726175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee8109f80 0x7f7ee810a400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3519726175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8108d90 0x7f7ee81091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 -- 172.21.15.82:0/3519726175 >> 172.21.15.82:0/3519726175 conn(0x7f7ee8077d30 msgr2=0x7f7ee807a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 -- 172.21.15.82:0/3519726175 shutdown_connections 2024-04-26T20:22:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.071+0000 7f7ee7200640 1 -- 172.21.15.82:0/3519726175 wait complete. 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.072+0000 7f7ee7200640 1 Processor -- start 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 -- start start 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ee8108d90 0x7f7ee819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8109f80 0x7f7ee819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 0x7f7ee81a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81148c0 con 0x7f7ee8109f80 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8114740 con 0x7f7ee8108d90 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee7200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8114a40 con 0x7f7ee810a940 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 0x7f7ee81a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8109f80 0x7f7ee819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 0x7f7ee81a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42518/0 (socket says 172.21.15.82:42518) 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee6800640 1 -- 172.21.15.82:0/3026839019 learned_addr learned my addr 172.21.15.82:0/3026839019 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.073+0000 7f7ee5e00640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ee8108d90 0x7f7ee819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee6800640 1 -- 172.21.15.82:0/3026839019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ee8108d90 msgr2=0x7f7ee819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee6800640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ee8108d90 0x7f7ee819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee6800640 1 -- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8109f80 msgr2=0x7f7ee819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee6800640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8109f80 0x7f7ee819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee6800640 1 -- 172.21.15.82:0/3026839019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee81a6ba0 con 0x7f7ee810a940 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee5400640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8109f80 0x7f7ee819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee6800640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 0x7f7ee81a6530 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000eb10 tx=0x7f7ee000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0004b20 con 0x7f7ee810a940 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee0004cc0 con 0x7f7ee810a940 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee81a6e90 con 0x7f7ee810a940 2024-04-26T20:22:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0010670 con 0x7f7ee810a940 2024-04-26T20:22:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.074+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee81a7350 con 0x7f7ee810a940 2024-04-26T20:22:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.075+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee8110180 con 0x7f7ee810a940 2024-04-26T20:22:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.078+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7ee0005000 con 0x7f7ee810a940 2024-04-26T20:22:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.079+0000 7f7edea00640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7ecc0a3c40 0x7f7ecc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.079+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7ee00d1080 con 0x7f7ee810a940 2024-04-26T20:22:59.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.079+0000 7f7ee5e00640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7ecc0a3c40 0x7f7ecc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.080+0000 7f7ee5e00640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7ecc0a3c40 0x7f7ecc0a6100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009530 tx=0x7f7ed8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.081+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f7ee0054060 con 0x7f7ee810a940 2024-04-26T20:22:59.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2146434489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:58 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/656946979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:58 smithi135 ceph-mon[32816]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:22:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2146434489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:22:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:58 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/656946979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:22:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:58 smithi082 ceph-mon[28105]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:22:59.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.282+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ee802dd40 con 0x7f7ee810a940 2024-04-26T20:22:59.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.284+0000 7f7edea00640 1 -- 172.21.15.82:0/3026839019 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24669 (secure 0 0 0) 0x7f7ee009d540 con 0x7f7ee810a940 2024-04-26T20:22:59.286 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:22:59.286 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":91,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:20:47.671770+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7ecc0a3c40 msgr2=0x7f7ecc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7ecc0a3c40 0x7f7ecc0a6100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009530 tx=0x7f7ed8009260 comp rx=0 tx=0).stop 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 msgr2=0x7f7ee81a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 0x7f7ee81a6530 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000eb10 tx=0x7f7ee000c2d0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 shutdown_connections 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f7ecc0a3c40 0x7f7ecc0a6100 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee810a940 0x7f7ee81a6530 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee8109f80 0x7f7ee819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 --2- 172.21.15.82:0/3026839019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ee8108d90 0x7f7ee819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 >> 172.21.15.82:0/3026839019 conn(0x7f7ee8077d30 msgr2=0x7f7ee810d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 shutdown_connections 2024-04-26T20:22:59.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.287+0000 7f7ee7200640 1 -- 172.21.15.82:0/3026839019 wait complete. 2024-04-26T20:22:59.309 DEBUG:tasks.fwd_scrub:Yielding 2024-04-26T20:22:59.309 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-26T20:22:59.324 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:22:59.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-26T20:22:59.325 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-26T20:22:59.325 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:22:59.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:22:59.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:22:59.331 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T20:22:59.347 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:22:59.347 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T20:22:59.347 INFO:tasks.workunit:timeout=3h 2024-04-26T20:22:59.347 INFO:tasks.workunit:cleanup=True 2024-04-26T20:22:59.348 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 72h/114d Inode: 1099511628283 Links: 2 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 20:20:21.681401297 +0000 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 20:20:21.681401297 +0000 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 20:22:48.176215587 +0000 2024-04-26T20:22:59.391 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-26 20:20:21.681401297 +0000 2024-04-26T20:22:59.392 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T20:22:59.392 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T20:22:59.512 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 -- 172.21.15.82:0/3029058092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58102970 msgr2=0x7f5a58102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/3029058092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58102970 0x7f5a58102d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009ca0 tx=0x7f5a4802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 -- 172.21.15.82:0/3029058092 shutdown_connections 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/3029058092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 0x7f5a5810adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/3029058092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a58103b60 0x7f5a58103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/3029058092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58102970 0x7f5a58102d90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 -- 172.21.15.82:0/3029058092 >> 172.21.15.82:0/3029058092 conn(0x7f5a580fdee0 msgr2=0x7f5a58100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 -- 172.21.15.82:0/3029058092 shutdown_connections 2024-04-26T20:22:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.521+0000 7f5a5cc00640 1 -- 172.21.15.82:0/3029058092 wait complete. 2024-04-26T20:22:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.522+0000 7f5a5cc00640 1 Processor -- start 2024-04-26T20:22:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 -- start start 2024-04-26T20:22:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a58102970 0x7f5a580766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58103b60 0x7f5a58074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 0x7f5a58075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5810e4a0 con 0x7f5a58103b60 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5810e320 con 0x7f5a58102970 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a5cc00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5810e620 con 0x7f5a58104520 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a4d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58103b60 0x7f5a58074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a4d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58103b60 0x7f5a58074d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42900/0 (socket says 172.21.15.82:42900) 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a56800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 0x7f5a58075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a4d400640 1 -- 172.21.15.82:0/470412238 learned_addr learned my addr 172.21.15.82:0/470412238 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.523+0000 7f5a55e00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a58102970 0x7f5a580766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a56800640 1 -- 172.21.15.82:0/470412238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a58102970 msgr2=0x7f5a580766e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a56800640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a58102970 0x7f5a580766e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a56800640 1 -- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58103b60 msgr2=0x7f5a58074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a56800640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58103b60 0x7f5a58074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a56800640 1 -- 172.21.15.82:0/470412238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a58075af0 con 0x7f5a58104520 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a56800640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 0x7f5a58075260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000e970 tx=0x7f5a5000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a4f400640 1 -- 172.21.15.82:0/470412238 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000ccc0 con 0x7f5a58104520 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a581a2ce0 con 0x7f5a58104520 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a4f400640 1 -- 172.21.15.82:0/470412238 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a50005020 con 0x7f5a58104520 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a4f400640 1 -- 172.21.15.82:0/470412238 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50004a00 con 0x7f5a58104520 2024-04-26T20:22:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.524+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a581a31d0 con 0x7f5a58104520 2024-04-26T20:22:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.527+0000 7f5a5fbb0740 1 Processor -- start 2024-04-26T20:22:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a4f400640 1 -- 172.21.15.82:0/470412238 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5a50004ba0 con 0x7f5a58104520 2024-04-26T20:22:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 -- start start 2024-04-26T20:22:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a299c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a29ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a2a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56144a1fe980 con 0x56144a299860 2024-04-26T20:22:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56144a19b220 con 0x56144a29a250 2024-04-26T20:22:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.528+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56144a1fa940 con 0x56144a29f3c0 2024-04-26T20:22:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a299c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a29ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a29ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34492/0 (socket says 172.21.15.82:34492) 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a55e00640 1 -- 172.21.15.82:0/920777192 learned_addr learned my addr 172.21.15.82:0/920777192 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a2a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 -- 172.21.15.82:0/920777192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 msgr2=0x56144a2a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a2a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 -- 172.21.15.82:0/920777192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 msgr2=0x56144a29ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a29ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 -- 172.21.15.82:0/920777192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561449fd87e0 con 0x56144a299860 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a55e00640 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a29ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.529+0000 7f5a4d400640 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a299c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5a58076450 tx=0x7f5a40009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3c736aae8c3d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.530+0000 7f5a4f400640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a3c0a3c40 0x7f5a3c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.530+0000 7f5a47000640 1 -- 172.21.15.82:0/920777192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40004030 con 0x56144a299860 2024-04-26T20:22:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.530+0000 7f5a47000640 1 -- 172.21.15.82:0/920777192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40005020 con 0x56144a299860 2024-04-26T20:22:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.530+0000 7f5a4f400640 1 -- 172.21.15.82:0/470412238 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5a500d08b0 con 0x7f5a58104520 2024-04-26T20:22:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.530+0000 7f5a47000640 1 -- 172.21.15.82:0/920777192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40004b60 con 0x56144a299860 2024-04-26T20:22:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.530+0000 7f5a55e00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a3c0a3c40 0x7f5a3c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/920777192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 msgr2=0x56144a299c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a299c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5a58076450 tx=0x7f5a40009520 comp rx=0 tx=0).stop 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/920777192 shutdown_connections 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a2a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a29ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/920777192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a299c80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/920777192 >> 172.21.15.82:0/920777192 conn(0x56144a294ed0 msgr2=0x56144a2952d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a55e00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a3c0a3c40 0x7f5a3c0a6100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x56144a29a650 tx=0x7f5a48005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/920777192 shutdown_connections 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/920777192 wait complete. 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.531+0000 7f5a5fbb0740 1 -- start start 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 Processor -- start 2024-04-26T20:22:59.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a299860 0x56144a2a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29a250 0x56144a2a4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 0x56144a2ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56144a2a23c0 con 0x56144a29f3c0 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56144a186170 con 0x56144a299860 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56144a2a2540 con 0x56144a29a250 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a5fbb0740 10 client.0 _ll_register_callbacks cb 0x56144a1f5770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a56800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 0x56144a2ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a299860 0x56144a2a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a56800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 0x56144a2ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42912/0 (socket says 172.21.15.82:42912) 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a56800640 1 -- 172.21.15.82:0/161904490 learned_addr learned my addr 172.21.15.82:0/161904490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.532+0000 7f5a4d400640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29a250 0x56144a2a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a55e00640 1 -- 172.21.15.82:0/161904490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29a250 msgr2=0x56144a2a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a55e00640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29a250 0x56144a2a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a55e00640 1 -- 172.21.15.82:0/161904490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 msgr2=0x56144a2ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a55e00640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 0x56144a2ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a55e00640 1 -- 172.21.15.82:0/161904490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56144a038f70 con 0x56144a299860 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a56800640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 0x56144a2ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a55e00640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a299860 0x56144a2a3d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x56144a29acc0 tx=0x7f5a4802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a6dc1990de0846 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a3b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.533+0000 7f5a3b400640 1 -- 172.21.15.82:0/161904490 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48004250 con 0x56144a299860 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a40005020 con 0x56144a299860 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a3b400640 1 -- 172.21.15.82:0/161904490 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5a480043f0 con 0x56144a299860 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a3b400640 1 -- 172.21.15.82:0/161904490 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a480045f0 con 0x56144a299860 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a5fbb0740 10 client.25580 fetch_fsmap learned FSMap version 29 2024-04-26T20:22:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561449ed0170 con 0x56144a299860 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a3b400640 1 -- 172.21.15.82:0/161904490 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40005020 con 0x56144a299860 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.534+0000 7f5a3b400640 1 -- 172.21.15.82:0/161904490 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5a48051070 con 0x56144a299860 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a5fbb0740 10 client.25580 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a5fbb0740 10 client.25580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a5fbb0740 20 client.25580 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a2af770 0x56144a2b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a5fbb0740 4 client.25580 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56144a20c590 con 0x56144a2af770 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.535+0000 7f5a4d400640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a2af770 0x56144a2b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.536+0000 7f5a3b400640 10 client.25580 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.536+0000 7f5a4d400640 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a2af770 0x56144a2b1be0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a43d9002fbd90b server_cookie=37be806418c50562 in_seq=0 out_seq=0 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.536+0000 7f5a3b400640 1 -- 172.21.15.82:0/161904490 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56144a20c590 con 0x56144a2af770 2024-04-26T20:22:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.536+0000 7f5a3b400640 10 client.25580 handle_command_reply: tid=0 2024-04-26T20:22:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.536+0000 7f5a5fbb0740 1 client.25580 shutdown 2024-04-26T20:22:59.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a299860 msgr2=0x56144a2a3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a299860 0x56144a2a3d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x56144a29acc0 tx=0x7f5a4802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 shutdown_connections 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a2af770 0x56144a2b1be0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29f3c0 0x56144a2ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29a250 0x56144a2a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a3b400640 0 client.25580 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/161904490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a299860 0x56144a2a3d00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 >> 172.21.15.82:0/161904490 conn(0x56144a294ed0 msgr2=0x56144a293ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 shutdown_connections 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/161904490 wait complete. 2024-04-26T20:22:59.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.537+0000 7f5a5fbb0740 20 client.25580 trim_cache size 0 max 16384 2024-04-26T20:22:59.554 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 Processor -- start 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 -- start start 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a2a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a2ab210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a297e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581ad510 con 0x56144a299860 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581af050 con 0x56144a29a250 2024-04-26T20:22:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.556+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581adbe0 con 0x56144a29f3c0 2024-04-26T20:22:59.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a2a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a2a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42926/0 (socket says 172.21.15.82:42926) 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a4d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a2ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a55e00640 1 -- 172.21.15.82:0/3287420886 learned_addr learned my addr 172.21.15.82:0/3287420886 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a56800640 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a297e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a4d400640 1 -- 172.21.15.82:0/3287420886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 msgr2=0x56144a297e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a4d400640 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a297e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a4d400640 1 -- 172.21.15.82:0/3287420886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 msgr2=0x56144a2a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a4d400640 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a2a4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a4d400640 1 -- 172.21.15.82:0/3287420886 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56144a28f440 con 0x56144a29a250 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.557+0000 7f5a55e00640 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a2a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.558+0000 7f5a4d400640 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a2ab210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a40014fd0 tx=0x7f5a40021040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b2e3e16e550e54 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.558+0000 7f5a46600640 1 -- 172.21.15.82:0/3287420886 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4002e0d0 con 0x56144a29a250 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.558+0000 7f5a46600640 1 -- 172.21.15.82:0/3287420886 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4002e720 con 0x56144a29a250 2024-04-26T20:22:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.558+0000 7f5a46600640 1 -- 172.21.15.82:0/3287420886 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000f930 con 0x56144a29a250 2024-04-26T20:22:59.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/3287420886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 msgr2=0x56144a2ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a2ab210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a40014fd0 tx=0x7f5a40021040 comp rx=0 tx=0).stop 2024-04-26T20:22:59.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/3287420886 shutdown_connections 2024-04-26T20:22:59.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a29f3c0 0x56144a297e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29a250 0x56144a2ab210 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/3287420886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a299860 0x56144a2a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/3287420886 >> 172.21.15.82:0/3287420886 conn(0x56144a294ed0 msgr2=0x56144a2a3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/3287420886 shutdown_connections 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.559+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/3287420886 wait complete. 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 -- start start 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 Processor -- start 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 0x56144a2a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29a250 0x56144a2a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29f3c0 0x56144a2aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581ae980 con 0x56144a29a250 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581ae2b0 con 0x56144a29f3c0 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581ab4f0 con 0x56144a299860 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a5fbb0740 10 client.0 _ll_register_callbacks cb 0x7f5a48009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 0x56144a2a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.560+0000 7f5a4d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29a250 0x56144a2a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 0x56144a2a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42562/0 (socket says 172.21.15.82:42562) 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 -- 172.21.15.82:0/1403975687 learned_addr learned my addr 172.21.15.82:0/1403975687 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a56800640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29f3c0 0x56144a2aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 -- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29f3c0 msgr2=0x56144a2aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29f3c0 0x56144a2aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 -- 172.21.15.82:0/1403975687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29a250 msgr2=0x56144a2a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29a250 0x56144a2a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 -- 172.21.15.82:0/1403975687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56144a2aa6e0 con 0x56144a299860 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a4d400640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29a250 0x56144a2a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a55e00640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 0x56144a2a8ba0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a48006010 tx=0x7f5a48003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb4a8f954b2df78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.561+0000 7f5a3b400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a3b400640 1 -- 172.21.15.82:0/1403975687 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48030a80 con 0x56144a299860 2024-04-26T20:22:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a4002e720 con 0x56144a299860 2024-04-26T20:22:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a3b400640 1 -- 172.21.15.82:0/1403975687 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5a48004b40 con 0x56144a299860 2024-04-26T20:22:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a3b400640 1 -- 172.21.15.82:0/1403975687 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a48004d40 con 0x56144a299860 2024-04-26T20:22:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 10 client.25609 fetch_fsmap learned FSMap version 29 2024-04-26T20:22:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56144a315f80 con 0x56144a299860 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a3b400640 1 -- 172.21.15.82:0/1403975687 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4002e720 con 0x56144a299860 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a3b400640 1 -- 172.21.15.82:0/1403975687 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5a48051040 con 0x56144a299860 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 10 client.25609 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 10 client.25609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 20 client.25609 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a316970 0x56144a318d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 4 client.25609 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.562+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56144a206400 con 0x56144a316970 2024-04-26T20:22:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.563+0000 7f5a4d400640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a316970 0x56144a318d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.563+0000 7f5a4d400640 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a316970 0x56144a318d90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bba58034ee74fbfd server_cookie=51108f88683db0b5 in_seq=0 out_seq=0 2024-04-26T20:22:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.563+0000 7f5a3b400640 10 client.25609 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.564+0000 7f5a3b400640 1 -- 172.21.15.82:0/1403975687 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56144a206400 con 0x56144a316970 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.564+0000 7f5a3b400640 10 client.25609 handle_command_reply: tid=0 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.564+0000 7f5a5fbb0740 1 client.25609 shutdown 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 msgr2=0x56144a2a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 0x56144a2a8ba0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a48006010 tx=0x7f5a48003f00 comp rx=0 tx=0).stop 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 shutdown_connections 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56144a316970 0x56144a318d90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56144a29f3c0 0x56144a2aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144a29a250 0x56144a2a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a3b400640 0 client.25609 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 --2- 172.21.15.82:0/1403975687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56144a299860 0x56144a2a8ba0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 >> 172.21.15.82:0/1403975687 conn(0x56144a294ed0 msgr2=0x56144a297e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 shutdown_connections 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 1 -- 172.21.15.82:0/1403975687 wait complete. 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.565+0000 7f5a5fbb0740 20 client.25609 trim_cache size 0 max 16384 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "032a4c3b-8878-40cf-b0f7-230e87a83f94", 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:22:59.570 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a3c0a3c40 msgr2=0x7f5a3c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a3c0a3c40 0x7f5a3c0a6100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x56144a29a650 tx=0x7f5a48005dc0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 msgr2=0x7f5a58075260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 0x7f5a58075260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000e970 tx=0x7f5a5000ee30 comp rx=0 tx=0).stop 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 shutdown_connections 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5a3c0a3c40 0x7f5a3c0a6100 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a58104520 0x7f5a58075260 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a58103b60 0x7f5a58074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 --2- 172.21.15.82:0/470412238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a58102970 0x7f5a580766e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 >> 172.21.15.82:0/470412238 conn(0x7f5a580fdee0 msgr2=0x7f5a58106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 shutdown_connections 2024-04-26T20:22:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.566+0000 7f5a5cc00640 1 -- 172.21.15.82:0/470412238 wait complete. 2024-04-26T20:22:59.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:22:59.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 -- 172.21.15.82:0/1592316962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60104410 msgr2=0x7f8c6010aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/1592316962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60104410 0x7f8c6010aca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009be0 tx=0x7f8c5802a6c0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 -- 172.21.15.82:0/1592316962 shutdown_connections 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/1592316962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60104410 0x7f8c6010aca0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/1592316962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c60103a50 0x7f8c60103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/1592316962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60102860 0x7f8c60102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 -- 172.21.15.82:0/1592316962 >> 172.21.15.82:0/1592316962 conn(0x7f8c600fddd0 msgr2=0x7f8c60100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 -- 172.21.15.82:0/1592316962 shutdown_connections 2024-04-26T20:22:59.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.834+0000 7f8c5fe00640 1 -- 172.21.15.82:0/1592316962 wait complete. 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.835+0000 7f8c5fe00640 1 Processor -- start 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.835+0000 7f8c5fe00640 1 -- start start 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.835+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 0x7f8c60198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.835+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103a50 0x7f8c60198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.835+0000 7f8c5fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c60104410 0x7f8c6019ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010e390 con 0x7f8c60103a50 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010e210 con 0x7f8c60104410 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010e510 con 0x7f8c60102860 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 0x7f8c60198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103a50 0x7f8c60198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 0x7f8c60198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42570/0 (socket says 172.21.15.82:42570) 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2154578837 learned_addr learned my addr 172.21.15.82:0/2154578837 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5f400640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c60104410 0x7f8c6019ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2154578837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c60104410 msgr2=0x7f8c6019ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c60104410 0x7f8c6019ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103a50 msgr2=0x7f8c60198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103a50 0x7f8c60198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.836+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2154578837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601a0620 con 0x7f8c60102860 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.837+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 0x7f8c60198a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000d770 tx=0x7f8c5000db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.837+0000 7f8c57400640 1 -- 172.21.15.82:0/2154578837 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50017070 con 0x7f8c60102860 2024-04-26T20:22:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.837+0000 7f8c57400640 1 -- 172.21.15.82:0/2154578837 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c50009cd0 con 0x7f8c60102860 2024-04-26T20:22:59.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.837+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601a0910 con 0x7f8c60102860 2024-04-26T20:22:59.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.837+0000 7f8c57400640 1 -- 172.21.15.82:0/2154578837 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50003c60 con 0x7f8c60102860 2024-04-26T20:22:59.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.837+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601a0e60 con 0x7f8c60102860 2024-04-26T20:22:59.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.840+0000 7f8c57400640 1 -- 172.21.15.82:0/2154578837 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8c50009820 con 0x7f8c60102860 2024-04-26T20:22:59.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.841+0000 7f8c687f4740 1 Processor -- start 2024-04-26T20:22:59.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.841+0000 7f8c687f4740 1 -- start start 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.841+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b3d70 0x5566554b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554b9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b98d0 0x5566554bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c687f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5566553c0030 con 0x5566554b3d70 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c687f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5566553db7f0 con 0x5566554b98d0 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c687f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5566553967e0 con 0x5566554b4760 2024-04-26T20:22:59.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c57400640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c440a3c40 0x7f8c440a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42582/0 (socket says 172.21.15.82:42582) 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2486344016 learned_addr learned my addr 172.21.15.82:0/2486344016 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c5e000640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b98d0 0x5566554bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c57400640 1 -- 172.21.15.82:0/2154578837 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8c500d02e0 con 0x7f8c60102860 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c5f400640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b3d70 0x5566554b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.842+0000 7f8c5f400640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c440a3c40 0x7f8c440a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2486344016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b98d0 msgr2=0x5566554bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b98d0 0x5566554bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2486344016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b3d70 msgr2=0x5566554b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b3d70 0x5566554b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2486344016 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566553a2050 con 0x5566554b4760 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5e000640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b98d0 0x5566554bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5f400640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b3d70 0x5566554b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554b9260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8c500cd940 tx=0x7f8c5006ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ffa4a84d27e0916 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c4be00640 1 -- 172.21.15.82:0/2486344016 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50020030 con 0x5566554b4760 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c5f400640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c440a3c40 0x7f8c440a6100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8c5802abe0 tx=0x7f8c58005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c4be00640 1 -- 172.21.15.82:0/2486344016 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c50009b10 con 0x5566554b4760 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.843+0000 7f8c4be00640 1 -- 172.21.15.82:0/2486344016 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c500a0490 con 0x5566554b4760 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 -- 172.21.15.82:0/2486344016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 msgr2=0x5566554b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554b9260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8c500cd940 tx=0x7f8c5006ba10 comp rx=0 tx=0).stop 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 -- 172.21.15.82:0/2486344016 shutdown_connections 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b98d0 0x5566554bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554b9260 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2486344016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b3d70 0x5566554b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 -- 172.21.15.82:0/2486344016 >> 172.21.15.82:0/2486344016 conn(0x5566554aafd0 msgr2=0x5566554ab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 -- 172.21.15.82:0/2486344016 shutdown_connections 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.844+0000 7f8c687f4740 1 -- 172.21.15.82:0/2486344016 wait complete. 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.845+0000 7f8c687f4740 1 -- start start 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.845+0000 7f8c687f4740 1 Processor -- start 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.845+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554bdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b98d0 0x5566554c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c687f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556655418200 con 0x5566554b98d0 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c687f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556655412ee0 con 0x5566554b3d70 2024-04-26T20:22:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c687f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55665541fe70 con 0x5566554b4760 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554bdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c687f4740 10 client.0 _ll_register_callbacks cb 0x556655409270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554be0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42596/0 (socket says 172.21.15.82:42596) 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 -- 172.21.15.82:0/17471057 learned_addr learned my addr 172.21.15.82:0/17471057 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5f400640 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b98d0 0x5566554c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 -- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 msgr2=0x5566554bdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554bdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 -- 172.21.15.82:0/17471057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b98d0 msgr2=0x5566554c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b98d0 0x5566554c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.846+0000 7f8c5e000640 1 -- 172.21.15.82:0/17471057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566551ef7d0 con 0x5566554b4760 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c5e000640 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554be0e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c012720 tx=0x7f8c4c012be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0110efeff9d4271 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c48c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c48c00640 1 -- 172.21.15.82:0/17471057 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c004020 con 0x5566554b4760 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566554217e0 con 0x5566554b4760 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c48c00640 1 -- 172.21.15.82:0/17471057 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8c4c0041c0 con 0x5566554b4760 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c48c00640 1 -- 172.21.15.82:0/17471057 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c4c025050 con 0x5566554b4760 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c687f4740 10 client.25621 fetch_fsmap learned FSMap version 29 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.847+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566551253f0 con 0x5566554b4760 2024-04-26T20:22:59.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c48c00640 1 -- 172.21.15.82:0/17471057 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5566554217e0 con 0x5566554b4760 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c48c00640 1 -- 172.21.15.82:0/17471057 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c4c003a10 con 0x5566554b4760 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c687f4740 10 client.25621 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c687f4740 10 client.25621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c687f4740 20 client.25621 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c687f4740 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554c97c0 0x5566554cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c687f4740 4 client.25621 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.848+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55665541b650 con 0x5566554c97c0 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.849+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554c97c0 0x5566554cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.849+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554c97c0 0x5566554cbbe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fec3c677d33c4ff server_cookie=5ac5f0f58786ab2c in_seq=0 out_seq=0 2024-04-26T20:22:59.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.849+0000 7f8c48c00640 10 client.25621 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c48c00640 1 -- 172.21.15.82:0/17471057 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55665541b650 con 0x5566554c97c0 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c48c00640 10 client.25621 handle_command_reply: tid=0 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 client.25621 shutdown 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 msgr2=0x5566554be0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554be0e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c012720 tx=0x7f8c4c012be0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 shutdown_connections 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554c97c0 0x5566554cbbe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b98d0 0x5566554c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b4760 0x5566554be0e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c48c00640 0 client.25621 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 --2- 172.21.15.82:0/17471057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554bdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 >> 172.21.15.82:0/17471057 conn(0x5566554aafd0 msgr2=0x5566554aa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 shutdown_connections 2024-04-26T20:22:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 1 -- 172.21.15.82:0/17471057 wait complete. 2024-04-26T20:22:59.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.850+0000 7f8c687f4740 20 client.25621 trim_cache size 0 max 16384 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.870+0000 7f8c687f4740 1 Processor -- start 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.870+0000 7f8c687f4740 1 -- start start 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.870+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554aafd0 0x5566554a6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.870+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b4760 0x5566554b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c687f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601aab70 con 0x5566554b4760 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c687f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601a9700 con 0x5566554b3d70 2024-04-26T20:22:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c687f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601a9dd0 con 0x5566554aafd0 2024-04-26T20:22:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b4760 0x5566554b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554aafd0 0x5566554a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b4760 0x5566554b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42986/0 (socket says 172.21.15.82:42986) 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5f400640 1 -- 172.21.15.82:0/2453204035 learned_addr learned my addr 172.21.15.82:0/2453204035 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5e000640 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2453204035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 msgr2=0x5566554c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2453204035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b4760 msgr2=0x5566554b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b4760 0x5566554b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.871+0000 7f8c5ea00640 1 -- 172.21.15.82:0/2453204035 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566554a6850 con 0x5566554aafd0 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.872+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554aafd0 0x5566554a6080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5566554bc550 tx=0x7f8c5009bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c24e1a0e220f6d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.872+0000 7f8c4b400640 1 -- 172.21.15.82:0/2453204035 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5006a070 con 0x5566554aafd0 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.872+0000 7f8c4b400640 1 -- 172.21.15.82:0/2453204035 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c5009c7e0 con 0x5566554aafd0 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.872+0000 7f8c4b400640 1 -- 172.21.15.82:0/2453204035 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50020040 con 0x5566554aafd0 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 -- 172.21.15.82:0/2453204035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554aafd0 msgr2=0x5566554a6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554aafd0 0x5566554a6080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5566554bc550 tx=0x7f8c5009bfb0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 -- 172.21.15.82:0/2453204035 shutdown_connections 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554b4760 0x5566554b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b3d70 0x5566554c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 --2- 172.21.15.82:0/2453204035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554aafd0 0x5566554a6080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 -- 172.21.15.82:0/2453204035 >> 172.21.15.82:0/2453204035 conn(0x5566554bd760 msgr2=0x5566554aa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 -- 172.21.15.82:0/2453204035 shutdown_connections 2024-04-26T20:22:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 -- 172.21.15.82:0/2453204035 wait complete. 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 -- start start 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.873+0000 7f8c687f4740 1 Processor -- start 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 0x5566554c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b3d70 0x5566554c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b4760 0x5566554c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601a7010 con 0x5566554aafd0 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601aa4a0 con 0x5566554b4760 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601a7680 con 0x5566554b3d70 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c687f4740 10 client.0 _ll_register_callbacks cb 0x7f8c4c009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 0x5566554c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c5ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 0x5566554c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42988/0 (socket says 172.21.15.82:42988) 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c5ea00640 1 -- 172.21.15.82:0/4267250413 learned_addr learned my addr 172.21.15.82:0/4267250413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c5f400640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b4760 0x5566554c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.874+0000 7f8c5e000640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b3d70 0x5566554c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c5ea00640 1 -- 172.21.15.82:0/4267250413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b3d70 msgr2=0x5566554c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b3d70 0x5566554c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c5ea00640 1 -- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b4760 msgr2=0x5566554c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b4760 0x5566554c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c5ea00640 1 -- 172.21.15.82:0/4267250413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566550e50f0 con 0x5566554aafd0 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c5ea00640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 0x5566554c2ae0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c50098540 tx=0x7f8c500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e4e38da89ca0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c48c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:22:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c48c00640 1 -- 172.21.15.82:0/4267250413 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50020050 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c48c00640 1 -- 172.21.15.82:0/4267250413 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8c5009a180 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5009c7e0 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c48c00640 1 -- 172.21.15.82:0/4267250413 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c5006a070 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.875+0000 7f8c687f4740 10 client.15504 fetch_fsmap learned FSMap version 29 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566553dba30 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c48c00640 1 -- 172.21.15.82:0/4267250413 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c50064080 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c48c00640 1 -- 172.21.15.82:0/4267250413 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c50098750 con 0x5566554aafd0 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 10 client.15504 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:22:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 20 client.15504 populate_metadata read hostname 'smithi082' 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554b98d0 0x556655532110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 4 client.15504 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.876+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556655396360 con 0x5566554b98d0 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.877+0000 7f8c5e000640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554b98d0 0x556655532110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.877+0000 7f8c5e000640 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554b98d0 0x556655532110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=895374b5e6db3704 server_cookie=2581341af5038a93 in_seq=0 out_seq=0 2024-04-26T20:22:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.877+0000 7f8c48c00640 10 client.15504 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c48c00640 1 -- 172.21.15.82:0/4267250413 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556655396360 con 0x5566554b98d0 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c48c00640 10 client.15504 handle_command_reply: tid=0 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 client.15504 shutdown 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 msgr2=0x5566554c2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 0x5566554c2ae0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c50098540 tx=0x7f8c500046c0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 shutdown_connections 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5566554b98d0 0x556655532110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566554b4760 0x5566554c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566554b3d70 0x5566554c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c48c00640 0 client.15504 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:22:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 --2- 172.21.15.82:0/4267250413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566554aafd0 0x5566554c2ae0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 >> 172.21.15.82:0/4267250413 conn(0x5566554bd760 msgr2=0x5566554adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 shutdown_connections 2024-04-26T20:22:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 1 -- 172.21.15.82:0/4267250413 wait complete. 2024-04-26T20:22:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.878+0000 7f8c687f4740 20 client.15504 trim_cache size 0 max 16384 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: "032a4c3b-8878-40cf-b0f7-230e87a83f94": { 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "032a4c3b-8878-40cf-b0f7-230e87a83f94", 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:22:59.890 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c440a3c40 msgr2=0x7f8c440a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c440a3c40 0x7f8c440a6100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8c5802abe0 tx=0x7f8c58005fd0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 msgr2=0x7f8c60198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 0x7f8c60198a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000d770 tx=0x7f8c5000db70 comp rx=0 tx=0).stop 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 shutdown_connections 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8c440a3c40 0x7f8c440a6100 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c60104410 0x7f8c6019ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103a50 0x7f8c60198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 --2- 172.21.15.82:0/2154578837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8c60102860 0x7f8c60198a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 >> 172.21.15.82:0/2154578837 conn(0x7f8c600fddd0 msgr2=0x7f8c60106dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 shutdown_connections 2024-04-26T20:22:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:22:59.879+0000 7f8c5fe00640 1 -- 172.21.15.82:0/2154578837 wait complete. 2024-04-26T20:22:59.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:59 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3470346846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:22:59.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:22:59 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3026839019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:22:59.902 INFO:tasks.cephfs.filesystem:scrub status for tag:032a4c3b-8878-40cf-b0f7-230e87a83f94 - {'path': '/', 'tag': '032a4c3b-8878-40cf-b0f7-230e87a83f94', 'options': 'recursive,force'} 2024-04-26T20:23:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:59 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3470346846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:23:00.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:22:59 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3026839019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:23:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:59 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3470346846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:23:00.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:22:59 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3026839019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:23:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:00 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:23:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:00 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:00 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:23:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:00 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:00 smithi139 ceph-mon[32999]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-26T20:23:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:00 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:23:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:00 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:00 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:23:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:00 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:01.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:00 smithi135 ceph-mon[32816]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-26T20:23:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:00 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:23:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:00 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:00 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:23:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:00 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:00 smithi082 ceph-mon[28105]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-26T20:23:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:03 smithi139 ceph-mon[32999]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:23:04.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:03 smithi135 ceph-mon[32816]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:23:04.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:03 smithi082 ceph-mon[28105]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 853 B/s wr, 11 op/s 2024-04-26T20:23:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:05 smithi139 ceph-mon[32999]: pgmap v420: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:23:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:05 smithi135 ceph-mon[32816]: pgmap v420: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:23:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:05 smithi082 ceph-mon[28105]: pgmap v420: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:23:07.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:07 smithi082 ceph-mon[28105]: pgmap v421: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 852 B/s wr, 10 op/s 2024-04-26T20:23:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:07 smithi139 ceph-mon[32999]: pgmap v421: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 852 B/s wr, 10 op/s 2024-04-26T20:23:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:07 smithi135 ceph-mon[32816]: pgmap v421: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 852 B/s wr, 10 op/s 2024-04-26T20:23:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:09 smithi082 ceph-mon[28105]: pgmap v422: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 852 B/s wr, 12 op/s 2024-04-26T20:23:10.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:09 smithi139 ceph-mon[32999]: pgmap v422: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 852 B/s wr, 12 op/s 2024-04-26T20:23:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:09 smithi135 ceph-mon[32816]: pgmap v422: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 852 B/s wr, 12 op/s 2024-04-26T20:23:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:11 smithi139 ceph-mon[32999]: pgmap v423: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 9 op/s 2024-04-26T20:23:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:11 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:23:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:11 smithi135 ceph-mon[32816]: pgmap v423: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 9 op/s 2024-04-26T20:23:12.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:11 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:23:12.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:11 smithi082 ceph-mon[28105]: pgmap v423: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 9 op/s 2024-04-26T20:23:12.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:11 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:23:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 -- 172.21.15.82:0/2658883427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 msgr2=0x7f6e0c10ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 --2- 172.21.15.82:0/2658883427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c10ce30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009ca0 tx=0x7f6e0402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 -- 172.21.15.82:0/2658883427 shutdown_connections 2024-04-26T20:23:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 --2- 172.21.15.82:0/2658883427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c10ce30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 --2- 172.21.15.82:0/2658883427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c106060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 --2- 172.21.15.82:0/2658883427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e0c1049f0 0x7f6e0c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.561+0000 7f6e11800640 1 -- 172.21.15.82:0/2658883427 >> 172.21.15.82:0/2658883427 conn(0x7f6e0c0fffa0 msgr2=0x7f6e0c1023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.562+0000 7f6e11800640 1 -- 172.21.15.82:0/2658883427 shutdown_connections 2024-04-26T20:23:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.562+0000 7f6e11800640 1 -- 172.21.15.82:0/2658883427 wait complete. 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.562+0000 7f6e11800640 1 Processor -- start 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 -- start start 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e0c1049f0 0x7f6e0c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c1a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c110570 con 0x7f6e0c1049f0 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1103f0 con 0x7f6e0c1065a0 2024-04-26T20:23:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e11800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1106f0 con 0x7f6e0c105be0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e10e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c1a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c19b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49482/0 (socket says 172.21.15.82:49482) 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e0b400640 1 -- 172.21.15.82:0/484709758 learned_addr learned my addr 172.21.15.82:0/484709758 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.563+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e0c1049f0 0x7f6e0c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e0b400640 1 -- 172.21.15.82:0/484709758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 msgr2=0x7f6e0c1a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e0b400640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c1a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e0b400640 1 -- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e0c1049f0 msgr2=0x7f6e0c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e0b400640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e0c1049f0 0x7f6e0c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e0b400640 1 -- 172.21.15.82:0/484709758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c1a2800 con 0x7f6e0c105be0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e10e00640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e0b400640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c19b120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6df800e9f0 tx=0x7f6df800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e08c00640 1 -- 172.21.15.82:0/484709758 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df800cd80 con 0x7f6e0c105be0 2024-04-26T20:23:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e08c00640 1 -- 172.21.15.82:0/484709758 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6df80054d0 con 0x7f6e0c105be0 2024-04-26T20:23:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c1a2af0 con 0x7f6e0c105be0 2024-04-26T20:23:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.564+0000 7f6e08c00640 1 -- 172.21.15.82:0/484709758 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8010690 con 0x7f6e0c105be0 2024-04-26T20:23:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.565+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c1a2ff0 con 0x7f6e0c105be0 2024-04-26T20:23:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 Processor -- start 2024-04-26T20:23:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 -- start start 2024-04-26T20:23:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751550de0 0x558751551200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x5587515562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751556940 0x558751558dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5587514b5380 con 0x558751556940 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558751451c30 con 0x558751550de0 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e15b94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5587514b1340 con 0x5587515517d0 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e08c00640 1 -- 172.21.15.82:0/484709758 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6df8004e90 con 0x7f6e0c105be0 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.568+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x5587515562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x5587515562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49492/0 (socket says 172.21.15.82:49492) 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751550de0 0x558751551200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e0be00640 1 -- 172.21.15.82:0/1141310354 learned_addr learned my addr 172.21.15.82:0/1141310354 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751556940 0x558751558dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 -- 172.21.15.82:0/1141310354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 msgr2=0x5587515562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x5587515562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 -- 172.21.15.82:0/1141310354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751556940 msgr2=0x558751558dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751556940 0x558751558dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 -- 172.21.15.82:0/1141310354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558751473940 con 0x558751550de0 2024-04-26T20:23:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e0be00640 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x5587515562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751556940 0x558751558dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.569+0000 7f6e10e00640 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751550de0 0x558751551200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e0402ade0 tx=0x7f6e04009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e90deca380c12f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e01600640 1 -- 172.21.15.82:0/1141310354 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04031450 con 0x558751550de0 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e01600640 1 -- 172.21.15.82:0/1141310354 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e04036040 con 0x558751550de0 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e01600640 1 -- 172.21.15.82:0/1141310354 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04004550 con 0x558751550de0 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e08c00640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6df00a3c30 0x7f6df00a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e08c00640 1 -- 172.21.15.82:0/484709758 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6df80d0ce0 con 0x7f6e0c105be0 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e0be00640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6df00a3c30 0x7f6df00a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e15b94740 1 -- 172.21.15.82:0/1141310354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751550de0 msgr2=0x558751551200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751550de0 0x558751551200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e0402ade0 tx=0x7f6e04009360 comp rx=0 tx=0).stop 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e15b94740 1 -- 172.21.15.82:0/1141310354 shutdown_connections 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751556940 0x558751558dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x5587515562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.570+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1141310354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751550de0 0x558751551200 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.571+0000 7f6e15b94740 1 -- 172.21.15.82:0/1141310354 >> 172.21.15.82:0/1141310354 conn(0x55875154c450 msgr2=0x55875154c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.571+0000 7f6e15b94740 1 -- 172.21.15.82:0/1141310354 shutdown_connections 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.571+0000 7f6e15b94740 1 -- 172.21.15.82:0/1141310354 wait complete. 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.571+0000 7f6e0be00640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6df00a3c30 0x7f6df00a60f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55875154d3c0 tx=0x7f6dfc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.571+0000 7f6e15b94740 1 -- start start 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.571+0000 7f6e15b94740 1 Processor -- start 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751550de0 0x55875155aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x55875155b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751556940 0x558751562420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558751559710 con 0x558751550de0 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55875143cc60 con 0x558751556940 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558751559890 con 0x5587515517d0 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e15b94740 10 client.0 _ll_register_callbacks cb 0x558751468e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751550de0 0x55875155aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x55875155b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751550de0 0x55875155aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34408/0 (socket says 172.21.15.82:34408) 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e0be00640 1 -- 172.21.15.82:0/1009414574 learned_addr learned my addr 172.21.15.82:0/1009414574 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.572+0000 7f6e10e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751556940 0x558751562420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e0b400640 1 -- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751556940 msgr2=0x558751562420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751556940 0x558751562420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e0b400640 1 -- 172.21.15.82:0/1009414574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751550de0 msgr2=0x55875155aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751550de0 0x55875155aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e0b400640 1 -- 172.21.15.82:0/1009414574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55875144b510 con 0x5587515517d0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x55875155b3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6df80ce330 tx=0x7f6df8098da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a63cdb8331f3d8e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6df6000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6df6000640 1 -- 172.21.15.82:0/1009414574 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df809c460 con 0x5587515517d0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6df6000640 1 -- 172.21.15.82:0/1009414574 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6df80ce580 con 0x5587515517d0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e04036040 con 0x5587515517d0 2024-04-26T20:23:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6df6000640 1 -- 172.21.15.82:0/1009414574 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6df8005180 con 0x5587515517d0 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e15b94740 10 client.25639 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.573+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587511c7210 con 0x5587515517d0 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6df6000640 1 -- 172.21.15.82:0/1009414574 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e04036040 con 0x5587515517d0 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6df6000640 1 -- 172.21.15.82:0/1009414574 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6df80a52e0 con 0x5587515517d0 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e15b94740 10 client.25639 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e15b94740 10 client.25639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e15b94740 20 client.25639 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751566a80 0x558751568e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e15b94740 4 client.25639 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587514c2f90 con 0x558751566a80 2024-04-26T20:23:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.574+0000 7f6e0be00640 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751566a80 0x558751568e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.575+0000 7f6e0be00640 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751566a80 0x558751568e70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f49470b8a8b15cf server_cookie=f5e2b42795bc1845 in_seq=0 out_seq=0 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.575+0000 7f6df6000640 10 client.25639 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6df6000640 1 -- 172.21.15.82:0/1009414574 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5587514c2f90 con 0x558751566a80 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6df6000640 10 client.25639 handle_command_reply: tid=0 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 client.25639 shutdown 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 msgr2=0x55875155b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x55875155b3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6df80ce330 tx=0x7f6df8098da0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 shutdown_connections 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751566a80 0x558751568e70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558751556940 0x558751562420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6df6000640 0 client.25639 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587515517d0 0x55875155b3e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1009414574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751550de0 0x55875155aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.576+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 >> 172.21.15.82:0/1009414574 conn(0x55875154c450 msgr2=0x55875154b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.577+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 shutdown_connections 2024-04-26T20:23:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.577+0000 7f6e15b94740 1 -- 172.21.15.82:0/1009414574 wait complete. 2024-04-26T20:23:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.577+0000 7f6e15b94740 20 client.25639 trim_cache size 0 max 16384 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 Processor -- start 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 -- start start 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x5587515472d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x55875154fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1ad280 con 0x55875154c450 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1aedc0 con 0x5587515517d0 2024-04-26T20:23:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.593+0000 7f6e15b94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1ad950 con 0x558751550de0 2024-04-26T20:23:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x5587515472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49510/0 (socket says 172.21.15.82:49510) 2024-04-26T20:23:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 -- 172.21.15.82:0/3993415470 learned_addr learned my addr 172.21.15.82:0/3993415470 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e10e00640 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x55875154fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 -- 172.21.15.82:0/3993415470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 msgr2=0x55875154fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x55875154fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 -- 172.21.15.82:0/3993415470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 msgr2=0x5587515472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x5587515472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 -- 172.21.15.82:0/3993415470 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587515691e0 con 0x558751550de0 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.594+0000 7f6e0b400640 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515623e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6df800cfd0 tx=0x7f6df8005680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f45814e3b4404ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e00c00640 1 -- 172.21.15.82:0/3993415470 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df809c460 con 0x558751550de0 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e00c00640 1 -- 172.21.15.82:0/3993415470 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6df80d44c0 con 0x558751550de0 2024-04-26T20:23:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e00c00640 1 -- 172.21.15.82:0/3993415470 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df809c8d0 con 0x558751550de0 2024-04-26T20:23:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 -- 172.21.15.82:0/3993415470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 msgr2=0x5587515623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515623e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6df800cfd0 tx=0x7f6df8005680 comp rx=0 tx=0).stop 2024-04-26T20:23:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 -- 172.21.15.82:0/3993415470 shutdown_connections 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x55875154fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515623e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 --2- 172.21.15.82:0/3993415470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x5587515472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.595+0000 7f6e15b94740 1 -- 172.21.15.82:0/3993415470 >> 172.21.15.82:0/3993415470 conn(0x558751556410 msgr2=0x55875154f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.596+0000 7f6e15b94740 1 -- 172.21.15.82:0/3993415470 shutdown_connections 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.596+0000 7f6e15b94740 1 -- 172.21.15.82:0/3993415470 wait complete. 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.596+0000 7f6e15b94740 1 -- start start 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.596+0000 7f6e15b94740 1 Processor -- start 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x558751560270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x558751561750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1ae6f0 con 0x55875154c450 2024-04-26T20:23:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1ae020 con 0x5587515517d0 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1ab260 con 0x558751550de0 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e15b94740 10 client.0 _ll_register_callbacks cb 0x7f6df800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x558751560270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49514/0 (socket says 172.21.15.82:49514) 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0b400640 1 -- 172.21.15.82:0/1290990045 learned_addr learned my addr 172.21.15.82:0/1290990045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e10e00640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x558751561750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0be00640 1 -- 172.21.15.82:0/1290990045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 msgr2=0x5587515607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0be00640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0be00640 1 -- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 msgr2=0x558751561750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0be00640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x558751561750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0be00640 1 -- 172.21.15.82:0/1290990045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558751293620 con 0x55875154c450 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.597+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6e0be00640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x558751560270 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5587515696d0 tx=0x7f6dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3d6eaf2f67e5f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6df6000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6df6000640 1 -- 172.21.15.82:0/1290990045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc01fb40 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6df6000640 1 -- 172.21.15.82:0/1290990045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6dfc01fce0 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587514bce00 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6df6000640 1 -- 172.21.15.82:0/1290990045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6dfc03c050 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6e15b94740 10 client.15522 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55875146fcb0 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.598+0000 7f6df6000640 1 -- 172.21.15.82:0/1290990045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5587514bce00 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6df6000640 1 -- 172.21.15.82:0/1290990045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6dfc003a80 con 0x55875154c450 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e15b94740 10 client.15522 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e15b94740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e15b94740 20 client.15522 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751556940 0x5587515cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e15b94740 4 client.15522 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:23:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5587514384b0 con 0x558751556940 2024-04-26T20:23:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.599+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751556940 0x5587515cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.600+0000 7f6e0b400640 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751556940 0x5587515cfde0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cabbd9d8badbd45 server_cookie=a42ed36a6bbb103d in_seq=0 out_seq=0 2024-04-26T20:23:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.600+0000 7f6df6000640 10 client.15522 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6df6000640 1 -- 172.21.15.82:0/1290990045 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5587514384b0 con 0x558751556940 2024-04-26T20:23:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6df6000640 10 client.15522 handle_command_reply: tid=0 2024-04-26T20:23:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 client.15522 shutdown 2024-04-26T20:23:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 msgr2=0x558751560270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x558751560270 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5587515696d0 tx=0x7f6dfc0046c0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 shutdown_connections 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x558751556940 0x5587515cfde0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587515517d0 0x558751561750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558751550de0 0x5587515607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 --2- 172.21.15.82:0/1290990045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875154c450 0x558751560270 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6df6000640 0 client.15522 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.613+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 >> 172.21.15.82:0/1290990045 conn(0x558751556410 msgr2=0x55875154adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.614+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 shutdown_connections 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.614+0000 7f6e15b94740 1 -- 172.21.15.82:0/1290990045 wait complete. 2024-04-26T20:23:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.614+0000 7f6e15b94740 20 client.15522 trim_cache size 0 max 16384 2024-04-26T20:23:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:23:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:23:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:23:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6df00a3c30 msgr2=0x7f6df00a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6df00a3c30 0x7f6df00a60f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55875154d3c0 tx=0x7f6dfc005f90 comp rx=0 tx=0).stop 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 msgr2=0x7f6e0c19b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c19b120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6df800e9f0 tx=0x7f6df800edf0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 shutdown_connections 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f6df00a3c30 0x7f6df00a60f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e0c1065a0 0x7f6e0c1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e0c105be0 0x7f6e0c19b120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 --2- 172.21.15.82:0/484709758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e0c1049f0 0x7f6e0c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 >> 172.21.15.82:0/484709758 conn(0x7f6e0c0fffa0 msgr2=0x7f6e0c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 shutdown_connections 2024-04-26T20:23:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:12.615+0000 7f6e11800640 1 -- 172.21.15.82:0/484709758 wait complete. 2024-04-26T20:23:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:13 smithi139 ceph-mon[32999]: pgmap v424: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 11 op/s 2024-04-26T20:23:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:13 smithi135 ceph-mon[32816]: pgmap v424: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 11 op/s 2024-04-26T20:23:14.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:13 smithi082 ceph-mon[28105]: pgmap v424: 129 pgs: 129 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 11 op/s 2024-04-26T20:23:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:15 smithi139 ceph-mon[32999]: pgmap v425: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T20:23:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:15 smithi135 ceph-mon[32816]: pgmap v425: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T20:23:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:15 smithi082 ceph-mon[28105]: pgmap v425: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-26T20:23:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:17 smithi139 ceph-mon[32999]: pgmap v426: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-26T20:23:18.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:17 smithi135 ceph-mon[32816]: pgmap v426: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-26T20:23:18.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:17 smithi082 ceph-mon[28105]: pgmap v426: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-26T20:23:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:19 smithi139 ceph-mon[32999]: pgmap v427: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 16 op/s 2024-04-26T20:23:20.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:19 smithi135 ceph-mon[32816]: pgmap v427: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 16 op/s 2024-04-26T20:23:20.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:19 smithi082 ceph-mon[28105]: pgmap v427: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 16 op/s 2024-04-26T20:23:21.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:20 smithi139 ceph-mon[32999]: pgmap v428: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T20:23:21.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:20 smithi135 ceph-mon[32816]: pgmap v428: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T20:23:21.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:20 smithi082 ceph-mon[28105]: pgmap v428: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T20:23:24.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:23 smithi139 ceph-mon[32999]: pgmap v429: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-26T20:23:24.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:23 smithi135 ceph-mon[32816]: pgmap v429: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-26T20:23:24.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:23 smithi082 ceph-mon[28105]: pgmap v429: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-26T20:23:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 -- 172.21.15.82:0/2072983214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 msgr2=0x7f8dec111400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 --2- 172.21.15.82:0/2072983214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec111400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009860 tx=0x7f8de402a340 comp rx=0 tx=0).stop 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 -- 172.21.15.82:0/2072983214 shutdown_connections 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 --2- 172.21.15.82:0/2072983214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec111400 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 --2- 172.21.15.82:0/2072983214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dec10a1b0 0x7f8dec10a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 --2- 172.21.15.82:0/2072983214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dec108fc0 0x7f8dec1093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 -- 172.21.15.82:0/2072983214 >> 172.21.15.82:0/2072983214 conn(0x7f8dec077f80 msgr2=0x7f8dec07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 -- 172.21.15.82:0/2072983214 shutdown_connections 2024-04-26T20:23:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.758+0000 7f8df0e00640 1 -- 172.21.15.82:0/2072983214 wait complete. 2024-04-26T20:23:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 Processor -- start 2024-04-26T20:23:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 -- start start 2024-04-26T20:23:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dec108fc0 0x7f8dec19f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dec10a1b0 0x7f8dec19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec1a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec114b00 con 0x7f8dec10ab70 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec114980 con 0x7f8dec108fc0 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.759+0000 7f8df0e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec114c80 con 0x7f8dec10a1b0 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec1a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec1a66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59308/0 (socket says 172.21.15.82:59308) 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 -- 172.21.15.82:0/3882983018 learned_addr learned my addr 172.21.15.82:0/3882983018 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8de9e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dec108fc0 0x7f8dec19f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8de9400640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dec10a1b0 0x7f8dec19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 -- 172.21.15.82:0/3882983018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dec10a1b0 msgr2=0x7f8dec19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dec10a1b0 0x7f8dec19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 -- 172.21.15.82:0/3882983018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dec108fc0 msgr2=0x7f8dec19f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dec108fc0 0x7f8dec19f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 -- 172.21.15.82:0/3882983018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec1a6d20 con 0x7f8dec10ab70 2024-04-26T20:23:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.760+0000 7f8dea800640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec1a66b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8de40057c0 tx=0x7f8de4032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.761+0000 7f8de2a00640 1 -- 172.21.15.82:0/3882983018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4040020 con 0x7f8dec10ab70 2024-04-26T20:23:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.761+0000 7f8de2a00640 1 -- 172.21.15.82:0/3882983018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8de4030dd0 con 0x7f8dec10ab70 2024-04-26T20:23:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.761+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec1a6fb0 con 0x7f8dec10ab70 2024-04-26T20:23:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.761+0000 7f8de2a00640 1 -- 172.21.15.82:0/3882983018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4037040 con 0x7f8dec10ab70 2024-04-26T20:23:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.761+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec1a7470 con 0x7f8dec10ab70 2024-04-26T20:23:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.764+0000 7f8df3c5e740 1 Processor -- start 2024-04-26T20:23:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.764+0000 7f8de2a00640 1 -- 172.21.15.82:0/3882983018 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8de4043020 con 0x7f8dec10ab70 2024-04-26T20:23:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.764+0000 7f8df3c5e740 1 -- start start 2024-04-26T20:23:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd89cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fabd801380 con 0x55fabd89d5c0 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fabd79dc30 con 0x55fabd8a2730 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fabd7fd340 con 0x55fabd89cbd0 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8de9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8de9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd89cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8de9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8a20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59320/0 (socket says 172.21.15.82:59320) 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8de9e00640 1 -- 172.21.15.82:0/1303810151 learned_addr learned my addr 172.21.15.82:0/1303810151 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.765+0000 7f8de9400640 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9400640 1 -- 172.21.15.82:0/1303810151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 msgr2=0x55fabd8a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9400640 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9400640 1 -- 172.21.15.82:0/1303810151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 msgr2=0x55fabd8a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9400640 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8a20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9400640 1 -- 172.21.15.82:0/1303810151 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabd7bf940 con 0x55fabd89cbd0 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9e00640 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9400640 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd89cff0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009820 tx=0x7f8dd40097b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c1a56d47a0e322e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de2a00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8dd00a3d70 0x7f8dd00a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8ddb400640 1 -- 172.21.15.82:0/1303810151 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4004020 con 0x55fabd89cbd0 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8ddb400640 1 -- 172.21.15.82:0/1303810151 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd40054d0 con 0x55fabd89cbd0 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8ddb400640 1 -- 172.21.15.82:0/1303810151 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4004ac0 con 0x55fabd89cbd0 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de2a00640 1 -- 172.21.15.82:0/3882983018 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8de40f0420 con 0x7f8dec10ab70 2024-04-26T20:23:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.766+0000 7f8de9e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8dd00a3d70 0x7f8dd00a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 -- 172.21.15.82:0/1303810151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 msgr2=0x55fabd89cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd89cff0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009820 tx=0x7f8dd40097b0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8de9e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8dd00a3d70 0x7f8dd00a6230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55fabd89d9c0 tx=0x7f8ddc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 -- 172.21.15.82:0/1303810151 shutdown_connections 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/1303810151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd89cff0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 -- 172.21.15.82:0/1303810151 >> 172.21.15.82:0/1303810151 conn(0x55fabd898240 msgr2=0x55fabd898640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 -- 172.21.15.82:0/1303810151 shutdown_connections 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.767+0000 7f8df3c5e740 1 -- 172.21.15.82:0/1303810151 wait complete. 2024-04-26T20:23:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 -- start start 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 Processor -- start 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 0x55fabd8a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd8a2730 0x55fabd8ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fabd8a56e0 con 0x55fabd89cbd0 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fabd788c60 con 0x55fabd89d5c0 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fabd8a5860 con 0x55fabd8a2730 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8df3c5e740 10 client.0 _ll_register_callbacks cb 0x55fabd7b4e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.768+0000 7f8de9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 0x55fabd8a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 0x55fabd8a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59326/0 (socket says 172.21.15.82:59326) 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9e00640 1 -- 172.21.15.82:0/2279789641 learned_addr learned my addr 172.21.15.82:0/2279789641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8dea800640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd8a2730 0x55fabd8ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 -- 172.21.15.82:0/2279789641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd8a2730 msgr2=0x55fabd8ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd8a2730 0x55fabd8ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 -- 172.21.15.82:0/2279789641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 msgr2=0x55fabd8a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 0x55fabd8a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 -- 172.21.15.82:0/2279789641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabd797510 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9e00640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 0x55fabd8a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8de9400640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8a7330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009820 tx=0x7f8dd40044c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a450c720d549d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.769+0000 7f8dcfe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8dcfe00640 1 -- 172.21.15.82:0/2279789641 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402d060 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd40054d0 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8dcfe00640 1 -- 172.21.15.82:0/2279789641 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8dd4019040 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8dcfe00640 1 -- 172.21.15.82:0/2279789641 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dd4034050 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8df3c5e740 10 client.25634 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fabd513210 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.770+0000 7f8dcfe00640 1 -- 172.21.15.82:0/2279789641 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd40054d0 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8dcfe00640 1 -- 172.21.15.82:0/2279789641 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dd401d030 con 0x55fabd89d5c0 2024-04-26T20:23:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8df3c5e740 10 client.25634 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8df3c5e740 10 client.25634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8df3c5e740 20 client.25634 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd8b2630 0x55fabd8b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8df3c5e740 4 client.25634 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fabd80ef90 con 0x55fabd8b2630 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.771+0000 7f8de9e00640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd8b2630 0x55fabd8b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.772+0000 7f8de9e00640 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd8b2630 0x55fabd8b4a20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=650cd591c700e074 server_cookie=816fd774a597357d in_seq=0 out_seq=0 2024-04-26T20:23:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.772+0000 7f8dcfe00640 10 client.25634 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8dcfe00640 1 -- 172.21.15.82:0/2279789641 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fabd80ef90 con 0x55fabd8b2630 2024-04-26T20:23:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8dcfe00640 10 client.25634 handle_command_reply: tid=0 2024-04-26T20:23:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 client.25634 shutdown 2024-04-26T20:23:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 msgr2=0x55fabd8a7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8a7330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009820 tx=0x7f8dd40044c0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 shutdown_connections 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd8b2630 0x55fabd8b4a20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd8a2730 0x55fabd8ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8a7330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/2279789641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89cbd0 0x55fabd8a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8dcfe00640 0 client.25634 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 >> 172.21.15.82:0/2279789641 conn(0x55fabd898240 msgr2=0x55fabd897440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 shutdown_connections 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 1 -- 172.21.15.82:0/2279789641 wait complete. 2024-04-26T20:23:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.773+0000 7f8df3c5e740 20 client.25634 trim_cache size 0 max 16384 2024-04-26T20:23:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 Processor -- start 2024-04-26T20:23:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 -- start start 2024-04-26T20:23:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd893170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 0x55fabd89b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1b1990 con 0x55fabd8a2730 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1b34d0 con 0x55fabd89d5c0 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1b2060 con 0x55fabd89cbd0 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8dea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 0x55fabd89b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8dea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 0x55fabd89b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59340/0 (socket says 172.21.15.82:59340) 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8dea800640 1 -- 172.21.15.82:0/4156383484 learned_addr learned my addr 172.21.15.82:0/4156383484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.790+0000 7f8de9e00640 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd893170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8dea800640 1 -- 172.21.15.82:0/4156383484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 msgr2=0x55fabd893170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8de9400640 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8dea800640 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd893170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8dea800640 1 -- 172.21.15.82:0/4156383484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 msgr2=0x55fabd8ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8dea800640 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8dea800640 1 -- 172.21.15.82:0/4156383484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabd5df620 con 0x55fabd8a2730 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8de9400640 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8dea800640 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 0x55fabd89b100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009230 tx=0x7f8de4030f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bb6e24718b3e77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8ddaa00640 1 -- 172.21.15.82:0/4156383484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de40d5070 con 0x55fabd8a2730 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8ddaa00640 1 -- 172.21.15.82:0/4156383484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8de40bc350 con 0x55fabd8a2730 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.791+0000 7f8ddaa00640 1 -- 172.21.15.82:0/4156383484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de40edcc0 con 0x55fabd8a2730 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 -- 172.21.15.82:0/4156383484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 msgr2=0x55fabd89b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 0x55fabd89b100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009230 tx=0x7f8de4030f80 comp rx=0 tx=0).stop 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 -- 172.21.15.82:0/4156383484 shutdown_connections 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd8a2730 0x55fabd89b100 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd89d5c0 0x55fabd8ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/4156383484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd893170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 -- 172.21.15.82:0/4156383484 >> 172.21.15.82:0/4156383484 conn(0x55fabd898240 msgr2=0x55fabd89e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 -- 172.21.15.82:0/4156383484 shutdown_connections 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 -- 172.21.15.82:0/4156383484 wait complete. 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.792+0000 7f8df3c5e740 1 -- start start 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 Processor -- start 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd8abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8ac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1b2e00 con 0x55fabd89d5c0 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1b2730 con 0x55fabd8a2730 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1af970 con 0x55fabd89cbd0 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8df3c5e740 10 client.0 _ll_register_callbacks cb 0x7f8ddc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8de9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8de9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59342/0 (socket says 172.21.15.82:59342) 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8de9400640 1 -- 172.21.15.82:0/558034161 learned_addr learned my addr 172.21.15.82:0/558034161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8de9e00640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd8abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.793+0000 7f8dea800640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8de9400640 1 -- 172.21.15.82:0/558034161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 msgr2=0x55fabd8abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8de9400640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd8abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8de9400640 1 -- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 msgr2=0x55fabd8ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8de9400640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8de9400640 1 -- 172.21.15.82:0/558034161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabd7bbcb0 con 0x55fabd89d5c0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8de9400640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8ac440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40058c0 tx=0x7f8dd40043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7f0609e8d0a2c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8dcfe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8dcfe00640 1 -- 172.21.15.82:0/558034161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402d070 con 0x55fabd89d5c0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8de40bc350 con 0x55fabd89d5c0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.794+0000 7f8dcfe00640 1 -- 172.21.15.82:0/558034161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8dd4009e40 con 0x55fabd89d5c0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8dcfe00640 1 -- 172.21.15.82:0/558034161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dd4040050 con 0x55fabd89d5c0 2024-04-26T20:23:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 10 client.15540 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fabd918e40 con 0x55fabd89d5c0 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8dcfe00640 1 -- 172.21.15.82:0/558034161 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8de40bc350 con 0x55fabd89d5c0 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8dcfe00640 1 -- 172.21.15.82:0/558034161 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dd401d040 con 0x55fabd89d5c0 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 10 client.15540 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 20 client.15540 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd919810 0x55fabd91bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 4 client.15540 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.795+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fabd808e00 con 0x55fabd919810 2024-04-26T20:23:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.796+0000 7f8de9e00640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd919810 0x55fabd91bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.796+0000 7f8de9e00640 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd919810 0x55fabd91bc30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b2ace894213c34 server_cookie=8527e2fe66b1eb8c in_seq=0 out_seq=0 2024-04-26T20:23:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.796+0000 7f8dcfe00640 10 client.15540 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8dcfe00640 1 -- 172.21.15.82:0/558034161 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fabd808e00 con 0x55fabd919810 2024-04-26T20:23:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8dcfe00640 10 client.15540 handle_command_reply: tid=0 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 client.15540 shutdown 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 msgr2=0x55fabd8ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8ac440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40058c0 tx=0x7f8dd40043a0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 shutdown_connections 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fabd919810 0x55fabd91bc30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fabd8a2730 0x55fabd8ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fabd89d5c0 0x55fabd8ac440 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 --2- 172.21.15.82:0/558034161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fabd89cbd0 0x55fabd8abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8dcfe00640 0 client.15540 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 >> 172.21.15.82:0/558034161 conn(0x55fabd898240 msgr2=0x55fabd89b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 shutdown_connections 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 1 -- 172.21.15.82:0/558034161 wait complete. 2024-04-26T20:23:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.803+0000 7f8df3c5e740 20 client.15540 trim_cache size 0 max 16384 2024-04-26T20:23:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:23:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:23:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:23:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8dd00a3d70 msgr2=0x7f8dd00a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8dd00a3d70 0x7f8dd00a6230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55fabd89d9c0 tx=0x7f8ddc009500 comp rx=0 tx=0).stop 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 msgr2=0x7f8dec1a66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec1a66b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8de40057c0 tx=0x7f8de4032da0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 shutdown_connections 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8dd00a3d70 0x7f8dd00a6230 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dec10ab70 0x7f8dec1a66b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dec10a1b0 0x7f8dec19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 --2- 172.21.15.82:0/3882983018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dec108fc0 0x7f8dec19f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:25.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 >> 172.21.15.82:0/3882983018 conn(0x7f8dec077f80 msgr2=0x7f8dec10d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:25.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 shutdown_connections 2024-04-26T20:23:25.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:25.804+0000 7f8df0e00640 1 -- 172.21.15.82:0/3882983018 wait complete. 2024-04-26T20:23:26.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:25 smithi139 ceph-mon[32999]: pgmap v430: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-26T20:23:26.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:25 smithi135 ceph-mon[32816]: pgmap v430: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-26T20:23:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:25 smithi082 ceph-mon[28105]: pgmap v430: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-26T20:23:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:27 smithi139 ceph-mon[32999]: pgmap v431: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-26T20:23:28.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:27 smithi135 ceph-mon[32816]: pgmap v431: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-26T20:23:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:27 smithi082 ceph-mon[28105]: pgmap v431: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-26T20:23:29.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:23:29.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:23:29.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:29 smithi082 ceph-mon[28105]: pgmap v432: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 511 B/s wr, 12 op/s 2024-04-26T20:23:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:29 smithi139 ceph-mon[32999]: pgmap v432: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 511 B/s wr, 12 op/s 2024-04-26T20:23:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:29 smithi135 ceph-mon[32816]: pgmap v432: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 511 B/s wr, 12 op/s 2024-04-26T20:23:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 -- 172.21.15.82:0/204741895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48105d80 msgr2=0x7f5f48106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 --2- 172.21.15.82:0/204741895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48105d80 0x7f5f48106200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009860 tx=0x7f5f3402a340 comp rx=0 tx=0).stop 2024-04-26T20:23:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 -- 172.21.15.82:0/204741895 shutdown_connections 2024-04-26T20:23:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 --2- 172.21.15.82:0/204741895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f4810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 --2- 172.21.15.82:0/204741895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48105d80 0x7f5f48106200 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 --2- 172.21.15.82:0/204741895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f48104b90 0x7f5f48104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 -- 172.21.15.82:0/204741895 >> 172.21.15.82:0/204741895 conn(0x7f5f481000e0 msgr2=0x7f5f48102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 -- 172.21.15.82:0/204741895 shutdown_connections 2024-04-26T20:23:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.126+0000 7f5f4e400640 1 -- 172.21.15.82:0/204741895 wait complete. 2024-04-26T20:23:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 Processor -- start 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 -- start start 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 0x7f5f4819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f48105d80 0x7f5f4819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f481a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481106c0 con 0x7f5f48106740 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48110540 con 0x7f5f48104b90 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.127+0000 7f5f4e400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48110840 con 0x7f5f48105d80 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f481a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 0x7f5f4819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f481a2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59360/0 (socket says 172.21.15.82:59360) 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 -- 172.21.15.82:0/2157501092 learned_addr learned my addr 172.21.15.82:0/2157501092 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 0x7f5f4819adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39940/0 (socket says 172.21.15.82:39940) 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f48105d80 0x7f5f4819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 -- 172.21.15.82:0/2157501092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f48105d80 msgr2=0x7f5f4819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f48105d80 0x7f5f4819b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 -- 172.21.15.82:0/2157501092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 msgr2=0x7f5f4819adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 0x7f5f4819adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 -- 172.21.15.82:0/2157501092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f481a29e0 con 0x7f5f48106740 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 0x7f5f4819adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.128+0000 7f5f47e00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f481a2370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000eb10 tx=0x7f5f4000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.129+0000 7f5f3fe00640 1 -- 172.21.15.82:0/2157501092 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000ce20 con 0x7f5f48106740 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.129+0000 7f5f3fe00640 1 -- 172.21.15.82:0/2157501092 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f40005020 con 0x7f5f48106740 2024-04-26T20:23:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.129+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f481a2cd0 con 0x7f5f48106740 2024-04-26T20:23:30.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.129+0000 7f5f3fe00640 1 -- 172.21.15.82:0/2157501092 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40010690 con 0x7f5f48106740 2024-04-26T20:23:30.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.129+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481a31a0 con 0x7f5f48106740 2024-04-26T20:23:30.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.132+0000 7f5f513db740 1 Processor -- start 2024-04-26T20:23:30.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.132+0000 7f5f3fe00640 1 -- 172.21.15.82:0/2157501092 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5f40005510 con 0x7f5f48106740 2024-04-26T20:23:30.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.132+0000 7f5f513db740 1 -- start start 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f513db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e293bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f513db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e298c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f513db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e29b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f513db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c1e1a4030 con 0x561c1e294180 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f513db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561c1e1bf7f0 con 0x561c1e2992f0 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f513db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561c1e17a7e0 con 0x561c1e293790 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f47400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e298c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f47400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e298c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59376/0 (socket says 172.21.15.82:59376) 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f47400640 1 -- 172.21.15.82:0/2440494408 learned_addr learned my addr 172.21.15.82:0/2440494408 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e293bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.133+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e29b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f47400640 1 -- 172.21.15.82:0/2440494408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 msgr2=0x561c1e293bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f47400640 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e293bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f47400640 1 -- 172.21.15.82:0/2440494408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 msgr2=0x561c1e29b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f47400640 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e29b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f47400640 1 -- 172.21.15.82:0/2440494408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1e186050 con 0x561c1e294180 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e29b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f3fe00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f2c0a3c40 0x7f5f2c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f47400640 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e298c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5f380114f0 tx=0x7f5f380119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9176ae45c7b94c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f3fe00640 1 -- 172.21.15.82:0/2157501092 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5f400d0e80 con 0x7f5f48106740 2024-04-26T20:23:30.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f2c0a3c40 0x7f5f2c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f3cc00640 1 -- 172.21.15.82:0/2440494408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3801e070 con 0x561c1e294180 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f3cc00640 1 -- 172.21.15.82:0/2440494408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f3800f680 con 0x561c1e294180 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.134+0000 7f5f3cc00640 1 -- 172.21.15.82:0/2440494408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f380037f0 con 0x561c1e294180 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 -- 172.21.15.82:0/2440494408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 msgr2=0x561c1e298c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f2c0a3c40 0x7f5f2c0a6100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000c00 tx=0x7f5f3402a340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e298c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5f380114f0 tx=0x7f5f380119b0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 -- 172.21.15.82:0/2440494408 shutdown_connections 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e29b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e298c80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 --2- 172.21.15.82:0/2440494408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e293bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 -- 172.21.15.82:0/2440494408 >> 172.21.15.82:0/2440494408 conn(0x561c1e28edb0 msgr2=0x561c1e28f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 -- 172.21.15.82:0/2440494408 shutdown_connections 2024-04-26T20:23:30.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.135+0000 7f5f513db740 1 -- 172.21.15.82:0/2440494408 wait complete. 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 -- start start 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 Processor -- start 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e29d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e29dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e2a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c1e1fc200 con 0x561c1e294180 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561c1e1f6ee0 con 0x561c1e2992f0 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561c1e203e70 con 0x561c1e293790 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.136+0000 7f5f513db740 10 client.0 _ll_register_callbacks cb 0x561c1e1ed270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e2a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f46a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e29dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e2a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39950/0 (socket says 172.21.15.82:39950) 2024-04-26T20:23:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 -- 172.21.15.82:0/296217555 learned_addr learned my addr 172.21.15.82:0/296217555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47400640 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e29d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 -- 172.21.15.82:0/296217555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 msgr2=0x561c1e29d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e29d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 -- 172.21.15.82:0/296217555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 msgr2=0x561c1e29dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e29dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 -- 172.21.15.82:0/296217555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c1dfd37d0 con 0x561c1e2992f0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f47e00640 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e2a4b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f400a5380 tx=0x7f5f4009cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90313b07df7287c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f31600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.137+0000 7f5f31600640 1 -- 172.21.15.82:0/296217555 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f400ce6c0 con 0x561c1e2992f0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f31600640 1 -- 172.21.15.82:0/296217555 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5f40087040 con 0x561c1e2992f0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f3800f680 con 0x561c1e2992f0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f31600640 1 -- 172.21.15.82:0/296217555 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5f400bd070 con 0x561c1e2992f0 2024-04-26T20:23:30.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f513db740 10 client.25646 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c1df093f0 con 0x561c1e2992f0 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f31600640 1 -- 172.21.15.82:0/296217555 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f3800f680 con 0x561c1e2992f0 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.138+0000 7f5f31600640 1 -- 172.21.15.82:0/296217555 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5f40098990 con 0x561c1e2992f0 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f513db740 10 client.25646 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f513db740 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f513db740 20 client.25646 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f513db740 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e2a9000 0x561c1e2ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f513db740 4 client.25646 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c1e2057e0 con 0x561c1e2a9000 2024-04-26T20:23:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.139+0000 7f5f47400640 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e2a9000 0x561c1e2ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.140+0000 7f5f47400640 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e2a9000 0x561c1e2ab450 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358d201832388ad0 server_cookie=6603eb59fe92c6e7 in_seq=0 out_seq=0 2024-04-26T20:23:30.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.140+0000 7f5f31600640 10 client.25646 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:30.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.140+0000 7f5f31600640 1 -- 172.21.15.82:0/296217555 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561c1e2057e0 con 0x561c1e2a9000 2024-04-26T20:23:30.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.140+0000 7f5f31600640 10 client.25646 handle_command_reply: tid=0 2024-04-26T20:23:30.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 client.25646 shutdown 2024-04-26T20:23:30.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 msgr2=0x561c1e2a4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e2a4b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f400a5380 tx=0x7f5f4009cd00 comp rx=0 tx=0).stop 2024-04-26T20:23:30.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 shutdown_connections 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e2a9000 0x561c1e2ab450 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e2992f0 0x561c1e2a4b10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e29dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f31600640 0 client.25646 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 --2- 172.21.15.82:0/296217555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e293790 0x561c1e29d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 >> 172.21.15.82:0/296217555 conn(0x561c1e28edb0 msgr2=0x561c1e28e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 shutdown_connections 2024-04-26T20:23:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 1 -- 172.21.15.82:0/296217555 wait complete. 2024-04-26T20:23:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.141+0000 7f5f513db740 20 client.25646 trim_cache size 0 max 16384 2024-04-26T20:23:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 Processor -- start 2024-04-26T20:23:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 -- start start 2024-04-26T20:23:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e289e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e2a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e2992f0 0x561c1e2924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481af0f0 con 0x561c1e294180 2024-04-26T20:23:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481adc80 con 0x561c1e293790 2024-04-26T20:23:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.160+0000 7f5f513db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481ae350 con 0x561c1e2992f0 2024-04-26T20:23:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f46a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e2a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e289e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f46a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e2a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59394/0 (socket says 172.21.15.82:59394) 2024-04-26T20:23:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f46a00640 1 -- 172.21.15.82:0/263420911 learned_addr learned my addr 172.21.15.82:0/263420911 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47e00640 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e2992f0 0x561c1e2924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 -- 172.21.15.82:0/263420911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e2992f0 msgr2=0x561c1e2924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e2992f0 0x561c1e2924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 -- 172.21.15.82:0/263420911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 msgr2=0x561c1e2a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e2a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 -- 172.21.15.82:0/263420911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1dec90f0 con 0x561c1e293790 2024-04-26T20:23:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.161+0000 7f5f47400640 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e289e30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x561c1e28fd70 tx=0x7f5f38009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e988127e253644 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f33e00640 1 -- 172.21.15.82:0/263420911 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3802f070 con 0x561c1e293790 2024-04-26T20:23:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f33e00640 1 -- 172.21.15.82:0/263420911 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f3800f680 con 0x561c1e293790 2024-04-26T20:23:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f33e00640 1 -- 172.21.15.82:0/263420911 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3802ae60 con 0x561c1e293790 2024-04-26T20:23:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 -- 172.21.15.82:0/263420911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 msgr2=0x561c1e289e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e289e30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x561c1e28fd70 tx=0x7f5f38009600 comp rx=0 tx=0).stop 2024-04-26T20:23:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 -- 172.21.15.82:0/263420911 shutdown_connections 2024-04-26T20:23:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e2992f0 0x561c1e2924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e294180 0x561c1e2a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 --2- 172.21.15.82:0/263420911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e289e30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 -- 172.21.15.82:0/263420911 >> 172.21.15.82:0/263420911 conn(0x561c1e28edb0 msgr2=0x561c1e291db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 -- 172.21.15.82:0/263420911 shutdown_connections 2024-04-26T20:23:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.162+0000 7f5f513db740 1 -- 172.21.15.82:0/263420911 wait complete. 2024-04-26T20:23:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 -- start start 2024-04-26T20:23:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 Processor -- start 2024-04-26T20:23:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e2a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e294180 0x561c1e2a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 0x561c1e2a3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481ab590 con 0x561c1e2992f0 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481aea20 con 0x561c1e293790 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481abc00 con 0x561c1e294180 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.163+0000 7f5f513db740 10 client.0 _ll_register_callbacks cb 0x7f5f4009d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 0x561c1e2a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 0x561c1e2a3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59400/0 (socket says 172.21.15.82:59400) 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 -- 172.21.15.82:0/2071317618 learned_addr learned my addr 172.21.15.82:0/2071317618 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47400640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e2a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f46a00640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e294180 0x561c1e2a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 -- 172.21.15.82:0/2071317618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e294180 msgr2=0x561c1e2a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e294180 0x561c1e2a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 -- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 msgr2=0x561c1e2a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e2a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 -- 172.21.15.82:0/2071317618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c1e1bfa30 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f47e00640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 0x561c1e2a3570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5f400a5760 tx=0x7f5f400a57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919716dde662970e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f31600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.164+0000 7f5f31600640 1 -- 172.21.15.82:0/2071317618 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f400a0ff0 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f31600640 1 -- 172.21.15.82:0/2071317618 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5f40087040 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f3800f680 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f31600640 1 -- 172.21.15.82:0/2071317618 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5f400ce6c0 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 10 client.15558 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c1e2a4ca0 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f31600640 1 -- 172.21.15.82:0/2071317618 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f3800f680 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f31600640 1 -- 172.21.15.82:0/2071317618 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5f400a2180 con 0x561c1e2992f0 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 10 client.15558 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 20 client.15558 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e30fb60 0x561c1e311f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 4 client.15558 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.165+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561c1e1ff650 con 0x561c1e30fb60 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.166+0000 7f5f47400640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e30fb60 0x561c1e311f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.166+0000 7f5f47400640 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e30fb60 0x561c1e311f80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=568c60f6da33cbc6 server_cookie=17a97b4a91151cf5 in_seq=0 out_seq=0 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.166+0000 7f5f31600640 10 client.15558 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.166+0000 7f5f31600640 1 -- 172.21.15.82:0/2071317618 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561c1e1ff650 con 0x561c1e30fb60 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.166+0000 7f5f31600640 10 client.15558 handle_command_reply: tid=0 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.166+0000 7f5f513db740 1 client.15558 shutdown 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 msgr2=0x561c1e2a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 0x561c1e2a3570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5f400a5760 tx=0x7f5f400a57e0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 shutdown_connections 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561c1e30fb60 0x561c1e311f80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c1e2992f0 0x561c1e2a3570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561c1e294180 0x561c1e2a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 --2- 172.21.15.82:0/2071317618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c1e293790 0x561c1e2a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f31600640 0 client.15558 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 >> 172.21.15.82:0/2071317618 conn(0x561c1e28edb0 msgr2=0x561c1e28d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 shutdown_connections 2024-04-26T20:23:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 1 -- 172.21.15.82:0/2071317618 wait complete. 2024-04-26T20:23:30.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.167+0000 7f5f513db740 20 client.15558 trim_cache size 0 max 16384 2024-04-26T20:23:30.180 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:23:30.180 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:23:30.180 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:23:30.180 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:23:30.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f2c0a3c40 msgr2=0x7f5f2c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f2c0a3c40 0x7f5f2c0a6100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000c00 tx=0x7f5f3402a340 comp rx=0 tx=0).stop 2024-04-26T20:23:30.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 msgr2=0x7f5f481a2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f481a2370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000eb10 tx=0x7f5f4000ef10 comp rx=0 tx=0).stop 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 shutdown_connections 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5f2c0a3c40 0x7f5f2c0a6100 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f48106740 0x7f5f481a2370 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f48105d80 0x7f5f4819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 --2- 172.21.15.82:0/2157501092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f48104b90 0x7f5f4819adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 >> 172.21.15.82:0/2157501092 conn(0x7f5f481000e0 msgr2=0x7f5f48109150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 shutdown_connections 2024-04-26T20:23:30.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.168+0000 7f5f4e400640 1 -- 172.21.15.82:0/2157501092 wait complete. 2024-04-26T20:23:30.186 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:23:30.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:23:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 -- 172.21.15.82:0/858974057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb434075310 msgr2=0x7fb434075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 --2- 172.21.15.82:0/858974057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb434075310 0x7fb434075770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb420009900 tx=0x7fb42002a480 comp rx=0 tx=0).stop 2024-04-26T20:23:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 -- 172.21.15.82:0/858974057 shutdown_connections 2024-04-26T20:23:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 --2- 172.21.15.82:0/858974057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb43410a620 0x7fb43410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 --2- 172.21.15.82:0/858974057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb434075310 0x7fb434075770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 --2- 172.21.15.82:0/858974057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4340768f0 0x7fb434074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 -- 172.21.15.82:0/858974057 >> 172.21.15.82:0/858974057 conn(0x7fb4340fdcc0 msgr2=0x7fb434100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 -- 172.21.15.82:0/858974057 shutdown_connections 2024-04-26T20:23:30.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.384+0000 7fb43aa00640 1 -- 172.21.15.82:0/858974057 wait complete. 2024-04-26T20:23:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.385+0000 7fb43aa00640 1 Processor -- start 2024-04-26T20:23:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.385+0000 7fb43aa00640 1 -- start start 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.385+0000 7fb43aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 0x7fb43419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4340768f0 0x7fb43419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43410a620 0x7fb4341a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43aa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb434110500 con 0x7fb43410a620 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43aa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb434110380 con 0x7fb434075310 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43aa00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb434110680 con 0x7fb4340768f0 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 0x7fb43419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43410a620 0x7fb4341a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb438c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4340768f0 0x7fb43419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 0x7fb43419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39994/0 (socket says 172.21.15.82:39994) 2024-04-26T20:23:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 -- 172.21.15.82:0/3881410443 learned_addr learned my addr 172.21.15.82:0/3881410443 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 -- 172.21.15.82:0/3881410443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4340768f0 msgr2=0x7fb43419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4340768f0 0x7fb43419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 -- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43410a620 msgr2=0x7fb4341a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43410a620 0x7fb4341a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb439600640 1 -- 172.21.15.82:0/3881410443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4341a2770 con 0x7fb434075310 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.386+0000 7fb43a000640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43410a620 0x7fb4341a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.387+0000 7fb439600640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 0x7fb43419abf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb42800e9f0 tx=0x7fb42800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.387+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42800cd80 con 0x7fb434075310 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.387+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4280108e0 con 0x7fb434075310 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.387+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4341a2a60 con 0x7fb434075310 2024-04-26T20:23:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.387+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428018980 con 0x7fb434075310 2024-04-26T20:23:30.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.387+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4341a2f80 con 0x7fb434075310 2024-04-26T20:23:30.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.388+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb434069670 con 0x7fb434075310 2024-04-26T20:23:30.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.390+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb428010430 con 0x7fb434075310 2024-04-26T20:23:30.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.392+0000 7fb432000640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb41c0a3c40 0x7fb41c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.392+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb4280d10d0 con 0x7fb434075310 2024-04-26T20:23:30.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.392+0000 7fb438c00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb41c0a3c40 0x7fb41c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.393+0000 7fb438c00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb41c0a3c40 0x7fb41c0a6100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb420031500 tx=0x7fb420005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.394+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fb42809cf40 con 0x7fb434075310 2024-04-26T20:23:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.641+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb43402db90 con 0x7fb434075310 2024-04-26T20:23:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.642+0000 7fb432000640 1 -- 172.21.15.82:0/3881410443 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11951 (secure 0 0 0) 0x7fb4280a1240 con 0x7fb434075310 2024-04-26T20:23:30.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:23:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:22:49.242424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24550,24529,24454,24554,24584]},"id":1}]} 2024-04-26T20:23:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-04-26T20:23:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb41c0a3c40 msgr2=0x7fb41c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb41c0a3c40 0x7fb41c0a6100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb420031500 tx=0x7fb420005a20 comp rx=0 tx=0).stop 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 msgr2=0x7fb43419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 0x7fb43419abf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb42800e9f0 tx=0x7fb42800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 shutdown_connections 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb41c0a3c40 0x7fb41c0a6100 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43410a620 0x7fb4341a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4340768f0 0x7fb43419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 --2- 172.21.15.82:0/3881410443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb434075310 0x7fb43419abf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 >> 172.21.15.82:0/3881410443 conn(0x7fb4340fdcc0 msgr2=0x7fb4341065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 shutdown_connections 2024-04-26T20:23:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.646+0000 7fb43aa00640 1 -- 172.21.15.82:0/3881410443 wait complete. 2024-04-26T20:23:30.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:23:30.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 -- 172.21.15.82:0/815616433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50076970 msgr2=0x7fbd50074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 --2- 172.21.15.82:0/815616433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50076970 0x7fbd50074dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009ca0 tx=0x7fbd4002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 -- 172.21.15.82:0/815616433 shutdown_connections 2024-04-26T20:23:30.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 --2- 172.21.15.82:0/815616433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd50111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 --2- 172.21.15.82:0/815616433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd50075390 0x7fbd50075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 --2- 172.21.15.82:0/815616433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50076970 0x7fbd50074dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 -- 172.21.15.82:0/815616433 >> 172.21.15.82:0/815616433 conn(0x7fbd500fde30 msgr2=0x7fbd50100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 -- 172.21.15.82:0/815616433 shutdown_connections 2024-04-26T20:23:30.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.866+0000 7fbd55a00640 1 -- 172.21.15.82:0/815616433 wait complete. 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.867+0000 7fbd55a00640 1 Processor -- start 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.867+0000 7fbd55a00640 1 -- start start 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50075390 0x7fbd5019f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd50076970 0x7fbd5019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd501a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501149c0 con 0x7fbd50076970 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50114840 con 0x7fbd5010ee90 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50114b40 con 0x7fbd50075390 2024-04-26T20:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd50076970 0x7fbd5019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd501a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50075390 0x7fbd5019f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd501a6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50750/0 (socket says 172.21.15.82:50750) 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd55000640 1 -- 172.21.15.82:0/238149073 learned_addr learned my addr 172.21.15.82:0/238149073 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.868+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50075390 0x7fbd5019f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33066/0 (socket says 172.21.15.82:33066) 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55000640 1 -- 172.21.15.82:0/238149073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50075390 msgr2=0x7fbd5019f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55000640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50075390 0x7fbd5019f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55000640 1 -- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd50076970 msgr2=0x7fbd5019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55000640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd50076970 0x7fbd5019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55000640 1 -- 172.21.15.82:0/238149073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd501a6c70 con 0x7fbd5010ee90 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55000640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd501a6600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800e970 tx=0x7fbd4800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd4cc00640 1 -- 172.21.15.82:0/238149073 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800ccc0 con 0x7fbd5010ee90 2024-04-26T20:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd4cc00640 1 -- 172.21.15.82:0/238149073 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd4800ce60 con 0x7fbd5010ee90 2024-04-26T20:23:30.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd501a6f60 con 0x7fbd5010ee90 2024-04-26T20:23:30.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd4cc00640 1 -- 172.21.15.82:0/238149073 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48010430 con 0x7fbd5010ee90 2024-04-26T20:23:30.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.869+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd501a7420 con 0x7fbd5010ee90 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 Processor -- start 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd4cc00640 1 -- 172.21.15.82:0/238149073 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbd48004f90 con 0x7fbd5010ee90 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 -- start start 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x55584804a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584804f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804fbb0 0x555848052040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555847fadc70 con 0x55584804aa40 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555847f66980 con 0x55584804a050 2024-04-26T20:23:30.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.873+0000 7fbd59f94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555847fa9c30 con 0x55584804fbb0 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x55584804a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x55584804a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50752/0 (socket says 172.21.15.82:50752) 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 -- 172.21.15.82:0/266131731 learned_addr learned my addr 172.21.15.82:0/266131731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584804f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804fbb0 0x555848052040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 -- 172.21.15.82:0/266131731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804fbb0 msgr2=0x555848052040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804fbb0 0x555848052040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 -- 172.21.15.82:0/266131731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 msgr2=0x55584804f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584804f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 -- 172.21.15.82:0/266131731 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555847f3e7b0 con 0x55584804a050 2024-04-26T20:23:30.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4cc00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd340a3c40 0x7fbd340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4cc00640 1 -- 172.21.15.82:0/238149073 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbd480d0cf0 con 0x7fbd5010ee90 2024-04-26T20:23:30.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.874+0000 7fbd4f400640 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x55584804a470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0058c0 tx=0x7fbd3c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db2faefec261bf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd340a3c40 0x7fbd340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd45600640 1 -- 172.21.15.82:0/266131731 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c004030 con 0x55584804a050 2024-04-26T20:23:30.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd45600640 1 -- 172.21.15.82:0/266131731 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd3c005020 con 0x55584804a050 2024-04-26T20:23:30.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd45600640 1 -- 172.21.15.82:0/266131731 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c004ba0 con 0x55584804a050 2024-04-26T20:23:30.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 -- 172.21.15.82:0/266131731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 msgr2=0x55584804a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x55584804a470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0058c0 tx=0x7fbd3c005850 comp rx=0 tx=0).stop 2024-04-26T20:23:30.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd340a3c40 0x7fbd340a6100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd40005e30 tx=0x7fbd40031b00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 -- 172.21.15.82:0/266131731 shutdown_connections 2024-04-26T20:23:30.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804fbb0 0x555848052040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584804f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 --2- 172.21.15.82:0/266131731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x55584804a470 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.875+0000 7fbd59f94740 1 -- 172.21.15.82:0/266131731 >> 172.21.15.82:0/266131731 conn(0x5558480456c0 msgr2=0x555848045ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.876+0000 7fbd59f94740 1 -- 172.21.15.82:0/266131731 shutdown_connections 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.876+0000 7fbd59f94740 1 -- 172.21.15.82:0/266131731 wait complete. 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.876+0000 7fbd59f94740 1 -- start start 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.876+0000 7fbd59f94740 1 Processor -- start 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 0x555848053f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x5558480544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x55584805b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555847facf80 con 0x55584804a050 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555847f5a260 con 0x55584804fbb0 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555847fb22a0 con 0x55584804aa40 2024-04-26T20:23:30.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd59f94740 10 client.0 _ll_register_callbacks cb 0x555847fa4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 0x555848053f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 0x555848053f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39824/0 (socket says 172.21.15.82:39824) 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 -- 172.21.15.82:0/1225247444 learned_addr learned my addr 172.21.15.82:0/1225247444 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4f400640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x5558480544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd55000640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x55584805b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 -- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 msgr2=0x5558480544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x5558480544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 -- 172.21.15.82:0/1225247444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 msgr2=0x55584805b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x55584805b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.877+0000 7fbd4fe00640 1 -- 172.21.15.82:0/1225247444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555847f3c1c0 con 0x55584804a050 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 0x555848053f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009ca0 tx=0x7fbd4002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180a78fbcef04728 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd3a000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd3a000640 1 -- 172.21.15.82:0/1225247444 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4002f610 con 0x55584804a050 2024-04-26T20:23:30.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd3a000640 1 -- 172.21.15.82:0/1225247444 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbd4002f7b0 con 0x55584804a050 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd3c005020 con 0x55584804a050 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd3a000640 1 -- 172.21.15.82:0/1225247444 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbd4002f9b0 con 0x55584804a050 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd59f94740 10 client.15576 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.878+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555847cbf3f0 con 0x55584804a050 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd3a000640 1 -- 172.21.15.82:0/1225247444 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd3c005020 con 0x55584804a050 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd3a000640 1 -- 172.21.15.82:0/1225247444 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbd40051070 con 0x55584804a050 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd59f94740 10 client.15576 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd59f94740 10 client.15576 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd59f94740 20 client.15576 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd59f94740 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55584805f9d0 0x555848061e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd59f94740 4 client.15576 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555847fbb880 con 0x55584805f9d0 2024-04-26T20:23:30.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.879+0000 7fbd4f400640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55584805f9d0 0x555848061e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.880+0000 7fbd4f400640 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55584805f9d0 0x555848061e70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9bdf1bb939b05b8d server_cookie=901073030f9e272f in_seq=0 out_seq=0 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.880+0000 7fbd3a000640 10 client.15576 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd3a000640 1 -- 172.21.15.82:0/1225247444 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555847fbb880 con 0x55584805f9d0 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd3a000640 10 client.15576 handle_command_reply: tid=0 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 client.15576 shutdown 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 msgr2=0x555848053f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 0x555848053f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009ca0 tx=0x7fbd4002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 shutdown_connections 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55584805f9d0 0x555848061e70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x55584805b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x5558480544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 --2- 172.21.15.82:0/1225247444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804a050 0x555848053f60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd3a000640 0 client.15576 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:23:30.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.881+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 >> 172.21.15.82:0/1225247444 conn(0x5558480456c0 msgr2=0x5558480447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.882+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 shutdown_connections 2024-04-26T20:23:30.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.882+0000 7fbd59f94740 1 -- 172.21.15.82:0/1225247444 wait complete. 2024-04-26T20:23:30.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.882+0000 7fbd59f94740 20 client.15576 trim_cache size 0 max 16384 2024-04-26T20:23:30.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.896+0000 7fbd59f94740 1 Processor -- start 2024-04-26T20:23:30.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.896+0000 7fbd59f94740 1 -- start start 2024-04-26T20:23:30.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.896+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804a050 0x555848054400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584805b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x555848044630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd59f94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501b1870 con 0x55584804aa40 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd59f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501b33b0 con 0x55584804fbb0 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd59f94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501b1f40 con 0x55584804a050 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584805b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584805b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39828/0 (socket says 172.21.15.82:39828) 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 -- 172.21.15.82:0/388802545 learned_addr learned my addr 172.21.15.82:0/388802545 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804a050 0x555848054400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd55000640 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x555848044630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 -- 172.21.15.82:0/388802545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804a050 msgr2=0x555848054400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804a050 0x555848054400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 -- 172.21.15.82:0/388802545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 msgr2=0x555848044630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x555848044630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd4f400640 1 -- 172.21.15.82:0/388802545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555847d897d0 con 0x55584804aa40 2024-04-26T20:23:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.897+0000 7fbd55000640 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x555848044630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd4f400640 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584805b4a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0058c0 tx=0x7fbd3c009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3738fa7b1ea6147f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd44c00640 1 -- 172.21.15.82:0/388802545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c005450 con 0x55584804aa40 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd44c00640 1 -- 172.21.15.82:0/388802545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd3c0055f0 con 0x55584804aa40 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd44c00640 1 -- 172.21.15.82:0/388802545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c02d5e0 con 0x55584804aa40 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 -- 172.21.15.82:0/388802545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 msgr2=0x55584805b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584805b4a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0058c0 tx=0x7fbd3c009fd0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 -- 172.21.15.82:0/388802545 shutdown_connections 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804fbb0 0x555848044630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804aa40 0x55584805b4a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 --2- 172.21.15.82:0/388802545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804a050 0x555848054400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.898+0000 7fbd59f94740 1 -- 172.21.15.82:0/388802545 >> 172.21.15.82:0/388802545 conn(0x5558480456c0 msgr2=0x555848043f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.899+0000 7fbd59f94740 1 -- 172.21.15.82:0/388802545 shutdown_connections 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.899+0000 7fbd59f94740 1 -- 172.21.15.82:0/388802545 wait complete. 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.899+0000 7fbd59f94740 1 -- start start 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.899+0000 7fbd59f94740 1 Processor -- start 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.899+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x555848058690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.899+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x555848058bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd59f94740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804fbb0 0x555848059be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd59f94740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501b2ce0 con 0x55584804fbb0 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd59f94740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501b2610 con 0x55584804a050 2024-04-26T20:23:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd59f94740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501af850 con 0x55584804aa40 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd59f94740 10 client.0 _ll_register_callbacks cb 0x7fbd40009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x555848058bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x555848058690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x555848058bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33110/0 (socket says 172.21.15.82:33110) 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 -- 172.21.15.82:0/4189513120 learned_addr learned my addr 172.21.15.82:0/4189513120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd55000640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804fbb0 0x555848059be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 -- 172.21.15.82:0/4189513120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 msgr2=0x555848058690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x555848058690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 -- 172.21.15.82:0/4189513120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804fbb0 msgr2=0x555848059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804fbb0 0x555848059be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd4f400640 1 -- 172.21.15.82:0/4189513120 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555847f542a0 con 0x55584804aa40 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.900+0000 7fbd55000640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804fbb0 0x555848059be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd4f400640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x555848058bd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0117f0 tx=0x7fbd3c005210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d0b4b8f0cf918a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd3a000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd3a000640 1 -- 172.21.15.82:0/4189513120 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c009b90 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd3a000640 1 -- 172.21.15.82:0/4189513120 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbd3c02d4e0 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd3c0055f0 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd3a000640 1 -- 172.21.15.82:0/4189513120 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbd3c041050 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd59f94740 10 client.25705 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55584805b300 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.901+0000 7fbd3a000640 1 -- 172.21.15.82:0/4189513120 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd3c0055f0 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd3a000640 1 -- 172.21.15.82:0/4189513120 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbd3c028040 con 0x55584804aa40 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd59f94740 10 client.25705 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd59f94740 10 client.25705 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd59f94740 20 client.25705 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd59f94740 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5558480c6040 0x5558480c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:30.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd59f94740 4 client.25705 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:23:30.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555847fb56f0 con 0x5558480c6040 2024-04-26T20:23:30.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5558480c6040 0x5558480c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd4fe00640 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5558480c6040 0x5558480c8430 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=817902ae595c20a5 server_cookie=5a962f47899ca4af in_seq=0 out_seq=0 2024-04-26T20:23:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.902+0000 7fbd3a000640 10 client.25705 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:23:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd3a000640 1 -- 172.21.15.82:0/4189513120 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555847fb56f0 con 0x5558480c6040 2024-04-26T20:23:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd3a000640 10 client.25705 handle_command_reply: tid=0 2024-04-26T20:23:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 client.25705 shutdown 2024-04-26T20:23:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 msgr2=0x555848058bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x555848058bd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0117f0 tx=0x7fbd3c005210 comp rx=0 tx=0).stop 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 shutdown_connections 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5558480c6040 0x5558480c8430 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55584804fbb0 0x555848059be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd3a000640 0 client.25705 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55584804aa40 0x555848058bd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 --2- 172.21.15.82:0/4189513120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55584804a050 0x555848058690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 >> 172.21.15.82:0/4189513120 conn(0x5558480456c0 msgr2=0x5558480447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 shutdown_connections 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 1 -- 172.21.15.82:0/4189513120 wait complete. 2024-04-26T20:23:30.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.903+0000 7fbd59f94740 20 client.25705 trim_cache size 0 max 16384 2024-04-26T20:23:30.910 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:23:30.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd340a3c40 msgr2=0x7fbd340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd340a3c40 0x7fbd340a6100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd40005e30 tx=0x7fbd40031b00 comp rx=0 tx=0).stop 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 msgr2=0x7fbd501a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd501a6600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800e970 tx=0x7fbd4800ed70 comp rx=0 tx=0).stop 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 shutdown_connections 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd340a3c40 0x7fbd340a6100 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5010ee90 0x7fbd501a6600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd50076970 0x7fbd5019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 --2- 172.21.15.82:0/238149073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd50075390 0x7fbd5019f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 >> 172.21.15.82:0/238149073 conn(0x7fbd500fde30 msgr2=0x7fbd50102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 shutdown_connections 2024-04-26T20:23:30.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:30.904+0000 7fbd55a00640 1 -- 172.21.15.82:0/238149073 wait complete. 2024-04-26T20:23:30.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:30 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3881410443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:23:30.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:23:31.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:30 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3881410443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:23:31.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:30 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3881410443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:23:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 -- 172.21.15.82:0/1363103511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4076970 msgr2=0x7faee4074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 --2- 172.21.15.82:0/1363103511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4076970 0x7faee4074dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faed4009ca0 tx=0x7faed402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 -- 172.21.15.82:0/1363103511 shutdown_connections 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 --2- 172.21.15.82:0/1363103511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee410cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 --2- 172.21.15.82:0/1363103511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee4075390 0x7faee4075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 --2- 172.21.15.82:0/1363103511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4076970 0x7faee4074dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 -- 172.21.15.82:0/1363103511 >> 172.21.15.82:0/1363103511 conn(0x7faee40fde30 msgr2=0x7faee4100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 -- 172.21.15.82:0/1363103511 shutdown_connections 2024-04-26T20:23:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.119+0000 7faee3e00640 1 -- 172.21.15.82:0/1363103511 wait complete. 2024-04-26T20:23:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.120+0000 7faee3e00640 1 Processor -- start 2024-04-26T20:23:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.120+0000 7faee3e00640 1 -- start start 2024-04-26T20:23:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.120+0000 7faee3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4075390 0x7faee419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.120+0000 7faee3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee4076970 0x7faee419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.120+0000 7faee3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee41a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.120+0000 7faee3e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faee41105b0 con 0x7faee410a780 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faee4110430 con 0x7faee4075390 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faee4110730 con 0x7faee4076970 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee41a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faeda000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee4076970 0x7faee419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee41a2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39858/0 (socket says 172.21.15.82:39858) 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 -- 172.21.15.82:0/77012008 learned_addr learned my addr 172.21.15.82:0/77012008 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee2a00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4075390 0x7faee419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 -- 172.21.15.82:0/77012008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee4076970 msgr2=0x7faee419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee4076970 0x7faee419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 -- 172.21.15.82:0/77012008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4075390 msgr2=0x7faee419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4075390 0x7faee419acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.121+0000 7faee3400640 1 -- 172.21.15.82:0/77012008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee41a28f0 con 0x7faee410a780 2024-04-26T20:23:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.122+0000 7faee3400640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee41a2250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e970 tx=0x7faedc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.122+0000 7faedbe00640 1 -- 172.21.15.82:0/77012008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00ccc0 con 0x7faee410a780 2024-04-26T20:23:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.122+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee41a2be0 con 0x7faee410a780 2024-04-26T20:23:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.122+0000 7faedbe00640 1 -- 172.21.15.82:0/77012008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faedc00ce60 con 0x7faee410a780 2024-04-26T20:23:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.122+0000 7faedbe00640 1 -- 172.21.15.82:0/77012008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc010430 con 0x7faee410a780 2024-04-26T20:23:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.122+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee41a30b0 con 0x7faee410a780 2024-04-26T20:23:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.125+0000 7faedbe00640 1 -- 172.21.15.82:0/77012008 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7faedc004ff0 con 0x7faee410a780 2024-04-26T20:23:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.125+0000 7faeec801740 1 Processor -- start 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 -- start start 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec707470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec70c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 0x55dcec70f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dcec66ac70 con 0x55dcec70cbb0 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dcec623980 con 0x55dcec707a40 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeec801740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dcec666c30 con 0x55dcec707050 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 0x55dcec70f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 0x55dcec70f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39864/0 (socket says 172.21.15.82:39864) 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeda000640 1 -- 172.21.15.82:0/1508254169 learned_addr learned my addr 172.21.15.82:0/1508254169 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faee2a00640 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec70c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.126+0000 7faeda000640 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec707470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faeda000640 1 -- 172.21.15.82:0/1508254169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 msgr2=0x55dcec707470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faeda000640 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec707470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faeda000640 1 -- 172.21.15.82:0/1508254169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 msgr2=0x55dcec70c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faeda000640 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec70c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faeda000640 1 -- 172.21.15.82:0/1508254169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcec5fb7b0 con 0x55dcec70cbb0 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faee2a00640 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec70c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faeda000640 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 0x55dcec70f040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faecc0117e0 tx=0x7faecc0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89986208c080d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faedbe00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faec80a3c40 0x7faec80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faed3e00640 1 -- 172.21.15.82:0/1508254169 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc004030 con 0x55dcec70cbb0 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faed3e00640 1 -- 172.21.15.82:0/1508254169 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc00f7c0 con 0x55dcec70cbb0 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faed3e00640 1 -- 172.21.15.82:0/1508254169 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc003830 con 0x55dcec70cbb0 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faedbe00640 1 -- 172.21.15.82:0/77012008 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7faedc0d0d40 con 0x7faee410a780 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.127+0000 7faee2a00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faec80a3c40 0x7faec80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 -- 172.21.15.82:0/1508254169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 msgr2=0x55dcec70f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 0x55dcec70f040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faecc0117e0 tx=0x7faecc0097d0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 -- 172.21.15.82:0/1508254169 shutdown_connections 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec70cbb0 0x55dcec70f040 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec70c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 --2- 172.21.15.82:0/1508254169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec707470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 -- 172.21.15.82:0/1508254169 >> 172.21.15.82:0/1508254169 conn(0x55dcec7026c0 msgr2=0x55dcec702ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 -- 172.21.15.82:0/1508254169 shutdown_connections 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faee2a00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faec80a3c40 0x7faec80a6100 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faed4005e30 tx=0x7faed4031b10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.128+0000 7faeec801740 1 -- 172.21.15.82:0/1508254169 wait complete. 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 -- start start 2024-04-26T20:23:31.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 Processor -- start 2024-04-26T20:23:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707050 0x55dcec710ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec711410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec718450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dcec669f80 con 0x55dcec707050 2024-04-26T20:23:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dcec617260 con 0x55dcec707a40 2024-04-26T20:23:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.129+0000 7faeec801740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dcec66f2a0 con 0x55dcec70cbb0 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeec801740 10 client.0 _ll_register_callbacks cb 0x55dcec661960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faee2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707050 0x55dcec710ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec711410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faee2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707050 0x55dcec710ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39874/0 (socket says 172.21.15.82:39874) 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec711410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50800/0 (socket says 172.21.15.82:50800) 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faee2a00640 1 -- 172.21.15.82:0/64445647 learned_addr learned my addr 172.21.15.82:0/64445647 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faee3400640 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec718450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 -- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 msgr2=0x55dcec718450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec718450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 -- 172.21.15.82:0/64445647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707050 msgr2=0x55dcec710ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707050 0x55dcec710ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 -- 172.21.15.82:0/64445647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcec5f91c0 con 0x55dcec707a40 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.130+0000 7faeda000640 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec711410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faecc0117e0 tx=0x7faecc00feb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5250b32817029c98 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faed0c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faed0c00640 1 -- 172.21.15.82:0/64445647 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc004250 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faecc00f7c0 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faed0c00640 1 -- 172.21.15.82:0/64445647 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7faecc0043f0 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faed0c00640 1 -- 172.21.15.82:0/64445647 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faecc030050 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faeec801740 10 client.25688 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dcec37c3f0 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.131+0000 7faed0c00640 1 -- 172.21.15.82:0/64445647 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc00f7c0 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faed0c00640 1 -- 172.21.15.82:0/64445647 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faecc004c50 con 0x55dcec707a40 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faeec801740 10 client.25688 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faeec801740 10 client.25688 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faeec801740 20 client.25688 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faeec801740 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec71c6e0 0x55dcec71eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faeec801740 4 client.25688 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcec678880 con 0x55dcec71c6e0 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.132+0000 7faee2a00640 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec71c6e0 0x55dcec71eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.133+0000 7faee2a00640 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec71c6e0 0x55dcec71eb10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b1990802a5585b95 server_cookie=307bf251f0d4b6bc in_seq=0 out_seq=0 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.133+0000 7faed0c00640 10 client.25688 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.133+0000 7faed0c00640 1 -- 172.21.15.82:0/64445647 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dcec678880 con 0x55dcec71c6e0 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.133+0000 7faed0c00640 10 client.25688 handle_command_reply: tid=0 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 client.25688 shutdown 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 msgr2=0x55dcec711410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec711410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faecc0117e0 tx=0x7faecc00feb0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 shutdown_connections 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec718450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec71c6e0 0x55dcec71eb10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707a40 0x55dcec711410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faed0c00640 0 client.25688 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 --2- 172.21.15.82:0/64445647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707050 0x55dcec710ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 >> 172.21.15.82:0/64445647 conn(0x55dcec7026c0 msgr2=0x55dcec7017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 shutdown_connections 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 1 -- 172.21.15.82:0/64445647 wait complete. 2024-04-26T20:23:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.134+0000 7faeec801740 20 client.25688 trim_cache size 0 max 16384 2024-04-26T20:23:31.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 Processor -- start 2024-04-26T20:23:31.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 -- start start 2024-04-26T20:23:31.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707050 0x55dcec7104f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec718410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec708130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ad400 con 0x55dcec707a40 2024-04-26T20:23:31.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faee41aef40 con 0x55dcec707050 2024-04-26T20:23:31.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeec801740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faee41adad0 con 0x55dcec70cbb0 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec718410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec718410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39890/0 (socket says 172.21.15.82:39890) 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.149+0000 7faeda000640 1 -- 172.21.15.82:0/2335336437 learned_addr learned my addr 172.21.15.82:0/2335336437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faee3400640 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec708130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faeda000640 1 -- 172.21.15.82:0/2335336437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 msgr2=0x55dcec708130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faeda000640 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec708130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faeda000640 1 -- 172.21.15.82:0/2335336437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707050 msgr2=0x55dcec7104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faee2a00640 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707050 0x55dcec7104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faeda000640 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707050 0x55dcec7104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faeda000640 1 -- 172.21.15.82:0/2335336437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcec4467d0 con 0x55dcec707a40 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faee2a00640 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707050 0x55dcec7104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faeda000640 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec718410 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faecc009ed0 tx=0x7faecc0116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eeb0c5c3745499b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.150+0000 7faed3400640 1 -- 172.21.15.82:0/2335336437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f790 con 0x55dcec707a40 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faed3400640 1 -- 172.21.15.82:0/2335336437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc02d070 con 0x55dcec707a40 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faed3400640 1 -- 172.21.15.82:0/2335336437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc011290 con 0x55dcec707a40 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 -- 172.21.15.82:0/2335336437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 msgr2=0x55dcec718410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec718410 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faecc009ed0 tx=0x7faecc0116e0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 -- 172.21.15.82:0/2335336437 shutdown_connections 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec70cbb0 0x55dcec708130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec718410 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 --2- 172.21.15.82:0/2335336437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec707050 0x55dcec7104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 -- 172.21.15.82:0/2335336437 >> 172.21.15.82:0/2335336437 conn(0x55dcec7026c0 msgr2=0x55dcec705f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 -- 172.21.15.82:0/2335336437 shutdown_connections 2024-04-26T20:23:31.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.151+0000 7faeec801740 1 -- 172.21.15.82:0/2335336437 wait complete. 2024-04-26T20:23:31.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 -- start start 2024-04-26T20:23:31.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 Processor -- start 2024-04-26T20:23:31.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec715a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec715fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec70cbb0 0x55dcec716fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ae870 con 0x55dcec707a40 2024-04-26T20:23:31.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ae1a0 con 0x55dcec70cbb0 2024-04-26T20:23:31.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ab3e0 con 0x55dcec707050 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.152+0000 7faeec801740 10 client.0 _ll_register_callbacks cb 0x7faecc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec715fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec715fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39906/0 (socket says 172.21.15.82:39906) 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 -- 172.21.15.82:0/718787271 learned_addr learned my addr 172.21.15.82:0/718787271 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faee3400640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec70cbb0 0x55dcec716fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faee2a00640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec715a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 -- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 msgr2=0x55dcec715a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec715a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 -- 172.21.15.82:0/718787271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec70cbb0 msgr2=0x55dcec716fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec70cbb0 0x55dcec716fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 -- 172.21.15.82:0/718787271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcec6112a0 con 0x55dcec707a40 2024-04-26T20:23:31.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faeda000640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec715fd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faecc000c00 tx=0x7faecc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1bed3514770c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.153+0000 7faed0c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faed0c00640 1 -- 172.21.15.82:0/718787271 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f790 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faed0c00640 1 -- 172.21.15.82:0/718787271 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7faecc011260 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faecc02d070 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faed0c00640 1 -- 172.21.15.82:0/718787271 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faecc044050 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faeec801740 10 client.15600 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dcec718670 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faed0c00640 1 -- 172.21.15.82:0/718787271 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc02d070 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.154+0000 7faed0c00640 1 -- 172.21.15.82:0/718787271 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faecc035780 con 0x55dcec707a40 2024-04-26T20:23:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faeec801740 10 client.15600 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faeec801740 10 client.15600 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faeec801740 20 client.15600 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faeec801740 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec783130 0x55dcec785550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faeec801740 4 client.15600 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dcec710cc0 con 0x55dcec783130 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.155+0000 7faee2a00640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec783130 0x55dcec785550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faee2a00640 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec783130 0x55dcec785550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6c7f4bfa80aedd72 server_cookie=1dd7b4c601dbf37f in_seq=0 out_seq=0 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faed0c00640 10 client.15600 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faed0c00640 1 -- 172.21.15.82:0/718787271 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dcec710cc0 con 0x55dcec783130 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faed0c00640 10 client.15600 handle_command_reply: tid=0 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 client.15600 shutdown 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 msgr2=0x55dcec715fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec715fd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faecc000c00 tx=0x7faecc005850 comp rx=0 tx=0).stop 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 shutdown_connections 2024-04-26T20:23:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55dcec783130 0x55dcec785550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcec70cbb0 0x55dcec716fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcec707a40 0x55dcec715fd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 --2- 172.21.15.82:0/718787271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcec707050 0x55dcec715a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faed0c00640 0 client.15600 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 >> 172.21.15.82:0/718787271 conn(0x55dcec7026c0 msgr2=0x55dcec705f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.156+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 shutdown_connections 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faeec801740 1 -- 172.21.15.82:0/718787271 wait complete. 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faeec801740 20 client.15600 trim_cache size 0 max 16384 2024-04-26T20:23:31.161 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:23:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faec80a3c40 msgr2=0x7faec80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faec80a3c40 0x7faec80a6100 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faed4005e30 tx=0x7faed4031b10 comp rx=0 tx=0).stop 2024-04-26T20:23:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 msgr2=0x7faee41a2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee41a2250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e970 tx=0x7faedc00ed70 comp rx=0 tx=0).stop 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 shutdown_connections 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7faec80a3c40 0x7faec80a6100 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faee410a780 0x7faee41a2250 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee4076970 0x7faee419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 --2- 172.21.15.82:0/77012008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4075390 0x7faee419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 >> 172.21.15.82:0/77012008 conn(0x7faee40fde30 msgr2=0x7faee4106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.157+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 shutdown_connections 2024-04-26T20:23:31.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.158+0000 7faee3e00640 1 -- 172.21.15.82:0/77012008 wait complete. 2024-04-26T20:23:31.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:23:31.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 -- 172.21.15.82:0/3003584256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 msgr2=0x7fef3c10ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 --2- 172.21.15.82:0/3003584256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c10ceb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fef34009ca0 tx=0x7fef3402a8b0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 -- 172.21.15.82:0/3003584256 shutdown_connections 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 --2- 172.21.15.82:0/3003584256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c10ceb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 --2- 172.21.15.82:0/3003584256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef3c105c60 0x7fef3c1060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 --2- 172.21.15.82:0/3003584256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c104a70 0x7fef3c104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 -- 172.21.15.82:0/3003584256 >> 172.21.15.82:0/3003584256 conn(0x7fef3c0fffe0 msgr2=0x7fef3c102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 -- 172.21.15.82:0/3003584256 shutdown_connections 2024-04-26T20:23:31.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.371+0000 7fef41800640 1 -- 172.21.15.82:0/3003584256 wait complete. 2024-04-26T20:23:31.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 Processor -- start 2024-04-26T20:23:31.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 -- start start 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef3c104a70 0x7fef3c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 0x7fef3c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c1a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1105d0 con 0x7fef3c106620 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c110450 con 0x7fef3c105c60 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.372+0000 7fef41800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c110750 con 0x7fef3c104a70 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef3b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 0x7fef3c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c1a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef3b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 0x7fef3c19b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50840/0 (socket says 172.21.15.82:50840) 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef3b400640 1 -- 172.21.15.82:0/489611666 learned_addr learned my addr 172.21.15.82:0/489611666 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef3be00640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef3c104a70 0x7fef3c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 -- 172.21.15.82:0/489611666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef3c104a70 msgr2=0x7fef3c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef3c104a70 0x7fef3c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 -- 172.21.15.82:0/489611666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 msgr2=0x7fef3c19b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 0x7fef3c19b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 -- 172.21.15.82:0/489611666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c1a2840 con 0x7fef3c106620 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef3b400640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 0x7fef3c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.373+0000 7fef40e00640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c1a21a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef3402aea0 tx=0x7fef34003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.374+0000 7fef38c00640 1 -- 172.21.15.82:0/489611666 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34004240 con 0x7fef3c106620 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.374+0000 7fef38c00640 1 -- 172.21.15.82:0/489611666 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef34040070 con 0x7fef3c106620 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.374+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c1a2ad0 con 0x7fef3c106620 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.374+0000 7fef38c00640 1 -- 172.21.15.82:0/489611666 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34045af0 con 0x7fef3c106620 2024-04-26T20:23:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.374+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c1a3070 con 0x7fef3c106620 2024-04-26T20:23:31.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.377+0000 7fef45bf8740 1 Processor -- start 2024-04-26T20:23:31.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.377+0000 7fef38c00640 1 -- 172.21.15.82:0/489611666 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fef340043e0 con 0x7fef3c106620 2024-04-26T20:23:31.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.377+0000 7fef45bf8740 1 -- start start 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932cf9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cf9a40 0x563932cfe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cfebb0 0x563932d01040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef45bf8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563932c5cc70 con 0x563932cfebb0 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef45bf8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563932c15980 con 0x563932cf9a40 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef45bf8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563932c58c30 con 0x563932cf9050 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef3b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cfebb0 0x563932d01040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef3b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cfebb0 0x563932d01040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39940/0 (socket says 172.21.15.82:39940) 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef3b400640 1 -- 172.21.15.82:0/79344646 learned_addr learned my addr 172.21.15.82:0/79344646 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef3be00640 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cf9a40 0x563932cfe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.378+0000 7fef3b400640 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932cf9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef3be00640 1 -- 172.21.15.82:0/79344646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 msgr2=0x563932cf9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef3be00640 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932cf9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef3be00640 1 -- 172.21.15.82:0/79344646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cfebb0 msgr2=0x563932d01040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef3be00640 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cfebb0 0x563932d01040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef3be00640 1 -- 172.21.15.82:0/79344646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563932bed7b0 con 0x563932cf9a40 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef3be00640 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cf9a40 0x563932cfe540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fef3c105ac0 tx=0x7fef2c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c506e8857fc473 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef31600640 1 -- 172.21.15.82:0/79344646 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c004050 con 0x563932cf9a40 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef31600640 1 -- 172.21.15.82:0/79344646 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef2c0054d0 con 0x563932cf9a40 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef31600640 1 -- 172.21.15.82:0/79344646 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c004c00 con 0x563932cf9a40 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.379+0000 7fef38c00640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fef200a3cc0 0x7fef200a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef38c00640 1 -- 172.21.15.82:0/489611666 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fef340f1c30 con 0x7fef3c106620 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 -- 172.21.15.82:0/79344646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cf9a40 msgr2=0x563932cfe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cf9a40 0x563932cfe540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fef3c105ac0 tx=0x7fef2c011810 comp rx=0 tx=0).stop 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef3b400640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fef200a3cc0 0x7fef200a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 -- 172.21.15.82:0/79344646 shutdown_connections 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cfebb0 0x563932d01040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cf9a40 0x563932cfe540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 --2- 172.21.15.82:0/79344646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932cf9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 -- 172.21.15.82:0/79344646 >> 172.21.15.82:0/79344646 conn(0x563932cf46c0 msgr2=0x563932cf4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 -- 172.21.15.82:0/79344646 shutdown_connections 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.380+0000 7fef45bf8740 1 -- 172.21.15.82:0/79344646 wait complete. 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef3b400640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fef200a3cc0 0x7fef200a6180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef28009fd0 tx=0x7fef28009d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 -- start start 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 Processor -- start 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932d02f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932d034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563932c5bf80 con 0x563932cf9050 2024-04-26T20:23:31.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563932c09260 con 0x563932cfebb0 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563932c612a0 con 0x563932cf9a40 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.381+0000 7fef45bf8740 10 client.0 _ll_register_callbacks cb 0x563932c53960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932d02f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef40e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932d02f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39954/0 (socket says 172.21.15.82:39954) 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 -- 172.21.15.82:0/631510968 learned_addr learned my addr 172.21.15.82:0/631510968 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3b400640 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932d034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 -- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 msgr2=0x563932d034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932d034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 -- 172.21.15.82:0/631510968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 msgr2=0x563932d0a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 -- 172.21.15.82:0/631510968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563932beb1c0 con 0x563932cf9050 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef3be00640 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932d02f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fef2c000c00 tx=0x7fef2c009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4103fe40564387c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.382+0000 7fef26000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef26000640 1 -- 172.21.15.82:0/631510968 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c029070 con 0x563932cf9050 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef26000640 1 -- 172.21.15.82:0/631510968 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fef2c003a00 con 0x563932cf9050 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef2c0054d0 con 0x563932cf9050 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef26000640 1 -- 172.21.15.82:0/631510968 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef2c035050 con 0x563932cf9050 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef45bf8740 10 client.15612 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56393296e3f0 con 0x563932cf9050 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.383+0000 7fef26000640 1 -- 172.21.15.82:0/631510968 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef2c0054d0 con 0x563932cf9050 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef26000640 1 -- 172.21.15.82:0/631510968 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fef2c0050a0 con 0x563932cf9050 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef45bf8740 10 client.15612 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef45bf8740 10 client.15612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef45bf8740 20 client.15612 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef45bf8740 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d0e850 0x563932d10ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef45bf8740 4 client.15612 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563932c6a880 con 0x563932d0e850 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.384+0000 7fef3b400640 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d0e850 0x563932d10ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.385+0000 7fef3b400640 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d0e850 0x563932d10ca0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4405e0422b75e573 server_cookie=9988c1365c692649 in_seq=0 out_seq=0 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.385+0000 7fef26000640 10 client.15612 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef26000640 1 -- 172.21.15.82:0/631510968 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563932c6a880 con 0x563932d0e850 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef26000640 10 client.15612 handle_command_reply: tid=0 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 client.15612 shutdown 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 msgr2=0x563932d02f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932d02f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fef2c000c00 tx=0x7fef2c009fa0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 shutdown_connections 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d0e850 0x563932d10ca0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932d034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 --2- 172.21.15.82:0/631510968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932d02f90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef26000640 0 client.15612 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 >> 172.21.15.82:0/631510968 conn(0x563932cf46c0 msgr2=0x563932cf37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 shutdown_connections 2024-04-26T20:23:31.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 1 -- 172.21.15.82:0/631510968 wait complete. 2024-04-26T20:23:31.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.386+0000 7fef45bf8740 20 client.15612 trim_cache size 0 max 16384 2024-04-26T20:23:31.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 Processor -- start 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 -- start start 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932cf79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932cf7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1ad310 con 0x563932cf9050 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1aee50 con 0x563932cfebb0 2024-04-26T20:23:31.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.401+0000 7fef45bf8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1ad9e0 con 0x563932cf9a40 2024-04-26T20:23:31.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932cf79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef40e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932cf7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932cf79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39962/0 (socket says 172.21.15.82:39962) 2024-04-26T20:23:31.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 -- 172.21.15.82:0/3628671836 learned_addr learned my addr 172.21.15.82:0/3628671836 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 -- 172.21.15.82:0/3628671836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 msgr2=0x563932cf7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932cf7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 -- 172.21.15.82:0/3628671836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 msgr2=0x563932d0a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 -- 172.21.15.82:0/3628671836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563932a387d0 con 0x563932cf9050 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3b400640 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932cf7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef40e00640 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.402+0000 7fef3be00640 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932cf79b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fef2c02e5d0 tx=0x7fef2c009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f139c85a4c54945 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef30c00640 1 -- 172.21.15.82:0/3628671836 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c032020 con 0x563932cf9050 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef30c00640 1 -- 172.21.15.82:0/3628671836 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef2c02e850 con 0x563932cf9050 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef30c00640 1 -- 172.21.15.82:0/3628671836 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c029070 con 0x563932cf9050 2024-04-26T20:23:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 -- 172.21.15.82:0/3628671836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 msgr2=0x563932cf79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932cf79b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fef2c02e5d0 tx=0x7fef2c009390 comp rx=0 tx=0).stop 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 -- 172.21.15.82:0/3628671836 shutdown_connections 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d0a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9a40 0x563932cf7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 --2- 172.21.15.82:0/3628671836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9050 0x563932cf79b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 -- 172.21.15.82:0/3628671836 >> 172.21.15.82:0/3628671836 conn(0x563932cf46c0 msgr2=0x563932cf72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 -- 172.21.15.82:0/3628671836 shutdown_connections 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.403+0000 7fef45bf8740 1 -- 172.21.15.82:0/3628671836 wait complete. 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 -- start start 2024-04-26T20:23:31.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 Processor -- start 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932d07100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 0x563932d07640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d72dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1ae780 con 0x563932cf9a40 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1ae0b0 con 0x563932cfebb0 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1ab2f0 con 0x563932cf9050 2024-04-26T20:23:31.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.404+0000 7fef45bf8740 10 client.0 _ll_register_callbacks cb 0x7fef28011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 0x563932d07640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 0x563932d07640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39970/0 (socket says 172.21.15.82:39970) 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 -- 172.21.15.82:0/1210369959 learned_addr learned my addr 172.21.15.82:0/1210369959 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef40e00640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d72dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3be00640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932d07100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 -- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 msgr2=0x563932d07100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932d07100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 -- 172.21.15.82:0/1210369959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 msgr2=0x563932d72dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d72dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 -- 172.21.15.82:0/1210369959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563932c032a0 con 0x563932cf9a40 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef3b400640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 0x563932d07640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef28005d00 tx=0x7fef28005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48775cbd06f6d690 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.405+0000 7fef26000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef26000640 1 -- 172.21.15.82:0/1210369959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2802bba0 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef26000640 1 -- 172.21.15.82:0/1210369959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fef2801a050 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef2c02e850 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef26000640 1 -- 172.21.15.82:0/1210369959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef2803f050 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef45bf8740 10 client.15618 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563932d74100 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef26000640 1 -- 172.21.15.82:0/1210369959 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef2c02e850 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.406+0000 7fef26000640 1 -- 172.21.15.82:0/1210369959 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fef280048c0 con 0x563932cf9a40 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef45bf8740 10 client.15618 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef45bf8740 10 client.15618 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef45bf8740 20 client.15618 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef45bf8740 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d74ae0 0x563932d76f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef45bf8740 4 client.15618 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563932c646f0 con 0x563932d74ae0 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef3be00640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d74ae0 0x563932d76f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef26000640 10 client.15618 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.407+0000 7fef3be00640 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d74ae0 0x563932d76f00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a70605d8dcbe3298 server_cookie=1b37a3edd6f88a5e in_seq=0 out_seq=0 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef26000640 1 -- 172.21.15.82:0/1210369959 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563932c646f0 con 0x563932d74ae0 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef26000640 10 client.15618 handle_command_reply: tid=0 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 client.15618 shutdown 2024-04-26T20:23:31.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 msgr2=0x563932d07640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 0x563932d07640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef28005d00 tx=0x7fef28005f90 comp rx=0 tx=0).stop 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 shutdown_connections 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x563932d74ae0 0x563932d76f00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563932cfebb0 0x563932d72dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563932cf9a40 0x563932d07640 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 --2- 172.21.15.82:0/1210369959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563932cf9050 0x563932d07100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 >> 172.21.15.82:0/1210369959 conn(0x563932cf46c0 msgr2=0x563932cf7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef26000640 0 client.15618 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 shutdown_connections 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 1 -- 172.21.15.82:0/1210369959 wait complete. 2024-04-26T20:23:31.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.408+0000 7fef45bf8740 20 client.15618 trim_cache size 0 max 16384 2024-04-26T20:23:31.415 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fef200a3cc0 msgr2=0x7fef200a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fef200a3cc0 0x7fef200a6180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef28009fd0 tx=0x7fef28009d00 comp rx=0 tx=0).stop 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 msgr2=0x7fef3c1a21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c1a21a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef3402aea0 tx=0x7fef34003ba0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 shutdown_connections 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fef200a3cc0 0x7fef200a6180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef3c106620 0x7fef3c1a21a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef3c105c60 0x7fef3c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 --2- 172.21.15.82:0/489611666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef3c104a70 0x7fef3c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 >> 172.21.15.82:0/489611666 conn(0x7fef3c0fffe0 msgr2=0x7fef3c108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 shutdown_connections 2024-04-26T20:23:31.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.409+0000 7fef41800640 1 -- 172.21.15.82:0/489611666 wait complete. 2024-04-26T20:23:31.428 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:23:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.628+0000 7f49a2200640 1 -- 172.21.15.82:0/3281543716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c105bf0 msgr2=0x7f499c107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.628+0000 7f49a2200640 1 --2- 172.21.15.82:0/3281543716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c105bf0 0x7f499c107fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4988009900 tx=0x7f498802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 -- 172.21.15.82:0/3281543716 shutdown_connections 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 --2- 172.21.15.82:0/3281543716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f499c108520 0x7f499c10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 --2- 172.21.15.82:0/3281543716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c105bf0 0x7f499c107fe0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 --2- 172.21.15.82:0/3281543716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c1032c0 0x7f499c1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 -- 172.21.15.82:0/3281543716 >> 172.21.15.82:0/3281543716 conn(0x7f499c0fccd0 msgr2=0x7f499c0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 -- 172.21.15.82:0/3281543716 shutdown_connections 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.629+0000 7f49a2200640 1 -- 172.21.15.82:0/3281543716 wait complete. 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.630+0000 7f49a2200640 1 Processor -- start 2024-04-26T20:23:31.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.630+0000 7f49a2200640 1 -- start start 2024-04-26T20:23:31.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.630+0000 7f49a2200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c1032c0 0x7f499c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.630+0000 7f49a2200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 0x7f499c198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a2200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f499c108520 0x7f499c1a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a2200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f499c10e370 con 0x7f499c105bf0 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a2200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f499c10e1f0 con 0x7f499c1032c0 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a2200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f499c10e4f0 con 0x7f499c108520 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f499be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 0x7f499c198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c1032c0 0x7f499c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f499be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 0x7f499c198fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39994/0 (socket says 172.21.15.82:39994) 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f499be00640 1 -- 172.21.15.82:0/4198436917 learned_addr learned my addr 172.21.15.82:0/4198436917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a1800640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f499c108520 0x7f499c1a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a0e00640 1 -- 172.21.15.82:0/4198436917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f499c108520 msgr2=0x7f499c1a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a0e00640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f499c108520 0x7f499c1a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a0e00640 1 -- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 msgr2=0x7f499c198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a0e00640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 0x7f499c198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f49a0e00640 1 -- 172.21.15.82:0/4198436917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c1a06c0 con 0x7f499c1032c0 2024-04-26T20:23:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.631+0000 7f499be00640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 0x7f499c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.632+0000 7f49a0e00640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c1032c0 0x7f499c198aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f499000e9f0 tx=0x7f499000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.632+0000 7f4999600640 1 -- 172.21.15.82:0/4198436917 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499000cd80 con 0x7f499c1032c0 2024-04-26T20:23:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.632+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c1a09b0 con 0x7f499c1032c0 2024-04-26T20:23:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.632+0000 7f4999600640 1 -- 172.21.15.82:0/4198436917 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49900035f0 con 0x7f499c1032c0 2024-04-26T20:23:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.632+0000 7f4999600640 1 -- 172.21.15.82:0/4198436917 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990010690 con 0x7f499c1032c0 2024-04-26T20:23:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.632+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c1a0f00 con 0x7f499c1032c0 2024-04-26T20:23:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.635+0000 7f49a6608740 1 Processor -- start 2024-04-26T20:23:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.635+0000 7f49a6608740 1 -- start start 2024-04-26T20:23:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.635+0000 7f4999600640 1 -- 172.21.15.82:0/4198436917 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f49900037a0 con 0x7f499c1032c0 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a6608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a6608740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a6608740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a6608740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c6f12bc70 con 0x562c6f1cdbb0 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a6608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562c6f0e4980 con 0x562c6f1c8050 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a6608740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562c6f127c30 con 0x562c6f1c8a40 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f499be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50876/0 (socket says 172.21.15.82:50876) 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f499be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39996/0 (socket says 172.21.15.82:39996) 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a1800640 1 -- 172.21.15.82:0/3576322658 learned_addr learned my addr 172.21.15.82:0/3576322658 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.636+0000 7f49a0e00640 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f49a1800640 1 -- 172.21.15.82:0/3576322658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 msgr2=0x562c6f1cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f49a1800640 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f49a1800640 1 -- 172.21.15.82:0/3576322658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 msgr2=0x562c6f1d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f49a1800640 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f49a1800640 1 -- 172.21.15.82:0/3576322658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6f0bc7b0 con 0x562c6f1c8050 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f499be00640 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f49a1800640 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1c8470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4994009fd0 tx=0x7f49940118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3387aa5b5164c91b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f498e000640 1 -- 172.21.15.82:0/3576322658 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994004d20 con 0x562c6f1c8050 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f498e000640 1 -- 172.21.15.82:0/3576322658 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4994004050 con 0x562c6f1c8050 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f498e000640 1 -- 172.21.15.82:0/3576322658 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994005240 con 0x562c6f1c8050 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.637+0000 7f4999600640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49840a3c40 0x7f49840a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f4999600640 1 -- 172.21.15.82:0/4198436917 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f49900d0c00 con 0x7f499c1032c0 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a0e00640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49840a3c40 0x7f49840a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 -- 172.21.15.82:0/3576322658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 msgr2=0x562c6f1c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1c8470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4994009fd0 tx=0x7f49940118d0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 -- 172.21.15.82:0/3576322658 shutdown_connections 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 --2- 172.21.15.82:0/3576322658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1c8470 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 -- 172.21.15.82:0/3576322658 >> 172.21.15.82:0/3576322658 conn(0x562c6f1c36c0 msgr2=0x562c6f1c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 -- 172.21.15.82:0/3576322658 shutdown_connections 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a6608740 1 -- 172.21.15.82:0/3576322658 wait complete. 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.638+0000 7f49a0e00640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49840a3c40 0x7f49840a6100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x562c6f1c8e40 tx=0x7f49900d46b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.639+0000 7f49a6608740 1 -- start start 2024-04-26T20:23:31.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.639+0000 7f49a6608740 1 Processor -- start 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.639+0000 7f49a6608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.639+0000 7f49a6608740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.639+0000 7f49a6608740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a6608740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562c6f12af80 con 0x562c6f1cdbb0 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a6608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562c6f0d8260 con 0x562c6f1c8050 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a6608740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562c6f1302a0 con 0x562c6f1c8a40 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a6608740 10 client.0 _ll_register_callbacks cb 0x562c6f122960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f499be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50890/0 (socket says 172.21.15.82:50890) 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 -- 172.21.15.82:0/4256850262 learned_addr learned my addr 172.21.15.82:0/4256850262 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 -- 172.21.15.82:0/4256850262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 msgr2=0x562c6f1d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 -- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 msgr2=0x562c6f1d9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.640+0000 7f49a1800640 1 -- 172.21.15.82:0/4256850262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6f0ba1c0 con 0x562c6f1c8050 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f49a1800640 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d1f00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4994005fd0 tx=0x7f49940118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9397fcaf703f3c2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f4982a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f4982a00640 1 -- 172.21.15.82:0/4256850262 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994004c40 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f4982a00640 1 -- 172.21.15.82:0/4256850262 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4994004de0 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4994004050 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f4982a00640 1 -- 172.21.15.82:0/4256850262 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4994036050 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f49a6608740 10 client.25721 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c6ee3d3f0 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.641+0000 7f4982a00640 1 -- 172.21.15.82:0/4256850262 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4994004050 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f4982a00640 1 -- 172.21.15.82:0/4256850262 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4994005030 con 0x562c6f1c8050 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f49a6608740 10 client.25721 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f49a6608740 10 client.25721 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:23:31.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f49a6608740 20 client.25721 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f49a6608740 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f1dd7a0 0x562c6f1dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f49a6608740 4 client.25721 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c6f139880 con 0x562c6f1dd7a0 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.642+0000 7f499be00640 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f1dd7a0 0x562c6f1dfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.643+0000 7f499be00640 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f1dd7a0 0x562c6f1dfb90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf528e9e8cdb6867 server_cookie=108c686ca206077d in_seq=0 out_seq=0 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.643+0000 7f4982a00640 10 client.25721 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f4982a00640 1 -- 172.21.15.82:0/4256850262 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562c6f139880 con 0x562c6f1dd7a0 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f4982a00640 10 client.25721 handle_command_reply: tid=0 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 client.25721 shutdown 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 msgr2=0x562c6f1d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d1f00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4994005fd0 tx=0x7f49940118d0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 shutdown_connections 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f1dd7a0 0x562c6f1dfb90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 --2- 172.21.15.82:0/4256850262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d1f00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 >> 172.21.15.82:0/4256850262 conn(0x562c6f1c36c0 msgr2=0x562c6f1c27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f4982a00640 0 client.25721 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 shutdown_connections 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 1 -- 172.21.15.82:0/4256850262 wait complete. 2024-04-26T20:23:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.644+0000 7f49a6608740 20 client.25721 trim_cache size 0 max 16384 2024-04-26T20:23:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.659+0000 7f49a6608740 1 Processor -- start 2024-04-26T20:23:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.659+0000 7f49a6608740 1 -- start start 2024-04-26T20:23:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.659+0000 7f49a6608740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8050 0x562c6f1c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.659+0000 7f49a6608740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a6608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1cdbb0 0x562c6f1c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a6608740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ab2a0 con 0x562c6f1c8050 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a6608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1acde0 con 0x562c6f1cdbb0 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a6608740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ab970 con 0x562c6f1c8a40 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8050 0x562c6f1c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33264/0 (socket says 172.21.15.82:33264) 2024-04-26T20:23:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 -- 172.21.15.82:0/4082089068 learned_addr learned my addr 172.21.15.82:0/4082089068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a1800640 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1cdbb0 0x562c6f1c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 -- 172.21.15.82:0/4082089068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1cdbb0 msgr2=0x562c6f1c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1cdbb0 0x562c6f1c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 -- 172.21.15.82:0/4082089068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8050 msgr2=0x562c6f1c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8050 0x562c6f1c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f499be00640 1 -- 172.21.15.82:0/4082089068 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6ef077d0 con 0x562c6f1c8a40 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.660+0000 7f49a1800640 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1cdbb0 0x562c6f1c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.661+0000 7f499be00640 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d9440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4988009230 tx=0x7f49880314a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbac8b674b39b43d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.661+0000 7f498d600640 1 -- 172.21.15.82:0/4082089068 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988035040 con 0x562c6f1c8a40 2024-04-26T20:23:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.661+0000 7f498d600640 1 -- 172.21.15.82:0/4082089068 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f498804b070 con 0x562c6f1c8a40 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.661+0000 7f498d600640 1 -- 172.21.15.82:0/4082089068 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49880462c0 con 0x562c6f1c8a40 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 -- 172.21.15.82:0/4082089068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 msgr2=0x562c6f1d9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d9440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4988009230 tx=0x7f49880314a0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 -- 172.21.15.82:0/4082089068 shutdown_connections 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1cdbb0 0x562c6f1c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1c8a40 0x562c6f1d9440 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 --2- 172.21.15.82:0/4082089068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8050 0x562c6f1c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 -- 172.21.15.82:0/4082089068 >> 172.21.15.82:0/4082089068 conn(0x562c6f1c36c0 msgr2=0x562c6f1c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 -- 172.21.15.82:0/4082089068 shutdown_connections 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 -- 172.21.15.82:0/4082089068 wait complete. 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 -- start start 2024-04-26T20:23:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.662+0000 7f49a6608740 1 Processor -- start 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 0x562c6f1d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ac710 con 0x562c6f1c8a40 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ac040 con 0x562c6f1c8050 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1a9280 con 0x562c6f1cdbb0 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a6608740 10 client.0 _ll_register_callbacks cb 0x7f49940093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 0x562c6f1d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 0x562c6f1d6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40022/0 (socket says 172.21.15.82:40022) 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 -- 172.21.15.82:0/928876040 learned_addr learned my addr 172.21.15.82:0/928876040 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a1800640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a1800640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 -- 172.21.15.82:0/928876040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1cdbb0 msgr2=0x562c6f1d7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 -- 172.21.15.82:0/928876040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 msgr2=0x562c6f1d6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f499be00640 1 -- 172.21.15.82:0/928876040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6f0d22a0 con 0x562c6f1c8a40 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.663+0000 7f49a1800640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f499be00640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 0x562c6f1d6b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f49880053c0 tx=0x7f498802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02bd3ceba1096ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f4982a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f4982a00640 1 -- 172.21.15.82:0/928876040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988035040 con 0x562c6f1c8a40 2024-04-26T20:23:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f4982a00640 1 -- 172.21.15.82:0/928876040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4988004450 con 0x562c6f1c8a40 2024-04-26T20:23:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f498804b070 con 0x562c6f1c8a40 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f4982a00640 1 -- 172.21.15.82:0/928876040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f498805e050 con 0x562c6f1c8a40 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f49a6608740 10 client.15636 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.664+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c6f1d9250 con 0x562c6f1c8a40 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f4982a00640 1 -- 172.21.15.82:0/928876040 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f498804b070 con 0x562c6f1c8a40 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f4982a00640 1 -- 172.21.15.82:0/928876040 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4988004a30 con 0x562c6f1c8a40 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a6608740 10 client.15636 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a6608740 10 client.15636 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a6608740 20 client.15636 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a6608740 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f24c7b0 0x562c6f24ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a6608740 4 client.15636 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c6f1336f0 con 0x562c6f24c7b0 2024-04-26T20:23:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.665+0000 7f49a1800640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f24c7b0 0x562c6f24ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a1800640 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f24c7b0 0x562c6f24ebd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c7100820bee10ff server_cookie=2f99cdcb76c55373 in_seq=0 out_seq=0 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f4982a00640 10 client.15636 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f4982a00640 1 -- 172.21.15.82:0/928876040 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c6f1336f0 con 0x562c6f24c7b0 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f4982a00640 10 client.15636 handle_command_reply: tid=0 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 client.15636 shutdown 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 msgr2=0x562c6f1d6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 0x562c6f1d6b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f49880053c0 tx=0x7f498802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 shutdown_connections 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562c6f24c7b0 0x562c6f24ebd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c6f1cdbb0 0x562c6f1d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562c6f1c8a40 0x562c6f1d6b80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 --2- 172.21.15.82:0/928876040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c6f1c8050 0x562c6f1d6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 >> 172.21.15.82:0/928876040 conn(0x562c6f1c36c0 msgr2=0x562c6f1c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f4982a00640 0 client.15636 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 shutdown_connections 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.666+0000 7f49a6608740 1 -- 172.21.15.82:0/928876040 wait complete. 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a6608740 20 client.15636 trim_cache size 0 max 16384 2024-04-26T20:23:31.672 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:23:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49840a3c40 msgr2=0x7f49840a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49840a3c40 0x7f49840a6100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x562c6f1c8e40 tx=0x7f49900d46b0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c1032c0 msgr2=0x7f499c198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c1032c0 0x7f499c198aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f499000e9f0 tx=0x7f499000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 shutdown_connections 2024-04-26T20:23:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49840a3c40 0x7f49840a6100 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f499c108520 0x7f499c1a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f499c105bf0 0x7f499c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 --2- 172.21.15.82:0/4198436917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f499c1032c0 0x7f499c198aa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 >> 172.21.15.82:0/4198436917 conn(0x7f499c0fccd0 msgr2=0x7f499c103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 shutdown_connections 2024-04-26T20:23:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.667+0000 7f49a2200640 1 -- 172.21.15.82:0/4198436917 wait complete. 2024-04-26T20:23:31.688 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:23:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.891+0000 7f229f200640 1 -- 172.21.15.82:0/1362113144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0106620 msgr2=0x7f22a010ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.891+0000 7f229f200640 1 --2- 172.21.15.82:0/1362113144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0106620 0x7f22a010ceb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2298009ca0 tx=0x7f229802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 -- 172.21.15.82:0/1362113144 shutdown_connections 2024-04-26T20:23:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 --2- 172.21.15.82:0/1362113144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0106620 0x7f22a010ceb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 --2- 172.21.15.82:0/1362113144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0105c60 0x7f22a01060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 --2- 172.21.15.82:0/1362113144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0104a70 0x7f22a0104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 -- 172.21.15.82:0/1362113144 >> 172.21.15.82:0/1362113144 conn(0x7f22a00fffe0 msgr2=0x7f22a0102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 -- 172.21.15.82:0/1362113144 shutdown_connections 2024-04-26T20:23:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.892+0000 7f229f200640 1 -- 172.21.15.82:0/1362113144 wait complete. 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 Processor -- start 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 -- start start 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0104a70 0x7f22a019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0105c60 0x7f22a019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 0x7f22a01a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01105d0 con 0x7f22a0106620 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0110450 con 0x7f22a0104a70 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0110750 con 0x7f22a0105c60 2024-04-26T20:23:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.893+0000 7f229e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 0x7f22a01a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 0x7f22a01a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40028/0 (socket says 172.21.15.82:40028) 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229e800640 1 -- 172.21.15.82:0/3134757442 learned_addr learned my addr 172.21.15.82:0/3134757442 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0104a70 0x7f22a019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229d400640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0105c60 0x7f22a019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 -- 172.21.15.82:0/3134757442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0105c60 msgr2=0x7f22a019b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0105c60 0x7f22a019b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 -- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 msgr2=0x7f22a01a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 0x7f22a01a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 -- 172.21.15.82:0/3134757442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a01a2870 con 0x7f22a0104a70 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229e800640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 0x7f22a01a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.894+0000 7f229de00640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0104a70 0x7f22a019ac60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f229000e9c0 tx=0x7f229000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.895+0000 7f2296a00640 1 -- 172.21.15.82:0/3134757442 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229000ccc0 con 0x7f22a0104a70 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.895+0000 7f2296a00640 1 -- 172.21.15.82:0/3134757442 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22900035f0 con 0x7f22a0104a70 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.895+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a01a2b60 con 0x7f22a0104a70 2024-04-26T20:23:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.895+0000 7f2296a00640 1 -- 172.21.15.82:0/3134757442 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229000ce60 con 0x7f22a0104a70 2024-04-26T20:23:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.895+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a01a30b0 con 0x7f22a0104a70 2024-04-26T20:23:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f2296a00640 1 -- 172.21.15.82:0/3134757442 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2290004000 con 0x7f22a0104a70 2024-04-26T20:23:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 Processor -- start 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 -- start start 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd718470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd71d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd720040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648bd67bc70 con 0x5648bd718050 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648bd634980 con 0x5648bd71dbb0 2024-04-26T20:23:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.898+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5648bd677c30 con 0x5648bd718a40 2024-04-26T20:23:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd718470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd720040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd71d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd720040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50926/0 (socket says 172.21.15.82:50926) 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd718470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40036/0 (socket says 172.21.15.82:40036) 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 -- 172.21.15.82:0/2480759643 learned_addr learned my addr 172.21.15.82:0/2480759643 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 -- 172.21.15.82:0/2480759643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 msgr2=0x5648bd71d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd71d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 -- 172.21.15.82:0/2480759643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 msgr2=0x5648bd718470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd718470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 -- 172.21.15.82:0/2480759643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648bd60c7b0 con 0x5648bd71dbb0 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229e800640 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd718470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.899+0000 7f229d400640 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd720040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f228c009cf0 tx=0x7f228c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af605a2a800090de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f228b400640 1 -- 172.21.15.82:0/2480759643 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c004230 con 0x5648bd71dbb0 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f228b400640 1 -- 172.21.15.82:0/2480759643 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0043d0 con 0x5648bd71dbb0 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f228b400640 1 -- 172.21.15.82:0/2480759643 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c019880 con 0x5648bd71dbb0 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f2296a00640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f22840a3c40 0x7f22840a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f2296a00640 1 -- 172.21.15.82:0/3134757442 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f22900d0e00 con 0x7f22a0104a70 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f229e800640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f22840a3c40 0x7f22840a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2480759643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 msgr2=0x5648bd720040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.900+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd720040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f228c009cf0 tx=0x7f228c011810 comp rx=0 tx=0).stop 2024-04-26T20:23:31.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2480759643 shutdown_connections 2024-04-26T20:23:31.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd720040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd71d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2480759643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd718470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2480759643 >> 172.21.15.82:0/2480759643 conn(0x5648bd7136c0 msgr2=0x5648bd713ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2480759643 shutdown_connections 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f229e800640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f22840a3c40 0x7f22840a6100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5648bd7192a0 tx=0x7f2298031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2480759643 wait complete. 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.901+0000 7f22a7f9c740 1 -- start start 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 Processor -- start 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718050 0x5648bd721f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 0x5648bd722470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd7294b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648bd67af80 con 0x5648bd718a40 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648bd628260 con 0x5648bd71dbb0 2024-04-26T20:23:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5648bd6802a0 con 0x5648bd718050 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f22a7f9c740 10 client.0 _ll_register_callbacks cb 0x5648bd672960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f229d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 0x5648bd722470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f229e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd7294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f229de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718050 0x5648bd721f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f229e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd7294b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50936/0 (socket says 172.21.15.82:50936) 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f229e800640 1 -- 172.21.15.82:0/628370959 learned_addr learned my addr 172.21.15.82:0/628370959 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.902+0000 7f229d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 0x5648bd722470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40048/0 (socket says 172.21.15.82:40048) 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229d400640 1 -- 172.21.15.82:0/628370959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718050 msgr2=0x5648bd721f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229d400640 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718050 0x5648bd721f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229d400640 1 -- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 msgr2=0x5648bd7294b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229d400640 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd7294b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229d400640 1 -- 172.21.15.82:0/628370959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648bd60a1c0 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229de00640 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718050 0x5648bd721f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f229d400640 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 0x5648bd722470 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f228c009cf0 tx=0x7f228c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98f854d74b6f29d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f227fe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f227fe00640 1 -- 172.21.15.82:0/628370959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c027070 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.903+0000 7f227fe00640 1 -- 172.21.15.82:0/628370959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f228c005240 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c0043d0 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f227fe00640 1 -- 172.21.15.82:0/628370959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f228c033050 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 10 client.15648 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648bd38d3f0 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f227fe00640 1 -- 172.21.15.82:0/628370959 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0043d0 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f227fe00640 1 -- 172.21.15.82:0/628370959 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f228c004b70 con 0x5648bd718a40 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 10 client.15648 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 20 client.15648 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd72d730 0x5648bd72fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 4 client.15648 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.904+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648bd689880 con 0x5648bd72d730 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.905+0000 7f229de00640 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd72d730 0x5648bd72fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.905+0000 7f229de00640 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd72d730 0x5648bd72fb40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a31439f87d8e998 server_cookie=c1fdf74708f62700 in_seq=0 out_seq=0 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.905+0000 7f227fe00640 10 client.15648 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.906+0000 7f227fe00640 1 -- 172.21.15.82:0/628370959 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5648bd689880 con 0x5648bd72d730 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.906+0000 7f227fe00640 10 client.15648 handle_command_reply: tid=0 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.906+0000 7f22a7f9c740 1 client.15648 shutdown 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 msgr2=0x5648bd722470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 0x5648bd722470 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f228c009cf0 tx=0x7f228c003820 comp rx=0 tx=0).stop 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 shutdown_connections 2024-04-26T20:23:31.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd72d730 0x5648bd72fb40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd71dbb0 0x5648bd7294b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718a40 0x5648bd722470 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/628370959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718050 0x5648bd721f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 >> 172.21.15.82:0/628370959 conn(0x5648bd7136c0 msgr2=0x5648bd7127b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f227fe00640 0 client.15648 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 shutdown_connections 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 1 -- 172.21.15.82:0/628370959 wait complete. 2024-04-26T20:23:31.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.907+0000 7f22a7f9c740 20 client.15648 trim_cache size 0 max 16384 2024-04-26T20:23:31.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.921+0000 7f22a7f9c740 1 Processor -- start 2024-04-26T20:23:31.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 -- start start 2024-04-26T20:23:31.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd7163a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd718a40 0x5648bd729470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd71dbb0 0x5648bd7168e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01ad4d0 con 0x5648bd718050 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01af010 con 0x5648bd718a40 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01adba0 con 0x5648bd71dbb0 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f229de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd7163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f229de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd7163a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40056/0 (socket says 172.21.15.82:40056) 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f229de00640 1 -- 172.21.15.82:0/2647051195 learned_addr learned my addr 172.21.15.82:0/2647051195 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f229e800640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd71dbb0 0x5648bd7168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.922+0000 7f229d400640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd718a40 0x5648bd729470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229de00640 1 -- 172.21.15.82:0/2647051195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd71dbb0 msgr2=0x5648bd7168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229de00640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd71dbb0 0x5648bd7168e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229de00640 1 -- 172.21.15.82:0/2647051195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd718a40 msgr2=0x5648bd729470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229de00640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd718a40 0x5648bd729470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229de00640 1 -- 172.21.15.82:0/2647051195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648bd4577d0 con 0x5648bd718050 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229d400640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd718a40 0x5648bd729470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229e800640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd71dbb0 0x5648bd7168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f229de00640 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd7163a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2290098f90 tx=0x7f22900d3250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95577dc6f0ac677 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f228aa00640 1 -- 172.21.15.82:0/2647051195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229009c520 con 0x5648bd718050 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f228aa00640 1 -- 172.21.15.82:0/2647051195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f229009d2c0 con 0x5648bd718050 2024-04-26T20:23:31.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.923+0000 7f228aa00640 1 -- 172.21.15.82:0/2647051195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229009ad00 con 0x5648bd718050 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2647051195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 msgr2=0x5648bd7163a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd7163a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2290098f90 tx=0x7f22900d3250 comp rx=0 tx=0).stop 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2647051195 shutdown_connections 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd71dbb0 0x5648bd7168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd718a40 0x5648bd729470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/2647051195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd718050 0x5648bd7163a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2647051195 >> 172.21.15.82:0/2647051195 conn(0x5648bd7136c0 msgr2=0x5648bd7127b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2647051195 shutdown_connections 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 -- 172.21.15.82:0/2647051195 wait complete. 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 -- start start 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.924+0000 7f22a7f9c740 1 Processor -- start 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd726a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 0x5648bd726fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd727fe0 0x5648bd728460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01ae940 con 0x5648bd71dbb0 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01ae270 con 0x5648bd727fe0 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01ab4b0 con 0x5648bd718a40 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f22a7f9c740 10 client.0 _ll_register_callbacks cb 0x7f2290005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:31.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 0x5648bd726fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 0x5648bd726fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40060/0 (socket says 172.21.15.82:40060) 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 -- 172.21.15.82:0/3812826020 learned_addr learned my addr 172.21.15.82:0/3812826020 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229de00640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd726a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229e800640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd727fe0 0x5648bd728460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 -- 172.21.15.82:0/3812826020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 msgr2=0x5648bd726a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd726a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 -- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd727fe0 msgr2=0x5648bd728460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd727fe0 0x5648bd728460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.925+0000 7f229d400640 1 -- 172.21.15.82:0/3812826020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648bd6222a0 con 0x5648bd71dbb0 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f229de00640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd726a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f229e800640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd727fe0 0x5648bd728460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f229d400640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 0x5648bd726fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f228c0059f0 tx=0x7f228c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bebdf12e55d54b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f227fe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:31.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f227fe00640 1 -- 172.21.15.82:0/3812826020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c03c060 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f227fe00640 1 -- 172.21.15.82:0/3812826020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f228c019ab0 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229009d2c0 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f227fe00640 1 -- 172.21.15.82:0/3812826020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f228c027070 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f22a7f9c740 10 client.15654 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.926+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648bd793df0 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f227fe00640 1 -- 172.21.15.82:0/3812826020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f229009d2c0 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f227fe00640 1 -- 172.21.15.82:0/3812826020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f228c019cb0 con 0x5648bd71dbb0 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f22a7f9c740 10 client.15654 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f22a7f9c740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f22a7f9c740 20 client.15654 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd794710 0x5648bd796b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f22a7f9c740 4 client.15654 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648bd6836f0 con 0x5648bd794710 2024-04-26T20:23:31.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.927+0000 7f229de00640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd794710 0x5648bd796b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f229de00640 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd794710 0x5648bd796b30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0394ff8e4b9495 server_cookie=bba52d4a43ef04b4 in_seq=0 out_seq=0 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f227fe00640 10 client.15654 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f227fe00640 1 -- 172.21.15.82:0/3812826020 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648bd6836f0 con 0x5648bd794710 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f227fe00640 10 client.15654 handle_command_reply: tid=0 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 client.15654 shutdown 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 msgr2=0x5648bd726fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 0x5648bd726fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f228c0059f0 tx=0x7f228c005d30 comp rx=0 tx=0).stop 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 shutdown_connections 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5648bd794710 0x5648bd796b30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648bd727fe0 0x5648bd728460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648bd71dbb0 0x5648bd726fd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 --2- 172.21.15.82:0/3812826020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bd718a40 0x5648bd726a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f227fe00640 0 client.15654 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:31.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 >> 172.21.15.82:0/3812826020 conn(0x5648bd7136c0 msgr2=0x5648bd719440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 shutdown_connections 2024-04-26T20:23:31.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.928+0000 7f22a7f9c740 1 -- 172.21.15.82:0/3812826020 wait complete. 2024-04-26T20:23:31.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f22a7f9c740 20 client.15654 trim_cache size 0 max 16384 2024-04-26T20:23:31.935 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:23:31.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f22840a3c40 msgr2=0x7f22840a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f22840a3c40 0x7f22840a6100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5648bd7192a0 tx=0x7f2298031af0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0104a70 msgr2=0x7f22a019ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:31.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0104a70 0x7f22a019ac60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f229000e9c0 tx=0x7f229000ee80 comp rx=0 tx=0).stop 2024-04-26T20:23:31.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 shutdown_connections 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f22840a3c40 0x7f22840a6100 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0106620 0x7f22a01a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a0105c60 0x7f22a019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 --2- 172.21.15.82:0/3134757442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a0104a70 0x7f22a019ac60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 >> 172.21.15.82:0/3134757442 conn(0x7f22a00fffe0 msgr2=0x7f22a0108fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 shutdown_connections 2024-04-26T20:23:31.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:31.929+0000 7f229f200640 1 -- 172.21.15.82:0/3134757442 wait complete. 2024-04-26T20:23:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:31 smithi082 ceph-mon[28105]: pgmap v433: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-26T20:23:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:31 smithi139 ceph-mon[32999]: pgmap v433: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-26T20:23:32.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:31 smithi135 ceph-mon[32816]: pgmap v433: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-26T20:23:32.948 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:23:32.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:23:32.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 -- 172.21.15.82:0/3328199341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1514101a10 msgr2=0x7f1514101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 --2- 172.21.15.82:0/3328199341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1514101a10 0x7f1514101e70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009860 tx=0x7f14fc02a340 comp rx=0 tx=0).stop 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 -- 172.21.15.82:0/3328199341 shutdown_connections 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 --2- 172.21.15.82:0/3328199341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141023b0 0x7f1514102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 --2- 172.21.15.82:0/3328199341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1514101a10 0x7f1514101e70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 --2- 172.21.15.82:0/3328199341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15141010b0 0x7f15141014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 -- 172.21.15.82:0/3328199341 >> 172.21.15.82:0/3328199341 conn(0x7f15140fccd0 msgr2=0x7f15140ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 -- 172.21.15.82:0/3328199341 shutdown_connections 2024-04-26T20:23:33.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.163+0000 7f1518a00640 1 -- 172.21.15.82:0/3328199341 wait complete. 2024-04-26T20:23:33.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 Processor -- start 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 -- start start 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 0x7f151419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1514101a10 0x7f151419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15141023b0 0x7f15141a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1514110560 con 0x7f1514101a10 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15141103e0 con 0x7f15141010b0 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1518a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15141106e0 con 0x7f15141023b0 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.165+0000 7f1512800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 0x7f151419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1514101a10 0x7f151419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 0x7f151419ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50968/0 (socket says 172.21.15.82:50968) 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 -- 172.21.15.82:0/255091637 learned_addr learned my addr 172.21.15.82:0/255091637 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1513200640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15141023b0 0x7f15141a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 -- 172.21.15.82:0/255091637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15141023b0 msgr2=0x7f15141a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15141023b0 0x7f15141a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 -- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1514101a10 msgr2=0x7f151419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1514101a10 0x7f151419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 -- 172.21.15.82:0/255091637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15141a2860 con 0x7f15141010b0 2024-04-26T20:23:33.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.166+0000 7f1512800640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 0x7f151419ac50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f150400c420 tx=0x7f1504009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.167+0000 7f150b400640 1 -- 172.21.15.82:0/255091637 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504003970 con 0x7f15141010b0 2024-04-26T20:23:33.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.167+0000 7f150b400640 1 -- 172.21.15.82:0/255091637 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1504004020 con 0x7f15141010b0 2024-04-26T20:23:33.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.167+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15141a2b50 con 0x7f15141010b0 2024-04-26T20:23:33.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.167+0000 7f150b400640 1 -- 172.21.15.82:0/255091637 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150400b980 con 0x7f15141010b0 2024-04-26T20:23:33.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.167+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15141a30f0 con 0x7f15141010b0 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.170+0000 7f151c3db740 1 Processor -- start 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.170+0000 7f150b400640 1 -- 172.21.15.82:0/255091637 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f150401d020 con 0x7f15141010b0 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.170+0000 7f151c3db740 1 -- start start 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.170+0000 7f151c3db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66bae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.170+0000 7f151c3db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66bb460 0x55abb66bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f151c3db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 0x55abb66c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f151c3db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55abb661f980 con 0x55abb66c05d0 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f151c3db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55abb65bc220 con 0x55abb66bb460 2024-04-26T20:23:33.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f151c3db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb661b940 con 0x55abb66baa70 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 0x55abb66c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1513200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 0x55abb66c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40086/0 (socket says 172.21.15.82:40086) 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 -- 172.21.15.82:0/1301237159 learned_addr learned my addr 172.21.15.82:0/1301237159 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1512800640 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66bb460 0x55abb66bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 -- 172.21.15.82:0/1301237159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 msgr2=0x55abb66bae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66bae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 -- 172.21.15.82:0/1301237159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66bb460 msgr2=0x55abb66bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66bb460 0x55abb66bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1511e00640 1 -- 172.21.15.82:0/1301237159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb63f97e0 con 0x55abb66c05d0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1513200640 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66bae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.171+0000 7f1512800640 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66bb460 0x55abb66bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f1511e00640 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 0x55abb66c2a60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14fc02a860 tx=0x7f14fc005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bbb2ed4cd1a568 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f150b400640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f14f80a3cc0 0x7f14f80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f1503400640 1 -- 172.21.15.82:0/1301237159 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc037040 con 0x55abb66c05d0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f1503400640 1 -- 172.21.15.82:0/1301237159 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc030dd0 con 0x55abb66c05d0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f150b400640 1 -- 172.21.15.82:0/255091637 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f15040d0780 con 0x7f15141010b0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f1503400640 1 -- 172.21.15.82:0/1301237159 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc003970 con 0x55abb66c05d0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.172+0000 7f1513200640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f14f80a3cc0 0x7f14f80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 -- 172.21.15.82:0/1301237159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 msgr2=0x55abb66c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 0x55abb66c2a60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14fc02a860 tx=0x7f14fc005b20 comp rx=0 tx=0).stop 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 -- 172.21.15.82:0/1301237159 shutdown_connections 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66c05d0 0x55abb66c2a60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66bb460 0x55abb66bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 --2- 172.21.15.82:0/1301237159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66bae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 -- 172.21.15.82:0/1301237159 >> 172.21.15.82:0/1301237159 conn(0x55abb66b60e0 msgr2=0x55abb66b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f1513200640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f14f80a3cc0 0x7f14f80a6180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55abb66bbcc0 tx=0x7f150c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 -- 172.21.15.82:0/1301237159 shutdown_connections 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 -- 172.21.15.82:0/1301237159 wait complete. 2024-04-26T20:23:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.173+0000 7f151c3db740 1 -- start start 2024-04-26T20:23:33.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 Processor -- start 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66baa70 0x55abb66c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66c05d0 0x55abb66cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55abb66c3520 con 0x55abb66bb460 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55abb65a7170 con 0x55abb66baa70 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb66c36a0 con 0x55abb66c05d0 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f151c3db740 10 client.0 _ll_register_callbacks cb 0x55abb6616770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.174+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40094/0 (socket says 172.21.15.82:40094) 2024-04-26T20:23:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 -- 172.21.15.82:0/2624850922 learned_addr learned my addr 172.21.15.82:0/2624850922 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1512800640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66baa70 0x55abb66c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1513200640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66c05d0 0x55abb66cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 -- 172.21.15.82:0/2624850922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66c05d0 msgr2=0x55abb66cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66c05d0 0x55abb66cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 -- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66baa70 msgr2=0x55abb66c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66baa70 0x55abb66c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 -- 172.21.15.82:0/2624850922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb6459f70 con 0x55abb66bb460 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f1511e00640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66c5380 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009830 tx=0x7f14fc030a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb525ec52c51f776 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f14f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.175+0000 7f14f7e00640 1 -- 172.21.15.82:0/2624850922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc037070 con 0x55abb66bb460 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f14f7e00640 1 -- 172.21.15.82:0/2624850922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f14fc005230 con 0x55abb66bb460 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc030dd0 con 0x55abb66bb460 2024-04-26T20:23:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f14f7e00640 1 -- 172.21.15.82:0/2624850922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f14fc057050 con 0x55abb66bb460 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 10 client.15666 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55abb62f1170 con 0x55abb66bb460 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f14f7e00640 1 -- 172.21.15.82:0/2624850922 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc030dd0 con 0x55abb66bb460 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f14f7e00640 1 -- 172.21.15.82:0/2624850922 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f14fc03d7b0 con 0x55abb66bb460 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 10 client.15666 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 20 client.15666 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb66d0520 0x55abb66d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 4 client.15666 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.176+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abb662d590 con 0x55abb66d0520 2024-04-26T20:23:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.177+0000 7f1512800640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb66d0520 0x55abb66d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.177+0000 7f14f7e00640 10 client.15666 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.177+0000 7f1512800640 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb66d0520 0x55abb66d2910 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b099b369b361b6a server_cookie=ea5acb0a3428916a in_seq=0 out_seq=0 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.178+0000 7f14f7e00640 1 -- 172.21.15.82:0/2624850922 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55abb662d590 con 0x55abb66d0520 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.178+0000 7f14f7e00640 10 client.15666 handle_command_reply: tid=0 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.178+0000 7f151c3db740 1 client.15666 shutdown 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 msgr2=0x55abb66c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66c5380 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009830 tx=0x7f14fc030a30 comp rx=0 tx=0).stop 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 shutdown_connections 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb66d0520 0x55abb66d2910 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66c05d0 0x55abb66cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f14f7e00640 0 client.15666 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66c5380 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 --2- 172.21.15.82:0/2624850922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66baa70 0x55abb66c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 >> 172.21.15.82:0/2624850922 conn(0x55abb66b60e0 msgr2=0x55abb66b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 shutdown_connections 2024-04-26T20:23:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 1 -- 172.21.15.82:0/2624850922 wait complete. 2024-04-26T20:23:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.179+0000 7f151c3db740 20 client.15666 trim_cache size 0 max 16384 2024-04-26T20:23:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 Processor -- start 2024-04-26T20:23:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 -- start start 2024-04-26T20:23:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15141ad320 con 0x55abb66bb460 2024-04-26T20:23:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15141aee60 con 0x55abb66c05d0 2024-04-26T20:23:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.198+0000 7f151c3db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15141ad9f0 con 0x55abb66baa70 2024-04-26T20:23:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40098/0 (socket says 172.21.15.82:40098) 2024-04-26T20:23:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1513200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 -- 172.21.15.82:0/783668473 learned_addr learned my addr 172.21.15.82:0/783668473 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1512800640 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 -- 172.21.15.82:0/783668473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 msgr2=0x55abb66b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 -- 172.21.15.82:0/783668473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 msgr2=0x55abb66b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 -- 172.21.15.82:0/783668473 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb66bbcf0 con 0x55abb66bb460 2024-04-26T20:23:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1512800640 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1511e00640 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66cc380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14fc005bd0 tx=0x7f14fc005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f416d3e23f7790 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1502a00640 1 -- 172.21.15.82:0/783668473 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc04a070 con 0x55abb66bb460 2024-04-26T20:23:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.199+0000 7f1502a00640 1 -- 172.21.15.82:0/783668473 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc03ee50 con 0x55abb66bb460 2024-04-26T20:23:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f1502a00640 1 -- 172.21.15.82:0/783668473 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc037070 con 0x55abb66bb460 2024-04-26T20:23:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 -- 172.21.15.82:0/783668473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 msgr2=0x55abb66cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66cc380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14fc005bd0 tx=0x7f14fc005b20 comp rx=0 tx=0).stop 2024-04-26T20:23:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 -- 172.21.15.82:0/783668473 shutdown_connections 2024-04-26T20:23:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66cc380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 --2- 172.21.15.82:0/783668473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 -- 172.21.15.82:0/783668473 >> 172.21.15.82:0/783668473 conn(0x55abb66b60e0 msgr2=0x55abb66bc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 -- 172.21.15.82:0/783668473 shutdown_connections 2024-04-26T20:23:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.200+0000 7f151c3db740 1 -- 172.21.15.82:0/783668473 wait complete. 2024-04-26T20:23:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 -- start start 2024-04-26T20:23:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 Processor -- start 2024-04-26T20:23:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15141ae790 con 0x55abb66bb460 2024-04-26T20:23:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15141ae0c0 con 0x55abb66c05d0 2024-04-26T20:23:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15141ab300 con 0x55abb66baa70 2024-04-26T20:23:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.201+0000 7f151c3db740 10 client.0 _ll_register_callbacks cb 0x7f150c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1512800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40114/0 (socket says 172.21.15.82:40114) 2024-04-26T20:23:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 -- 172.21.15.82:0/980927983 learned_addr learned my addr 172.21.15.82:0/980927983 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1513200640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 -- 172.21.15.82:0/980927983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 msgr2=0x55abb66c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 -- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 msgr2=0x55abb66cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 -- 172.21.15.82:0/980927983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb66cb740 con 0x55abb66bb460 2024-04-26T20:23:33.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1512800640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:33.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f1511e00640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66ca190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14fc03ddc0 tx=0x7f14fc046670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255f9ef8bbfdc6f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.202+0000 7f14f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:33.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f14f7e00640 1 -- 172.21.15.82:0/980927983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc04a040 con 0x55abb66bb460 2024-04-26T20:23:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f14f7e00640 1 -- 172.21.15.82:0/980927983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f14fc03d690 con 0x55abb66bb460 2024-04-26T20:23:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc03ee50 con 0x55abb66bb460 2024-04-26T20:23:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f14f7e00640 1 -- 172.21.15.82:0/980927983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f14fc037040 con 0x55abb66bb460 2024-04-26T20:23:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 10 client.15672 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55abb6736be0 con 0x55abb66bb460 2024-04-26T20:23:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f14f7e00640 1 -- 172.21.15.82:0/980927983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc03ee50 con 0x55abb66bb460 2024-04-26T20:23:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f14f7e00640 1 -- 172.21.15.82:0/980927983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f14fc032440 con 0x55abb66bb460 2024-04-26T20:23:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 10 client.15672 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 20 client.15672 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb6737540 0x55abb6739960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 4 client.15672 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:23:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.203+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55abb6627400 con 0x55abb6737540 2024-04-26T20:23:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.204+0000 7f1512800640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb6737540 0x55abb6739960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.204+0000 7f1512800640 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb6737540 0x55abb6739960 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77e35587fca6e14 server_cookie=108d6cb5a7829f98 in_seq=0 out_seq=0 2024-04-26T20:23:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.204+0000 7f14f7e00640 10 client.15672 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.205+0000 7f14f7e00640 1 -- 172.21.15.82:0/980927983 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55abb6627400 con 0x55abb6737540 2024-04-26T20:23:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.205+0000 7f14f7e00640 10 client.15672 handle_command_reply: tid=0 2024-04-26T20:23:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.205+0000 7f151c3db740 1 client.15672 shutdown 2024-04-26T20:23:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.205+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 msgr2=0x55abb66ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.205+0000 7f151c3db740 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66ca190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14fc03ddc0 tx=0x7f14fc046670 comp rx=0 tx=0).stop 2024-04-26T20:23:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 shutdown_connections 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55abb6737540 0x55abb6739960 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abb66c05d0 0x55abb66cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abb66bb460 0x55abb66ca190 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f14f7e00640 0 client.15672 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 --2- 172.21.15.82:0/980927983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb66baa70 0x55abb66c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 >> 172.21.15.82:0/980927983 conn(0x55abb66b60e0 msgr2=0x55abb66b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 shutdown_connections 2024-04-26T20:23:33.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 1 -- 172.21.15.82:0/980927983 wait complete. 2024-04-26T20:23:33.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.206+0000 7f151c3db740 20 client.15672 trim_cache size 0 max 16384 2024-04-26T20:23:33.224 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:23:33.224 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:23:33.224 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "7094975b-7fe7-412a-94ed-9c6581735034", 2024-04-26T20:23:33.224 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:23:33.224 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:23:33.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f14f80a3cc0 msgr2=0x7f14f80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f14f80a3cc0 0x7f14f80a6180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55abb66bbcc0 tx=0x7f150c005f90 comp rx=0 tx=0).stop 2024-04-26T20:23:33.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 msgr2=0x7f151419ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 0x7f151419ac50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f150400c420 tx=0x7f1504009f90 comp rx=0 tx=0).stop 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 shutdown_connections 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f14f80a3cc0 0x7f14f80a6180 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15141023b0 0x7f15141a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1514101a10 0x7f151419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 --2- 172.21.15.82:0/255091637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15141010b0 0x7f151419ac50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 >> 172.21.15.82:0/255091637 conn(0x7f15140fccd0 msgr2=0x7f15140fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 shutdown_connections 2024-04-26T20:23:33.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.207+0000 7f1518a00640 1 -- 172.21.15.82:0/255091637 wait complete. 2024-04-26T20:23:33.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:23:33.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:23:33.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.432+0000 7f211b200640 1 -- 172.21.15.82:0/1697982062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 msgr2=0x7f211c1060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.432+0000 7f211b200640 1 --2- 172.21.15.82:0/1697982062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 0x7f211c1060e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2104009900 tx=0x7f210402a410 comp rx=0 tx=0).stop 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 -- 172.21.15.82:0/1697982062 shutdown_connections 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 --2- 172.21.15.82:0/1697982062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106620 0x7f211c10ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 --2- 172.21.15.82:0/1697982062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 0x7f211c1060e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 --2- 172.21.15.82:0/1697982062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 -- 172.21.15.82:0/1697982062 >> 172.21.15.82:0/1697982062 conn(0x7f211c0fffe0 msgr2=0x7f211c102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 -- 172.21.15.82:0/1697982062 shutdown_connections 2024-04-26T20:23:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.433+0000 7f211b200640 1 -- 172.21.15.82:0/1697982062 wait complete. 2024-04-26T20:23:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 Processor -- start 2024-04-26T20:23:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 -- start start 2024-04-26T20:23:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 0x7f211c19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106620 0x7f211c1a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1105f0 con 0x7f211c105c60 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f211c110470 con 0x7f211c104a70 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f211b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f211c110770 con 0x7f211c106620 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f2119e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f2113e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 0x7f211c19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f2119e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51014/0 (socket says 172.21.15.82:51014) 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.434+0000 7f2119e00640 1 -- 172.21.15.82:0/1658031157 learned_addr learned my addr 172.21.15.82:0/1658031157 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f211a800640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106620 0x7f211c1a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2119e00640 1 -- 172.21.15.82:0/1658031157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106620 msgr2=0x7f211c1a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2119e00640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106620 0x7f211c1a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2119e00640 1 -- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 msgr2=0x7f211c19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2119e00640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 0x7f211c19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2119e00640 1 -- 172.21.15.82:0/1658031157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c1a28b0 con 0x7f211c104a70 2024-04-26T20:23:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2119e00640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c19ac70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f210c00e9c0 tx=0x7f210c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f2112a00640 1 -- 172.21.15.82:0/1658031157 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c00cd80 con 0x7f211c104a70 2024-04-26T20:23:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.435+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c1a2ba0 con 0x7f211c104a70 2024-04-26T20:23:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.436+0000 7f2112a00640 1 -- 172.21.15.82:0/1658031157 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f210c0035f0 con 0x7f211c104a70 2024-04-26T20:23:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.436+0000 7f2112a00640 1 -- 172.21.15.82:0/1658031157 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c010690 con 0x7f211c104a70 2024-04-26T20:23:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.436+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c1a3110 con 0x7f211c104a70 2024-04-26T20:23:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 Processor -- start 2024-04-26T20:23:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 -- start start 2024-04-26T20:23:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f61fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f624e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f627950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b0f530030 con 0x561b0f6254c0 2024-04-26T20:23:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b0f54b7f0 con 0x561b0f620350 2024-04-26T20:23:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2123c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561b0f5067e0 con 0x561b0f61f960 2024-04-26T20:23:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.440+0000 7f2112a00640 1 -- 172.21.15.82:0/1658031157 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f210c0037a0 con 0x7f211c104a70 2024-04-26T20:23:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f2113e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f627950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f61fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f2113e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f627950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40128/0 (socket says 172.21.15.82:40128) 2024-04-26T20:23:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f2113e00640 1 -- 172.21.15.82:0/2536434621 learned_addr learned my addr 172.21.15.82:0/2536434621 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f2119e00640 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f624e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 -- 172.21.15.82:0/2536434621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 msgr2=0x561b0f624e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f624e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 -- 172.21.15.82:0/2536434621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 msgr2=0x561b0f627950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f627950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 -- 172.21.15.82:0/2536434621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b0f512050 con 0x561b0f61f960 2024-04-26T20:23:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f2113e00640 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f627950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f2119e00640 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f624e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.441+0000 7f211a800640 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f61fd80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2114009f00 tx=0x7f2114011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf10712d44e89ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f210b400640 1 -- 172.21.15.82:0/2536434621 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114004d20 con 0x561b0f61f960 2024-04-26T20:23:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f210b400640 1 -- 172.21.15.82:0/2536434621 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2114004030 con 0x561b0f61f960 2024-04-26T20:23:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f210b400640 1 -- 172.21.15.82:0/2536434621 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114005260 con 0x561b0f61f960 2024-04-26T20:23:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f2112a00640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21000a3c40 0x7f21000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f2112a00640 1 -- 172.21.15.82:0/1658031157 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f210c0d0c90 con 0x7f211c104a70 2024-04-26T20:23:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f2123c7a740 1 -- 172.21.15.82:0/2536434621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 msgr2=0x561b0f61fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.442+0000 7f2123c7a740 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f61fd80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2114009f00 tx=0x7f2114011810 comp rx=0 tx=0).stop 2024-04-26T20:23:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2119e00640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21000a3c40 0x7f21000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 -- 172.21.15.82:0/2536434621 shutdown_connections 2024-04-26T20:23:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f627950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f624e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 --2- 172.21.15.82:0/2536434621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f61fd80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 -- 172.21.15.82:0/2536434621 >> 172.21.15.82:0/2536434621 conn(0x561b0f61afd0 msgr2=0x561b0f61b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 -- 172.21.15.82:0/2536434621 shutdown_connections 2024-04-26T20:23:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 -- 172.21.15.82:0/2536434621 wait complete. 2024-04-26T20:23:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2119e00640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21000a3c40 0x7f21000a6100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x561b0f620750 tx=0x7f210c0bd040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 -- start start 2024-04-26T20:23:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.443+0000 7f2123c7a740 1 Processor -- start 2024-04-26T20:23:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f6297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f620350 0x561b0f629cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f6254c0 0x561b0f630d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b0f588200 con 0x561b0f620350 2024-04-26T20:23:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b0f582ee0 con 0x561b0f6254c0 2024-04-26T20:23:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561b0f58fe70 con 0x561b0f61f960 2024-04-26T20:23:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2123c7a740 10 client.0 _ll_register_callbacks cb 0x561b0f579270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f211a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f6297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f2113e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f620350 0x561b0f629cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f211a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f6297b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33410/0 (socket says 172.21.15.82:33410) 2024-04-26T20:23:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f211a800640 1 -- 172.21.15.82:0/3732551508 learned_addr learned my addr 172.21.15.82:0/3732551508 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.444+0000 7f211a800640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f6254c0 0x561b0f630d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f211a800640 1 -- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f6254c0 msgr2=0x561b0f630d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f211a800640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f6254c0 0x561b0f630d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f211a800640 1 -- 172.21.15.82:0/3732551508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f620350 msgr2=0x561b0f629cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f211a800640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f620350 0x561b0f629cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f211a800640 1 -- 172.21.15.82:0/3732551508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b0f35f7d0 con 0x561b0f61f960 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f2113e00640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f620350 0x561b0f629cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f211a800640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f6297b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2114005790 tx=0x7f2114009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72cbdb2580134756 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f20ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:23:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f20ffe00640 1 -- 172.21.15.82:0/3732551508 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211402d060 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2114004030 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f20ffe00640 1 -- 172.21.15.82:0/3732551508 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2114004c40 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f20ffe00640 1 -- 172.21.15.82:0/3732551508 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f211401e040 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f2123c7a740 10 client.25807 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.445+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561b0f2953f0 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f20ffe00640 1 -- 172.21.15.82:0/3732551508 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2114004030 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f20ffe00640 1 -- 172.21.15.82:0/3732551508 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2114024070 con 0x561b0f61f960 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f2123c7a740 10 client.25807 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f2123c7a740 10 client.25807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f2123c7a740 20 client.25807 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f2123c7a740 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f634ff0 0x561b0f6373e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f2123c7a740 4 client.25807 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.446+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b0f5917e0 con 0x561b0f634ff0 2024-04-26T20:23:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.447+0000 7f2113e00640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f634ff0 0x561b0f6373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.447+0000 7f2113e00640 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f634ff0 0x561b0f6373e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e341aa8a4b4f2f5 server_cookie=8f874055b306b7fb in_seq=0 out_seq=0 2024-04-26T20:23:33.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.447+0000 7f20ffe00640 10 client.25807 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f20ffe00640 1 -- 172.21.15.82:0/3732551508 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561b0f5917e0 con 0x561b0f634ff0 2024-04-26T20:23:33.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f20ffe00640 10 client.25807 handle_command_reply: tid=0 2024-04-26T20:23:33.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 client.25807 shutdown 2024-04-26T20:23:33.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 msgr2=0x561b0f6297b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f6297b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2114005790 tx=0x7f2114009c80 comp rx=0 tx=0).stop 2024-04-26T20:23:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 shutdown_connections 2024-04-26T20:23:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f634ff0 0x561b0f6373e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f6254c0 0x561b0f630d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f620350 0x561b0f629cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 --2- 172.21.15.82:0/3732551508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f6297b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f20ffe00640 0 client.25807 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 >> 172.21.15.82:0/3732551508 conn(0x561b0f61afd0 msgr2=0x561b0f61a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 shutdown_connections 2024-04-26T20:23:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 1 -- 172.21.15.82:0/3732551508 wait complete. 2024-04-26T20:23:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.448+0000 7f2123c7a740 20 client.25807 trim_cache size 0 max 16384 2024-04-26T20:23:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.467+0000 7f2123c7a740 1 Processor -- start 2024-04-26T20:23:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 -- start start 2024-04-26T20:23:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f616080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f630cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f61e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1aef50 con 0x561b0f6254c0 2024-04-26T20:23:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1adae0 con 0x561b0f620350 2024-04-26T20:23:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2123c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ae1b0 con 0x561b0f61f960 2024-04-26T20:23:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f211a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f616080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f211a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f616080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33416/0 (socket says 172.21.15.82:33416) 2024-04-26T20:23:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f211a800640 1 -- 172.21.15.82:0/549420637 learned_addr learned my addr 172.21.15.82:0/549420637 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f211a800640 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f61e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.468+0000 7f2113e00640 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f630cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f211a800640 1 -- 172.21.15.82:0/549420637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 msgr2=0x561b0f630cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f211a800640 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f630cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f211a800640 1 -- 172.21.15.82:0/549420637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 msgr2=0x561b0f61e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f211a800640 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f61e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f211a800640 1 -- 172.21.15.82:0/549420637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b0f616850 con 0x561b0f61f960 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f211a800640 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f616080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2114006010 tx=0x7f2114014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd89c416c92d4342 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f210aa00640 1 -- 172.21.15.82:0/549420637 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211402d070 con 0x561b0f61f960 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f210aa00640 1 -- 172.21.15.82:0/549420637 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2114003f60 con 0x561b0f61f960 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.469+0000 7f210aa00640 1 -- 172.21.15.82:0/549420637 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211403a730 con 0x561b0f61f960 2024-04-26T20:23:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 -- 172.21.15.82:0/549420637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 msgr2=0x561b0f616080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f616080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2114006010 tx=0x7f2114014040 comp rx=0 tx=0).stop 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 -- 172.21.15.82:0/549420637 shutdown_connections 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f61e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f630cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 --2- 172.21.15.82:0/549420637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f616080 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 -- 172.21.15.82:0/549420637 >> 172.21.15.82:0/549420637 conn(0x561b0f61afd0 msgr2=0x561b0f629a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 -- 172.21.15.82:0/549420637 shutdown_connections 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 -- 172.21.15.82:0/549420637 wait complete. 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.470+0000 7f2123c7a740 1 -- start start 2024-04-26T20:23:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 Processor -- start 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f62dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f62e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f699530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ab3f0 con 0x561b0f6254c0 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ae880 con 0x561b0f620350 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1aba60 con 0x561b0f61f960 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2123c7a740 10 client.0 _ll_register_callbacks cb 0x7f21140093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f211a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f62dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2113e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f62e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f211a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f699530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2113e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f62e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51058/0 (socket says 172.21.15.82:51058) 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.471+0000 7f2113e00640 1 -- 172.21.15.82:0/4144159725 learned_addr learned my addr 172.21.15.82:0/4144159725 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2113e00640 1 -- 172.21.15.82:0/4144159725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 msgr2=0x561b0f62dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2113e00640 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f62dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2113e00640 1 -- 172.21.15.82:0/4144159725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 msgr2=0x561b0f699530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2113e00640 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f699530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2113e00640 1 -- 172.21.15.82:0/4144159725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b0f2550f0 con 0x561b0f620350 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f211a800640 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f62dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2113e00640 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f62e160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2104005ab0 tx=0x7f2104004280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b3bb23d4b7916fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f20ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f20ffe00640 1 -- 172.21.15.82:0/4144159725 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104035040 con 0x561b0f620350 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2114003f60 con 0x561b0f620350 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.472+0000 7f20ffe00640 1 -- 172.21.15.82:0/4144159725 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2104046720 con 0x561b0f620350 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f20ffe00640 1 -- 172.21.15.82:0/4144159725 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2104046920 con 0x561b0f620350 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 10 client.25778 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561b0f54ba30 con 0x561b0f620350 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f20ffe00640 1 -- 172.21.15.82:0/4144159725 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2114003f60 con 0x561b0f620350 2024-04-26T20:23:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f20ffe00640 1 -- 172.21.15.82:0/4144159725 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f21040316c0 con 0x561b0f620350 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 10 client.25778 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 10 client.25778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 20 client.25778 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f69b360 0x561b0f69d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 4 client.25778 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.473+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b0f58b650 con 0x561b0f69b360 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.474+0000 7f211a800640 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f69b360 0x561b0f69d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.474+0000 7f20ffe00640 10 client.25778 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.474+0000 7f211a800640 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f69b360 0x561b0f69d780 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e70f1551826f148 server_cookie=d4f3bcdcc81d19cf in_seq=0 out_seq=0 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f20ffe00640 1 -- 172.21.15.82:0/4144159725 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561b0f58b650 con 0x561b0f69b360 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f20ffe00640 10 client.25778 handle_command_reply: tid=0 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 client.25778 shutdown 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 msgr2=0x561b0f62e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f62e160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2104005ab0 tx=0x7f2104004280 comp rx=0 tx=0).stop 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 shutdown_connections 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b0f69b360 0x561b0f69d780 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f6254c0 0x561b0f699530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f20ffe00640 0 client.25778 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b0f620350 0x561b0f62e160 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 --2- 172.21.15.82:0/4144159725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b0f61f960 0x561b0f62dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 >> 172.21.15.82:0/4144159725 conn(0x561b0f61afd0 msgr2=0x561b0f620df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 shutdown_connections 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 1 -- 172.21.15.82:0/4144159725 wait complete. 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.475+0000 7f2123c7a740 20 client.25778 trim_cache size 0 max 16384 2024-04-26T20:23:33.489 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: "7094975b-7fe7-412a-94ed-9c6581735034": { 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "7094975b-7fe7-412a-94ed-9c6581735034", 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:23:33.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:23:33.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:23:33.491 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:23:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21000a3c40 msgr2=0x7f21000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21000a3c40 0x7f21000a6100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x561b0f620750 tx=0x7f210c0bd040 comp rx=0 tx=0).stop 2024-04-26T20:23:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 msgr2=0x7f211c19ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c19ac70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f210c00e9c0 tx=0x7f210c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:23:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 shutdown_connections 2024-04-26T20:23:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21000a3c40 0x7f21000a6100 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106620 0x7f211c1a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c105c60 0x7f211c19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 --2- 172.21.15.82:0/1658031157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c104a70 0x7f211c19ac70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 >> 172.21.15.82:0/1658031157 conn(0x7f211c0fffe0 msgr2=0x7f211c108fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 shutdown_connections 2024-04-26T20:23:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:23:33.476+0000 7f211b200640 1 -- 172.21.15.82:0/1658031157 wait complete. 2024-04-26T20:23:33.496 INFO:tasks.cephfs.filesystem:scrub status for tag:7094975b-7fe7-412a-94ed-9c6581735034 - {'path': '/', 'tag': '7094975b-7fe7-412a-94ed-9c6581735034', 'options': 'recursive,force'} 2024-04-26T20:23:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:33 smithi139 ceph-mon[32999]: pgmap v434: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2024-04-26T20:23:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:33 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:23:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:33 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:33 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:23:34.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:33 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:34.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:33 smithi135 ceph-mon[32816]: pgmap v434: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2024-04-26T20:23:34.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:33 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:23:34.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:33 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:34.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:33 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:23:34.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:33 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:34.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:33 smithi082 ceph-mon[28105]: pgmap v434: 129 pgs: 129 active+clean; 653 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2024-04-26T20:23:34.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:33 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:23:34.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:33 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:34.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:33 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:23:34.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:33 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:23:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:35 smithi139 ceph-mon[32999]: pgmap v435: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:23:36.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:35 smithi135 ceph-mon[32816]: pgmap v435: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:23:36.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:35 smithi082 ceph-mon[28105]: pgmap v435: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:23:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:36 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:23:37.089 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:36 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:23:37.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:36 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:23:38.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:37 smithi139 ceph-mon[32999]: pgmap v436: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-04-26T20:23:38.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:37 smithi135 ceph-mon[32816]: pgmap v436: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-04-26T20:23:38.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:37 smithi082 ceph-mon[28105]: pgmap v436: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 -- 172.21.15.82:0/4267792679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 msgr2=0x7f1aec105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 --2- 172.21.15.82:0/4267792679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec105880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009860 tx=0x7f1ae002a340 comp rx=0 tx=0).stop 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 -- 172.21.15.82:0/4267792679 shutdown_connections 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 --2- 172.21.15.82:0/4267792679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aec1086f0 0x7f1aec10aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 --2- 172.21.15.82:0/4267792679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 --2- 172.21.15.82:0/4267792679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec105880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 -- 172.21.15.82:0/4267792679 >> 172.21.15.82:0/4267792679 conn(0x7f1aec0fce20 msgr2=0x7f1aec0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 -- 172.21.15.82:0/4267792679 shutdown_connections 2024-04-26T20:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.947+0000 7f1af3800640 1 -- 172.21.15.82:0/4267792679 wait complete. 2024-04-26T20:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.948+0000 7f1af3800640 1 Processor -- start 2024-04-26T20:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.948+0000 7f1af3800640 1 -- start start 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af3800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af3800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af3800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aec1086f0 0x7f1aec1a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af3800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec10e500 con 0x7f1aec105dc0 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af3800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec10e380 con 0x7f1aec1086f0 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af3800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec10e680 con 0x7f1aec103490 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40172/0 (socket says 172.21.15.82:40172) 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 -- 172.21.15.82:0/320099205 learned_addr learned my addr 172.21.15.82:0/320099205 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af0e00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af1800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aec1086f0 0x7f1aec1a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 -- 172.21.15.82:0/320099205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 msgr2=0x7f1aec19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 -- 172.21.15.82:0/320099205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aec1086f0 msgr2=0x7f1aec1a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aec1086f0 0x7f1aec1a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1aebe00640 1 -- 172.21.15.82:0/320099205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec1a2970 con 0x7f1aec105dc0 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.949+0000 7f1af0e00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.950+0000 7f1aebe00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec19b290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800e9f0 tx=0x7f1ad800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.950+0000 7f1ae9600640 1 -- 172.21.15.82:0/320099205 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800ccc0 con 0x7f1aec105dc0 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.950+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aec1a2c60 con 0x7f1aec105dc0 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.950+0000 7f1ae9600640 1 -- 172.21.15.82:0/320099205 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad80108e0 con 0x7f1aec105dc0 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.950+0000 7f1ae9600640 1 -- 172.21.15.82:0/320099205 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8018820 con 0x7f1aec105dc0 2024-04-26T20:23:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.950+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aec1a31b0 con 0x7f1aec105dc0 2024-04-26T20:23:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1ae9600640 1 -- 172.21.15.82:0/320099205 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1ad8010430 con 0x7f1aec105dc0 2024-04-26T20:23:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 Processor -- start 2024-04-26T20:23:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 -- start start 2024-04-26T20:23:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdabeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdac6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584fda23380 con 0x5584fdac4730 2024-04-26T20:23:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5584fd9bfc30 con 0x5584fdabebd0 2024-04-26T20:23:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.954+0000 7f1af6797740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584fda1f340 con 0x5584fdabf5c0 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdabeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1aebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdac6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdabeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51090/0 (socket says 172.21.15.82:51090) 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 -- 172.21.15.82:0/416735745 learned_addr learned my addr 172.21.15.82:0/416735745 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 -- 172.21.15.82:0/416735745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 msgr2=0x5584fdac40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 -- 172.21.15.82:0/416735745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 msgr2=0x5584fdac6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdac6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af1800640 1 -- 172.21.15.82:0/416735745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584fd9e1940 con 0x5584fdabebd0 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.955+0000 7f1af0e00640 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1af1800640 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdabeff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009fd0 tx=0x7f1ae40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12b465ebb84d8f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1ae9600640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1ad40a3cf0 0x7f1ad40a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1ade000640 1 -- 172.21.15.82:0/416735745 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4004d20 con 0x5584fdabebd0 2024-04-26T20:23:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1ade000640 1 -- 172.21.15.82:0/416735745 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae4004050 con 0x5584fdabebd0 2024-04-26T20:23:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1ade000640 1 -- 172.21.15.82:0/416735745 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4005280 con 0x5584fdabebd0 2024-04-26T20:23:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1ae9600640 1 -- 172.21.15.82:0/320099205 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1ad80d0ab0 con 0x7f1aec105dc0 2024-04-26T20:23:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.956+0000 7f1af0e00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1ad40a3cf0 0x7f1ad40a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 -- 172.21.15.82:0/416735745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 msgr2=0x5584fdabeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdabeff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009fd0 tx=0x7f1ae40118d0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 -- 172.21.15.82:0/416735745 shutdown_connections 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdac6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 --2- 172.21.15.82:0/416735745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdabeff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 -- 172.21.15.82:0/416735745 >> 172.21.15.82:0/416735745 conn(0x5584fdaba240 msgr2=0x5584fdaba640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af0e00640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1ad40a3cf0 0x7f1ad40a61b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1ae002a930 tx=0x7f1ae002c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 -- 172.21.15.82:0/416735745 shutdown_connections 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 -- 172.21.15.82:0/416735745 wait complete. 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.957+0000 7f1af6797740 1 -- start start 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 Processor -- start 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 0x5584fdac8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdac4730 0x5584fdad0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584fdac76e0 con 0x5584fdabebd0 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5584fd9aac60 con 0x5584fdac4730 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584fdac7860 con 0x5584fdabf5c0 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af6797740 10 client.0 _ll_register_callbacks cb 0x5584fd9d6e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 0x5584fdac8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 0x5584fdac8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40176/0 (socket says 172.21.15.82:40176) 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1af0e00640 1 -- 172.21.15.82:0/247619659 learned_addr learned my addr 172.21.15.82:0/247619659 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.958+0000 7f1aebe00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af1800640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdac4730 0x5584fdad0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af0e00640 1 -- 172.21.15.82:0/247619659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 msgr2=0x5584fdac92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af0e00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af0e00640 1 -- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdac4730 msgr2=0x5584fdad0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af0e00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdac4730 0x5584fdad0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af0e00640 1 -- 172.21.15.82:0/247619659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584fd9b9510 con 0x5584fdabebd0 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1aebe00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af1800640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdac4730 0x5584fdad0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1af0e00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 0x5584fdac8db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00057c0 tx=0x7f1ae002a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758541f1a9456519 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1ad2a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.959+0000 7f1ad2a00640 1 -- 172.21.15.82:0/247619659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0037040 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1ad2a00640 1 -- 172.21.15.82:0/247619659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1ae0004450 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae4004050 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1ad2a00640 1 -- 172.21.15.82:0/247619659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ae0056050 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 10 client.15702 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5584fd735210 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1ad2a00640 1 -- 172.21.15.82:0/247619659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae4004050 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1ad2a00640 1 -- 172.21.15.82:0/247619659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1ae0003af0 con 0x5584fdabebd0 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 10 client.15702 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 20 client.15702 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.960+0000 7f1af6797740 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdad48f0 0x5584fdad6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.961+0000 7f1af6797740 4 client.15702 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.961+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584fda30f90 con 0x5584fdad48f0 2024-04-26T20:23:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.961+0000 7f1aebe00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdad48f0 0x5584fdad6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.962+0000 7f1aebe00640 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdad48f0 0x5584fdad6d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8095187d76f31c server_cookie=6bf955424cb52213 in_seq=0 out_seq=0 2024-04-26T20:23:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.962+0000 7f1ad2a00640 10 client.15702 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.962+0000 7f1ad2a00640 1 -- 172.21.15.82:0/247619659 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5584fda30f90 con 0x5584fdad48f0 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.962+0000 7f1ad2a00640 10 client.15702 handle_command_reply: tid=0 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.962+0000 7f1af6797740 1 client.15702 shutdown 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 msgr2=0x5584fdac8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 0x5584fdac8db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00057c0 tx=0x7f1ae002a340 comp rx=0 tx=0).stop 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 shutdown_connections 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdad48f0 0x5584fdad6d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdac4730 0x5584fdad0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdac92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1ad2a00640 0 client.15702 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 --2- 172.21.15.82:0/247619659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdabebd0 0x5584fdac8db0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 >> 172.21.15.82:0/247619659 conn(0x5584fdaba240 msgr2=0x5584fdab9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 shutdown_connections 2024-04-26T20:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 1 -- 172.21.15.82:0/247619659 wait complete. 2024-04-26T20:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.963+0000 7f1af6797740 20 client.15702 trim_cache size 0 max 16384 2024-04-26T20:23:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 Processor -- start 2024-04-26T20:23:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 -- start start 2024-04-26T20:23:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdac9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdad02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdabd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1ad620 con 0x5584fdac4730 2024-04-26T20:23:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1af160 con 0x5584fdabebd0 2024-04-26T20:23:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.979+0000 7f1af6797740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1adcf0 con 0x5584fdabf5c0 2024-04-26T20:23:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdac9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdac9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51120/0 (socket says 172.21.15.82:51120) 2024-04-26T20:23:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1aebe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdad02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 -- 172.21.15.82:0/902096382 learned_addr learned my addr 172.21.15.82:0/902096382 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af1800640 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdabd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 -- 172.21.15.82:0/902096382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 msgr2=0x5584fdad02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdad02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 -- 172.21.15.82:0/902096382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 msgr2=0x5584fdabd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdabd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1af0e00640 1 -- 172.21.15.82:0/902096382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584fd801620 con 0x5584fdabebd0 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.980+0000 7f1aebe00640 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdad02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.981+0000 7f1af0e00640 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdac9250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ae003e4b0 tx=0x7f1ae0030d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb8c02635bdae02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.981+0000 7f1add600640 1 -- 172.21.15.82:0/902096382 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0037070 con 0x5584fdabebd0 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.981+0000 7f1add600640 1 -- 172.21.15.82:0/902096382 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae0030b50 con 0x5584fdabebd0 2024-04-26T20:23:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.981+0000 7f1add600640 1 -- 172.21.15.82:0/902096382 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0003bc0 con 0x5584fdabebd0 2024-04-26T20:23:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.981+0000 7f1af6797740 1 -- 172.21.15.82:0/902096382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 msgr2=0x5584fdac9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.981+0000 7f1af6797740 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdac9250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ae003e4b0 tx=0x7f1ae0030d80 comp rx=0 tx=0).stop 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 -- 172.21.15.82:0/902096382 shutdown_connections 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdabd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabf5c0 0x5584fdad02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 --2- 172.21.15.82:0/902096382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabebd0 0x5584fdac9250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 -- 172.21.15.82:0/902096382 >> 172.21.15.82:0/902096382 conn(0x5584fdaba240 msgr2=0x5584fdabcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 -- 172.21.15.82:0/902096382 shutdown_connections 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 -- 172.21.15.82:0/902096382 wait complete. 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 -- start start 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.982+0000 7f1af6797740 1 Processor -- start 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 0x5584fdacd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabf5c0 0x5584fdacde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdacee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1aea90 con 0x5584fdac4730 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1ae3c0 con 0x5584fdabf5c0 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1ab600 con 0x5584fdabebd0 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af6797740 10 client.0 _ll_register_callbacks cb 0x7f1ae40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 0x5584fdacd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdacee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 0x5584fdacd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:33494/0 (socket says 172.21.15.82:33494) 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 -- 172.21.15.82:0/2325395195 learned_addr learned my addr 172.21.15.82:0/2325395195 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1aebe00640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabf5c0 0x5584fdacde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 -- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabf5c0 msgr2=0x5584fdacde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabf5c0 0x5584fdacde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 -- 172.21.15.82:0/2325395195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 msgr2=0x5584fdacee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdacee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af0e00640 1 -- 172.21.15.82:0/2325395195 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584fd9ddcb0 con 0x5584fdabebd0 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.983+0000 7f1af1800640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdacee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1af0e00640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 0x5584fdacd930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0030a80 tx=0x7f1ae003e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7eedc7ba5e29dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1ad2a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1ad2a00640 1 -- 172.21.15.82:0/2325395195 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0067060 con 0x5584fdabebd0 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae0030b50 con 0x5584fdabebd0 2024-04-26T20:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1ad2a00640 1 -- 172.21.15.82:0/2325395195 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1ae0032a00 con 0x5584fdabebd0 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1ad2a00640 1 -- 172.21.15.82:0/2325395195 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ae006e050 con 0x5584fdabebd0 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1af6797740 10 client.25831 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.984+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5584fdad05b0 con 0x5584fdabebd0 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1ad2a00640 1 -- 172.21.15.82:0/2325395195 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae0030b50 con 0x5584fdabebd0 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1ad2a00640 1 -- 172.21.15.82:0/2325395195 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1ae003eb30 con 0x5584fdabebd0 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1af6797740 10 client.25831 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1af6797740 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1af6797740 20 client.25831 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1af6797740 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdb3b410 0x5584fdb3d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1af6797740 4 client.25831 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584fda2ae00 con 0x5584fdb3b410 2024-04-26T20:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.985+0000 7f1aebe00640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdb3b410 0x5584fdb3d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.986+0000 7f1aebe00640 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdb3b410 0x5584fdb3d830 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5395274c7c3addf2 server_cookie=130bd4a48f3d843 in_seq=0 out_seq=0 2024-04-26T20:23:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.986+0000 7f1ad2a00640 10 client.25831 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1ad2a00640 1 -- 172.21.15.82:0/2325395195 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584fda2ae00 con 0x5584fdb3b410 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1ad2a00640 10 client.25831 handle_command_reply: tid=0 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 client.25831 shutdown 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 msgr2=0x5584fdacd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 0x5584fdacd930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0030a80 tx=0x7f1ae003e000 comp rx=0 tx=0).stop 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 shutdown_connections 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5584fdb3b410 0x5584fdb3d830 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fdac4730 0x5584fdacee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1ad2a00640 0 client.25831 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5584fdabf5c0 0x5584fdacde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 --2- 172.21.15.82:0/2325395195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584fdabebd0 0x5584fdacd930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 >> 172.21.15.82:0/2325395195 conn(0x5584fdaba240 msgr2=0x5584fdabd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 shutdown_connections 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 1 -- 172.21.15.82:0/2325395195 wait complete. 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.993+0000 7f1af6797740 20 client.25831 trim_cache size 0 max 16384 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:23:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:23:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1ad40a3cf0 msgr2=0x7f1ad40a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1ad40a3cf0 0x7f1ad40a61b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1ae002a930 tx=0x7f1ae002c040 comp rx=0 tx=0).stop 2024-04-26T20:23:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 msgr2=0x7f1aec19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec19b290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800e9f0 tx=0x7f1ad800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 shutdown_connections 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1ad40a3cf0 0x7f1ad40a61b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1aec1086f0 0x7f1aec1a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1aec105dc0 0x7f1aec19b290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 --2- 172.21.15.82:0/320099205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aec103490 0x7f1aec19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 >> 172.21.15.82:0/320099205 conn(0x7f1aec0fce20 msgr2=0x7f1aec102c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 shutdown_connections 2024-04-26T20:23:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:38.994+0000 7f1af3800640 1 -- 172.21.15.82:0/320099205 wait complete. 2024-04-26T20:23:39.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:38 smithi139 ceph-mon[32999]: pgmap v437: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-04-26T20:23:39.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:38 smithi135 ceph-mon[32816]: pgmap v437: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-04-26T20:23:39.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:38 smithi082 ceph-mon[28105]: pgmap v437: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-04-26T20:23:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:39 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:40.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:39 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:40.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:39 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:23:41.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:40 smithi139 ceph-mon[32999]: pgmap v438: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-04-26T20:23:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:23:41.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:40 smithi135 ceph-mon[32816]: pgmap v438: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-04-26T20:23:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:23:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:40 smithi082 ceph-mon[28105]: pgmap v438: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-04-26T20:23:44.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:43 smithi139 ceph-mon[32999]: pgmap v439: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-04-26T20:23:44.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:43 smithi135 ceph-mon[32816]: pgmap v439: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-04-26T20:23:44.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:43 smithi082 ceph-mon[28105]: pgmap v439: 129 pgs: 129 active+clean; 663 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-04-26T20:23:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:45 smithi139 ceph-mon[32999]: pgmap v440: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T20:23:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:45 smithi135 ceph-mon[32816]: pgmap v440: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T20:23:46.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:45 smithi082 ceph-mon[28105]: pgmap v440: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-26T20:23:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:47 smithi139 ceph-mon[32999]: pgmap v441: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-04-26T20:23:48.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:47 smithi135 ceph-mon[32816]: pgmap v441: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-04-26T20:23:48.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:47 smithi082 ceph-mon[28105]: pgmap v441: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-04-26T20:23:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:49 smithi139 ceph-mon[32999]: pgmap v442: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-04-26T20:23:50.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:49 smithi135 ceph-mon[32816]: pgmap v442: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-04-26T20:23:50.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:49 smithi082 ceph-mon[28105]: pgmap v442: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-04-26T20:23:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:51 smithi139 ceph-mon[32999]: pgmap v443: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:23:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:51 smithi135 ceph-mon[32816]: pgmap v443: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:23:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 -- 172.21.15.82:0/2737813441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 msgr2=0x7fefe8074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 --2- 172.21.15.82:0/2737813441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe8074dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009890 tx=0x7fefd802a360 comp rx=0 tx=0).stop 2024-04-26T20:23:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 -- 172.21.15.82:0/2737813441 shutdown_connections 2024-04-26T20:23:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 --2- 172.21.15.82:0/2737813441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 0x7fefe8111180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 --2- 172.21.15.82:0/2737813441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe8075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 --2- 172.21.15.82:0/2737813441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe8074dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 -- 172.21.15.82:0/2737813441 >> 172.21.15.82:0/2737813441 conn(0x7fefe80fdd30 msgr2=0x7fefe8100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 -- 172.21.15.82:0/2737813441 shutdown_connections 2024-04-26T20:23:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.131+0000 7fefe7200640 1 -- 172.21.15.82:0/2737813441 wait complete. 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 Processor -- start 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 -- start start 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe819f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 0x7fefe81a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81148e0 con 0x7fefe8075390 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8114760 con 0x7fefe8076970 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.132+0000 7fefe7200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8114a60 con 0x7fefe810ed90 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe819f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe819f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60004/0 (socket says 172.21.15.82:60004) 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 -- 172.21.15.82:0/3523256972 learned_addr learned my addr 172.21.15.82:0/3523256972 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe6800640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 0x7fefe81a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5400640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 -- 172.21.15.82:0/3523256972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 msgr2=0x7fefe81a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 0x7fefe81a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 -- 172.21.15.82:0/3523256972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 msgr2=0x7fefe819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5e00640 1 -- 172.21.15.82:0/3523256972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe81a6c40 con 0x7fefe8075390 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe6800640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 0x7fefe81a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.133+0000 7fefe5400640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.134+0000 7fefe5e00640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe819f070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fefd80057c0 tx=0x7fefd8032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.134+0000 7fefdea00640 1 -- 172.21.15.82:0/3523256972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8037040 con 0x7fefe8075390 2024-04-26T20:23:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.134+0000 7fefdea00640 1 -- 172.21.15.82:0/3523256972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefd8030520 con 0x7fefe8075390 2024-04-26T20:23:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.134+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe81a6ed0 con 0x7fefe8075390 2024-04-26T20:23:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.134+0000 7fefdea00640 1 -- 172.21.15.82:0/3523256972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8005280 con 0x7fefe8075390 2024-04-26T20:23:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.134+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81a7280 con 0x7fefe8075390 2024-04-26T20:23:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefdea00640 1 -- 172.21.15.82:0/3523256972 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fefd8043020 con 0x7fefe8075390 2024-04-26T20:23:52.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 Processor -- start 2024-04-26T20:23:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 -- start start 2024-04-26T20:23:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff2de0 0x55602aff3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602aff82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602affadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55602af57380 con 0x55602aff37d0 2024-04-26T20:23:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55602aef3c30 con 0x55602aff8940 2024-04-26T20:23:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.138+0000 7fefefff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55602af53340 con 0x55602aff2de0 2024-04-26T20:23:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602aff82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe6800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff2de0 0x55602aff3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602affadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602aff82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60012/0 (socket says 172.21.15.82:60012) 2024-04-26T20:23:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe5e00640 1 -- 172.21.15.82:0/2463289092 learned_addr learned my addr 172.21.15.82:0/2463289092 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe6800640 1 -- 172.21.15.82:0/2463289092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 msgr2=0x55602affadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe6800640 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602affadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe6800640 1 -- 172.21.15.82:0/2463289092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 msgr2=0x55602aff82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe6800640 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602aff82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.139+0000 7fefe6800640 1 -- 172.21.15.82:0/2463289092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602af15940 con 0x55602aff2de0 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefe6800640 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff2de0 0x55602aff3200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005fd0 tx=0x7fefe0011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d673167c61c9a1f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefdea00640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fefcc0a3d80 0x7fefcc0a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefd3400640 1 -- 172.21.15.82:0/2463289092 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004d20 con 0x55602aff2de0 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefd3400640 1 -- 172.21.15.82:0/2463289092 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe000f9a0 con 0x55602aff2de0 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefd3400640 1 -- 172.21.15.82:0/2463289092 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004390 con 0x55602aff2de0 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefdea00640 1 -- 172.21.15.82:0/3523256972 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fefd80efd30 con 0x7fefe8075390 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.140+0000 7fefe5e00640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fefcc0a3d80 0x7fefcc0a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 -- 172.21.15.82:0/2463289092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff2de0 msgr2=0x55602aff3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff2de0 0x55602aff3200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005fd0 tx=0x7fefe0011bf0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefe5e00640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fefcc0a3d80 0x7fefcc0a6240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009860 tx=0x7fefd80f37e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 -- 172.21.15.82:0/2463289092 shutdown_connections 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602affadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602aff82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 --2- 172.21.15.82:0/2463289092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff2de0 0x55602aff3200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 -- 172.21.15.82:0/2463289092 >> 172.21.15.82:0/2463289092 conn(0x55602afee450 msgr2=0x55602afee850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 -- 172.21.15.82:0/2463289092 shutdown_connections 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.141+0000 7fefefff1740 1 -- 172.21.15.82:0/2463289092 wait complete. 2024-04-26T20:23:52.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 -- start start 2024-04-26T20:23:52.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 Processor -- start 2024-04-26T20:23:52.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff2de0 0x55602affcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602affd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff8940 0x55602b004550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55602affb8f0 con 0x55602aff37d0 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55602aedec60 con 0x55602aff2de0 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55602affba70 con 0x55602aff8940 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.142+0000 7fefefff1740 10 client.0 _ll_register_callbacks cb 0x55602af0ae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff2de0 0x55602affcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602affd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff2de0 0x55602affcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:54412/0 (socket says 172.21.15.82:54412) 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe6800640 1 -- 172.21.15.82:0/3240467366 learned_addr learned my addr 172.21.15.82:0/3240467366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe6800640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff8940 0x55602b004550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 -- 172.21.15.82:0/3240467366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff8940 msgr2=0x55602b004550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff8940 0x55602b004550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 -- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff2de0 msgr2=0x55602affcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff2de0 0x55602affcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 -- 172.21.15.82:0/3240467366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602aeed510 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe6800640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff8940 0x55602b004550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefe5400640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602affd510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fefe81a0530 tx=0x7fefd400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25c798440ec5ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.143+0000 7fefc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.144+0000 7fefc7e00640 1 -- 172.21.15.82:0/3240467366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd401e020 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.144+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe000f9a0 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.144+0000 7fefc7e00640 1 -- 172.21.15.82:0/3240467366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fefd40047a0 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.144+0000 7fefc7e00640 1 -- 172.21.15.82:0/3240467366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefd40049a0 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.144+0000 7fefefff1740 10 client.15720 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.144+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55602ac69210 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefc7e00640 1 -- 172.21.15.82:0/3240467366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe000f9a0 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefc7e00640 1 -- 172.21.15.82:0/3240467366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fefd4019070 con 0x55602aff37d0 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefefff1740 10 client.15720 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefefff1740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefefff1740 20 client.15720 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefefff1740 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b008b70 0x55602b00afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefefff1740 4 client.15720 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:23:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55602af64f90 con 0x55602b008b70 2024-04-26T20:23:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.145+0000 7fefe6800640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b008b70 0x55602b00afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.146+0000 7fefe6800640 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b008b70 0x55602b00afc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2df94839da403c6 server_cookie=42a6456659948c72 in_seq=0 out_seq=0 2024-04-26T20:23:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.146+0000 7fefc7e00640 10 client.15720 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefc7e00640 1 -- 172.21.15.82:0/3240467366 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55602af64f90 con 0x55602b008b70 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefc7e00640 10 client.15720 handle_command_reply: tid=0 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 client.15720 shutdown 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 msgr2=0x55602affd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602affd510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fefe81a0530 tx=0x7fefd400f790 comp rx=0 tx=0).stop 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 shutdown_connections 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b008b70 0x55602b00afc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff8940 0x55602b004550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff37d0 0x55602affd510 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 --2- 172.21.15.82:0/3240467366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff2de0 0x55602affcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefc7e00640 0 client.15720 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 >> 172.21.15.82:0/3240467366 conn(0x55602afee450 msgr2=0x55602afed650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 shutdown_connections 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 1 -- 172.21.15.82:0/3240467366 wait complete. 2024-04-26T20:23:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.147+0000 7fefefff1740 20 client.15720 trim_cache size 0 max 16384 2024-04-26T20:23:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.178+0000 7fefefff1740 1 Processor -- start 2024-04-26T20:23:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 -- start start 2024-04-26T20:23:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602aff19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b00f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b17f0 con 0x55602aff2de0 2024-04-26T20:23:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b3330 con 0x55602aff8940 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefefff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b1ec0 con 0x55602aff37d0 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefe6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602aff19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefe5400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefe6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602aff19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60036/0 (socket says 172.21.15.82:60036) 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefe5400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b004510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:52080/0 (socket says 172.21.15.82:52080) 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.179+0000 7fefe6800640 1 -- 172.21.15.82:0/3945490352 learned_addr learned my addr 172.21.15.82:0/3945490352 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b00f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 -- 172.21.15.82:0/3945490352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 msgr2=0x55602b004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 -- 172.21.15.82:0/3945490352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 msgr2=0x55602b00f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b00f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 -- 172.21.15.82:0/3945490352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602ad35620 con 0x55602aff2de0 2024-04-26T20:23:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe5400640 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.180+0000 7fefe6800640 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602aff19f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005f10 tx=0x7fefe0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7bffad8daf5ad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefd2a00640 1 -- 172.21.15.82:0/3945490352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0031040 con 0x55602aff2de0 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefd2a00640 1 -- 172.21.15.82:0/3945490352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe0009e00 con 0x55602aff2de0 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefd2a00640 1 -- 172.21.15.82:0/3945490352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe001e040 con 0x55602aff2de0 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 -- 172.21.15.82:0/3945490352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 msgr2=0x55602aff19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602aff19f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005f10 tx=0x7fefe0009500 comp rx=0 tx=0).stop 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 -- 172.21.15.82:0/3945490352 shutdown_connections 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b00f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b004510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 --2- 172.21.15.82:0/3945490352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602aff19f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.181+0000 7fefefff1740 1 -- 172.21.15.82:0/3945490352 >> 172.21.15.82:0/3945490352 conn(0x55602afee450 msgr2=0x55602aff12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.182+0000 7fefefff1740 1 -- 172.21.15.82:0/3945490352 shutdown_connections 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.182+0000 7fefefff1740 1 -- 172.21.15.82:0/3945490352 wait complete. 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.182+0000 7fefefff1740 1 -- start start 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.182+0000 7fefefff1740 1 Processor -- start 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602b003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b0043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b0024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b2c60 con 0x55602aff2de0 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b2590 con 0x55602aff8940 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81af7d0 con 0x55602aff37d0 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefefff1740 10 client.0 _ll_register_callbacks cb 0x7fefd4011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefe6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602b003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefe6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602b003e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60046/0 (socket says 172.21.15.82:60046) 2024-04-26T20:23:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefe6800640 1 -- 172.21.15.82:0/802169100 learned_addr learned my addr 172.21.15.82:0/802169100 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefe5400640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b0043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.183+0000 7fefe6800640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b0024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe6800640 1 -- 172.21.15.82:0/802169100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 msgr2=0x55602b0043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe6800640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b0043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe6800640 1 -- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 msgr2=0x55602b0024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe6800640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b0024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe6800640 1 -- 172.21.15.82:0/802169100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602af11cb0 con 0x55602aff2de0 2024-04-26T20:23:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe5400640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b0043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:52.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefe6800640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602b003e60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005d70 tx=0x7fefe0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3de72e83329fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefc7e00640 1 -- 172.21.15.82:0/802169100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0011140 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefc7e00640 1 -- 172.21.15.82:0/802169100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fefe00112e0 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe0009e00 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.184+0000 7fefc7e00640 1 -- 172.21.15.82:0/802169100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefe00043a0 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 10 client.15726 fetch_fsmap learned FSMap version 29 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55602b06fa30 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefc7e00640 1 -- 172.21.15.82:0/802169100 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe0009e00 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefc7e00640 1 -- 172.21.15.82:0/802169100 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fefe0024040 con 0x55602aff2de0 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 10 client.15726 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:23:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:23:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 20 client.15726 populate_metadata read hostname 'smithi082' 2024-04-26T20:23:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b070280 0x55602b0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 4 client.15726 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:23:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.185+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55602af5ee00 con 0x55602b070280 2024-04-26T20:23:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:51 smithi082 ceph-mon[28105]: pgmap v443: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:23:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.186+0000 7fefe5400640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b070280 0x55602b0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.186+0000 7fefe5400640 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b070280 0x55602b0726a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96533b4a0b686721 server_cookie=f7409916870693c2 in_seq=0 out_seq=0 2024-04-26T20:23:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.186+0000 7fefc7e00640 10 client.15726 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefc7e00640 1 -- 172.21.15.82:0/802169100 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55602af5ee00 con 0x55602b070280 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefc7e00640 10 client.15726 handle_command_reply: tid=0 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 client.15726 shutdown 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 msgr2=0x55602b003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602b003e60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005d70 tx=0x7fefe0000f40 comp rx=0 tx=0).stop 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 shutdown_connections 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55602b070280 0x55602b0726a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602aff8940 0x55602b0024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602aff37d0 0x55602b0043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefc7e00640 0 client.15726 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 --2- 172.21.15.82:0/802169100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602aff2de0 0x55602b003e60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 >> 172.21.15.82:0/802169100 conn(0x55602afee450 msgr2=0x55602afecdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 shutdown_connections 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.190+0000 7fefefff1740 1 -- 172.21.15.82:0/802169100 wait complete. 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefefff1740 20 client.15726 trim_cache size 0 max 16384 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:23:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fefcc0a3d80 msgr2=0x7fefcc0a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fefcc0a3d80 0x7fefcc0a6240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009860 tx=0x7fefd80f37e0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 msgr2=0x7fefe819f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe819f070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fefd80057c0 tx=0x7fefd8032d30 comp rx=0 tx=0).stop 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 shutdown_connections 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fefcc0a3d80 0x7fefcc0a6240 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe810ed90 0x7fefe81a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8076970 0x7fefe819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 --2- 172.21.15.82:0/3523256972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe8075390 0x7fefe819f070 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.191+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 >> 172.21.15.82:0/3523256972 conn(0x7fefe80fdd30 msgr2=0x7fefe8102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.192+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 shutdown_connections 2024-04-26T20:23:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:23:52.192+0000 7fefe7200640 1 -- 172.21.15.82:0/3523256972 wait complete. 2024-04-26T20:23:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:53 smithi139 ceph-mon[32999]: pgmap v444: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-26T20:23:54.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:53 smithi135 ceph-mon[32816]: pgmap v444: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-26T20:23:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:53 smithi082 ceph-mon[28105]: pgmap v444: 129 pgs: 129 active+clean; 664 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-26T20:23:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:55 smithi139 ceph-mon[32999]: pgmap v445: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-26T20:23:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:55 smithi135 ceph-mon[32816]: pgmap v445: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-26T20:23:56.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:55 smithi082 ceph-mon[28105]: pgmap v445: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-26T20:23:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:57 smithi139 ceph-mon[32999]: pgmap v446: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:23:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:57 smithi135 ceph-mon[32816]: pgmap v446: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:23:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:57 smithi082 ceph-mon[28105]: pgmap v446: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:23:59.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:23:58 smithi139 ceph-mon[32999]: pgmap v447: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:23:59.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:23:58 smithi135 ceph-mon[32816]: pgmap v447: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:23:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:23:58 smithi082 ceph-mon[28105]: pgmap v447: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:01 smithi139 ceph-mon[32999]: pgmap v448: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:24:02.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:01 smithi135 ceph-mon[32816]: pgmap v448: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:24:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:01 smithi082 ceph-mon[28105]: pgmap v448: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-26T20:24:03.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:24:03.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:24:03.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.666+0000 7f68d9a00640 1 -- 172.21.15.82:0/3368272481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 msgr2=0x7f68d4101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.666+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3368272481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d4101b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009900 tx=0x7f68c402a410 comp rx=0 tx=0).stop 2024-04-26T20:24:03.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 -- 172.21.15.82:0/3368272481 shutdown_connections 2024-04-26T20:24:03.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3368272481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d41032f0 0x7f68d4109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3368272481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d4102930 0x7f68d4102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3368272481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d4101b60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 -- 172.21.15.82:0/3368272481 >> 172.21.15.82:0/3368272481 conn(0x7f68d40fccd0 msgr2=0x7f68d40ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 -- 172.21.15.82:0/3368272481 shutdown_connections 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.667+0000 7f68d9a00640 1 -- 172.21.15.82:0/3368272481 wait complete. 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.668+0000 7f68d9a00640 1 Processor -- start 2024-04-26T20:24:03.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.668+0000 7f68d9a00640 1 -- start start 2024-04-26T20:24:03.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 0x7f68d419b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 0x7f68d41a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410d2c0 con 0x7f68d4101740 2024-04-26T20:24:03.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410d140 con 0x7f68d41032f0 2024-04-26T20:24:03.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410d440 con 0x7f68d4102930 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 0x7f68d419b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 0x7f68d41a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 0x7f68d419b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41858/0 (socket says 172.21.15.82:41858) 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d3400640 1 -- 172.21.15.82:0/3582420247 learned_addr learned my addr 172.21.15.82:0/3582420247 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.669+0000 7f68d9000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 0x7f68d41a21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44616/0 (socket says 172.21.15.82:44616) 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d9000640 1 -- 172.21.15.82:0/3582420247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 msgr2=0x7f68d419b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d9000640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 0x7f68d419b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d9000640 1 -- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 msgr2=0x7f68d419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d9000640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d419acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d9000640 1 -- 172.21.15.82:0/3582420247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d41a2890 con 0x7f68d41032f0 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d3400640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 0x7f68d419b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d3e00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d9000640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 0x7f68d41a21f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009fd0 tx=0x7f68cc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d0c00640 1 -- 172.21.15.82:0/3582420247 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00ce20 con 0x7f68d41032f0 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d0c00640 1 -- 172.21.15.82:0/3582420247 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68cc005020 con 0x7f68d41032f0 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.670+0000 7f68d0c00640 1 -- 172.21.15.82:0/3582420247 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc010670 con 0x7f68d41032f0 2024-04-26T20:24:03.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.671+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d4192a00 con 0x7f68d41032f0 2024-04-26T20:24:03.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.671+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d4192f00 con 0x7f68d41032f0 2024-04-26T20:24:03.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.674+0000 7f68ddfa9740 1 Processor -- start 2024-04-26T20:24:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68d0c00640 1 -- 172.21.15.82:0/3582420247 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f68cc0054b0 con 0x7f68d41032f0 2024-04-26T20:24:03.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 -- start start 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a3350 0x5617043a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043aa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617042b3030 con 0x5617043a84c0 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617042ce7f0 con 0x5617043a2960 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.675+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5617042897e0 con 0x5617043a3350 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44622/0 (socket says 172.21.15.82:44622) 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3400640 1 -- 172.21.15.82:0/213642353 learned_addr learned my addr 172.21.15.82:0/213642353 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3e00640 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a3350 0x5617043a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3400640 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3e00640 1 -- 172.21.15.82:0/213642353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 msgr2=0x5617043a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3e00640 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3e00640 1 -- 172.21.15.82:0/213642353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 msgr2=0x5617043aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3e00640 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.676+0000 7f68d3e00640 1 -- 172.21.15.82:0/213642353 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561704295050 con 0x5617043a3350 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.677+0000 7f68d3e00640 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a3350 0x5617043a7e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f68c402a930 tx=0x7f68c403eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6937f8340e6f593 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.677+0000 7f68c9600640 1 -- 172.21.15.82:0/213642353 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4035070 con 0x5617043a3350 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.677+0000 7f68d0c00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68b80a3cc0 0x7f68b80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.677+0000 7f68c9600640 1 -- 172.21.15.82:0/213642353 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68c4005040 con 0x5617043a3350 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.677+0000 7f68c9600640 1 -- 172.21.15.82:0/213642353 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4004a90 con 0x5617043a3350 2024-04-26T20:24:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.677+0000 7f68d0c00640 1 -- 172.21.15.82:0/3582420247 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f68cc0d0ce0 con 0x7f68d41032f0 2024-04-26T20:24:03.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 -- 172.21.15.82:0/213642353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a3350 msgr2=0x5617043a7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a3350 0x5617043a7e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f68c402a930 tx=0x7f68c403eaf0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 -- 172.21.15.82:0/213642353 shutdown_connections 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a3350 0x5617043a7e50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/213642353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 -- 172.21.15.82:0/213642353 >> 172.21.15.82:0/213642353 conn(0x56170439dfd0 msgr2=0x56170439e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 -- 172.21.15.82:0/213642353 shutdown_connections 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68d3400640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68b80a3cc0 0x7f68b80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.678+0000 7f68ddfa9740 1 -- 172.21.15.82:0/213642353 wait complete. 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.679+0000 7f68ddfa9740 1 -- start start 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.679+0000 7f68ddfa9740 1 Processor -- start 2024-04-26T20:24:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.679+0000 7f68d3400640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68b80a3cc0 0x7f68b80a6180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5617043a3bb0 tx=0x7f68c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x5617043ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a84c0 0x5617043b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56170430b200 con 0x5617043a3350 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561704305ee0 con 0x5617043a84c0 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561704312e70 con 0x5617043a2960 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68ddfa9740 10 client.0 _ll_register_callbacks cb 0x5617042fc270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68d3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68d3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37548/0 (socket says 172.21.15.82:37548) 2024-04-26T20:24:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68d3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x5617043ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68d3400640 1 -- 172.21.15.82:0/847387421 learned_addr learned my addr 172.21.15.82:0/847387421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.680+0000 7f68d9000640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a84c0 0x5617043b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3e00640 1 -- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a84c0 msgr2=0x5617043b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3e00640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a84c0 0x5617043b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3e00640 1 -- 172.21.15.82:0/847387421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 msgr2=0x5617043acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3e00640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3e00640 1 -- 172.21.15.82:0/847387421 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617040e27d0 con 0x5617043a2960 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3400640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68d3e00640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x5617043ac750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x56170439ef40 tx=0x7f68c40042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c5abbc5007823d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68be000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68be000640 1 -- 172.21.15.82:0/847387421 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4035070 con 0x5617043a2960 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.681+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68c4005040 con 0x5617043a2960 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68be000640 1 -- 172.21.15.82:0/847387421 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f68c404d070 con 0x5617043a2960 2024-04-26T20:24:03.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68be000640 1 -- 172.21.15.82:0/847387421 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68c4004810 con 0x5617043a2960 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68ddfa9740 10 client.25861 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617040183f0 con 0x5617043a2960 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68be000640 1 -- 172.21.15.82:0/847387421 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68c4005040 con 0x5617043a2960 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68be000640 1 -- 172.21.15.82:0/847387421 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f68c403ece0 con 0x5617043a2960 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68ddfa9740 10 client.25861 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.682+0000 7f68ddfa9740 10 client.25861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.683+0000 7f68ddfa9740 20 client.25861 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.683+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x5617043ba220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.683+0000 7f68ddfa9740 4 client.25861 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:03.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.683+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617043147e0 con 0x5617043b7e30 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.683+0000 7f68d3400640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x5617043ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.684+0000 7f68d3400640 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x5617043ba220 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a591b3276acdb6f1 server_cookie=2a77d7ce1a137a68 in_seq=0 out_seq=0 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.684+0000 7f68be000640 10 client.25861 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.684+0000 7f68be000640 1 -- 172.21.15.82:0/847387421 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617043147e0 con 0x5617043b7e30 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68be000640 10 client.25861 handle_command_reply: tid=0 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 client.25861 shutdown 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 msgr2=0x5617043ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x5617043ac750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x56170439ef40 tx=0x7f68c40042e0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 shutdown_connections 2024-04-26T20:24:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x5617043ba220 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68be000640 0 client.25861 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a84c0 0x5617043b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/847387421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x5617043ac750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 >> 172.21.15.82:0/847387421 conn(0x56170439dfd0 msgr2=0x56170439d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 shutdown_connections 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.685+0000 7f68ddfa9740 1 -- 172.21.15.82:0/847387421 wait complete. 2024-04-26T20:24:03.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.686+0000 7f68ddfa9740 20 client.25861 trim_cache size 0 max 16384 2024-04-26T20:24:03.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 Processor -- start 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 -- start start 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x56170439d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a3350 0x56170439d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68d41aaa60 con 0x5617043a84c0 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68d41a95f0 con 0x5617043a3350 2024-04-26T20:24:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.704+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68d41a9cc0 con 0x5617043a2960 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x56170439d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d9000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x56170439d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41876/0 (socket says 172.21.15.82:41876) 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 -- 172.21.15.82:0/3677930918 learned_addr learned my addr 172.21.15.82:0/3677930918 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3400640 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a3350 0x56170439d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 -- 172.21.15.82:0/3677930918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a3350 msgr2=0x56170439d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a3350 0x56170439d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 -- 172.21.15.82:0/3677930918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 msgr2=0x5617043b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 -- 172.21.15.82:0/3677930918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561703fd80f0 con 0x5617043a2960 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.705+0000 7f68d3e00640 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x56170439d070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009900 tx=0x7f68c402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a319f3016e38b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.706+0000 7f68c8c00640 1 -- 172.21.15.82:0/3677930918 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4035070 con 0x5617043a2960 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.706+0000 7f68c8c00640 1 -- 172.21.15.82:0/3677930918 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68c4031710 con 0x5617043a2960 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.706+0000 7f68c8c00640 1 -- 172.21.15.82:0/3677930918 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4004e40 con 0x5617043a2960 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.706+0000 7f68ddfa9740 1 -- 172.21.15.82:0/3677930918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 msgr2=0x56170439d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.706+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x56170439d070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009900 tx=0x7f68c402a410 comp rx=0 tx=0).stop 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 -- 172.21.15.82:0/3677930918 shutdown_connections 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a84c0 0x5617043b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a3350 0x56170439d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/3677930918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a2960 0x56170439d070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 -- 172.21.15.82:0/3677930918 >> 172.21.15.82:0/3677930918 conn(0x56170439dfd0 msgr2=0x56170439c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 -- 172.21.15.82:0/3677930918 shutdown_connections 2024-04-26T20:24:03.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 -- 172.21.15.82:0/3677930918 wait complete. 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 -- start start 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.707+0000 7f68ddfa9740 1 Processor -- start 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a84c0 0x56170441c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68d41a6f00 con 0x5617043a3350 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68d41aa390 con 0x5617043a2960 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68d41a7570 con 0x5617043a84c0 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68ddfa9740 10 client.0 _ll_register_callbacks cb 0x7f68c0011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68d3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68d3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68d3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44660/0 (socket says 172.21.15.82:44660) 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68d3e00640 1 -- 172.21.15.82:0/368057941 learned_addr learned my addr 172.21.15.82:0/368057941 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68d9000640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a84c0 0x56170441c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.708+0000 7f68d3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37570/0 (socket says 172.21.15.82:37570) 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3e00640 1 -- 172.21.15.82:0/368057941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a84c0 msgr2=0x56170441c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3e00640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a84c0 0x56170441c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3e00640 1 -- 172.21.15.82:0/368057941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 msgr2=0x5617043b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3e00640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3e00640 1 -- 172.21.15.82:0/368057941 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617042cea30 con 0x5617043a2960 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3400640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68d3e00640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043b0800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f68c4004320 tx=0x7f68c4004f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3d3acd72cb7ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68be000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.709+0000 7f68be000640 1 -- 172.21.15.82:0/368057941 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4035040 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68c4031710 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68be000640 1 -- 172.21.15.82:0/368057941 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f68c4044070 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68be000640 1 -- 172.21.15.82:0/368057941 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68c4031ad0 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68ddfa9740 10 client.25832 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56170441d5b0 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68be000640 1 -- 172.21.15.82:0/368057941 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68c4031710 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68be000640 1 -- 172.21.15.82:0/368057941 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f68c4051460 con 0x5617043a2960 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68ddfa9740 10 client.25832 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.710+0000 7f68ddfa9740 10 client.25832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68ddfa9740 20 client.25832 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x56170441fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68ddfa9740 4 client.25832 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:24:03.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56170430e650 con 0x5617043b7e30 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68d3400640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x56170441fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68d3400640 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x56170441fc40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a036d144602ab8 server_cookie=9d5fb982799bd431 in_seq=0 out_seq=0 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.711+0000 7f68be000640 10 client.25832 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68be000640 1 -- 172.21.15.82:0/368057941 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56170430e650 con 0x5617043b7e30 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68be000640 10 client.25832 handle_command_reply: tid=0 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 client.25832 shutdown 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 msgr2=0x5617043b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043b0800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f68c4004320 tx=0x7f68c4004f70 comp rx=0 tx=0).stop 2024-04-26T20:24:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 shutdown_connections 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5617043b7e30 0x56170441fc40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617043a84c0 0x56170441c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617043a3350 0x5617043b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68be000640 0 client.25832 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 --2- 172.21.15.82:0/368057941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617043a2960 0x5617043b0800 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 >> 172.21.15.82:0/368057941 conn(0x56170439dfd0 msgr2=0x56170439d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 shutdown_connections 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 1 -- 172.21.15.82:0/368057941 wait complete. 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.712+0000 7f68ddfa9740 20 client.25832 trim_cache size 0 max 16384 2024-04-26T20:24:03.717 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:24:03.718 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:24:03.718 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:24:03.718 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:24:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68b80a3cc0 msgr2=0x7f68b80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68b80a3cc0 0x7f68b80a6180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5617043a3bb0 tx=0x7f68c0005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 msgr2=0x7f68d41a21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 0x7f68d41a21f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009fd0 tx=0x7f68cc00ef10 comp rx=0 tx=0).stop 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 shutdown_connections 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f68b80a3cc0 0x7f68b80a6180 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d41032f0 0x7f68d41a21f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68d4102930 0x7f68d419b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 --2- 172.21.15.82:0/3582420247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68d4101740 0x7f68d419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 >> 172.21.15.82:0/3582420247 conn(0x7f68d40fccd0 msgr2=0x7f68d40fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 shutdown_connections 2024-04-26T20:24:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.714+0000 7f68d9a00640 1 -- 172.21.15.82:0/3582420247 wait complete. 2024-04-26T20:24:03.734 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:24:03.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:03.802 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:03 smithi082 ceph-mon[28105]: pgmap v449: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 -- 172.21.15.82:0/98931329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788102790 msgr2=0x7fc788102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 --2- 172.21.15.82:0/98931329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788102790 0x7fc788102bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009900 tx=0x7fc77c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 -- 172.21.15.82:0/98931329 shutdown_connections 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 --2- 172.21.15.82:0/98931329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788104340 0x7fc78810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 --2- 172.21.15.82:0/98931329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc788103980 0x7fc788103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 --2- 172.21.15.82:0/98931329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788102790 0x7fc788102bb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 -- 172.21.15.82:0/98931329 >> 172.21.15.82:0/98931329 conn(0x7fc7880fdd00 msgr2=0x7fc788100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 -- 172.21.15.82:0/98931329 shutdown_connections 2024-04-26T20:24:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.919+0000 7fc78ee00640 1 -- 172.21.15.82:0/98931329 wait complete. 2024-04-26T20:24:03.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.920+0000 7fc78ee00640 1 Processor -- start 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.920+0000 7fc78ee00640 1 -- start start 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.920+0000 7fc78ee00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 0x7fc78819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.920+0000 7fc78ee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788103980 0x7fc78819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78ee00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc788104340 0x7fc7881a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78ee00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810e300 con 0x7fc788102790 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78ee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810e180 con 0x7fc788103980 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78ee00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810e480 con 0x7fc788104340 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 0x7fc78819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 0x7fc78819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37600/0 (socket says 172.21.15.82:37600) 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 -- 172.21.15.82:0/2536195878 learned_addr learned my addr 172.21.15.82:0/2536195878 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78d000640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788103980 0x7fc78819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78e400640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc788104340 0x7fc7881a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 -- 172.21.15.82:0/2536195878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc788104340 msgr2=0x7fc7881a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc788104340 0x7fc7881a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 -- 172.21.15.82:0/2536195878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788103980 msgr2=0x7fc78819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788103980 0x7fc78819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.921+0000 7fc78da00640 1 -- 172.21.15.82:0/2536195878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7881a27e0 con 0x7fc788102790 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.922+0000 7fc78da00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 0x7fc78819abc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc77c031500 tx=0x7fc77c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.922+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c03f070 con 0x7fc788102790 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.922+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc77c031c50 con 0x7fc788102790 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.922+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7881a2a70 con 0x7fc788102790 2024-04-26T20:24:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.922+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c035030 con 0x7fc788102790 2024-04-26T20:24:03.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.922+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7881a2fb0 con 0x7fc788102790 2024-04-26T20:24:03.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.924+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7881a3180 con 0x7fc788102790 2024-04-26T20:24:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.926+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc77c042070 con 0x7fc788102790 2024-04-26T20:24:03.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.928+0000 7fc786000640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7700a3cc0 0x7fc7700a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:03.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.928+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc77c0f0fb0 con 0x7fc788102790 2024-04-26T20:24:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.928+0000 7fc78d000640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7700a3cc0 0x7fc7700a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.929+0000 7fc78d000640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7700a3cc0 0x7fc7700a6180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc78819c0d0 tx=0x7fc774005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:03.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:03.933+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc77c0bce20 con 0x7fc788102790 2024-04-26T20:24:04.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:03 smithi139 ceph-mon[32999]: pgmap v449: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:04.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:03 smithi135 ceph-mon[32816]: pgmap v449: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:04.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.203+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7881a3510 con 0x7fc788102790 2024-04-26T20:24:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.204+0000 7fc786000640 1 -- 172.21.15.82:0/2536195878 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11951 (secure 0 0 0) 0x7fc77c0c1120 con 0x7fc788102790 2024-04-26T20:24:04.205 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:24:04.205 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:22:49.242424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24550,24529,24454,24554,24584]},"id":1}]} 2024-04-26T20:24:04.206 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-04-26T20:24:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7700a3cc0 msgr2=0x7fc7700a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7700a3cc0 0x7fc7700a6180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc78819c0d0 tx=0x7fc774005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 msgr2=0x7fc78819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 0x7fc78819abc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc77c031500 tx=0x7fc77c003c10 comp rx=0 tx=0).stop 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 shutdown_connections 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7700a3cc0 0x7fc7700a6180 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc788104340 0x7fc7881a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc788103980 0x7fc78819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 --2- 172.21.15.82:0/2536195878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc788102790 0x7fc78819abc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 >> 172.21.15.82:0/2536195878 conn(0x7fc7880fdd00 msgr2=0x7fc788074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 shutdown_connections 2024-04-26T20:24:04.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.206+0000 7fc78ee00640 1 -- 172.21.15.82:0/2536195878 wait complete. 2024-04-26T20:24:04.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:24:04.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 -- 172.21.15.82:0/3412640379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58102430 msgr2=0x7f8e581028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 --2- 172.21.15.82:0/3412640379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58102430 0x7f8e581028b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009ca0 tx=0x7f8e5002a950 comp rx=0 tx=0).stop 2024-04-26T20:24:04.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 -- 172.21.15.82:0/3412640379 shutdown_connections 2024-04-26T20:24:04.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 --2- 172.21.15.82:0/3412640379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58102430 0x7f8e581028b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 --2- 172.21.15.82:0/3412640379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58101a90 0x7f8e58101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 --2- 172.21.15.82:0/3412640379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101130 0x7f8e58101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 -- 172.21.15.82:0/3412640379 >> 172.21.15.82:0/3412640379 conn(0x7f8e580fccd0 msgr2=0x7f8e580ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 -- 172.21.15.82:0/3412640379 shutdown_connections 2024-04-26T20:24:04.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.396+0000 7f8e5e800640 1 -- 172.21.15.82:0/3412640379 wait complete. 2024-04-26T20:24:04.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 Processor -- start 2024-04-26T20:24:04.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 -- start start 2024-04-26T20:24:04.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58101130 0x7f8e5819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101a90 0x7f8e5819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58102430 0x7f8e581a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58110550 con 0x7f8e58101a90 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581103d0 con 0x7f8e58101130 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.398+0000 7f8e5e800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581106d0 con 0x7f8e58102430 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101a90 0x7f8e5819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58101130 0x7f8e5819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101a90 0x7f8e5819b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37612/0 (socket says 172.21.15.82:37612) 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5ca00640 1 -- 172.21.15.82:0/1762736289 learned_addr learned my addr 172.21.15.82:0/1762736289 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5de00640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58102430 0x7f8e581a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5d400640 1 -- 172.21.15.82:0/1762736289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58102430 msgr2=0x7f8e581a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58102430 0x7f8e581a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5d400640 1 -- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101a90 msgr2=0x7f8e5819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101a90 0x7f8e5819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5d400640 1 -- 172.21.15.82:0/1762736289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e581a28e0 con 0x7f8e58101130 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.399+0000 7f8e5de00640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58102430 0x7f8e581a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.400+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58101130 0x7f8e5819acf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00e9f0 tx=0x7f8e4c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.400+0000 7f8e56000640 1 -- 172.21.15.82:0/1762736289 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00ccc0 con 0x7f8e58101130 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.400+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581a2bd0 con 0x7f8e58101130 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.400+0000 7f8e56000640 1 -- 172.21.15.82:0/1762736289 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e4c0108e0 con 0x7f8e58101130 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.400+0000 7f8e56000640 1 -- 172.21.15.82:0/1762736289 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c018880 con 0x7f8e58101130 2024-04-26T20:24:04.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.400+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e581a3120 con 0x7f8e58101130 2024-04-26T20:24:04.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 Processor -- start 2024-04-26T20:24:04.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 -- start start 2024-04-26T20:24:04.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e56000640 1 -- 172.21.15.82:0/1762736289 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8e4c010430 con 0x7f8e58101130 2024-04-26T20:24:04.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7e050 0x563ed5b7e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7ea40 0x563ed5b83540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b86040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563ed5ae1c70 con 0x563ed5b7e050 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ed5a9a980 con 0x563ed5b7ea40 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.405+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563ed5addc30 con 0x563ed5b83bb0 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7ea40 0x563ed5b83540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b86040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b86040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41930/0 (socket says 172.21.15.82:41930) 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 -- 172.21.15.82:0/608429644 learned_addr learned my addr 172.21.15.82:0/608429644 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5de00640 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7e050 0x563ed5b7e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 -- 172.21.15.82:0/608429644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7ea40 msgr2=0x563ed5b83540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7ea40 0x563ed5b83540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 -- 172.21.15.82:0/608429644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7e050 msgr2=0x563ed5b7e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7e050 0x563ed5b7e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5ca00640 1 -- 172.21.15.82:0/608429644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed5a727b0 con 0x563ed5b83bb0 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.406+0000 7f8e5de00640 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7e050 0x563ed5b7e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.407+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b86040 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009d60 tx=0x7f8e44011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e41f0bcad405c42a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.407+0000 7f8e4a600640 1 -- 172.21.15.82:0/608429644 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44004230 con 0x563ed5b83bb0 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.407+0000 7f8e4a600640 1 -- 172.21.15.82:0/608429644 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e440043d0 con 0x563ed5b83bb0 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.407+0000 7f8e4a600640 1 -- 172.21.15.82:0/608429644 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44004d90 con 0x563ed5b83bb0 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.407+0000 7f8e56000640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8e400a3c40 0x7f8e400a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.408+0000 7f8e56000640 1 -- 172.21.15.82:0/1762736289 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8e4c0d0c40 con 0x7f8e58101130 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.408+0000 7f8e5de00640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8e400a3c40 0x7f8e400a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.408+0000 7f8e62b7c740 1 -- 172.21.15.82:0/608429644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 msgr2=0x563ed5b86040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.408+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b86040 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009d60 tx=0x7f8e44011810 comp rx=0 tx=0).stop 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e5de00640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8e400a3c40 0x7f8e400a6100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x563ed5b7f2a0 tx=0x7f8e5002f870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 -- 172.21.15.82:0/608429644 shutdown_connections 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b86040 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7ea40 0x563ed5b83540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/608429644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7e050 0x563ed5b7e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 -- 172.21.15.82:0/608429644 >> 172.21.15.82:0/608429644 conn(0x563ed5b796c0 msgr2=0x563ed5b79ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 -- 172.21.15.82:0/608429644 shutdown_connections 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.409+0000 7f8e62b7c740 1 -- 172.21.15.82:0/608429644 wait complete. 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.410+0000 7f8e62b7c740 1 -- start start 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.410+0000 7f8e62b7c740 1 Processor -- start 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.410+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b87f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.410+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b7ea40 0x563ed5b88450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b83bb0 0x563ed5b8f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563ed5ae0f80 con 0x563ed5b83bb0 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ed5a8e260 con 0x563ed5b7e050 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563ed5ae62a0 con 0x563ed5b7ea40 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e62b7c740 10 client.0 _ll_register_callbacks cb 0x563ed5ad8960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b83bb0 0x563ed5b8f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b87f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b7ea40 0x563ed5b88450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b87f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44714/0 (socket says 172.21.15.82:44714) 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b7ea40 0x563ed5b88450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41942/0 (socket says 172.21.15.82:41942) 2024-04-26T20:24:04.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 -- 172.21.15.82:0/3503783094 learned_addr learned my addr 172.21.15.82:0/3503783094 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 -- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b7ea40 msgr2=0x563ed5b88450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b7ea40 0x563ed5b88450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 -- 172.21.15.82:0/3503783094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b83bb0 msgr2=0x563ed5b8f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b83bb0 0x563ed5b8f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.411+0000 7f8e5d400640 1 -- 172.21.15.82:0/3503783094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed5a701c0 con 0x563ed5b7e050 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.412+0000 7f8e5d400640 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b87f10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c09ca40 tx=0x7f8e4c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84489ccf65a2e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.412+0000 7f8e3ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.412+0000 7f8e3ea00640 1 -- 172.21.15.82:0/3503783094 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0bd070 con 0x563ed5b7e050 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.412+0000 7f8e3ea00640 1 -- 172.21.15.82:0/3503783094 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8e4c0ce480 con 0x563ed5b7e050 2024-04-26T20:24:04.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.412+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e440043d0 con 0x563ed5b7e050 2024-04-26T20:24:04.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.413+0000 7f8e3ea00640 1 -- 172.21.15.82:0/3503783094 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e4c0d4020 con 0x563ed5b7e050 2024-04-26T20:24:04.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.413+0000 7f8e62b7c740 10 client.25850 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:04.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.413+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ed57f33f0 con 0x563ed5b7e050 2024-04-26T20:24:04.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.413+0000 7f8e3ea00640 1 -- 172.21.15.82:0/3503783094 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e4c0b7070 con 0x563ed5b7e050 2024-04-26T20:24:04.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e3ea00640 1 -- 172.21.15.82:0/3503783094 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8e4c0bbbc0 con 0x563ed5b7e050 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e62b7c740 10 client.25850 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e62b7c740 10 client.25850 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e62b7c740 20 client.25850 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5b939b0 0x563ed5b95e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e62b7c740 4 client.25850 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ed5aef880 con 0x563ed5b939b0 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.414+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5b939b0 0x563ed5b95e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.415+0000 7f8e3ea00640 10 client.25850 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.415+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5b939b0 0x563ed5b95e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=21235c72ac87f5e3 server_cookie=9f66064a48b86015 in_seq=0 out_seq=0 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e3ea00640 1 -- 172.21.15.82:0/3503783094 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563ed5aef880 con 0x563ed5b939b0 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e3ea00640 10 client.25850 handle_command_reply: tid=0 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 client.25850 shutdown 2024-04-26T20:24:04.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 msgr2=0x563ed5b87f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b87f10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c09ca40 tx=0x7f8e4c00cef0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 shutdown_connections 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5b939b0 0x563ed5b95e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b83bb0 0x563ed5b8f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b7ea40 0x563ed5b88450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e3ea00640 0 client.25850 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/3503783094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b87f10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 >> 172.21.15.82:0/3503783094 conn(0x563ed5b796c0 msgr2=0x563ed5b787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 shutdown_connections 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.416+0000 7f8e62b7c740 1 -- 172.21.15.82:0/3503783094 wait complete. 2024-04-26T20:24:04.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.417+0000 7f8e62b7c740 20 client.25850 trim_cache size 0 max 16384 2024-04-26T20:24:04.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 Processor -- start 2024-04-26T20:24:04.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 -- start start 2024-04-26T20:24:04.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b7f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b7f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581ad410 con 0x563ed5b7ea40 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581aef50 con 0x563ed5b7e050 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.443+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581adae0 con 0x563ed5b83bb0 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b7f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b7f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44720/0 (socket says 172.21.15.82:44720) 2024-04-26T20:24:04.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 -- 172.21.15.82:0/1285350183 learned_addr learned my addr 172.21.15.82:0/1285350183 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5de00640 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b7f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 -- 172.21.15.82:0/1285350183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 msgr2=0x563ed5b7f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b7f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 -- 172.21.15.82:0/1285350183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 msgr2=0x563ed5b8f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.444+0000 7f8e5d400640 1 -- 172.21.15.82:0/1285350183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed58bd7d0 con 0x563ed5b7e050 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.445+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b7f2d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c09c7b0 tx=0x7f8e4c09afc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd9d757fa2a7ead0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.445+0000 7f8e49c00640 1 -- 172.21.15.82:0/1285350183 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c09c5f0 con 0x563ed5b7e050 2024-04-26T20:24:04.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.445+0000 7f8e49c00640 1 -- 172.21.15.82:0/1285350183 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e4c0b7070 con 0x563ed5b7e050 2024-04-26T20:24:04.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.445+0000 7f8e49c00640 1 -- 172.21.15.82:0/1285350183 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c09cab0 con 0x563ed5b7e050 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1285350183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 msgr2=0x563ed5b7f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b7f2d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c09c7b0 tx=0x7f8e4c09afc0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1285350183 shutdown_connections 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b7f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1285350183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b7f2d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1285350183 >> 172.21.15.82:0/1285350183 conn(0x563ed5b796c0 msgr2=0x563ed5b787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1285350183 shutdown_connections 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1285350183 wait complete. 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.446+0000 7f8e62b7c740 1 -- start start 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 Processor -- start 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b8ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b8e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581ae880 con 0x563ed5b7ea40 2024-04-26T20:24:04.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581ae1b0 con 0x563ed5b7e050 2024-04-26T20:24:04.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581ab3f0 con 0x563ed5b83bb0 2024-04-26T20:24:04.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.447+0000 7f8e62b7c740 10 client.0 _ll_register_callbacks cb 0x7f8e4c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b8ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b8ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44736/0 (socket says 172.21.15.82:44736) 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 -- 172.21.15.82:0/1247012431 learned_addr learned my addr 172.21.15.82:0/1247012431 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5de00640 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b8e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 -- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 msgr2=0x563ed5b8e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b8e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 -- 172.21.15.82:0/1247012431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 msgr2=0x563ed5b8d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.448+0000 7f8e5d400640 1 -- 172.21.15.82:0/1247012431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed5a882a0 con 0x563ed5b7e050 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e5d400640 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b8ce90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c09ad60 tx=0x7f8e4c010cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc79eed36078958 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e3ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e3ea00640 1 -- 172.21.15.82:0/1247012431 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c09c5f0 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e4c0b7070 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e3ea00640 1 -- 172.21.15.82:0/1247012431 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8e4c09c100 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e3ea00640 1 -- 172.21.15.82:0/1247012431 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e4c098920 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e62b7c740 10 client.25856 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ed5bfa130 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.449+0000 7f8e3ea00640 1 -- 172.21.15.82:0/1247012431 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e4c0b7070 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e3ea00640 1 -- 172.21.15.82:0/1247012431 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8e4c0a1f40 con 0x563ed5b7e050 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e62b7c740 10 client.25856 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e62b7c740 10 client.25856 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e62b7c740 20 client.25856 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5bfa740 0x563ed5bfcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e62b7c740 4 client.25856 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:04.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ed5ae96f0 con 0x563ed5bfa740 2024-04-26T20:24:04.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.450+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5bfa740 0x563ed5bfcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e5ca00640 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5bfa740 0x563ed5bfcb30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7626580cc625dc32 server_cookie=e3eaffeea2e8c25d in_seq=0 out_seq=0 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e3ea00640 10 client.25856 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e3ea00640 1 -- 172.21.15.82:0/1247012431 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ed5ae96f0 con 0x563ed5bfa740 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e3ea00640 10 client.25856 handle_command_reply: tid=0 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 client.25856 shutdown 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 msgr2=0x563ed5b8ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b8ce90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c09ad60 tx=0x7f8e4c010cc0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 shutdown_connections 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563ed5bfa740 0x563ed5bfcb30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ed5b83bb0 0x563ed5b8e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ed5b7ea40 0x563ed5b8d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 --2- 172.21.15.82:0/1247012431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ed5b7e050 0x563ed5b8ce90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 >> 172.21.15.82:0/1247012431 conn(0x563ed5b796c0 msgr2=0x563ed5b7c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.451+0000 7f8e3ea00640 0 client.25856 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.452+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 shutdown_connections 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.452+0000 7f8e62b7c740 1 -- 172.21.15.82:0/1247012431 wait complete. 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.452+0000 7f8e62b7c740 20 client.25856 trim_cache size 0 max 16384 2024-04-26T20:24:04.456 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8e400a3c40 msgr2=0x7f8e400a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8e400a3c40 0x7f8e400a6100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x563ed5b7f2a0 tx=0x7f8e5002f870 comp rx=0 tx=0).stop 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58101130 msgr2=0x7f8e5819acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58101130 0x7f8e5819acf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00e9f0 tx=0x7f8e4c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 shutdown_connections 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8e400a3c40 0x7f8e400a6100 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e58102430 0x7f8e581a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e58101a90 0x7f8e5819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 --2- 172.21.15.82:0/1762736289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e58101130 0x7f8e5819acf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 >> 172.21.15.82:0/1762736289 conn(0x7f8e580fccd0 msgr2=0x7f8e580fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 shutdown_connections 2024-04-26T20:24:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.453+0000 7f8e5e800640 1 -- 172.21.15.82:0/1762736289 wait complete. 2024-04-26T20:24:04.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:24:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 -- 172.21.15.82:0/1298460948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081023d0 msgr2=0x7f3e08102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 --2- 172.21.15.82:0/1298460948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081023d0 0x7f3e08102850 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ca0 tx=0x7f3e0002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 -- 172.21.15.82:0/1298460948 shutdown_connections 2024-04-26T20:24:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 --2- 172.21.15.82:0/1298460948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081023d0 0x7f3e08102850 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 --2- 172.21.15.82:0/1298460948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e08101a30 0x7f3e08101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 --2- 172.21.15.82:0/1298460948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081010d0 0x7f3e081014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.665+0000 7f3e07e00640 1 -- 172.21.15.82:0/1298460948 >> 172.21.15.82:0/1298460948 conn(0x7f3e080fccd0 msgr2=0x7f3e080ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.666+0000 7f3e07e00640 1 -- 172.21.15.82:0/1298460948 shutdown_connections 2024-04-26T20:24:04.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.666+0000 7f3e07e00640 1 -- 172.21.15.82:0/1298460948 wait complete. 2024-04-26T20:24:04.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.666+0000 7f3e07e00640 1 Processor -- start 2024-04-26T20:24:04.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 -- start start 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 0x7f3e0819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e08101a30 0x7f3e0819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081023d0 0x7f3e081a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08110590 con 0x7f3e081010d0 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08110410 con 0x7f3e08101a30 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e07e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08110710 con 0x7f3e081023d0 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 0x7f3e0819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 0x7f3e0819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37668/0 (socket says 172.21.15.82:37668) 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.667+0000 7f3e06a00640 1 -- 172.21.15.82:0/3135321072 learned_addr learned my addr 172.21.15.82:0/3135321072 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06000640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e08101a30 0x7f3e0819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e07400640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081023d0 0x7f3e081a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06a00640 1 -- 172.21.15.82:0/3135321072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081023d0 msgr2=0x7f3e081a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06a00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081023d0 0x7f3e081a21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06a00640 1 -- 172.21.15.82:0/3135321072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e08101a30 msgr2=0x7f3e0819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06a00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e08101a30 0x7f3e0819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06a00640 1 -- 172.21.15.82:0/3135321072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e081a2880 con 0x7f3e081010d0 2024-04-26T20:24:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e07400640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081023d0 0x7f3e081a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.668+0000 7f3e06a00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 0x7f3e0819ac70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3df800ea60 tx=0x7f3df800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.669+0000 7f3dff400640 1 -- 172.21.15.82:0/3135321072 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df800cde0 con 0x7f3e081010d0 2024-04-26T20:24:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.669+0000 7f3dff400640 1 -- 172.21.15.82:0/3135321072 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df80035f0 con 0x7f3e081010d0 2024-04-26T20:24:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.669+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e081a2b70 con 0x7f3e081010d0 2024-04-26T20:24:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.669+0000 7f3dff400640 1 -- 172.21.15.82:0/3135321072 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8010690 con 0x7f3e081010d0 2024-04-26T20:24:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.669+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e081a30c0 con 0x7f3e081010d0 2024-04-26T20:24:04.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 Processor -- start 2024-04-26T20:24:04.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 -- start start 2024-04-26T20:24:04.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a320470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a325540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a328040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55944a283c70 con 0x55944a320050 2024-04-26T20:24:04.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55944a23c980 con 0x55944a320a40 2024-04-26T20:24:04.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.672+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55944a27fc30 con 0x55944a325bb0 2024-04-26T20:24:04.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e07400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a320470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a328040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a328040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41974/0 (socket says 172.21.15.82:41974) 2024-04-26T20:24:04.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 -- 172.21.15.82:0/1801072136 learned_addr learned my addr 172.21.15.82:0/1801072136 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 -- 172.21.15.82:0/1801072136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 msgr2=0x55944a325540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a325540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 -- 172.21.15.82:0/1801072136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 msgr2=0x55944a320470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a320470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.673+0000 7f3e06000640 1 -- 172.21.15.82:0/1801072136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944a2147b0 con 0x55944a325bb0 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.674+0000 7f3e06000640 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a328040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009c70 tx=0x7f3df4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f63a0000dfbe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.674+0000 7f3df3e00640 1 -- 172.21.15.82:0/1801072136 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4004230 con 0x55944a325bb0 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.674+0000 7f3df3e00640 1 -- 172.21.15.82:0/1801072136 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df40043d0 con 0x55944a325bb0 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.674+0000 7f3df3e00640 1 -- 172.21.15.82:0/1801072136 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4019740 con 0x55944a325bb0 2024-04-26T20:24:04.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.674+0000 7f3dff400640 1 -- 172.21.15.82:0/3135321072 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3df80037a0 con 0x7f3e081010d0 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1801072136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 msgr2=0x55944a328040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a328040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009c70 tx=0x7f3df4011810 comp rx=0 tx=0).stop 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1801072136 shutdown_connections 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a328040 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a325540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1801072136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a320470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1801072136 >> 172.21.15.82:0/1801072136 conn(0x55944a31b6c0 msgr2=0x55944a31bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1801072136 shutdown_connections 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.675+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1801072136 wait complete. 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.676+0000 7f3dff400640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3dec0a3d50 0x7f3dec0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.676+0000 7f3e10a2e740 1 -- start start 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.676+0000 7f3dff400640 1 -- 172.21.15.82:0/3135321072 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f3df8010430 con 0x7f3e081010d0 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.676+0000 7f3e10a2e740 1 Processor -- start 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.676+0000 7f3e07400640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3dec0a3d50 0x7f3dec0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320050 0x55944a332720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a332c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 0x55944a339c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55944a282f80 con 0x55944a325bb0 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55944a230260 con 0x55944a320a40 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e07400640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3dec0a3d50 0x7f3dec0a6210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005e30 tx=0x7f3e00005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55944a2882a0 con 0x55944a320050 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e10a2e740 10 client.0 _ll_register_callbacks cb 0x55944a27a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.677+0000 7f3e07400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 0x55944a339c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 0x55944a339c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37680/0 (socket says 172.21.15.82:37680) 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 -- 172.21.15.82:0/182847007 learned_addr learned my addr 172.21.15.82:0/182847007 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 -- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320050 msgr2=0x55944a332720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320050 0x55944a332720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 -- 172.21.15.82:0/182847007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 msgr2=0x55944a332c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a332c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 -- 172.21.15.82:0/182847007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944a2121c0 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df40043d0 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3e07400640 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 0x55944a339c30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e0002f540 tx=0x7f3e0002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42caa5f301b883c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.678+0000 7f3df0c00640 10 client.15780 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.679+0000 7f3df0c00640 1 -- 172.21.15.82:0/182847007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00004250 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.679+0000 7f3df0c00640 1 -- 172.21.15.82:0/182847007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f3e000043f0 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.679+0000 7f3df0c00640 1 -- 172.21.15.82:0/182847007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e000045f0 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.679+0000 7f3e10a2e740 10 client.15780 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.679+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559449f953f0 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3df0c00640 1 -- 172.21.15.82:0/182847007 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3e00051070 con 0x55944a325bb0 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e10a2e740 10 client.15780 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e10a2e740 10 client.15780 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:24:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e10a2e740 20 client.15780 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e10a2e740 4 client.15780 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55944a291880 con 0x55944a33e040 2024-04-26T20:24:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.680+0000 7f3e06a00640 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.681+0000 7f3e06a00640 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3404d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=970dff73d3c69a05 server_cookie=39bfb486cacc028f in_seq=0 out_seq=0 2024-04-26T20:24:04.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.681+0000 7f3df0c00640 10 client.15780 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:04.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3df0c00640 1 -- 172.21.15.82:0/182847007 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55944a291880 con 0x55944a33e040 2024-04-26T20:24:04.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3df0c00640 10 client.15780 handle_command_reply: tid=0 2024-04-26T20:24:04.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 client.15780 shutdown 2024-04-26T20:24:04.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 msgr2=0x55944a339c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 0x55944a339c30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3e0002f540 tx=0x7f3e0002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 shutdown_connections 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a325bb0 0x55944a339c30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3404d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3df0c00640 0 client.15780 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a332c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/182847007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320050 0x55944a332720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 >> 172.21.15.82:0/182847007 conn(0x55944a31b6c0 msgr2=0x55944a31a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 shutdown_connections 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.682+0000 7f3e10a2e740 1 -- 172.21.15.82:0/182847007 wait complete. 2024-04-26T20:24:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.683+0000 7f3e10a2e740 20 client.15780 trim_cache size 0 max 16384 2024-04-26T20:24:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 Processor -- start 2024-04-26T20:24:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 -- start start 2024-04-26T20:24:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a321460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 0x55944a339bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a325bb0 0x55944a3219a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081a90b0 con 0x55944a320050 2024-04-26T20:24:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081aabf0 con 0x55944a325bb0 2024-04-26T20:24:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081a9780 con 0x55944a320a40 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e06000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 0x55944a339bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e07400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a325bb0 0x55944a3219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.710+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a321460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 0x55944a339bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42000/0 (socket says 172.21.15.82:42000) 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06000640 1 -- 172.21.15.82:0/2368675685 learned_addr learned my addr 172.21.15.82:0/2368675685 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06a00640 1 -- 172.21.15.82:0/2368675685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 msgr2=0x55944a339bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06a00640 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 0x55944a339bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06a00640 1 -- 172.21.15.82:0/2368675685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a325bb0 msgr2=0x55944a3219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06a00640 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a325bb0 0x55944a3219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06a00640 1 -- 172.21.15.82:0/2368675685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944a05f7d0 con 0x55944a320050 2024-04-26T20:24:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06000640 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 0x55944a339bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.711+0000 7f3e06a00640 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a321460 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3df80ce120 tx=0x7f3df8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4fde8a8bf7e75d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.712+0000 7f3df3400640 1 -- 172.21.15.82:0/2368675685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df809cff0 con 0x55944a320050 2024-04-26T20:24:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.712+0000 7f3df3400640 1 -- 172.21.15.82:0/2368675685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df809c8f0 con 0x55944a320050 2024-04-26T20:24:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.712+0000 7f3df3400640 1 -- 172.21.15.82:0/2368675685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8004000 con 0x55944a320050 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 -- 172.21.15.82:0/2368675685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 msgr2=0x55944a321460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a321460 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3df80ce120 tx=0x7f3df8000bc0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 -- 172.21.15.82:0/2368675685 shutdown_connections 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a325bb0 0x55944a3219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a320a40 0x55944a339bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/2368675685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a321460 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 -- 172.21.15.82:0/2368675685 >> 172.21.15.82:0/2368675685 conn(0x55944a31b6c0 msgr2=0x55944a31a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 -- 172.21.15.82:0/2368675685 shutdown_connections 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.713+0000 7f3e10a2e740 1 -- 172.21.15.82:0/2368675685 wait complete. 2024-04-26T20:24:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.714+0000 7f3e10a2e740 1 -- start start 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.714+0000 7f3e10a2e740 1 Processor -- start 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.714+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a337600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.714+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a337b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e10a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a338b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081aa520 con 0x55944a320050 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081a9e50 con 0x55944a320a40 2024-04-26T20:24:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e10a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081a7090 con 0x55944a325bb0 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e10a2e740 10 client.0 _ll_register_callbacks cb 0x7f3df8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a337600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a337600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37696/0 (socket says 172.21.15.82:37696) 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 -- 172.21.15.82:0/1205793872 learned_addr learned my addr 172.21.15.82:0/1205793872 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06000640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a337b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e07400640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a338b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 -- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 msgr2=0x55944a338b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a338b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 -- 172.21.15.82:0/1205793872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 msgr2=0x55944a337b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a337b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e06a00640 1 -- 172.21.15.82:0/1205793872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944a22a2a0 con 0x55944a320050 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.715+0000 7f3e07400640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a338b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3e06a00640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a337600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d010 tx=0x7f3df80ce060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd89a9413b6a410b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3df0c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3df0c00640 1 -- 172.21.15.82:0/1205793872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80a0ca0 con 0x55944a320050 2024-04-26T20:24:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3df0c00640 1 -- 172.21.15.82:0/1205793872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f3df8004000 con 0x55944a320050 2024-04-26T20:24:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df809c8f0 con 0x55944a320050 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3df0c00640 1 -- 172.21.15.82:0/1205793872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3df80a5560 con 0x55944a320050 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3e10a2e740 10 client.15786 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.716+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55944a3a4780 con 0x55944a320050 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3df0c00640 1 -- 172.21.15.82:0/1205793872 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df809c8f0 con 0x55944a320050 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3df0c00640 1 -- 172.21.15.82:0/1205793872 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3df80a50d0 con 0x55944a320050 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e10a2e740 10 client.15786 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e10a2e740 10 client.15786 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e10a2e740 20 client.15786 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e10a2e740 4 client.15786 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55944a28b6f0 con 0x55944a33e040 2024-04-26T20:24:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.717+0000 7f3e06000640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.718+0000 7f3e06000640 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3a7030 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d99c03093caa2cf3 server_cookie=2a332b24e1df1648 in_seq=0 out_seq=0 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.718+0000 7f3df0c00640 10 client.15786 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.718+0000 7f3df0c00640 1 -- 172.21.15.82:0/1205793872 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55944a28b6f0 con 0x55944a33e040 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.718+0000 7f3df0c00640 10 client.15786 handle_command_reply: tid=0 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.718+0000 7f3e10a2e740 1 client.15786 shutdown 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 msgr2=0x55944a337600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a337600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d010 tx=0x7f3df80ce060 comp rx=0 tx=0).stop 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 shutdown_connections 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55944a325bb0 0x55944a338b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55944a33e040 0x55944a3a7030 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55944a320a40 0x55944a337b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 --2- 172.21.15.82:0/1205793872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55944a320050 0x55944a337600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 >> 172.21.15.82:0/1205793872 conn(0x55944a31b6c0 msgr2=0x55944a31e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3df0c00640 0 client.15786 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 shutdown_connections 2024-04-26T20:24:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 1 -- 172.21.15.82:0/1205793872 wait complete. 2024-04-26T20:24:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.719+0000 7f3e10a2e740 20 client.15786 trim_cache size 0 max 16384 2024-04-26T20:24:04.723 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3dec0a3d50 msgr2=0x7f3dec0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3dec0a3d50 0x7f3dec0a6210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005e30 tx=0x7f3e00005da0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 msgr2=0x7f3e0819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 0x7f3e0819ac70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3df800ea60 tx=0x7f3df800ef20 comp rx=0 tx=0).stop 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 shutdown_connections 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3dec0a3d50 0x7f3dec0a6210 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e081023d0 0x7f3e081a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e08101a30 0x7f3e0819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 --2- 172.21.15.82:0/3135321072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e081010d0 0x7f3e0819ac70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 >> 172.21.15.82:0/3135321072 conn(0x7f3e080fccd0 msgr2=0x7f3e080fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 shutdown_connections 2024-04-26T20:24:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.720+0000 7f3e07e00640 1 -- 172.21.15.82:0/3135321072 wait complete. 2024-04-26T20:24:04.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:24:04.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 -- 172.21.15.82:0/170818955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101130 msgr2=0x7fc728101550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 --2- 172.21.15.82:0/170818955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101130 0x7fc728101550 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc718009900 tx=0x7fc71802a480 comp rx=0 tx=0).stop 2024-04-26T20:24:04.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 -- 172.21.15.82:0/170818955 shutdown_connections 2024-04-26T20:24:04.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 --2- 172.21.15.82:0/170818955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 0x7fc7281028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 --2- 172.21.15.82:0/170818955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101a90 0x7fc728101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 --2- 172.21.15.82:0/170818955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101130 0x7fc728101550 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 -- 172.21.15.82:0/170818955 >> 172.21.15.82:0/170818955 conn(0x7fc7280fccd0 msgr2=0x7fc7280ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.916+0000 7fc72ce00640 1 -- 172.21.15.82:0/170818955 shutdown_connections 2024-04-26T20:24:04.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.917+0000 7fc72ce00640 1 -- 172.21.15.82:0/170818955 wait complete. 2024-04-26T20:24:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.918+0000 7fc72ce00640 1 Processor -- start 2024-04-26T20:24:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.918+0000 7fc72ce00640 1 -- start start 2024-04-26T20:24:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.918+0000 7fc72ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101130 0x7fc72819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.918+0000 7fc72ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 0x7fc72819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.918+0000 7fc72ce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 0x7fc7281a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc72ce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281105b0 con 0x7fc728101a90 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc72ce00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc728110430 con 0x7fc728101130 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc72ce00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc728110730 con 0x7fc728102430 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 0x7fc72819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc727400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101130 0x7fc72819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 0x7fc72819b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37712/0 (socket says 172.21.15.82:37712) 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 -- 172.21.15.82:0/1928154441 learned_addr learned my addr 172.21.15.82:0/1928154441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc727e00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 0x7fc7281a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 -- 172.21.15.82:0/1928154441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 msgr2=0x7fc7281a21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 0x7fc7281a21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 -- 172.21.15.82:0/1928154441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101130 msgr2=0x7fc72819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101130 0x7fc72819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc726a00640 1 -- 172.21.15.82:0/1928154441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7281a2850 con 0x7fc728101a90 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.919+0000 7fc727e00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 0x7fc7281a21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.920+0000 7fc727400640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101130 0x7fc72819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.920+0000 7fc726a00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 0x7fc72819b180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc71400ea60 tx=0x7fc71400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.920+0000 7fc71fe00640 1 -- 172.21.15.82:0/1928154441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71400cde0 con 0x7fc728101a90 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.920+0000 7fc71fe00640 1 -- 172.21.15.82:0/1928154441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7140035f0 con 0x7fc728101a90 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.920+0000 7fc71fe00640 1 -- 172.21.15.82:0/1928154441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714010690 con 0x7fc728101a90 2024-04-26T20:24:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.920+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7281a2b40 con 0x7fc728101a90 2024-04-26T20:24:04.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.921+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7281a3010 con 0x7fc728101a90 2024-04-26T20:24:04.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.924+0000 7fc73136e740 1 Processor -- start 2024-04-26T20:24:04.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.924+0000 7fc73136e740 1 -- start start 2024-04-26T20:24:04.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc73136e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf306c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc73136e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf307250 0x555abf30bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc73136e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf30e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc73136e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555abf261c70 con 0x555abf306860 2024-04-26T20:24:04.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc73136e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555abf21a980 con 0x555abf307250 2024-04-26T20:24:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc73136e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555abf25dc30 con 0x555abf30c3c0 2024-04-26T20:24:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.925+0000 7fc727e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf306c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf306c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37718/0 (socket says 172.21.15.82:37718) 2024-04-26T20:24:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf307250 0x555abf30bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 -- 172.21.15.82:0/4133064814 learned_addr learned my addr 172.21.15.82:0/4133064814 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 -- 172.21.15.82:0/4133064814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 msgr2=0x555abf30e850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf30e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc71fe00640 1 -- 172.21.15.82:0/1928154441 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc7140037a0 con 0x7fc728101a90 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 -- 172.21.15.82:0/4133064814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf307250 msgr2=0x555abf30bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf307250 0x555abf30bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727e00640 1 -- 172.21.15.82:0/4133064814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555abf1f27b0 con 0x555abf306860 2024-04-26T20:24:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.926+0000 7fc727400640 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf307250 0x555abf30bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:04.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.927+0000 7fc727e00640 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf306c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f90 tx=0x7fc72000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f723e358cdba125e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.927+0000 7fc71cc00640 1 -- 172.21.15.82:0/4133064814 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720003b70 con 0x555abf306860 2024-04-26T20:24:04.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.928+0000 7fc71cc00640 1 -- 172.21.15.82:0/4133064814 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc720003d10 con 0x555abf306860 2024-04-26T20:24:04.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.928+0000 7fc71cc00640 1 -- 172.21.15.82:0/4133064814 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720011960 con 0x555abf306860 2024-04-26T20:24:04.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.928+0000 7fc71fe00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc70c0a3d90 0x7fc70c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc71fe00640 1 -- 172.21.15.82:0/1928154441 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc7140d0c30 con 0x7fc728101a90 2024-04-26T20:24:04.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 -- 172.21.15.82:0/4133064814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 msgr2=0x555abf306c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf306c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f90 tx=0x7fc72000f7f0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc727400640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc70c0a3d90 0x7fc70c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 -- 172.21.15.82:0/4133064814 shutdown_connections 2024-04-26T20:24:04.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf30e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf307250 0x555abf30bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 --2- 172.21.15.82:0/4133064814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf306c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.929+0000 7fc73136e740 1 -- 172.21.15.82:0/4133064814 >> 172.21.15.82:0/4133064814 conn(0x555abf301ed0 msgr2=0x555abf3022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.930+0000 7fc73136e740 1 -- 172.21.15.82:0/4133064814 shutdown_connections 2024-04-26T20:24:04.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.930+0000 7fc73136e740 1 -- 172.21.15.82:0/4133064814 wait complete. 2024-04-26T20:24:04.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.930+0000 7fc727400640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc70c0a3d90 0x7fc70c0a6250 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc718031500 tx=0x7fc718005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.930+0000 7fc73136e740 1 -- start start 2024-04-26T20:24:04.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.931+0000 7fc73136e740 1 Processor -- start 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.931+0000 7fc73136e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf3107b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.931+0000 7fc73136e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf307250 0x555abf310cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.931+0000 7fc73136e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf317d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.931+0000 7fc73136e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555abf260f80 con 0x555abf307250 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.931+0000 7fc73136e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555abf20e260 con 0x555abf306860 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc73136e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555abf2662a0 con 0x555abf30c3c0 2024-04-26T20:24:04.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc73136e740 10 client.0 _ll_register_callbacks cb 0x555abf258960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:04.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf317d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf3107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf317d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42044/0 (socket says 172.21.15.82:42044) 2024-04-26T20:24:04.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 -- 172.21.15.82:0/2986253184 learned_addr learned my addr 172.21.15.82:0/2986253184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc726a00640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf307250 0x555abf310cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 -- 172.21.15.82:0/2986253184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 msgr2=0x555abf3107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf3107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 -- 172.21.15.82:0/2986253184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf307250 msgr2=0x555abf310cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf307250 0x555abf310cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc727e00640 1 -- 172.21.15.82:0/2986253184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555abf1f01c0 con 0x555abf30c3c0 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.932+0000 7fc726a00640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf307250 0x555abf310cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.933+0000 7fc727e00640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf317d30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc72000fcf0 tx=0x7fc720003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc30aab3cd9686 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.933+0000 7fc711600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:04.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.933+0000 7fc711600640 1 -- 172.21.15.82:0/2986253184 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72002a060 con 0x555abf30c3c0 2024-04-26T20:24:04.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.934+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc720003d10 con 0x555abf30c3c0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.934+0000 7fc711600640 1 -- 172.21.15.82:0/2986253184 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc720004c50 con 0x555abf30c3c0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.934+0000 7fc711600640 1 -- 172.21.15.82:0/2986253184 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc720031050 con 0x555abf30c3c0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.934+0000 7fc73136e740 10 client.25909 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.934+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555abef733f0 con 0x555abf30c3c0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.934+0000 7fc711600640 1 -- 172.21.15.82:0/2986253184 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc720003d10 con 0x555abf30c3c0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc711600640 1 -- 172.21.15.82:0/2986253184 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc7200040f0 con 0x555abf30c3c0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc73136e740 10 client.25909 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc73136e740 10 client.25909 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc73136e740 20 client.25909 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc73136e740 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf32cea0 0x555abf32f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc73136e740 4 client.25909 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555abf26f880 con 0x555abf32cea0 2024-04-26T20:24:04.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.935+0000 7fc727400640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf32cea0 0x555abf32f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.936+0000 7fc711600640 10 client.25909 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:04.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.936+0000 7fc727400640 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf32cea0 0x555abf32f290 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f80d34e875ee3ce server_cookie=e85c7c637e669fbe in_seq=0 out_seq=0 2024-04-26T20:24:04.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc711600640 1 -- 172.21.15.82:0/2986253184 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555abf26f880 con 0x555abf32cea0 2024-04-26T20:24:04.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc711600640 10 client.25909 handle_command_reply: tid=0 2024-04-26T20:24:04.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 client.25909 shutdown 2024-04-26T20:24:04.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 msgr2=0x555abf317d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf317d30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc72000fcf0 tx=0x7fc720003ba0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 shutdown_connections 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf32cea0 0x555abf32f290 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf30c3c0 0x555abf317d30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.937+0000 7fc73136e740 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf307250 0x555abf310cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.938+0000 7fc73136e740 1 --2- 172.21.15.82:0/2986253184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf3107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.938+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 >> 172.21.15.82:0/2986253184 conn(0x555abf301ed0 msgr2=0x555abf2f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.938+0000 7fc711600640 0 client.25909 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.938+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 shutdown_connections 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.938+0000 7fc73136e740 1 -- 172.21.15.82:0/2986253184 wait complete. 2024-04-26T20:24:04.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.938+0000 7fc73136e740 20 client.25909 trim_cache size 0 max 16384 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.965+0000 7fc73136e740 1 Processor -- start 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.965+0000 7fc73136e740 1 -- start start 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.965+0000 7fc73136e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf305750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.965+0000 7fc73136e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf317cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc73136e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf30c3c0 0x555abf308950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc73136e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc728072030 con 0x555abf306860 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc73136e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc728073b70 con 0x555abf30c3c0 2024-04-26T20:24:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc73136e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc728072700 con 0x555abf307250 2024-04-26T20:24:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf305750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf305750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37728/0 (socket says 172.21.15.82:37728) 2024-04-26T20:24:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 -- 172.21.15.82:0/2842417088 learned_addr learned my addr 172.21.15.82:0/2842417088 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc726a00640 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf317cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727e00640 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf30c3c0 0x555abf308950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 -- 172.21.15.82:0/2842417088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 msgr2=0x555abf317cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf317cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 -- 172.21.15.82:0/2842417088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf30c3c0 msgr2=0x555abf308950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf30c3c0 0x555abf308950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.966+0000 7fc727400640 1 -- 172.21.15.82:0/2842417088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555abf03d7d0 con 0x555abf306860 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.967+0000 7fc727400640 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf305750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc718006010 tx=0x7fc718041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bfe14921c017d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.967+0000 7fc713e00640 1 -- 172.21.15.82:0/2842417088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71805b070 con 0x555abf306860 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.967+0000 7fc713e00640 1 -- 172.21.15.82:0/2842417088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc718031760 con 0x555abf306860 2024-04-26T20:24:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.967+0000 7fc713e00640 1 -- 172.21.15.82:0/2842417088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718035050 con 0x555abf306860 2024-04-26T20:24:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 -- 172.21.15.82:0/2842417088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 msgr2=0x555abf305750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf305750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc718006010 tx=0x7fc718041000 comp rx=0 tx=0).stop 2024-04-26T20:24:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 -- 172.21.15.82:0/2842417088 shutdown_connections 2024-04-26T20:24:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf30c3c0 0x555abf308950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf317cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 --2- 172.21.15.82:0/2842417088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf306860 0x555abf305750 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 -- 172.21.15.82:0/2842417088 >> 172.21.15.82:0/2842417088 conn(0x555abf301ed0 msgr2=0x555abf2f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 -- 172.21.15.82:0/2842417088 shutdown_connections 2024-04-26T20:24:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.968+0000 7fc73136e740 1 -- 172.21.15.82:0/2842417088 wait complete. 2024-04-26T20:24:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.969+0000 7fc73136e740 1 -- start start 2024-04-26T20:24:04.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.969+0000 7fc73136e740 1 Processor -- start 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf314d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf3152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf30c3c0 0x555abf3913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7280734a0 con 0x555abf30c3c0 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc728072dd0 con 0x555abf306860 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc728070010 con 0x555abf307250 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc73136e740 10 client.0 _ll_register_callbacks cb 0x7fc720015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc727e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf30c3c0 0x555abf3913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc727400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf314d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc726a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf3152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc727400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf314d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44822/0 (socket says 172.21.15.82:44822) 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.970+0000 7fc727400640 1 -- 172.21.15.82:0/3223851765 learned_addr learned my addr 172.21.15.82:0/3223851765 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc727400640 1 -- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 msgr2=0x555abf3152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc727400640 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf3152c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc727400640 1 -- 172.21.15.82:0/3223851765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf30c3c0 msgr2=0x555abf3913c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc727400640 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf30c3c0 0x555abf3913c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc727400640 1 -- 172.21.15.82:0/3223851765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555abf2082a0 con 0x555abf306860 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc727400640 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf314d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc718000c00 tx=0x7fc718056550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692060167488fe15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:04.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc711600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc711600640 1 -- 172.21.15.82:0/3223851765 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71805b070 con 0x555abf306860 2024-04-26T20:24:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc718031760 con 0x555abf306860 2024-04-26T20:24:04.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.971+0000 7fc711600640 1 -- 172.21.15.82:0/3223851765 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc718056700 con 0x555abf306860 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc711600640 1 -- 172.21.15.82:0/3223851765 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc718069050 con 0x555abf306860 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 10 client.25886 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555abf392b30 con 0x555abf306860 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc711600640 1 -- 172.21.15.82:0/3223851765 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc718031760 con 0x555abf306860 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc711600640 1 -- 172.21.15.82:0/3223851765 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc718053070 con 0x555abf306860 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 10 client.25886 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 10 client.25886 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 20 client.25886 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf393460 0x555abf395880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 4 client.25886 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.972+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555abf2696f0 con 0x555abf393460 2024-04-26T20:24:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc726a00640 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf393460 0x555abf395880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc726a00640 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf393460 0x555abf395880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=feae62df5b04ca7b server_cookie=989dcc4c5d2a9bb4 in_seq=0 out_seq=0 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc711600640 10 client.25886 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc711600640 1 -- 172.21.15.82:0/3223851765 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555abf2696f0 con 0x555abf393460 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc711600640 10 client.25886 handle_command_reply: tid=0 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc73136e740 1 client.25886 shutdown 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 msgr2=0x555abf314d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.973+0000 7fc73136e740 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf314d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc718000c00 tx=0x7fc718056550 comp rx=0 tx=0).stop 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 shutdown_connections 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x555abf393460 0x555abf395880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555abf30c3c0 0x555abf3913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555abf307250 0x555abf3152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 --2- 172.21.15.82:0/3223851765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555abf306860 0x555abf314d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 >> 172.21.15.82:0/3223851765 conn(0x555abf301ed0 msgr2=0x555abf2f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc711600640 0 client.25886 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 shutdown_connections 2024-04-26T20:24:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 1 -- 172.21.15.82:0/3223851765 wait complete. 2024-04-26T20:24:04.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.974+0000 7fc73136e740 20 client.25886 trim_cache size 0 max 16384 2024-04-26T20:24:04.978 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc70c0a3d90 msgr2=0x7fc70c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc70c0a3d90 0x7fc70c0a6250 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc718031500 tx=0x7fc718005a20 comp rx=0 tx=0).stop 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 msgr2=0x7fc72819b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 0x7fc72819b180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc71400ea60 tx=0x7fc71400ef20 comp rx=0 tx=0).stop 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 shutdown_connections 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc70c0a3d90 0x7fc70c0a6250 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc728102430 0x7fc7281a21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc728101a90 0x7fc72819b180 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 --2- 172.21.15.82:0/1928154441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc728101130 0x7fc72819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 >> 172.21.15.82:0/1928154441 conn(0x7fc7280fccd0 msgr2=0x7fc728100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 shutdown_connections 2024-04-26T20:24:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:04.975+0000 7fc72ce00640 1 -- 172.21.15.82:0/1928154441 wait complete. 2024-04-26T20:24:04.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:04 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2536195878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:04.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:24:05.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:04 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2536195878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:05.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:04 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2536195878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 -- 172.21.15.82:0/3054100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4103400 msgr2=0x7fd9c41057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 --2- 172.21.15.82:0/3054100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4103400 0x7fd9c41057f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009900 tx=0x7fd9b802a410 comp rx=0 tx=0).stop 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 -- 172.21.15.82:0/3054100159 shutdown_connections 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 --2- 172.21.15.82:0/3054100159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9c4108660 0x7fd9c410aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 --2- 172.21.15.82:0/3054100159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4105d30 0x7fd9c4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 --2- 172.21.15.82:0/3054100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4103400 0x7fd9c41057f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 -- 172.21.15.82:0/3054100159 >> 172.21.15.82:0/3054100159 conn(0x7fd9c40fcdf0 msgr2=0x7fd9c40ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.181+0000 7fd9cc800640 1 -- 172.21.15.82:0/3054100159 shutdown_connections 2024-04-26T20:24:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.182+0000 7fd9cc800640 1 -- 172.21.15.82:0/3054100159 wait complete. 2024-04-26T20:24:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.183+0000 7fd9cc800640 1 Processor -- start 2024-04-26T20:24:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.183+0000 7fd9cc800640 1 -- start start 2024-04-26T20:24:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.183+0000 7fd9cc800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 0x7fd9c4102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.183+0000 7fd9cc800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4105d30 0x7fd9c41013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.183+0000 7fd9cc800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9c4108660 0x7fd9c41018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9cc800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c410e4b0 con 0x7fd9c4105d30 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9cc800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c410e330 con 0x7fd9c4103400 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9cc800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c410e630 con 0x7fd9c4108660 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 0x7fd9c4102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 0x7fd9c4102d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44842/0 (socket says 172.21.15.82:44842) 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 -- 172.21.15.82:0/2316324618 learned_addr learned my addr 172.21.15.82:0/2316324618 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9400640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4105d30 0x7fd9c41013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9c4108660 0x7fd9c41018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 -- 172.21.15.82:0/2316324618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9c4108660 msgr2=0x7fd9c41018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9c4108660 0x7fd9c41018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 -- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4105d30 msgr2=0x7fd9c41013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4105d30 0x7fd9c41013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.184+0000 7fd9c9e00640 1 -- 172.21.15.82:0/2316324618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c4102180 con 0x7fd9c4103400 2024-04-26T20:24:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.185+0000 7fd9c9e00640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 0x7fd9c4102d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8005940 tx=0x7fd9b80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.185+0000 7fd9bea00640 1 -- 172.21.15.82:0/2316324618 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b803f030 con 0x7fd9c4103400 2024-04-26T20:24:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.185+0000 7fd9bea00640 1 -- 172.21.15.82:0/2316324618 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9b8003cb0 con 0x7fd9c4103400 2024-04-26T20:24:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.185+0000 7fd9bea00640 1 -- 172.21.15.82:0/2316324618 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8035070 con 0x7fd9c4103400 2024-04-26T20:24:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.185+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c41a2d30 con 0x7fd9c4103400 2024-04-26T20:24:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.185+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c41a31c0 con 0x7fd9c4103400 2024-04-26T20:24:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 Processor -- start 2024-04-26T20:24:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 -- start start 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb10412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 0x557eb1046390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1048e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557eb0fa4c70 con 0x557eb1041890 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557eb0f5d980 con 0x557eb1040ea0 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.190+0000 7fd9cf610740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557eb0fa0c30 con 0x557eb1046a00 2024-04-26T20:24:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9bea00640 1 -- 172.21.15.82:0/2316324618 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd9b8042030 con 0x7fd9c4103400 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb10412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb10412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44850/0 (socket says 172.21.15.82:44850) 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 -- 172.21.15.82:0/3813164388 learned_addr learned my addr 172.21.15.82:0/3813164388 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9c9400640 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1048e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 -- 172.21.15.82:0/3813164388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 msgr2=0x557eb1048e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1048e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 -- 172.21.15.82:0/3813164388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 msgr2=0x557eb1046390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 0x557eb1046390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.191+0000 7fd9ca800640 1 -- 172.21.15.82:0/3813164388 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb0f357b0 con 0x557eb1040ea0 2024-04-26T20:24:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.192+0000 7fd9ca800640 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb10412c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009fd0 tx=0x7fd9c00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3c8a0782253224 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.192+0000 7fd9b3000640 1 -- 172.21.15.82:0/3813164388 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0004d20 con 0x557eb1040ea0 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.192+0000 7fd9b3000640 1 -- 172.21.15.82:0/3813164388 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c0004050 con 0x557eb1040ea0 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.192+0000 7fd9b3000640 1 -- 172.21.15.82:0/3813164388 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0005280 con 0x557eb1040ea0 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9bea00640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9ac0a3cc0 0x7fd9ac0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9bea00640 1 -- 172.21.15.82:0/2316324618 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd9b80f0c20 con 0x7fd9c4103400 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9c9e00640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9ac0a3cc0 0x7fd9ac0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9cf610740 1 -- 172.21.15.82:0/3813164388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 msgr2=0x557eb10412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9cf610740 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb10412c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009fd0 tx=0x7fd9c00118d0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9cf610740 1 -- 172.21.15.82:0/3813164388 shutdown_connections 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.193+0000 7fd9cf610740 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1048e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.194+0000 7fd9cf610740 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 0x557eb1046390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.194+0000 7fd9cf610740 1 --2- 172.21.15.82:0/3813164388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb10412c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.194+0000 7fd9cf610740 1 -- 172.21.15.82:0/3813164388 >> 172.21.15.82:0/3813164388 conn(0x557eb103c510 msgr2=0x557eb103c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.194+0000 7fd9cf610740 1 -- 172.21.15.82:0/3813164388 shutdown_connections 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.194+0000 7fd9cf610740 1 -- 172.21.15.82:0/3813164388 wait complete. 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.194+0000 7fd9c9e00640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9ac0a3cc0 0x7fd9ac0a6180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557eb1042300 tx=0x7fd9b803b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 -- start start 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 Processor -- start 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 0x557eb1053570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1041890 0x557eb1053ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb105aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557eb0fa3f80 con 0x557eb1040ea0 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557eb0f51260 con 0x557eb1041890 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557eb0fa92a0 con 0x557eb1046a00 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.195+0000 7fd9cf610740 10 client.0 _ll_register_callbacks cb 0x557eb0f9b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 0x557eb1053570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 0x557eb1053570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37774/0 (socket says 172.21.15.82:37774) 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 -- 172.21.15.82:0/2002580302 learned_addr learned my addr 172.21.15.82:0/2002580302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9c9400640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1041890 0x557eb1053ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb105aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 -- 172.21.15.82:0/2002580302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 msgr2=0x557eb105aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb105aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 -- 172.21.15.82:0/2002580302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1041890 msgr2=0x557eb1053ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1041890 0x557eb1053ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.196+0000 7fd9ca800640 1 -- 172.21.15.82:0/2002580302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb0f331c0 con 0x557eb1040ea0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 0x557eb1053570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9c001b040 tx=0x7fd9c00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4006b15b6eb21d93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9a7400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9a7400640 1 -- 172.21.15.82:0/2002580302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0004c40 con 0x557eb1040ea0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9a7400640 1 -- 172.21.15.82:0/2002580302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd9c0004de0 con 0x557eb1040ea0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c0004050 con 0x557eb1040ea0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9a7400640 1 -- 172.21.15.82:0/2002580302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9c0036050 con 0x557eb1040ea0 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9cf610740 10 client.15813 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.197+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557eb0cb63f0 con 0x557eb1040ea0 2024-04-26T20:24:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.198+0000 7fd9a7400640 1 -- 172.21.15.82:0/2002580302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c0004050 con 0x557eb1040ea0 2024-04-26T20:24:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.198+0000 7fd9a7400640 1 -- 172.21.15.82:0/2002580302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd9c0028480 con 0x557eb1040ea0 2024-04-26T20:24:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9cf610740 10 client.15813 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9cf610740 10 client.15813 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9cf610740 20 client.15813 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb105ee00 0x557eb1061210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9cf610740 4 client.15813 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557eb0fb2880 con 0x557eb105ee00 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.199+0000 7fd9c9400640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb105ee00 0x557eb1061210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.200+0000 7fd9c9400640 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb105ee00 0x557eb1061210 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28cdf5c5304d8719 server_cookie=edb863c5925ead91 in_seq=0 out_seq=0 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.200+0000 7fd9a7400640 10 client.15813 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9a7400640 1 -- 172.21.15.82:0/2002580302 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557eb0fb2880 con 0x557eb105ee00 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9a7400640 10 client.15813 handle_command_reply: tid=0 2024-04-26T20:24:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 client.15813 shutdown 2024-04-26T20:24:05.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 msgr2=0x557eb1053570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 0x557eb1053570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9c001b040 tx=0x7fd9c00047d0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 shutdown_connections 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb105ee00 0x557eb1061210 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb105aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1041890 0x557eb1053ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2002580302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1040ea0 0x557eb1053570 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 >> 172.21.15.82:0/2002580302 conn(0x557eb103c510 msgr2=0x557eb103b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9a7400640 0 client.15813 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.201+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 shutdown_connections 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.202+0000 7fd9cf610740 1 -- 172.21.15.82:0/2002580302 wait complete. 2024-04-26T20:24:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.202+0000 7fd9cf610740 20 client.15813 trim_cache size 0 max 16384 2024-04-26T20:24:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.216+0000 7fd9cf610740 1 Processor -- start 2024-04-26T20:24:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.216+0000 7fd9cf610740 1 -- start start 2024-04-26T20:24:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb103ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 0x557eb103b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb103b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9cf610740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41a9440 con 0x557eb1041890 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9cf610740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41aaf80 con 0x557eb1040ea0 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9cf610740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41a9b10 con 0x557eb1046a00 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb103ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb103ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44868/0 (socket says 172.21.15.82:44868) 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 -- 172.21.15.82:0/2104656632 learned_addr learned my addr 172.21.15.82:0/2104656632 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb103b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 -- 172.21.15.82:0/2104656632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 msgr2=0x557eb103b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb103b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 -- 172.21.15.82:0/2104656632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 msgr2=0x557eb103b340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:24:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.217+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 0x557eb103b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.218+0000 7fd9ca800640 1 -- 172.21.15.82:0/2104656632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb0d807d0 con 0x557eb1040ea0 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.218+0000 7fd9ca800640 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb103ae00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009560 tx=0x7fd9c00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4115a1d8621399cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.218+0000 7fd9b2600640 1 -- 172.21.15.82:0/2104656632 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0003db0 con 0x557eb1040ea0 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.218+0000 7fd9b2600640 1 -- 172.21.15.82:0/2104656632 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c002d070 con 0x557eb1040ea0 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.218+0000 7fd9b2600640 1 -- 172.21.15.82:0/2104656632 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0028d20 con 0x557eb1040ea0 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 -- 172.21.15.82:0/2104656632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 msgr2=0x557eb103ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb103ae00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009560 tx=0x7fd9c00118d0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 -- 172.21.15.82:0/2104656632 shutdown_connections 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb103b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1041890 0x557eb103b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 --2- 172.21.15.82:0/2104656632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb103ae00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.219+0000 7fd9cf610740 1 -- 172.21.15.82:0/2104656632 >> 172.21.15.82:0/2104656632 conn(0x557eb103c510 msgr2=0x557eb103fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.220+0000 7fd9cf610740 1 -- 172.21.15.82:0/2104656632 shutdown_connections 2024-04-26T20:24:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.220+0000 7fd9cf610740 1 -- 172.21.15.82:0/2104656632 wait complete. 2024-04-26T20:24:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.220+0000 7fd9cf610740 1 -- start start 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.220+0000 7fd9cf610740 1 Processor -- start 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb1057500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1057a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1058a50 0x557eb1058ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41aa8b0 con 0x557eb1058a50 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41aa1e0 con 0x557eb1040ea0 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41a7420 con 0x557eb1046a00 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.221+0000 7fd9cf610740 10 client.0 _ll_register_callbacks cb 0x7fd9b4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1057a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1057a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42104/0 (socket says 172.21.15.82:42104) 2024-04-26T20:24:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 -- 172.21.15.82:0/425617628 learned_addr learned my addr 172.21.15.82:0/425617628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9ca800640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb1057500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9ca800640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1058a50 0x557eb1058ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 -- 172.21.15.82:0/425617628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 msgr2=0x557eb1057500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb1057500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 -- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1058a50 msgr2=0x557eb1058ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1058a50 0x557eb1058ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 -- 172.21.15.82:0/425617628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb0f4b2a0 con 0x557eb1046a00 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9c9400640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1057a40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009dd0 tx=0x7fd9b40108c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c5dbd1deb1d0fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.222+0000 7fd9a7400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9a7400640 1 -- 172.21.15.82:0/425617628 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4024070 con 0x557eb1046a00 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c002d070 con 0x557eb1046a00 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9a7400640 1 -- 172.21.15.82:0/425617628 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd9b40205c0 con 0x557eb1046a00 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9a7400640 1 -- 172.21.15.82:0/425617628 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9b402d050 con 0x557eb1046a00 2024-04-26T20:24:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9cf610740 10 client.25933 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557eb10c5420 con 0x557eb1046a00 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.223+0000 7fd9a7400640 1 -- 172.21.15.82:0/425617628 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c002d070 con 0x557eb1046a00 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9a7400640 1 -- 172.21.15.82:0/425617628 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd9b4027020 con 0x557eb1046a00 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9cf610740 10 client.25933 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9cf610740 10 client.25933 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9cf610740 20 client.25933 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9cf610740 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb10c5e00 0x557eb10c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9cf610740 4 client.25933 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557eb0fac6f0 con 0x557eb10c5e00 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.224+0000 7fd9ca800640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb10c5e00 0x557eb10c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9ca800640 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb10c5e00 0x557eb10c8220 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=981847f9e3dc23d2 server_cookie=e15648d84a3c980 in_seq=0 out_seq=0 2024-04-26T20:24:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9a7400640 10 client.25933 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9a7400640 1 -- 172.21.15.82:0/425617628 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557eb0fac6f0 con 0x557eb10c5e00 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9a7400640 10 client.25933 handle_command_reply: tid=0 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9cf610740 1 client.25933 shutdown 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 msgr2=0x557eb1057a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.225+0000 7fd9cf610740 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1057a40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009dd0 tx=0x7fd9b40108c0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 shutdown_connections 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x557eb10c5e00 0x557eb10c8220 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557eb1058a50 0x557eb1058ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9a7400640 0 client.25933 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557eb1046a00 0x557eb1057a40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 --2- 172.21.15.82:0/425617628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557eb1040ea0 0x557eb1057500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 >> 172.21.15.82:0/425617628 conn(0x557eb103c510 msgr2=0x557eb1042330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 shutdown_connections 2024-04-26T20:24:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 1 -- 172.21.15.82:0/425617628 wait complete. 2024-04-26T20:24:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.226+0000 7fd9cf610740 20 client.25933 trim_cache size 0 max 16384 2024-04-26T20:24:05.231 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9ac0a3cc0 msgr2=0x7fd9ac0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9ac0a3cc0 0x7fd9ac0a6180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557eb1042300 tx=0x7fd9b803b720 comp rx=0 tx=0).stop 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 msgr2=0x7fd9c4102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 0x7fd9c4102d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8005940 tx=0x7fd9b80042f0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 shutdown_connections 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd9ac0a3cc0 0x7fd9ac0a6180 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9c4108660 0x7fd9c41018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9c4105d30 0x7fd9c41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 --2- 172.21.15.82:0/2316324618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c4103400 0x7fd9c4102d70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 >> 172.21.15.82:0/2316324618 conn(0x7fd9c40fcdf0 msgr2=0x7fd9c4103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.227+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 shutdown_connections 2024-04-26T20:24:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.228+0000 7fd9cc800640 1 -- 172.21.15.82:0/2316324618 wait complete. 2024-04-26T20:24:05.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:24:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 -- 172.21.15.82:0/3639317378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1016b0 msgr2=0x7fc40c101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 --2- 172.21.15.82:0/3639317378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1016b0 0x7fc40c101ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009900 tx=0x7fc3fc02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 -- 172.21.15.82:0/3639317378 shutdown_connections 2024-04-26T20:24:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 --2- 172.21.15.82:0/3639317378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 0x7fc40c109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 --2- 172.21.15.82:0/3639317378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1028a0 0x7fc40c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 --2- 172.21.15.82:0/3639317378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1016b0 0x7fc40c101ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.382+0000 7fc411c00640 1 -- 172.21.15.82:0/3639317378 >> 172.21.15.82:0/3639317378 conn(0x7fc40c0fcc20 msgr2=0x7fc40c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.384+0000 7fc411c00640 1 -- 172.21.15.82:0/3639317378 shutdown_connections 2024-04-26T20:24:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.384+0000 7fc411c00640 1 -- 172.21.15.82:0/3639317378 wait complete. 2024-04-26T20:24:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.385+0000 7fc411c00640 1 Processor -- start 2024-04-26T20:24:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.385+0000 7fc411c00640 1 -- start start 2024-04-26T20:24:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 0x7fc40c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1028a0 0x7fc40c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 0x7fc40c1a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c114940 con 0x7fc40c103260 2024-04-26T20:24:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1147c0 con 0x7fc40c1028a0 2024-04-26T20:24:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c114ac0 con 0x7fc40c1016b0 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc40b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1028a0 0x7fc40c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc40be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 0x7fc40c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc40be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 0x7fc40c19efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42126/0 (socket says 172.21.15.82:42126) 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc40be00640 1 -- 172.21.15.82:0/3617299363 learned_addr learned my addr 172.21.15.82:0/3617299363 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc40b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1028a0 0x7fc40c19f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44896/0 (socket says 172.21.15.82:44896) 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.386+0000 7fc411200640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 0x7fc40c1a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc40be00640 1 -- 172.21.15.82:0/3617299363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1028a0 msgr2=0x7fc40c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc40be00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1028a0 0x7fc40c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc40be00640 1 -- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 msgr2=0x7fc40c1a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc40be00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 0x7fc40c1a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc40be00640 1 -- 172.21.15.82:0/3617299363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c1a6be0 con 0x7fc40c1016b0 2024-04-26T20:24:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc411200640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 0x7fc40c1a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.387+0000 7fc40be00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 0x7fc40c19efc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009850 tx=0x7fc3fc003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.388+0000 7fc408c00640 1 -- 172.21.15.82:0/3617299363 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc03f070 con 0x7fc40c1016b0 2024-04-26T20:24:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.388+0000 7fc408c00640 1 -- 172.21.15.82:0/3617299363 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3fc031c50 con 0x7fc40c1016b0 2024-04-26T20:24:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.388+0000 7fc408c00640 1 -- 172.21.15.82:0/3617299363 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc035030 con 0x7fc40c1016b0 2024-04-26T20:24:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.388+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c1a6e70 con 0x7fc40c1016b0 2024-04-26T20:24:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.388+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1a7220 con 0x7fc40c1016b0 2024-04-26T20:24:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.393+0000 7fc416054740 1 Processor -- start 2024-04-26T20:24:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.393+0000 7fc416054740 1 -- start start 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.393+0000 7fc408c00640 1 -- 172.21.15.82:0/3617299363 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc3fc042070 con 0x7fc40c1016b0 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.393+0000 7fc416054740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc416054740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d832d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc416054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 0x55cee6d85dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc416054740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cee6ce2380 con 0x55cee6d7dde0 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc416054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee6c7ec30 con 0x55cee6d83940 2024-04-26T20:24:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc416054740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cee6cde340 con 0x55cee6d7e7d0 2024-04-26T20:24:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc411200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc40be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc40b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 0x55cee6d85dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc40b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 0x55cee6d85dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44908/0 (socket says 172.21.15.82:44908) 2024-04-26T20:24:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc40b400640 1 -- 172.21.15.82:0/2118019360 learned_addr learned my addr 172.21.15.82:0/2118019360 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.394+0000 7fc411200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37810/0 (socket says 172.21.15.82:37810) 2024-04-26T20:24:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.395+0000 7fc40b400640 1 -- 172.21.15.82:0/2118019360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 msgr2=0x55cee6d832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.395+0000 7fc40b400640 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d832d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.395+0000 7fc40b400640 1 -- 172.21.15.82:0/2118019360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 msgr2=0x55cee6d7e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.395+0000 7fc40b400640 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.395+0000 7fc40b400640 1 -- 172.21.15.82:0/2118019360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee6ca0940 con 0x55cee6d83940 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.395+0000 7fc411200640 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.396+0000 7fc408c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3f00a3d00 0x7fc3f00a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.396+0000 7fc408c00640 1 -- 172.21.15.82:0/3617299363 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc3fc0f1290 con 0x7fc40c1016b0 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.396+0000 7fc40b400640 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 0x55cee6d85dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009ca0 tx=0x7fc3f8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc7dec0d6c34f988 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.396+0000 7fc411200640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3f00a3d00 0x7fc3f00a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.396+0000 7fc401600640 1 -- 172.21.15.82:0/2118019360 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f801e070 con 0x55cee6d83940 2024-04-26T20:24:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.396+0000 7fc401600640 1 -- 172.21.15.82:0/2118019360 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f8019ae0 con 0x55cee6d83940 2024-04-26T20:24:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.398+0000 7fc411200640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3f00a3d00 0x7fc3f00a61c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55cee6d7f030 tx=0x7fc404007720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.399+0000 7fc401600640 1 -- 172.21.15.82:0/2118019360 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800e9b0 con 0x55cee6d83940 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.399+0000 7fc416054740 1 -- 172.21.15.82:0/2118019360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 msgr2=0x55cee6d85dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.399+0000 7fc416054740 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 0x55cee6d85dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009ca0 tx=0x7fc3f8011810 comp rx=0 tx=0).stop 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 -- 172.21.15.82:0/2118019360 shutdown_connections 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d83940 0x55cee6d85dd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d832d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 --2- 172.21.15.82:0/2118019360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 -- 172.21.15.82:0/2118019360 >> 172.21.15.82:0/2118019360 conn(0x55cee6d79450 msgr2=0x55cee6d79850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 -- 172.21.15.82:0/2118019360 shutdown_connections 2024-04-26T20:24:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 -- 172.21.15.82:0/2118019360 wait complete. 2024-04-26T20:24:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.400+0000 7fc416054740 1 -- start start 2024-04-26T20:24:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.401+0000 7fc416054740 1 Processor -- start 2024-04-26T20:24:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.401+0000 7fc416054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7dde0 0x55cee6d88030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.401+0000 7fc416054740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d88570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc416054740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc416054740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cee6d868f0 con 0x55cee6d83940 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc416054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cee6c69c60 con 0x55cee6d7dde0 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc416054740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cee6d86a70 con 0x55cee6d7e7d0 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc40be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7dde0 0x55cee6d88030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc40b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d88570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc40b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d88570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42146/0 (socket says 172.21.15.82:42146) 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc40b400640 1 -- 172.21.15.82:0/2182030829 learned_addr learned my addr 172.21.15.82:0/2182030829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc416054740 10 client.0 _ll_register_callbacks cb 0x55cee6c95e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.402+0000 7fc411200640 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc40b400640 1 -- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7dde0 msgr2=0x55cee6d88030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc40b400640 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7dde0 0x55cee6d88030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc40b400640 1 -- 172.21.15.82:0/2182030829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 msgr2=0x55cee6d8f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc40b400640 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc40b400640 1 -- 172.21.15.82:0/2182030829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee6c78510 con 0x55cee6d7e7d0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc40b400640 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d88570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009f50 tx=0x7fc3f8019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66bce901ddd8d08f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.403+0000 7fc3f6000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc3f6000640 1 -- 172.21.15.82:0/2182030829 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8028020 con 0x55cee6d7e7d0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3f8019ae0 con 0x55cee6d7e7d0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc3f6000640 1 -- 172.21.15.82:0/2182030829 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc3f8005050 con 0x55cee6d7e7d0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc3f6000640 1 -- 172.21.15.82:0/2182030829 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc3f8033050 con 0x55cee6d7e7d0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc416054740 10 client.25945 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cee69f4210 con 0x55cee6d7e7d0 2024-04-26T20:24:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.404+0000 7fc3f6000640 1 -- 172.21.15.82:0/2182030829 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f8005c50 con 0x55cee6d7e7d0 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc3f6000640 1 -- 172.21.15.82:0/2182030829 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc3f800e6f0 con 0x55cee6d7e7d0 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc416054740 10 client.25945 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc416054740 10 client.25945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc416054740 20 client.25945 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc416054740 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6d93780 0x55cee6d95bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc416054740 4 client.25945 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.405+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc3f8019ae0 con 0x55cee6d93780 2024-04-26T20:24:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.406+0000 7fc40be00640 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6d93780 0x55cee6d95bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.406+0000 7fc40be00640 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6d93780 0x55cee6d95bb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aca5da75c6be04bf server_cookie=8c7de9158aadbc5e in_seq=0 out_seq=0 2024-04-26T20:24:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.406+0000 7fc3f6000640 10 client.25945 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.407+0000 7fc3f6000640 1 -- 172.21.15.82:0/2182030829 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7fc3f8019ae0 con 0x55cee6d93780 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.407+0000 7fc3f6000640 10 client.25945 handle_command_reply: tid=0 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.407+0000 7fc416054740 1 client.25945 shutdown 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.407+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 msgr2=0x55cee6d88570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.407+0000 7fc416054740 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d88570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009f50 tx=0x7fc3f8019660 comp rx=0 tx=0).stop 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 shutdown_connections 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6d93780 0x55cee6d95bb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7e7d0 0x55cee6d88570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 --2- 172.21.15.82:0/2182030829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7dde0 0x55cee6d88030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 >> 172.21.15.82:0/2182030829 conn(0x55cee6d79450 msgr2=0x55cee6d78650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc3f6000640 0 client.25945 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 shutdown_connections 2024-04-26T20:24:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 1 -- 172.21.15.82:0/2182030829 wait complete. 2024-04-26T20:24:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.408+0000 7fc416054740 20 client.25945 trim_cache size 0 max 16384 2024-04-26T20:24:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.433+0000 7fc416054740 1 Processor -- start 2024-04-26T20:24:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 -- start start 2024-04-26T20:24:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d7ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 0x55cee6d8f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1b1760 con 0x55cee6d7dde0 2024-04-26T20:24:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1b32a0 con 0x55cee6d7e7d0 2024-04-26T20:24:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.434+0000 7fc416054740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1b1e30 con 0x55cee6d83940 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc40be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 0x55cee6d8f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 0x55cee6d8f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42158/0 (socket says 172.21.15.82:42158) 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 -- 172.21.15.82:0/2308179442 learned_addr learned my addr 172.21.15.82:0/2308179442 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc40b400640 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d7ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 -- 172.21.15.82:0/2308179442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 msgr2=0x55cee6d7ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d7ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 -- 172.21.15.82:0/2308179442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 msgr2=0x55cee6d7f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.435+0000 7fc411200640 1 -- 172.21.15.82:0/2308179442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee6ac0620 con 0x55cee6d83940 2024-04-26T20:24:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.436+0000 7fc411200640 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 0x55cee6d8f500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc404003c00 tx=0x7fc404014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e1484c371df2dfd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.436+0000 7fc400c00640 1 -- 172.21.15.82:0/2308179442 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40400f5c0 con 0x55cee6d83940 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.436+0000 7fc400c00640 1 -- 172.21.15.82:0/2308179442 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40400fc10 con 0x55cee6d83940 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.436+0000 7fc400c00640 1 -- 172.21.15.82:0/2308179442 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40401ab00 con 0x55cee6d83940 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 -- 172.21.15.82:0/2308179442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 msgr2=0x55cee6d8f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 0x55cee6d8f500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc404003c00 tx=0x7fc404014000 comp rx=0 tx=0).stop 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 -- 172.21.15.82:0/2308179442 shutdown_connections 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d83940 0x55cee6d8f500 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d7ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 --2- 172.21.15.82:0/2308179442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d7dde0 0x55cee6d7f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.437+0000 7fc416054740 1 -- 172.21.15.82:0/2308179442 >> 172.21.15.82:0/2308179442 conn(0x55cee6d79450 msgr2=0x55cee6d88030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.441+0000 7fc416054740 1 -- 172.21.15.82:0/2308179442 shutdown_connections 2024-04-26T20:24:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.441+0000 7fc416054740 1 -- 172.21.15.82:0/2308179442 wait complete. 2024-04-26T20:24:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.441+0000 7fc416054740 1 -- start start 2024-04-26T20:24:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 Processor -- start 2024-04-26T20:24:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7dde0 0x55cee6d8c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d8cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1b2bd0 con 0x55cee6d83940 2024-04-26T20:24:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1b2500 con 0x55cee6d7e7d0 2024-04-26T20:24:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1af740 con 0x55cee6d7dde0 2024-04-26T20:24:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.442+0000 7fc416054740 10 client.0 _ll_register_callbacks cb 0x7fc3f801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7dde0 0x55cee6d8c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d8cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7dde0 0x55cee6d8c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42170/0 (socket says 172.21.15.82:42170) 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40be00640 1 -- 172.21.15.82:0/907805932 learned_addr learned my addr 172.21.15.82:0/907805932 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc411200640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 -- 172.21.15.82:0/907805932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7dde0 msgr2=0x55cee6d8c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7dde0 0x55cee6d8c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 -- 172.21.15.82:0/907805932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 msgr2=0x55cee6d8da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 -- 172.21.15.82:0/907805932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee6c9ccb0 con 0x55cee6d7e7d0 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc411200640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc40b400640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d8cae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8011d10 tx=0x7fc3f800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eced527bedf8401 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.443+0000 7fc3f6000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.444+0000 7fc3f6000640 1 -- 172.21.15.82:0/907805932 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8015020 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.444+0000 7fc3f6000640 1 -- 172.21.15.82:0/907805932 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc3f800e470 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.444+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40400fc10 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.444+0000 7fc3f6000640 1 -- 172.21.15.82:0/907805932 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc3f801e040 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.444+0000 7fc416054740 10 client.25922 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.444+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cee6d8f1b0 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc3f6000640 1 -- 172.21.15.82:0/907805932 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40400fc10 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc3f6000640 1 -- 172.21.15.82:0/907805932 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc3f80035f0 con 0x55cee6d7e7d0 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc416054740 10 client.25922 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc416054740 10 client.25922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc416054740 20 client.25922 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc416054740 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6df9df0 0x55cee6dfc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc416054740 4 client.25922 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:24:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.445+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cee6ceff90 con 0x55cee6df9df0 2024-04-26T20:24:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.446+0000 7fc40be00640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6df9df0 0x55cee6dfc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.447+0000 7fc40be00640 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6df9df0 0x55cee6dfc1e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a206db085825927 server_cookie=1a5e6abe6feab344 in_seq=0 out_seq=0 2024-04-26T20:24:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.447+0000 7fc3f6000640 10 client.25922 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 -- 172.21.15.82:0/700497820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 msgr2=0x7fd4ec101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 --2- 172.21.15.82:0/700497820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec101530 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009860 tx=0x7fd4dc02a340 comp rx=0 tx=0).stop 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 -- 172.21.15.82:0/700497820 shutdown_connections 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 --2- 172.21.15.82:0/700497820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec102410 0x7fd4ec102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 --2- 172.21.15.82:0/700497820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec101a70 0x7fd4ec101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 --2- 172.21.15.82:0/700497820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec101530 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.451+0000 7fd4eb200640 1 -- 172.21.15.82:0/700497820 >> 172.21.15.82:0/700497820 conn(0x7fd4ec0fccd0 msgr2=0x7fd4ec0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fd4eb200640 1 -- 172.21.15.82:0/700497820 shutdown_connections 2024-04-26T20:24:05.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fd4eb200640 1 -- 172.21.15.82:0/700497820 wait complete. 2024-04-26T20:24:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fc3f6000640 1 -- 172.21.15.82:0/907805932 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cee6ceff90 con 0x55cee6df9df0 2024-04-26T20:24:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fc3f6000640 10 client.25922 handle_command_reply: tid=0 2024-04-26T20:24:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fc416054740 1 client.25922 shutdown 2024-04-26T20:24:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 msgr2=0x55cee6d8cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.452+0000 7fc416054740 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d8cae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8011d10 tx=0x7fc3f800ef90 comp rx=0 tx=0).stop 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 shutdown_connections 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cee6df9df0 0x55cee6dfc1e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cee6d83940 0x55cee6d8da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cee6d7e7d0 0x55cee6d8cae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 --2- 172.21.15.82:0/907805932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cee6d7dde0 0x55cee6d8c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 >> 172.21.15.82:0/907805932 conn(0x55cee6d79450 msgr2=0x55cee6d87f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc3f6000640 0 client.25922 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 shutdown_connections 2024-04-26T20:24:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 1 -- 172.21.15.82:0/907805932 wait complete. 2024-04-26T20:24:05.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fd4eb200640 1 Processor -- start 2024-04-26T20:24:05.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fc416054740 20 client.25922 trim_cache size 0 max 16384 2024-04-26T20:24:05.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.453+0000 7fd4eb200640 1 -- start start 2024-04-26T20:24:05.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:24:05.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:24:05.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:24:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:24:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4eb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 0x7fd4ec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4eb200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec102410 0x7fd4ec1aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4eb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec110550 con 0x7fd4ec101110 2024-04-26T20:24:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4eb200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1103d0 con 0x7fd4ec101a70 2024-04-26T20:24:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4eb200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1106d0 con 0x7fd4ec102410 2024-04-26T20:24:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4e9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 0x7fd4ec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4e9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 0x7fd4ec071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44938/0 (socket says 172.21.15.82:44938) 2024-04-26T20:24:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4e9400640 1 -- 172.21.15.82:0/3053646961 learned_addr learned my addr 172.21.15.82:0/3053646961 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4ea800640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec102410 0x7fd4ec1aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.454+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3f00a3d00 msgr2=0x7fc3f00a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3f00a3d00 0x7fc3f00a61c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55cee6d7f030 tx=0x7fc404007720 comp rx=0 tx=0).stop 2024-04-26T20:24:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 msgr2=0x7fc40c19efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 0x7fc40c19efc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009850 tx=0x7fc3fc003b90 comp rx=0 tx=0).stop 2024-04-26T20:24:05.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4e9400640 1 -- 172.21.15.82:0/3053646961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec102410 msgr2=0x7fd4ec1aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 shutdown_connections 2024-04-26T20:24:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3f00a3d00 0x7fc3f00a61c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc40c103260 0x7fc40c1a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c1028a0 0x7fc40c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 --2- 172.21.15.82:0/3617299363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc40c1016b0 0x7fc40c19efc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 >> 172.21.15.82:0/3617299363 conn(0x7fc40c0fcc20 msgr2=0x7fc40c105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4e9400640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec102410 0x7fd4ec1aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4e9400640 1 -- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 msgr2=0x7fd4ec0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4e9400640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec0713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 shutdown_connections 2024-04-26T20:24:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fc411c00640 1 -- 172.21.15.82:0/3617299363 wait complete. 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4e9400640 1 -- 172.21.15.82:0/3053646961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ec1ab1a0 con 0x7fd4ec101a70 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.455+0000 7fd4ea800640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec102410 0x7fd4ec1aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.456+0000 7fd4e9400640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 0x7fd4ec071910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800d770 tx=0x7fd4d800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.456+0000 7fd4e2a00640 1 -- 172.21.15.82:0/3053646961 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8017070 con 0x7fd4ec101a70 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.456+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ec1ab3d0 con 0x7fd4ec101a70 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.456+0000 7fd4e2a00640 1 -- 172.21.15.82:0/3053646961 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d80054d0 con 0x7fd4ec101a70 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.456+0000 7fd4e2a00640 1 -- 172.21.15.82:0/3053646961 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004c30 con 0x7fd4ec101a70 2024-04-26T20:24:05.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.456+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ec1ab8f0 con 0x7fd4ec101a70 2024-04-26T20:24:05.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 Processor -- start 2024-04-26T20:24:05.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 -- start start 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56388a732c70 con 0x56388a7cfa40 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56388a6eb980 con 0x56388a7d4bb0 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.463+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56388a72ec30 con 0x56388a7cf050 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.464+0000 7fd4e2a00640 1 -- 172.21.15.82:0/3053646961 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd4d8004e10 con 0x7fd4ec101a70 2024-04-26T20:24:05.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.464+0000 7fd4ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.464+0000 7fd4e9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.464+0000 7fd4e9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.464+0000 7fd4ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42196/0 (socket says 172.21.15.82:42196) 2024-04-26T20:24:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.464+0000 7fd4ea800640 1 -- 172.21.15.82:0/714827791 learned_addr learned my addr 172.21.15.82:0/714827791 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4ea800640 1 -- 172.21.15.82:0/714827791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 msgr2=0x56388a7d7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4ea800640 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4ea800640 1 -- 172.21.15.82:0/714827791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 msgr2=0x56388a7d4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4ea800640 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4ea800640 1 -- 172.21.15.82:0/714827791 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388a6c37b0 con 0x56388a7cf050 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4e9400640 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.465+0000 7fd4ea800640 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7cf470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400f480 tx=0x7fd4e400f940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f99b8bdcc2561 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.466+0000 7fd4d7000640 1 -- 172.21.15.82:0/714827791 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e401d070 con 0x56388a7cf050 2024-04-26T20:24:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.466+0000 7fd4d7000640 1 -- 172.21.15.82:0/714827791 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e400cc30 con 0x56388a7cf050 2024-04-26T20:24:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.466+0000 7fd4e2a00640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4d00a3c40 0x7fd4d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.466+0000 7fd4e2a00640 1 -- 172.21.15.82:0/3053646961 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd4d80d0460 con 0x7fd4ec101a70 2024-04-26T20:24:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 -- 172.21.15.82:0/714827791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 msgr2=0x56388a7cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7cf470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400f480 tx=0x7fd4e400f940 comp rx=0 tx=0).stop 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4d00a3c40 0x7fd4d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 -- 172.21.15.82:0/714827791 shutdown_connections 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/714827791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7cf470 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 -- 172.21.15.82:0/714827791 >> 172.21.15.82:0/714827791 conn(0x56388a7ca6c0 msgr2=0x56388a7caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.467+0000 7fd4f3b88740 1 -- 172.21.15.82:0/714827791 shutdown_connections 2024-04-26T20:24:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.468+0000 7fd4f3b88740 1 -- 172.21.15.82:0/714827791 wait complete. 2024-04-26T20:24:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.468+0000 7fd4f3b88740 1 -- start start 2024-04-26T20:24:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.468+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4d00a3c40 0x7fd4d00a6100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009780 tx=0x7fd4dc005ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.468+0000 7fd4f3b88740 1 Processor -- start 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7d8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7e0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56388a731f80 con 0x56388a7cfa40 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56388a6df260 con 0x56388a7d4bb0 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56388a7372a0 con 0x56388a7cf050 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.469+0000 7fd4f3b88740 10 client.0 _ll_register_callbacks cb 0x56388a729960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7d8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7d8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42200/0 (socket says 172.21.15.82:42200) 2024-04-26T20:24:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 -- 172.21.15.82:0/1190763071 learned_addr learned my addr 172.21.15.82:0/1190763071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9400640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4ea800640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 -- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 msgr2=0x56388a7e0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7e0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 -- 172.21.15.82:0/1190763071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 msgr2=0x56388a7d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 -- 172.21.15.82:0/1190763071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388a6c11c0 con 0x56388a7cf050 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4ea800640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7d8f10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc034000 tx=0x7fd4dc02a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee8e2c30b5b95e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.470+0000 7fd4cb400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.471+0000 7fd4cb400640 1 -- 172.21.15.82:0/1190763071 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc045040 con 0x56388a7cf050 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.471+0000 7fd4cb400640 1 -- 172.21.15.82:0/1190763071 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd4dc0035f0 con 0x56388a7cf050 2024-04-26T20:24:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.471+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4e400cc30 con 0x56388a7cf050 2024-04-26T20:24:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.472+0000 7fd4cb400640 1 -- 172.21.15.82:0/1190763071 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4dc037040 con 0x56388a7cf050 2024-04-26T20:24:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.472+0000 7fd4f3b88740 10 client.25963 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.472+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56388a4443f0 con 0x56388a7cf050 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.472+0000 7fd4cb400640 1 -- 172.21.15.82:0/1190763071 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e400cc30 con 0x56388a7cf050 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.472+0000 7fd4cb400640 1 -- 172.21.15.82:0/1190763071 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd4dc03e820 con 0x56388a7cf050 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4f3b88740 10 client.25963 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4f3b88740 10 client.25963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4f3b88740 20 client.25963 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a7e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4f3b88740 4 client.25963 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56388a740880 con 0x56388a7e49c0 2024-04-26T20:24:05.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.473+0000 7fd4e9400640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a7e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.474+0000 7fd4e9400640 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a7e6e80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c294bfe5dd3540eb server_cookie=8c367689e6693d42 in_seq=0 out_seq=0 2024-04-26T20:24:05.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.474+0000 7fd4cb400640 10 client.25963 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.474+0000 7fd4cb400640 1 -- 172.21.15.82:0/1190763071 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56388a740880 con 0x56388a7e49c0 2024-04-26T20:24:05.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.474+0000 7fd4cb400640 10 client.25963 handle_command_reply: tid=0 2024-04-26T20:24:05.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 client.25963 shutdown 2024-04-26T20:24:05.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 msgr2=0x56388a7d8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7d8f10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc034000 tx=0x7fd4dc02a340 comp rx=0 tx=0).stop 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 shutdown_connections 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a7e6e80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4cb400640 0 client.25963 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cfa40 0x56388a7d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/1190763071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7d8f10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.475+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 >> 172.21.15.82:0/1190763071 conn(0x56388a7ca6c0 msgr2=0x56388a7c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.476+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 shutdown_connections 2024-04-26T20:24:05.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.476+0000 7fd4f3b88740 1 -- 172.21.15.82:0/1190763071 wait complete. 2024-04-26T20:24:05.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.476+0000 7fd4f3b88740 20 client.25963 trim_cache size 0 max 16384 2024-04-26T20:24:05.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 Processor -- start 2024-04-26T20:24:05.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 -- start start 2024-04-26T20:24:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cf050 0x56388a7d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cfa40 0x56388a7e0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1b5c60 con 0x56388a7cf050 2024-04-26T20:24:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1b77a0 con 0x56388a7d4bb0 2024-04-26T20:24:05.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.504+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1b6330 con 0x56388a7cfa40 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4e9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cf050 0x56388a7d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44966/0 (socket says 172.21.15.82:44966) 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 -- 172.21.15.82:0/831656636 learned_addr learned my addr 172.21.15.82:0/831656636 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4e9400640 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cfa40 0x56388a7e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 -- 172.21.15.82:0/831656636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cfa40 msgr2=0x56388a7e0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cfa40 0x56388a7e0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 -- 172.21.15.82:0/831656636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cf050 msgr2=0x56388a7d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cf050 0x56388a7d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4ea800640 1 -- 172.21.15.82:0/831656636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388a50e7d0 con 0x56388a7d4bb0 2024-04-26T20:24:05.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.505+0000 7fd4e9400640 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cfa40 0x56388a7e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:05.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.506+0000 7fd4ea800640 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d0810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4e401a000 tx=0x7fd4e4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56754430ffcc2872 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.506+0000 7fd4d6600640 1 -- 172.21.15.82:0/831656636 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4025020 con 0x56388a7d4bb0 2024-04-26T20:24:05.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.506+0000 7fd4d6600640 1 -- 172.21.15.82:0/831656636 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e4009c90 con 0x56388a7d4bb0 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.506+0000 7fd4d6600640 1 -- 172.21.15.82:0/831656636 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e401d040 con 0x56388a7d4bb0 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 -- 172.21.15.82:0/831656636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 msgr2=0x56388a7d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d0810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4e401a000 tx=0x7fd4e4009b30 comp rx=0 tx=0).stop 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 -- 172.21.15.82:0/831656636 shutdown_connections 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7d4bb0 0x56388a7d0810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cfa40 0x56388a7e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/831656636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7cf050 0x56388a7d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 -- 172.21.15.82:0/831656636 >> 172.21.15.82:0/831656636 conn(0x56388a7ca6c0 msgr2=0x56388a7cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 -- 172.21.15.82:0/831656636 shutdown_connections 2024-04-26T20:24:05.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.507+0000 7fd4f3b88740 1 -- 172.21.15.82:0/831656636 wait complete. 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.508+0000 7fd4f3b88740 1 -- start start 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.508+0000 7fd4f3b88740 1 Processor -- start 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7cfa40 0x56388a7de320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7d4bb0 0x56388a7df330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1b70d0 con 0x56388a7d4bb0 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1b6a00 con 0x56388a7cfa40 2024-04-26T20:24:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec1b3c40 con 0x56388a7cf050 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4f3b88740 10 client.0 _ll_register_callbacks cb 0x7fd4dc042040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7ddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42212/0 (socket says 172.21.15.82:42212) 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 -- 172.21.15.82:0/2101262670 learned_addr learned my addr 172.21.15.82:0/2101262670 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9400640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7cfa40 0x56388a7de320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4ea800640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7d4bb0 0x56388a7df330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 -- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7cfa40 msgr2=0x56388a7de320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7cfa40 0x56388a7de320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 -- 172.21.15.82:0/2101262670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7d4bb0 msgr2=0x56388a7df330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7d4bb0 0x56388a7df330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.509+0000 7fd4e9e00640 1 -- 172.21.15.82:0/2101262670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388a6d92a0 con 0x56388a7cf050 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.510+0000 7fd4e9e00640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7ddde0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc02a930 tx=0x7fd4dc032580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b52bfde5e4699d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.510+0000 7fd4cb400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:05.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.510+0000 7fd4cb400640 1 -- 172.21.15.82:0/2101262670 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc060060 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.510+0000 7fd4cb400640 1 -- 172.21.15.82:0/2101262670 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd4dc03e890 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.510+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4e4009c90 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4cb400640 1 -- 172.21.15.82:0/2101262670 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4dc067050 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4f3b88740 10 client.25969 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56388a84b030 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4cb400640 1 -- 172.21.15.82:0/2101262670 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e4009c90 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4cb400640 1 -- 172.21.15.82:0/2101262670 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd4dc0036f0 con 0x56388a7cf050 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4f3b88740 10 client.25969 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4f3b88740 10 client.25969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.511+0000 7fd4f3b88740 20 client.25969 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.512+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a84da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.512+0000 7fd4f3b88740 4 client.25969 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.512+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56388a73a6f0 con 0x56388a7e49c0 2024-04-26T20:24:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.512+0000 7fd4e9400640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a84da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4e9400640 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a84da10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fbd95ba706d82af server_cookie=aaea1c0bb408ba54 in_seq=0 out_seq=0 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4cb400640 10 client.25969 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4cb400640 1 -- 172.21.15.82:0/2101262670 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56388a73a6f0 con 0x56388a7e49c0 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4cb400640 10 client.25969 handle_command_reply: tid=0 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 client.25969 shutdown 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 msgr2=0x56388a7ddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7ddde0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc02a930 tx=0x7fd4dc032580 comp rx=0 tx=0).stop 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 shutdown_connections 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56388a7e49c0 0x56388a84da10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388a7d4bb0 0x56388a7df330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56388a7cfa40 0x56388a7de320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4cb400640 0 client.25969 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 --2- 172.21.15.82:0/2101262670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56388a7cf050 0x56388a7ddde0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.513+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 >> 172.21.15.82:0/2101262670 conn(0x56388a7ca6c0 msgr2=0x56388a7c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.514+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 shutdown_connections 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.514+0000 7fd4f3b88740 1 -- 172.21.15.82:0/2101262670 wait complete. 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.514+0000 7fd4f3b88740 20 client.25969 trim_cache size 0 max 16384 2024-04-26T20:24:05.517 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4d00a3c40 msgr2=0x7fd4d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4d00a3c40 0x7fd4d00a6100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009780 tx=0x7fd4dc005ad0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 msgr2=0x7fd4ec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 0x7fd4ec071910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800d770 tx=0x7fd4d800dc30 comp rx=0 tx=0).stop 2024-04-26T20:24:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 shutdown_connections 2024-04-26T20:24:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4d00a3c40 0x7fd4d00a6100 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4ec102410 0x7fd4ec1aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ec101a70 0x7fd4ec071910 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 --2- 172.21.15.82:0/3053646961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec101110 0x7fd4ec0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 >> 172.21.15.82:0/3053646961 conn(0x7fd4ec0fccd0 msgr2=0x7fd4ec0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 shutdown_connections 2024-04-26T20:24:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:05.516+0000 7fd4eb200640 1 -- 172.21.15.82:0/3053646961 wait complete. 2024-04-26T20:24:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:05 smithi082 ceph-mon[28105]: pgmap v450: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:06.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:05 smithi139 ceph-mon[32999]: pgmap v450: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:05 smithi135 ceph-mon[32816]: pgmap v450: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:06.542 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:24:06.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:24:06.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 -- 172.21.15.82:0/3693050463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101a70 msgr2=0x7f19b4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 --2- 172.21.15.82:0/3693050463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101a70 0x7f19b4101ed0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009900 tx=0x7f19a002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 -- 172.21.15.82:0/3693050463 shutdown_connections 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 --2- 172.21.15.82:0/3693050463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b4102410 0x7f19b4102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 --2- 172.21.15.82:0/3693050463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101a70 0x7f19b4101ed0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 --2- 172.21.15.82:0/3693050463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19b4101110 0x7f19b4101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 -- 172.21.15.82:0/3693050463 >> 172.21.15.82:0/3693050463 conn(0x7f19b40fccd0 msgr2=0x7f19b40ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 -- 172.21.15.82:0/3693050463 shutdown_connections 2024-04-26T20:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.712+0000 7f19b9600640 1 -- 172.21.15.82:0/3693050463 wait complete. 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.713+0000 7f19b9600640 1 Processor -- start 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 -- start start 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 0x7f19b419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19b4101a70 0x7f19b419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b4102410 0x7f19b41a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19b4110530 con 0x7f19b4102410 2024-04-26T20:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41103b0 con 0x7f19b4101110 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b9600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41106b0 con 0x7f19b4101a70 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 0x7f19b419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 0x7f19b419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44994/0 (socket says 172.21.15.82:44994) 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b3e00640 1 -- 172.21.15.82:0/1478315677 learned_addr learned my addr 172.21.15.82:0/1478315677 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b8c00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b4102410 0x7f19b41a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.714+0000 7f19b3400640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19b4101a70 0x7f19b419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b3e00640 1 -- 172.21.15.82:0/1478315677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19b4101a70 msgr2=0x7f19b419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b3e00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19b4101a70 0x7f19b419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b3e00640 1 -- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b4102410 msgr2=0x7f19b41a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b3e00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b4102410 0x7f19b41a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b3e00640 1 -- 172.21.15.82:0/1478315677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b41a2890 con 0x7f19b4101110 2024-04-26T20:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b3e00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 0x7f19b419ac80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19a400e9f0 tx=0x7f19a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.715+0000 7f19b0c00640 1 -- 172.21.15.82:0/1478315677 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a400cd80 con 0x7f19b4101110 2024-04-26T20:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.716+0000 7f19b0c00640 1 -- 172.21.15.82:0/1478315677 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19a40108e0 con 0x7f19b4101110 2024-04-26T20:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.716+0000 7f19b0c00640 1 -- 172.21.15.82:0/1478315677 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4018980 con 0x7f19b4101110 2024-04-26T20:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.716+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b41a2b80 con 0x7f19b4101110 2024-04-26T20:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.716+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b41a3080 con 0x7f19b4101110 2024-04-26T20:24:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.720+0000 7f19bda15740 1 Processor -- start 2024-04-26T20:24:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.720+0000 7f19bda15740 1 -- start start 2024-04-26T20:24:06.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.720+0000 7f19bda15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cb2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.720+0000 7f19bda15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb3460 0x55b536cb7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19bda15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb85d0 0x55b536cbaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19b0c00640 1 -- 172.21.15.82:0/1478315677 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f19a4010430 con 0x7f19b4101110 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19bda15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b536c17980 con 0x55b536cb2a70 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19bda15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b536bb4220 con 0x55b536cb3460 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19bda15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b536c13940 con 0x55b536cb85d0 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19b8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cb2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb3460 0x55b536cb7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19b8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cb2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37938/0 (socket says 172.21.15.82:37938) 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19b8c00640 1 -- 172.21.15.82:0/2819033676 learned_addr learned my addr 172.21.15.82:0/2819033676 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.721+0000 7f19b3400640 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb85d0 0x55b536cbaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b8c00640 1 -- 172.21.15.82:0/2819033676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb85d0 msgr2=0x55b536cbaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b8c00640 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb85d0 0x55b536cbaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b8c00640 1 -- 172.21.15.82:0/2819033676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb3460 msgr2=0x55b536cb7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b8c00640 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb3460 0x55b536cb7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b8c00640 1 -- 172.21.15.82:0/2819033676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5369f17e0 con 0x55b536cb2a70 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b3e00640 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb3460 0x55b536cb7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19b8c00640 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cb2e90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009fd0 tx=0x7f19ac0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735033d7dfb842f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19a9200640 1 -- 172.21.15.82:0/2819033676 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac004d20 con 0x55b536cb2a70 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19a9200640 1 -- 172.21.15.82:0/2819033676 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19ac004050 con 0x55b536cb2a70 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.722+0000 7f19a9200640 1 -- 172.21.15.82:0/2819033676 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac005260 con 0x55b536cb2a70 2024-04-26T20:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.723+0000 7f19b0c00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19980a3cc0 0x7f19980a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.723+0000 7f19b0c00640 1 -- 172.21.15.82:0/1478315677 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f19a40d0ca0 con 0x7f19b4101110 2024-04-26T20:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.723+0000 7f19bda15740 1 -- 172.21.15.82:0/2819033676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 msgr2=0x55b536cb2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.723+0000 7f19bda15740 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cb2e90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009fd0 tx=0x7f19ac0118d0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 -- 172.21.15.82:0/2819033676 shutdown_connections 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb85d0 0x55b536cbaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb3460 0x55b536cb7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 --2- 172.21.15.82:0/2819033676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cb2e90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 -- 172.21.15.82:0/2819033676 >> 172.21.15.82:0/2819033676 conn(0x55b536cae0e0 msgr2=0x55b536cae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19b3e00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19980a3cc0 0x7f19980a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 -- 172.21.15.82:0/2819033676 shutdown_connections 2024-04-26T20:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 -- 172.21.15.82:0/2819033676 wait complete. 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19bda15740 1 -- start start 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.724+0000 7f19b3e00640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19980a3cc0 0x7f19980a6180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55b536cb3ed0 tx=0x7f19a40d47f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 Processor -- start 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb2a70 0x55b536cbce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cbd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb85d0 0x55b536cc43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b536cbb580 con 0x55b536cb85d0 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b536b9f170 con 0x55b536cb2a70 2024-04-26T20:24:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b536cbb700 con 0x55b536cb3460 2024-04-26T20:24:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.725+0000 7f19bda15740 10 client.0 _ll_register_callbacks cb 0x55b536c0e770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb2a70 0x55b536cbce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb2a70 0x55b536cbce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45008/0 (socket says 172.21.15.82:45008) 2024-04-26T20:24:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 -- 172.21.15.82:0/3695755724 learned_addr learned my addr 172.21.15.82:0/3695755724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb85d0 0x55b536cc43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b3400640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cbd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 -- 172.21.15.82:0/3695755724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 msgr2=0x55b536cbd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cbd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 -- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb2a70 msgr2=0x55b536cbce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb2a70 0x55b536cbce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.726+0000 7f19b8c00640 1 -- 172.21.15.82:0/3695755724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b536a51f70 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.727+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb85d0 0x55b536cc43e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f19ac005c40 tx=0x7f19ac000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553f275a75660db3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.727+0000 7f199d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.727+0000 7f199d600640 1 -- 172.21.15.82:0/3695755724 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0045c0 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.727+0000 7f199d600640 1 -- 172.21.15.82:0/3695755724 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f19ac004a40 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.727+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ac004050 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f199d600640 1 -- 172.21.15.82:0/3695755724 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f19ac004c40 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 10 client.15855 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b5368e9170 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f199d600640 1 -- 172.21.15.82:0/3695755724 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19ac004050 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f199d600640 1 -- 172.21.15.82:0/3695755724 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f19ac005030 con 0x55b536cb85d0 2024-04-26T20:24:06.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 10 client.15855 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 20 client.15855 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536cc8660 0x55b536ccaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 4 client.15855 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.728+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b536c25590 con 0x55b536cc8660 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.729+0000 7f19b3400640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536cc8660 0x55b536ccaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.729+0000 7f199d600640 10 client.15855 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.729+0000 7f19b3400640 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536cc8660 0x55b536ccaa70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4351439c0b44cce server_cookie=fcf795e7514aa109 in_seq=0 out_seq=0 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.730+0000 7f199d600640 1 -- 172.21.15.82:0/3695755724 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b536c25590 con 0x55b536cc8660 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.730+0000 7f199d600640 10 client.15855 handle_command_reply: tid=0 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.730+0000 7f19bda15740 1 client.15855 shutdown 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.730+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb85d0 msgr2=0x55b536cc43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb85d0 0x55b536cc43e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f19ac005c40 tx=0x7f19ac000f40 comp rx=0 tx=0).stop 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 shutdown_connections 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536cc8660 0x55b536ccaa70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb85d0 0x55b536cc43e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cbd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f199d600640 0 client.15855 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 --2- 172.21.15.82:0/3695755724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb2a70 0x55b536cbce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 >> 172.21.15.82:0/3695755724 conn(0x55b536cae0e0 msgr2=0x55b536cad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 shutdown_connections 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 1 -- 172.21.15.82:0/3695755724 wait complete. 2024-04-26T20:24:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.731+0000 7f19bda15740 20 client.15855 trim_cache size 0 max 16384 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.767+0000 7f19bda15740 1 Processor -- start 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.767+0000 7f19bda15740 1 -- start start 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.767+0000 7f19bda15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb2a70 0x55b536cb1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.767+0000 7f19bda15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 0x55b536cc43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.767+0000 7f19bda15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536ccf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19bda15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41ad4c0 con 0x55b536cb3460 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19bda15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41af000 con 0x55b536cb85d0 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19bda15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41adb90 con 0x55b536cb2a70 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 0x55b536cc43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 0x55b536cc43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37942/0 (socket says 172.21.15.82:37942) 2024-04-26T20:24:06.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 -- 172.21.15.82:0/3263948430 learned_addr learned my addr 172.21.15.82:0/3263948430 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb2a70 0x55b536cb1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536ccf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 -- 172.21.15.82:0/3263948430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb2a70 msgr2=0x55b536cb1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb2a70 0x55b536cb1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 -- 172.21.15.82:0/3263948430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 msgr2=0x55b536ccf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536ccf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.768+0000 7f19b3400640 1 -- 172.21.15.82:0/3263948430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b536cbb460 con 0x55b536cb3460 2024-04-26T20:24:06.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.769+0000 7f19b3400640 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 0x55b536cc43a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f19a002a910 tx=0x7f19a0005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59ddf57a8f01375 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.769+0000 7f199fe00640 1 -- 172.21.15.82:0/3263948430 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a004a070 con 0x55b536cb3460 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.769+0000 7f199fe00640 1 -- 172.21.15.82:0/3263948430 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19a0045dc0 con 0x55b536cb3460 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.769+0000 7f199fe00640 1 -- 172.21.15.82:0/3263948430 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0035040 con 0x55b536cb3460 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 -- 172.21.15.82:0/3263948430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 msgr2=0x55b536cc43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 0x55b536cc43a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f19a002a910 tx=0x7f19a0005a20 comp rx=0 tx=0).stop 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 -- 172.21.15.82:0/3263948430 shutdown_connections 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536ccf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb3460 0x55b536cc43a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 --2- 172.21.15.82:0/3263948430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb2a70 0x55b536cb1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.770+0000 7f19bda15740 1 -- 172.21.15.82:0/3263948430 >> 172.21.15.82:0/3263948430 conn(0x55b536cae0e0 msgr2=0x55b536cb1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.771+0000 7f19bda15740 1 -- 172.21.15.82:0/3263948430 shutdown_connections 2024-04-26T20:24:06.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.771+0000 7f19bda15740 1 -- 172.21.15.82:0/3263948430 wait complete. 2024-04-26T20:24:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.771+0000 7f19bda15740 1 -- start start 2024-04-26T20:24:06.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.771+0000 7f19bda15740 1 Processor -- start 2024-04-26T20:24:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cc20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cc25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536cc3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41ae930 con 0x55b536cb2a70 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41ae260 con 0x55b536cb85d0 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41ab4a0 con 0x55b536cb3460 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19bda15740 10 client.0 _ll_register_callbacks cb 0x7f19ac0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19b8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cc20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19b8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cc20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37954/0 (socket says 172.21.15.82:37954) 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19b8c00640 1 -- 172.21.15.82:0/3364918357 learned_addr learned my addr 172.21.15.82:0/3364918357 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.772+0000 7f19b3400640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cc25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536cc3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 -- 172.21.15.82:0/3364918357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 msgr2=0x55b536cc25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cc25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 -- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 msgr2=0x55b536cc3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536cc3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 -- 172.21.15.82:0/3364918357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b536cc3b70 con 0x55b536cb2a70 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b3400640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cc25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f19b8c00640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cc20a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f19ac003e70 tx=0x7f19ac000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93faba6b93e148e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f199d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.773+0000 7f199d600640 1 -- 172.21.15.82:0/3364918357 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac037070 con 0x55b536cb2a70 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.774+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19a0045dc0 con 0x55b536cb2a70 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.774+0000 7f199d600640 1 -- 172.21.15.82:0/3364918357 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f19ac0040f0 con 0x55b536cb2a70 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.774+0000 7f199d600640 1 -- 172.21.15.82:0/3364918357 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f19ac004f00 con 0x55b536cb2a70 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.774+0000 7f19bda15740 10 client.15861 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.774+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b536d2f150 con 0x55b536cb2a70 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.774+0000 7f199d600640 1 -- 172.21.15.82:0/3364918357 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19a0045dc0 con 0x55b536cb2a70 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f199d600640 1 -- 172.21.15.82:0/3364918357 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f19ac00f810 con 0x55b536cb2a70 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19bda15740 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19bda15740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19bda15740 20 client.15861 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19bda15740 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536d2fb20 0x55b536d31f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19bda15740 4 client.15861 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:24:06.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b536c1f400 con 0x55b536d2fb20 2024-04-26T20:24:06.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.775+0000 7f19b3400640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536d2fb20 0x55b536d31f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.776+0000 7f199d600640 10 client.15861 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.776+0000 7f19b3400640 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536d2fb20 0x55b536d31f40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae00875d916eb933 server_cookie=122901e93bd55e47 in_seq=0 out_seq=0 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.777+0000 7f199d600640 1 -- 172.21.15.82:0/3364918357 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b536c1f400 con 0x55b536d2fb20 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.777+0000 7f199d600640 10 client.15861 handle_command_reply: tid=0 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.777+0000 7f19bda15740 1 client.15861 shutdown 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 msgr2=0x55b536cc20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cc20a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f19ac003e70 tx=0x7f19ac000f40 comp rx=0 tx=0).stop 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 shutdown_connections 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b536d2fb20 0x55b536d31f40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f199d600640 0 client.15861 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b536cb85d0 0x55b536cc3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b536cb3460 0x55b536cc25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 --2- 172.21.15.82:0/3364918357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b536cb2a70 0x55b536cc20a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 >> 172.21.15.82:0/3364918357 conn(0x55b536cae0e0 msgr2=0x55b536cb1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 shutdown_connections 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.778+0000 7f19bda15740 1 -- 172.21.15.82:0/3364918357 wait complete. 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.779+0000 7f19bda15740 20 client.15861 trim_cache size 0 max 16384 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "991acc27-d88b-4d5a-a974-e79e14a03005", 2024-04-26T20:24:06.782 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:24:06.783 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:24:06.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.779+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19980a3cc0 msgr2=0x7f19980a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.779+0000 7f19b9600640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19980a3cc0 0x7f19980a6180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55b536cb3ed0 tx=0x7f19a40d47f0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.779+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 msgr2=0x7f19b419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.779+0000 7f19b9600640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 0x7f19b419ac80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19a400e9f0 tx=0x7f19a400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 shutdown_connections 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f19980a3cc0 0x7f19980a6180 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b4102410 0x7f19b41a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19b4101a70 0x7f19b419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 --2- 172.21.15.82:0/1478315677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b4101110 0x7f19b419ac80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 >> 172.21.15.82:0/1478315677 conn(0x7f19b40fccd0 msgr2=0x7f19b40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 shutdown_connections 2024-04-26T20:24:06.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.780+0000 7f19b9600640 1 -- 172.21.15.82:0/1478315677 wait complete. 2024-04-26T20:24:06.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:24:06.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:24:06.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 -- 172.21.15.82:0/1566341291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda741085a0 msgr2=0x7fda7410a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 --2- 172.21.15.82:0/1566341291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda741085a0 0x7fda7410a990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009be0 tx=0x7fda6c02a6c0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 -- 172.21.15.82:0/1566341291 shutdown_connections 2024-04-26T20:24:06.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 --2- 172.21.15.82:0/1566341291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda741085a0 0x7fda7410a990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 --2- 172.21.15.82:0/1566341291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda74105c70 0x7fda74108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 --2- 172.21.15.82:0/1566341291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda74103340 0x7fda74105730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 -- 172.21.15.82:0/1566341291 >> 172.21.15.82:0/1566341291 conn(0x7fda740fccd0 msgr2=0x7fda740ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 -- 172.21.15.82:0/1566341291 shutdown_connections 2024-04-26T20:24:06.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.964+0000 7fda7aa00640 1 -- 172.21.15.82:0/1566341291 wait complete. 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 Processor -- start 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 -- start start 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 0x7fda7419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda74105c70 0x7fda7419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda741085a0 0x7fda741a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda7410e370 con 0x7fda74105c70 2024-04-26T20:24:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda7410e1f0 con 0x7fda74103340 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.966+0000 7fda7aa00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fda7410e4f0 con 0x7fda741085a0 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 0x7fda7419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 0x7fda7419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45060/0 (socket says 172.21.15.82:45060) 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 -- 172.21.15.82:0/113798173 learned_addr learned my addr 172.21.15.82:0/113798173 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda78c00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda74105c70 0x7fda7419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda7a000640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda741085a0 0x7fda741a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 -- 172.21.15.82:0/113798173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda741085a0 msgr2=0x7fda741a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda741085a0 0x7fda741a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 -- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda74105c70 msgr2=0x7fda7419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda74105c70 0x7fda7419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.967+0000 7fda79600640 1 -- 172.21.15.82:0/113798173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda741a2870 con 0x7fda74103340 2024-04-26T20:24:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.968+0000 7fda79600640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 0x7fda7419ac60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda6800e9c0 tx=0x7fda6800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.968+0000 7fda72000640 1 -- 172.21.15.82:0/113798173 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6800cde0 con 0x7fda74103340 2024-04-26T20:24:06.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.968+0000 7fda72000640 1 -- 172.21.15.82:0/113798173 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda680035f0 con 0x7fda74103340 2024-04-26T20:24:06.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.968+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda741a2b60 con 0x7fda74103340 2024-04-26T20:24:06.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.968+0000 7fda72000640 1 -- 172.21.15.82:0/113798173 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68010690 con 0x7fda74103340 2024-04-26T20:24:06.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.968+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda741a30b0 con 0x7fda74103340 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 Processor -- start 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 -- start start 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda72000640 1 -- 172.21.15.82:0/113798173 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fda68004000 con 0x7fda74103340 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313e960 0x55f1d313ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 0x55f1d3143e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d3146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f1d304f030 con 0x55f1d313f350 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1d306a7f0 con 0x55f1d31444c0 2024-04-26T20:24:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.973+0000 7fda7ee15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f1d30257e0 con 0x55f1d313e960 2024-04-26T20:24:06.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda79600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 0x55f1d3143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda78c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d3146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda78c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d3146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45064/0 (socket says 172.21.15.82:45064) 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda79600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 0x55f1d3143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37978/0 (socket says 172.21.15.82:37978) 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda78c00640 1 -- 172.21.15.82:0/4167775106 learned_addr learned my addr 172.21.15.82:0/4167775106 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda7a000640 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313e960 0x55f1d313ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda79600640 1 -- 172.21.15.82:0/4167775106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313e960 msgr2=0x55f1d313ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda79600640 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313e960 0x55f1d313ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda79600640 1 -- 172.21.15.82:0/4167775106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 msgr2=0x55f1d3146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.974+0000 7fda79600640 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d3146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.975+0000 7fda79600640 1 -- 172.21.15.82:0/4167775106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d3031050 con 0x55f1d313f350 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.975+0000 7fda7a000640 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313e960 0x55f1d313ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:06.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.975+0000 7fda79600640 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 0x55f1d3143e50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fda680ce370 tx=0x7fda680d4de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d685edbe8dea24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.975+0000 7fda72000640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda5c0a3c40 0x7fda5c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.976+0000 7fda66600640 1 -- 172.21.15.82:0/4167775106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6809bf90 con 0x55f1d313f350 2024-04-26T20:24:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.976+0000 7fda72000640 1 -- 172.21.15.82:0/113798173 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fda680d0d20 con 0x7fda74103340 2024-04-26T20:24:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.976+0000 7fda66600640 1 -- 172.21.15.82:0/4167775106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda6809d240 con 0x55f1d313f350 2024-04-26T20:24:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.976+0000 7fda66600640 1 -- 172.21.15.82:0/4167775106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6809c2c0 con 0x55f1d313f350 2024-04-26T20:24:06.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.976+0000 7fda7a000640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda5c0a3c40 0x7fda5c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 -- 172.21.15.82:0/4167775106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 msgr2=0x55f1d3143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 0x55f1d3143e50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fda680ce370 tx=0x7fda680d4de0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7a000640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda5c0a3c40 0x7fda5c0a6100 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006010 tx=0x7fda6c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 -- 172.21.15.82:0/4167775106 shutdown_connections 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d3146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313f350 0x55f1d3143e50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 --2- 172.21.15.82:0/4167775106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313e960 0x55f1d313ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 -- 172.21.15.82:0/4167775106 >> 172.21.15.82:0/4167775106 conn(0x55f1d3139fd0 msgr2=0x55f1d313a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 -- 172.21.15.82:0/4167775106 shutdown_connections 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.977+0000 7fda7ee15740 1 -- 172.21.15.82:0/4167775106 wait complete. 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.978+0000 7fda7ee15740 1 -- start start 2024-04-26T20:24:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.978+0000 7fda7ee15740 1 Processor -- start 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 0x55f1d3148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d3148c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d31444c0 0x55f1d314fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f1d30a7200 con 0x55f1d31444c0 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1d30a1ee0 con 0x55f1d313e960 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f1d30aee70 con 0x55f1d313f350 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7ee15740 10 client.0 _ll_register_callbacks cb 0x55f1d3098270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 0x55f1d3148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 0x55f1d3148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45078/0 (socket says 172.21.15.82:45078) 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 -- 172.21.15.82:0/3208147765 learned_addr learned my addr 172.21.15.82:0/3208147765 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda7a000640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d31444c0 0x55f1d314fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda78c00640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d3148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 -- 172.21.15.82:0/3208147765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 msgr2=0x55f1d3148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d3148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 -- 172.21.15.82:0/3208147765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d31444c0 msgr2=0x55f1d314fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d31444c0 0x55f1d314fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.979+0000 7fda79600640 1 -- 172.21.15.82:0/3208147765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d2e7e7d0 con 0x55f1d313e960 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda79600640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 0x55f1d3148750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda68009230 tx=0x7fda680d0fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0075f67e809256 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:06.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda5aa00640 1 -- 172.21.15.82:0/3208147765 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6809c4a0 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda5aa00640 1 -- 172.21.15.82:0/3208147765 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fda6809ae40 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda6809d240 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda5aa00640 1 -- 172.21.15.82:0/3208147765 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda6809c680 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda7ee15740 10 client.25964 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1d2db43f0 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.980+0000 7fda5aa00640 1 -- 172.21.15.82:0/3208147765 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda6809d240 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda5aa00640 1 -- 172.21.15.82:0/3208147765 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fda6809cda0 con 0x55f1d313e960 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda7ee15740 10 client.25964 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda7ee15740 10 client.25964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda7ee15740 20 client.25964 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d3153e30 0x55f1d3156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda7ee15740 4 client.25964 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1d30b07e0 con 0x55f1d3153e30 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.981+0000 7fda78c00640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d3153e30 0x55f1d3156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.982+0000 7fda78c00640 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d3153e30 0x55f1d3156220 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5624bf18346a258b server_cookie=9e0aa7eb23047a3b in_seq=0 out_seq=0 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.982+0000 7fda5aa00640 10 client.25964 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.982+0000 7fda5aa00640 1 -- 172.21.15.82:0/3208147765 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1d30b07e0 con 0x55f1d3153e30 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda5aa00640 10 client.25964 handle_command_reply: tid=0 2024-04-26T20:24:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 client.25964 shutdown 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 msgr2=0x55f1d3148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 0x55f1d3148750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fda68009230 tx=0x7fda680d0fe0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 shutdown_connections 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d3153e30 0x55f1d3156220 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d31444c0 0x55f1d314fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d3148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3208147765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313e960 0x55f1d3148750 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda5aa00640 0 client.25964 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:06.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 >> 172.21.15.82:0/3208147765 conn(0x55f1d3139fd0 msgr2=0x55f1d31391f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:06.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 shutdown_connections 2024-04-26T20:24:06.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 1 -- 172.21.15.82:0/3208147765 wait complete. 2024-04-26T20:24:06.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:06.983+0000 7fda7ee15740 20 client.25964 trim_cache size 0 max 16384 2024-04-26T20:24:07.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.002+0000 7fda7ee15740 1 Processor -- start 2024-04-26T20:24:07.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.002+0000 7fda7ee15740 1 -- start start 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.002+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d3140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.002+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313f350 0x55f1d314fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.002+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d31444c0 0x55f1d313d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda7ee15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda741aef30 con 0x55f1d313e960 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda7ee15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda741adac0 con 0x55f1d313f350 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda7ee15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fda741ae190 con 0x55f1d31444c0 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d3140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda78c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313f350 0x55f1d314fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d3140650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37996/0 (socket says 172.21.15.82:37996) 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 -- 172.21.15.82:0/3435285472 learned_addr learned my addr 172.21.15.82:0/3435285472 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda7a000640 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d31444c0 0x55f1d313d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 -- 172.21.15.82:0/3435285472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d31444c0 msgr2=0x55f1d313d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d31444c0 0x55f1d313d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 -- 172.21.15.82:0/3435285472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313f350 msgr2=0x55f1d314fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313f350 0x55f1d314fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.003+0000 7fda79600640 1 -- 172.21.15.82:0/3435285472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d2d740f0 con 0x55f1d313e960 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.004+0000 7fda79600640 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d3140650 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fda680d4310 tx=0x7fda680d1050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf81008e7e967a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:07.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.004+0000 7fda65c00640 1 -- 172.21.15.82:0/3435285472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6809c910 con 0x55f1d313e960 2024-04-26T20:24:07.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.004+0000 7fda65c00640 1 -- 172.21.15.82:0/3435285472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda68003aa0 con 0x55f1d313e960 2024-04-26T20:24:07.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.004+0000 7fda65c00640 1 -- 172.21.15.82:0/3435285472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68098800 con 0x55f1d313e960 2024-04-26T20:24:07.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 -- 172.21.15.82:0/3435285472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 msgr2=0x55f1d3140650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:07.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d3140650 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fda680d4310 tx=0x7fda680d1050 comp rx=0 tx=0).stop 2024-04-26T20:24:07.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 -- 172.21.15.82:0/3435285472 shutdown_connections 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d31444c0 0x55f1d313d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d313f350 0x55f1d314fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 --2- 172.21.15.82:0/3435285472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d3140650 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 -- 172.21.15.82:0/3435285472 >> 172.21.15.82:0/3435285472 conn(0x55f1d3139fd0 msgr2=0x55f1d313cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 -- 172.21.15.82:0/3435285472 shutdown_connections 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.005+0000 7fda7ee15740 1 -- 172.21.15.82:0/3435285472 wait complete. 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.006+0000 7fda7ee15740 1 -- start start 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.006+0000 7fda7ee15740 1 Processor -- start 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d314dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d314e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d314f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda741ab3d0 con 0x55f1d313e960 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda741ae860 con 0x55f1d31444c0 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fda741aba40 con 0x55f1d313f350 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7ee15740 10 client.0 _ll_register_callbacks cb 0x7fda600097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda79600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d314dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda78c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d314e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda78c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d314e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:42336/0 (socket says 172.21.15.82:42336) 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda78c00640 1 -- 172.21.15.82:0/792088317 learned_addr learned my addr 172.21.15.82:0/792088317 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.007+0000 7fda7a000640 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d314f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda78c00640 1 -- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 msgr2=0x55f1d314f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda78c00640 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d314f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda78c00640 1 -- 172.21.15.82:0/792088317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 msgr2=0x55f1d314dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda78c00640 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d314dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda78c00640 1 -- 172.21.15.82:0/792088317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d306aa30 con 0x55f1d313f350 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda78c00640 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d314e230 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda60009e00 tx=0x7fda60010a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aed8475b371bdeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda5aa00640 1 -- 172.21.15.82:0/792088317 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60026060 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda68003aa0 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda5aa00640 1 -- 172.21.15.82:0/792088317 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fda60004440 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda5aa00640 1 -- 172.21.15.82:0/792088317 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda6002d050 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.008+0000 7fda7ee15740 10 client.26005 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.009+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1d31ba9e0 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.009+0000 7fda5aa00640 1 -- 172.21.15.82:0/792088317 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda68003aa0 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda5aa00640 1 -- 172.21.15.82:0/792088317 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fda60003a00 con 0x55f1d313f350 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda7ee15740 10 client.26005 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda7ee15740 10 client.26005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda7ee15740 20 client.26005 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda7ee15740 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d31bb310 0x55f1d31bd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda7ee15740 4 client.26005 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:24:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f1d30aa650 con 0x55f1d31bb310 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.010+0000 7fda79600640 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d31bb310 0x55f1d31bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda5aa00640 10 client.26005 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda79600640 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d31bb310 0x55f1d31bd730 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2a631220f42be0 server_cookie=4320b42f23a96e0a in_seq=0 out_seq=0 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda5aa00640 1 -- 172.21.15.82:0/792088317 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f1d30aa650 con 0x55f1d31bb310 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda5aa00640 10 client.26005 handle_command_reply: tid=0 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda7ee15740 1 client.26005 shutdown 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 msgr2=0x55f1d314e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda7ee15740 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d314e230 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda60009e00 tx=0x7fda60010a20 comp rx=0 tx=0).stop 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 shutdown_connections 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.011+0000 7fda7ee15740 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1d31bb310 0x55f1d31bd730 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1d31444c0 0x55f1d314f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda5aa00640 0 client.26005 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1d313f350 0x55f1d314e230 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 1 --2- 172.21.15.82:0/792088317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1d313e960 0x55f1d314dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 >> 172.21.15.82:0/792088317 conn(0x55f1d3139fd0 msgr2=0x55f1d313d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 shutdown_connections 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 1 -- 172.21.15.82:0/792088317 wait complete. 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.012+0000 7fda7ee15740 20 client.26005 trim_cache size 0 max 16384 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stdout: "991acc27-d88b-4d5a-a974-e79e14a03005": { 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:24:07.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "991acc27-d88b-4d5a-a974-e79e14a03005", 2024-04-26T20:24:07.020 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:24:07.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:24:07.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:24:07.020 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda5c0a3c40 msgr2=0x7fda5c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda5c0a3c40 0x7fda5c0a6100 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006010 tx=0x7fda6c004a40 comp rx=0 tx=0).stop 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 msgr2=0x7fda7419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 0x7fda7419ac60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda6800e9c0 tx=0x7fda6800ee80 comp rx=0 tx=0).stop 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 shutdown_connections 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fda5c0a3c40 0x7fda5c0a6100 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda741085a0 0x7fda741a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda74105c70 0x7fda7419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 --2- 172.21.15.82:0/113798173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74103340 0x7fda7419ac60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 >> 172.21.15.82:0/113798173 conn(0x7fda740fccd0 msgr2=0x7fda74102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 shutdown_connections 2024-04-26T20:24:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:07.013+0000 7fda7aa00640 1 -- 172.21.15.82:0/113798173 wait complete. 2024-04-26T20:24:07.038 INFO:tasks.cephfs.filesystem:scrub status for tag:991acc27-d88b-4d5a-a974-e79e14a03005 - {'path': '/', 'tag': '991acc27-d88b-4d5a-a974-e79e14a03005', 'options': 'recursive,force'} 2024-04-26T20:24:08.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:07 smithi139 ceph-mon[32999]: pgmap v451: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-26T20:24:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:07 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:24:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:07 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:07 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:24:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:07 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:07 smithi135 ceph-mon[32816]: pgmap v451: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-26T20:24:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:07 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:24:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:07 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:07 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:24:08.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:07 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:08.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:07 smithi082 ceph-mon[28105]: pgmap v451: 129 pgs: 129 active+clean; 665 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-26T20:24:08.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:07 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:24:08.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:07 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:08.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:07 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:24:08.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:07 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:10.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:09 smithi139 ceph-mon[32999]: pgmap v452: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:09 smithi135 ceph-mon[32816]: pgmap v452: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:10.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:09 smithi082 ceph-mon[28105]: pgmap v452: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:11 smithi139 ceph-mon[32999]: pgmap v453: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-26T20:24:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:11 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:24:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:11 smithi135 ceph-mon[32816]: pgmap v453: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-26T20:24:12.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:11 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:24:12.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:11 smithi082 ceph-mon[28105]: pgmap v453: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-26T20:24:12.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:11 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:24:14.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:13 smithi139 ceph-mon[32999]: pgmap v454: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:13 smithi135 ceph-mon[32816]: pgmap v454: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:14.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:13 smithi082 ceph-mon[28105]: pgmap v454: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:16.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:15 smithi139 ceph-mon[32999]: pgmap v455: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:15 smithi135 ceph-mon[32816]: pgmap v455: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:15 smithi082 ceph-mon[28105]: pgmap v455: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:16 smithi139 ceph-mon[32999]: pgmap v456: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:16 smithi135 ceph-mon[32816]: pgmap v456: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:16 smithi082 ceph-mon[28105]: pgmap v456: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-26T20:24:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.649+0000 7fc0ae000640 1 -- 172.21.15.82:0/3619078907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 msgr2=0x7fc0a8107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.649+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3619078907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a8107f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc094009900 tx=0x7fc09402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 -- 172.21.15.82:0/3619078907 shutdown_connections 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3619078907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0a8108490 0x7fc0a810a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3619078907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a8107f50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3619078907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a8105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 -- 172.21.15.82:0/3619078907 >> 172.21.15.82:0/3619078907 conn(0x7fc0a80fcc20 msgr2=0x7fc0a80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 -- 172.21.15.82:0/3619078907 shutdown_connections 2024-04-26T20:24:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.650+0000 7fc0ae000640 1 -- 172.21.15.82:0/3619078907 wait complete. 2024-04-26T20:24:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.651+0000 7fc0ae000640 1 Processor -- start 2024-04-26T20:24:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.651+0000 7fc0ae000640 1 -- start start 2024-04-26T20:24:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0ae000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0ae000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0ae000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0a8108490 0x7fc0a81a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0ae000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810e320 con 0x7fc0a8103230 2024-04-26T20:24:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0ae000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810e1a0 con 0x7fc0a8105b60 2024-04-26T20:24:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0ae000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810e4a0 con 0x7fc0a8108490 2024-04-26T20:24:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a819ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37956/0 (socket says 172.21.15.82:37956) 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.652+0000 7fc0acc00640 1 -- 172.21.15.82:0/3233508716 learned_addr learned my addr 172.21.15.82:0/3233508716 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0ad600640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0a8108490 0x7fc0a81a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0a7e00640 1 -- 172.21.15.82:0/3233508716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0a8108490 msgr2=0x7fc0a81a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0a8108490 0x7fc0a81a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0a7e00640 1 -- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 msgr2=0x7fc0a819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0a7e00640 1 -- 172.21.15.82:0/3233508716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a81a2870 con 0x7fc0a8105b60 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.653+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a819b1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc09402a910 tx=0x7fc094003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.654+0000 7fc0a5600640 1 -- 172.21.15.82:0/3233508716 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09403f070 con 0x7fc0a8105b60 2024-04-26T20:24:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.654+0000 7fc0a5600640 1 -- 172.21.15.82:0/3233508716 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc094031c50 con 0x7fc0a8105b60 2024-04-26T20:24:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.654+0000 7fc0a5600640 1 -- 172.21.15.82:0/3233508716 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094035030 con 0x7fc0a8105b60 2024-04-26T20:24:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.655+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a81a2b00 con 0x7fc0a8105b60 2024-04-26T20:24:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.655+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81a2f70 con 0x7fc0a8105b60 2024-04-26T20:24:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.659+0000 7fc0b2584740 1 Processor -- start 2024-04-26T20:24:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 -- start start 2024-04-26T20:24:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0a5600640 1 -- 172.21.15.82:0/3233508716 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc094042070 con 0x7fc0a8105b60 2024-04-26T20:24:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b77de0 0x564579b78200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b7d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 0x564579b7fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564579adc380 con 0x564579b787d0 2024-04-26T20:24:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564579a78c30 con 0x564579b7d940 2024-04-26T20:24:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.660+0000 7fc0b2584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564579ad8340 con 0x564579b77de0 2024-04-26T20:24:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 0x564579b7fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 0x564579b7fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38274/0 (socket says 172.21.15.82:38274) 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 -- 172.21.15.82:0/965739275 learned_addr learned my addr 172.21.15.82:0/965739275 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0ad600640 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b77de0 0x564579b78200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0acc00640 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b7d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 -- 172.21.15.82:0/965739275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b77de0 msgr2=0x564579b78200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b77de0 0x564579b78200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 -- 172.21.15.82:0/965739275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 msgr2=0x564579b7d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b7d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0a7e00640 1 -- 172.21.15.82:0/965739275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564579a9a940 con 0x564579b7d940 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.661+0000 7fc0acc00640 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b7d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.662+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 0x564579b7fdd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ee580 tx=0x7fc0940f91a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98a78a80dc50746b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.662+0000 7fc099c00640 1 -- 172.21.15.82:0/965739275 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0940f9bd0 con 0x564579b7d940 2024-04-26T20:24:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.662+0000 7fc099c00640 1 -- 172.21.15.82:0/965739275 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0940fe030 con 0x564579b7d940 2024-04-26T20:24:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.662+0000 7fc099c00640 1 -- 172.21.15.82:0/965739275 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0941023d0 con 0x564579b7d940 2024-04-26T20:24:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.662+0000 7fc0a5600640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0900a3cb0 0x7fc0900a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.663+0000 7fc0a5600640 1 -- 172.21.15.82:0/3233508716 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc0940f0ff0 con 0x7fc0a8105b60 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.663+0000 7fc0ad600640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0900a3cb0 0x7fc0900a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.663+0000 7fc0b2584740 1 -- 172.21.15.82:0/965739275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 msgr2=0x564579b7fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.663+0000 7fc0b2584740 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 0x564579b7fdd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ee580 tx=0x7fc0940f91a0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0ad600640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0900a3cb0 0x7fc0900a6170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x564579b79030 tx=0x7fc0a0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 -- 172.21.15.82:0/965739275 shutdown_connections 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b7d940 0x564579b7fdd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b7d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 --2- 172.21.15.82:0/965739275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b77de0 0x564579b78200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 -- 172.21.15.82:0/965739275 >> 172.21.15.82:0/965739275 conn(0x564579b73450 msgr2=0x564579b73850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 -- 172.21.15.82:0/965739275 shutdown_connections 2024-04-26T20:24:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.664+0000 7fc0b2584740 1 -- 172.21.15.82:0/965739275 wait complete. 2024-04-26T20:24:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.665+0000 7fc0b2584740 1 -- start start 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.665+0000 7fc0b2584740 1 Processor -- start 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b81d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b82280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579b892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564579b806b0 con 0x564579b7d940 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564579a63c60 con 0x564579b77de0 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564579b80830 con 0x564579b787d0 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0b2584740 10 client.0 _ll_register_callbacks cb 0x564579a8fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b81d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b81d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38290/0 (socket says 172.21.15.82:38290) 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0acc00640 1 -- 172.21.15.82:0/3813838264 learned_addr learned my addr 172.21.15.82:0/3813838264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b82280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.666+0000 7fc0ad600640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579b892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0acc00640 1 -- 172.21.15.82:0/3813838264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 msgr2=0x564579b82280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b82280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0acc00640 1 -- 172.21.15.82:0/3813838264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 msgr2=0x564579b892c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579b892c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0acc00640 1 -- 172.21.15.82:0/3813838264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564579a72510 con 0x564579b77de0 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0ad600640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579b892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b81d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc09c013cc0 tx=0x7fc09c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca02984238ad28c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc08e000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc08e000640 1 -- 172.21.15.82:0/3813838264 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c020060 con 0x564579b77de0 2024-04-26T20:24:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0940fe030 con 0x564579b77de0 2024-04-26T20:24:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.667+0000 7fc08e000640 1 -- 172.21.15.82:0/3813838264 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc09c01b630 con 0x564579b77de0 2024-04-26T20:24:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.668+0000 7fc08e000640 1 -- 172.21.15.82:0/3813838264 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc09c027050 con 0x564579b77de0 2024-04-26T20:24:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.668+0000 7fc0b2584740 10 client.25982 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.668+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5645797ee210 con 0x564579b77de0 2024-04-26T20:24:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.668+0000 7fc08e000640 1 -- 172.21.15.82:0/3813838264 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0940fe030 con 0x564579b77de0 2024-04-26T20:24:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc08e000640 1 -- 172.21.15.82:0/3813838264 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc09c00e440 con 0x564579b77de0 2024-04-26T20:24:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0b2584740 10 client.25982 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0b2584740 10 client.25982 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0b2584740 20 client.25982 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579b8d780 0x564579b8fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0b2584740 4 client.25982 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564579ae9f90 con 0x564579b8d780 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.669+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579b8d780 0x564579b8fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.670+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579b8d780 0x564579b8fbb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d60df94f06b360a server_cookie=4189841350573050 in_seq=0 out_seq=0 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.670+0000 7fc08e000640 10 client.25982 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.670+0000 7fc08e000640 1 -- 172.21.15.82:0/3813838264 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564579ae9f90 con 0x564579b8d780 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.670+0000 7fc08e000640 10 client.25982 handle_command_reply: tid=0 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 client.25982 shutdown 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 msgr2=0x564579b81d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b81d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc09c013cc0 tx=0x7fc09c0117b0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 shutdown_connections 2024-04-26T20:24:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579b8d780 0x564579b8fbb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579b892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b82280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3813838264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b81d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc08e000640 0 client.25982 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.671+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 >> 172.21.15.82:0/3813838264 conn(0x564579b73450 msgr2=0x564579b72650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.673+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 shutdown_connections 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.673+0000 7fc0b2584740 1 -- 172.21.15.82:0/3813838264 wait complete. 2024-04-26T20:24:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.673+0000 7fc0b2584740 20 client.25982 trim_cache size 0 max 16384 2024-04-26T20:24:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 Processor -- start 2024-04-26T20:24:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 -- start start 2024-04-26T20:24:18.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b76a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b89280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b7d940 0x564579b7d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ad440 con 0x564579b787d0 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81aef80 con 0x564579b77de0 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.703+0000 7fc0b2584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81adb10 con 0x564579b7d940 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b76a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b76a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38300/0 (socket says 172.21.15.82:38300) 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 -- 172.21.15.82:0/434226202 learned_addr learned my addr 172.21.15.82:0/434226202 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0ad600640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b7d940 0x564579b7d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b89280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 -- 172.21.15.82:0/434226202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b7d940 msgr2=0x564579b7d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b7d940 0x564579b7d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 -- 172.21.15.82:0/434226202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 msgr2=0x564579b89280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b89280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 -- 172.21.15.82:0/434226202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645798ba620 con 0x564579b77de0 2024-04-26T20:24:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0ad600640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b7d940 0x564579b7d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b89280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.704+0000 7fc0acc00640 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b76a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00e8e0 tx=0x7fc09c011cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8998d02a78b44478 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.705+0000 7fc099200640 1 -- 172.21.15.82:0/434226202 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c00ecd0 con 0x564579b77de0 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.705+0000 7fc099200640 1 -- 172.21.15.82:0/434226202 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09c030070 con 0x564579b77de0 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.705+0000 7fc099200640 1 -- 172.21.15.82:0/434226202 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c003960 con 0x564579b77de0 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 -- 172.21.15.82:0/434226202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 msgr2=0x564579b76a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b76a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00e8e0 tx=0x7fc09c011cb0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 -- 172.21.15.82:0/434226202 shutdown_connections 2024-04-26T20:24:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b7d940 0x564579b7d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b787d0 0x564579b89280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 --2- 172.21.15.82:0/434226202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b76a60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 -- 172.21.15.82:0/434226202 >> 172.21.15.82:0/434226202 conn(0x564579b73450 msgr2=0x564579b73830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 -- 172.21.15.82:0/434226202 shutdown_connections 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.706+0000 7fc0b2584740 1 -- 172.21.15.82:0/434226202 wait complete. 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 -- start start 2024-04-26T20:24:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 Processor -- start 2024-04-26T20:24:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b86310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b86850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579bf1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ae8b0 con 0x564579b7d940 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ae1e0 con 0x564579b77de0 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ab420 con 0x564579b787d0 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.707+0000 7fc0b2584740 10 client.0 _ll_register_callbacks cb 0x7fc09c009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b86310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0ad600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579bf1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b86310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38308/0 (socket says 172.21.15.82:38308) 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 -- 172.21.15.82:0/3102826957 learned_addr learned my addr 172.21.15.82:0/3102826957 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b86850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 -- 172.21.15.82:0/3102826957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 msgr2=0x564579b86850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b86850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 -- 172.21.15.82:0/3102826957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 msgr2=0x564579bf1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.708+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579bf1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc0acc00640 1 -- 172.21.15.82:0/3102826957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564579a96cb0 con 0x564579b77de0 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc0ad600640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579bf1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b86850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc0acc00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b86310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00e5e0 tx=0x7fc09c009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7f0da4beb5d311 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc08e000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc08e000640 1 -- 172.21.15.82:0/3102826957 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c005110 con 0x564579b77de0 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c030070 con 0x564579b77de0 2024-04-26T20:24:18.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.709+0000 7fc08e000640 1 -- 172.21.15.82:0/3102826957 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc09c0052b0 con 0x564579b77de0 2024-04-26T20:24:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc08e000640 1 -- 172.21.15.82:0/3102826957 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc09c03f050 con 0x564579b77de0 2024-04-26T20:24:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 10 client.25988 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564579bf3420 con 0x564579b77de0 2024-04-26T20:24:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc08e000640 1 -- 172.21.15.82:0/3102826957 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09c030070 con 0x564579b77de0 2024-04-26T20:24:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc08e000640 1 -- 172.21.15.82:0/3102826957 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc09c01b660 con 0x564579b77de0 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 10 client.25988 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 10 client.25988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 20 client.25988 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579bf3dc0 0x564579bf61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 4 client.25988 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.710+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564579ae3e00 con 0x564579bf3dc0 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.711+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579bf3dc0 0x564579bf61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.711+0000 7fc0a7e00640 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579bf3dc0 0x564579bf61e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbfaba6e4418632 server_cookie=aed73ff2aff45421 in_seq=0 out_seq=0 2024-04-26T20:24:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.711+0000 7fc08e000640 10 client.25988 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc08e000640 1 -- 172.21.15.82:0/3102826957 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564579ae3e00 con 0x564579bf3dc0 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc08e000640 10 client.25988 handle_command_reply: tid=0 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 client.25988 shutdown 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 msgr2=0x564579b86310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b86310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00e5e0 tx=0x7fc09c009f80 comp rx=0 tx=0).stop 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 shutdown_connections 2024-04-26T20:24:18.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564579bf3dc0 0x564579bf61e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564579b7d940 0x564579bf1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564579b787d0 0x564579b86850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 --2- 172.21.15.82:0/3102826957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564579b77de0 0x564579b86310 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 >> 172.21.15.82:0/3102826957 conn(0x564579b73450 msgr2=0x564579b761d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.715+0000 7fc08e000640 0 client.25988 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.716+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 shutdown_connections 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.716+0000 7fc0b2584740 1 -- 172.21.15.82:0/3102826957 wait complete. 2024-04-26T20:24:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.716+0000 7fc0b2584740 20 client.25988 trim_cache size 0 max 16384 2024-04-26T20:24:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:24:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:24:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:24:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:24:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0900a3cb0 msgr2=0x7fc0900a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0900a3cb0 0x7fc0900a6170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x564579b79030 tx=0x7fc0a0009500 comp rx=0 tx=0).stop 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 msgr2=0x7fc0a819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a819b1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc09402a910 tx=0x7fc094003c10 comp rx=0 tx=0).stop 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 shutdown_connections 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0900a3cb0 0x7fc0900a6170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0a8108490 0x7fc0a81a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0a8105b60 0x7fc0a819b1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 --2- 172.21.15.82:0/3233508716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8103230 0x7fc0a819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 >> 172.21.15.82:0/3233508716 conn(0x7fc0a80fcc20 msgr2=0x7fc0a8102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 shutdown_connections 2024-04-26T20:24:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:18.717+0000 7fc0ae000640 1 -- 172.21.15.82:0/3233508716 wait complete. 2024-04-26T20:24:20.070 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:19 smithi082 ceph-mon[28105]: pgmap v457: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 341 B/s wr, 12 op/s 2024-04-26T20:24:20.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:19 smithi139 ceph-mon[32999]: pgmap v457: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 341 B/s wr, 12 op/s 2024-04-26T20:24:20.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:19 smithi135 ceph-mon[32816]: pgmap v457: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 341 B/s wr, 12 op/s 2024-04-26T20:24:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:21 smithi139 ceph-mon[32999]: pgmap v458: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:24:22.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:21 smithi135 ceph-mon[32816]: pgmap v458: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:24:22.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:21 smithi082 ceph-mon[28105]: pgmap v458: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:24:24.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:23 smithi139 ceph-mon[32999]: pgmap v459: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T20:24:24.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:23 smithi135 ceph-mon[32816]: pgmap v459: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T20:24:24.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:23 smithi082 ceph-mon[28105]: pgmap v459: 129 pgs: 129 active+clean; 666 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T20:24:26.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:25 smithi139 ceph-mon[32999]: pgmap v460: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:26.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:25 smithi135 ceph-mon[32816]: pgmap v460: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:25 smithi082 ceph-mon[28105]: pgmap v460: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-26T20:24:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:27 smithi139 ceph-mon[32999]: pgmap v461: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:24:28.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:27 smithi135 ceph-mon[32816]: pgmap v461: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:24:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:27 smithi082 ceph-mon[28105]: pgmap v461: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:24:28.986 INFO:tasks.workunit.client.0.smithi082.stderr:Updating files: 62% (7612/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T20:24:29.522 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T20:24:29.526 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.526 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T20:24:29.526 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T20:24:29.526 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T20:24:29.526 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:29.527 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T20:24:29.537 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T20:24:29.591 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T20:24:29.598 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T20:24:29.598 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T20:24:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:29 smithi139 ceph-mon[32999]: pgmap v462: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:29 smithi135 ceph-mon[32816]: pgmap v462: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:29 smithi082 ceph-mon[28105]: pgmap v462: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-26T20:24:30.472 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T20:24:30.581 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T20:24:30.664 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T20:24:30.670 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T20:24:30.670 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T20:24:30.750 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T20:24:30.760 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:24:30.761 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T20:24:30.811 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-04-26T20:24:30.812 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-04-26T20:24:30.812 DEBUG:teuthology.orchestra.run.smithi082:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-04-26T20:24:30.881 INFO:tasks.workunit.client.0.smithi082.stdout:getting blogbench 2024-04-26T20:24:30.882 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'getting blogbench' 2024-04-26T20:24:30.882 INFO:tasks.workunit.client.0.smithi082.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-04-26T20:24:30.919 INFO:tasks.workunit.client.0.smithi082.stderr:--2024-04-26 20:24:30-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-04-26T20:24:30.920 INFO:tasks.workunit.client.0.smithi082.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-26T20:24:30.962 INFO:tasks.workunit.client.0.smithi082.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-26T20:24:31.026 INFO:tasks.workunit.client.0.smithi082.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-26T20:24:31.026 INFO:tasks.workunit.client.0.smithi082.stderr:Length: 103355 (101K) [application/octet-stream] 2024-04-26T20:24:31.030 INFO:tasks.workunit.client.0.smithi082.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-04-26T20:24:31.041 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:31.146 INFO:tasks.workunit.client.0.smithi082.stderr: 0K .......... .......... .......... .......... .......... 49% 439K 0s 2024-04-26T20:24:31.203 INFO:tasks.workunit.client.0.smithi082.stderr: 50K .......... .......... .......... .......... .......... 99% 860K 0s 2024-04-26T20:24:31.203 INFO:tasks.workunit.client.0.smithi082.stderr: 100K 100% 1.74T=0.2s 2024-04-26T20:24:31.204 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:31.204 INFO:tasks.workunit.client.0.smithi082.stderr:2024-04-26 20:24:31 (587 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-04-26T20:24:31.204 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-26T20:24:31.206 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-04-26T20:24:31.246 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/ 2024-04-26T20:24:31.247 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/m4/ 2024-04-26T20:24:31.248 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-04-26T20:24:31.250 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/ 2024-04-26T20:24:31.252 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/blogbench.8 2024-04-26T20:24:31.253 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/Makefile.am 2024-04-26T20:24:31.255 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/Makefile.in 2024-04-26T20:24:31.257 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/ 2024-04-26T20:24:31.258 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/mysnprintf.c 2024-04-26T20:24:31.260 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/mysnprintf.h 2024-04-26T20:24:31.261 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/blogbench.c 2024-04-26T20:24:31.263 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/blogbench.h 2024-04-26T20:24:31.265 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/fakesnprintf.c 2024-04-26T20:24:31.266 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/fakesnprintf.h 2024-04-26T20:24:31.268 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/blogbench_p.h 2024-04-26T20:24:31.269 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-04-26T20:24:31.271 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-04-26T20:24:31.273 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/Makefile.am 2024-04-26T20:24:31.275 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/Makefile.in 2024-04-26T20:24:31.276 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/process.c 2024-04-26T20:24:31.278 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/globals.h 2024-04-26T20:24:31.280 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/commenter.c 2024-04-26T20:24:31.281 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/rewriter.c 2024-04-26T20:24:31.283 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/reader.c 2024-04-26T20:24:31.285 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/writer.c 2024-04-26T20:24:31.286 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/helpers.c 2024-04-26T20:24:31.288 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/NEWS 2024-04-26T20:24:31.290 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/compile 2024-04-26T20:24:31.291 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/depcomp 2024-04-26T20:24:31.293 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/aclocal.m4 2024-04-26T20:24:31.295 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/README 2024-04-26T20:24:31.297 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/configure 2024-04-26T20:24:31.306 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/configure.ac 2024-04-26T20:24:31.307 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/config.guess 2024-04-26T20:24:31.309 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/install-sh 2024-04-26T20:24:31.311 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/config.sub 2024-04-26T20:24:31.313 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/missing 2024-04-26T20:24:31.314 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/mkinstalldirs 2024-04-26T20:24:31.316 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/Makefile.am 2024-04-26T20:24:31.317 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/Makefile.in 2024-04-26T20:24:31.319 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/config.h.in 2024-04-26T20:24:31.321 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/AUTHORS 2024-04-26T20:24:31.322 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/INSTALL 2024-04-26T20:24:31.324 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/ChangeLog 2024-04-26T20:24:31.326 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/COPYING 2024-04-26T20:24:31.329 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd blogbench-1.0/ 2024-04-26T20:24:31.329 INFO:tasks.workunit.client.0.smithi082.stdout:making blogbench 2024-04-26T20:24:31.330 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'making blogbench' 2024-04-26T20:24:31.330 INFO:tasks.workunit.client.0.smithi082.stderr:+ ./configure 2024-04-26T20:24:31.618 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-26T20:24:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.863+0000 7f5604e00640 1 -- 172.21.15.82:0/1120709313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010ab70 msgr2=0x7f5600111400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.863+0000 7f5604e00640 1 --2- 172.21.15.82:0/1120709313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010ab70 0x7f5600111400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009ca0 tx=0x7f55f802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 -- 172.21.15.82:0/1120709313 shutdown_connections 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 --2- 172.21.15.82:0/1120709313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010ab70 0x7f5600111400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 --2- 172.21.15.82:0/1120709313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560010a1b0 0x7f560010a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 --2- 172.21.15.82:0/1120709313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5600108fc0 0x7f56001093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 -- 172.21.15.82:0/1120709313 >> 172.21.15.82:0/1120709313 conn(0x7f5600077f80 msgr2=0x7f560007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 -- 172.21.15.82:0/1120709313 shutdown_connections 2024-04-26T20:24:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.864+0000 7f5604e00640 1 -- 172.21.15.82:0/1120709313 wait complete. 2024-04-26T20:24:31.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.865+0000 7f5604e00640 1 Processor -- start 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.865+0000 7f5604e00640 1 -- start start 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.865+0000 7f5604e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5600108fc0 0x7f560019f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f5604e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 0x7f560019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f5604e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560010ab70 0x7f56001a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f5604e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5600114b50 con 0x7f5600108fc0 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f5604e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56001149d0 con 0x7f560010a1b0 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f5604e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5600114cd0 con 0x7f560010ab70 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 0x7f560019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55fde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5600108fc0 0x7f560019f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 0x7f560019f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60004/0 (socket says 172.21.15.82:60004) 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 -- 172.21.15.82:0/1676613551 learned_addr learned my addr 172.21.15.82:0/1676613551 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55fe800640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560010ab70 0x7f56001a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 -- 172.21.15.82:0/1676613551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560010ab70 msgr2=0x7f56001a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560010ab70 0x7f56001a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 -- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5600108fc0 msgr2=0x7f560019f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5600108fc0 0x7f560019f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 -- 172.21.15.82:0/1676613551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56001a6d00 con 0x7f560010a1b0 2024-04-26T20:24:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.866+0000 7f55f7e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 0x7f560019f620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e9f0 tx=0x7f55e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.867+0000 7f55f6a00640 1 -- 172.21.15.82:0/1676613551 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e800cd80 con 0x7f560010a1b0 2024-04-26T20:24:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.867+0000 7f55f6a00640 1 -- 172.21.15.82:0/1676613551 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e80108e0 con 0x7f560010a1b0 2024-04-26T20:24:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.867+0000 7f55f6a00640 1 -- 172.21.15.82:0/1676613551 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8018980 con 0x7f560010a1b0 2024-04-26T20:24:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.867+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56001a6ff0 con 0x7f560010a1b0 2024-04-26T20:24:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.867+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56001a7460 con 0x7f560010a1b0 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.870+0000 7f5607c1a740 1 Processor -- start 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.870+0000 7f5607c1a740 1 -- start start 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f55f6a00640 1 -- 172.21.15.82:0/1676613551 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f55e8010430 con 0x7f560010a1b0 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b770c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b79bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f5607c1a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564256ad6380 con 0x564256b77730 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f5607c1a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564256a72c30 con 0x564256b725c0 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f5607c1a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564256ad2340 con 0x564256b71bd0 2024-04-26T20:24:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f55fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b770c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f55fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b770c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60010/0 (socket says 172.21.15.82:60010) 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f55fde00640 1 -- 172.21.15.82:0/1520840438 learned_addr learned my addr 172.21.15.82:0/1520840438 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f55fe800640 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.871+0000 7f55f7e00640 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b79bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55fde00640 1 -- 172.21.15.82:0/1520840438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 msgr2=0x564256b71ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55fde00640 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b71ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55fde00640 1 -- 172.21.15.82:0/1520840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 msgr2=0x564256b79bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55fde00640 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b79bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55fde00640 1 -- 172.21.15.82:0/1520840438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564256a94940 con 0x564256b725c0 2024-04-26T20:24:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55fde00640 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b770c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009ca0 tx=0x7f55f0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2400138e74ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55ef400640 1 -- 172.21.15.82:0/1520840438 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0004220 con 0x564256b725c0 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55ef400640 1 -- 172.21.15.82:0/1520840438 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f00043c0 con 0x564256b725c0 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55ef400640 1 -- 172.21.15.82:0/1520840438 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00197a0 con 0x564256b725c0 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.872+0000 7f55f6a00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f55e00a3d70 0x7f55e00a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f55f6a00640 1 -- 172.21.15.82:0/1676613551 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f55e80d0c00 con 0x7f560010a1b0 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f55fe800640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f55e00a3d70 0x7f55e00a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 -- 172.21.15.82:0/1520840438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 msgr2=0x564256b770c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b770c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009ca0 tx=0x7f55f0011810 comp rx=0 tx=0).stop 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 -- 172.21.15.82:0/1520840438 shutdown_connections 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b79bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b770c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 --2- 172.21.15.82:0/1520840438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b71ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 -- 172.21.15.82:0/1520840438 >> 172.21.15.82:0/1520840438 conn(0x564256b6d240 msgr2=0x564256b6d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 -- 172.21.15.82:0/1520840438 shutdown_connections 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f5607c1a740 1 -- 172.21.15.82:0/1520840438 wait complete. 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.873+0000 7f55fe800640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f55e00a3d70 0x7f55e00a6230 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f55f8031b50 tx=0x7f55f8005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.874+0000 7f5607c1a740 1 -- start start 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.874+0000 7f5607c1a740 1 Processor -- start 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.874+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b7bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.874+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 0x564256b7c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.874+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b77730 0x564256b83340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f5607c1a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564256b7a6e0 con 0x564256b725c0 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f5607c1a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564256a5dc60 con 0x564256b77730 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f5607c1a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564256b7a860 con 0x564256b71bd0 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f5607c1a740 10 client.0 _ll_register_callbacks cb 0x564256a89e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 0x564256b7c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 0x564256b7c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40934/0 (socket says 172.21.15.82:40934) 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fde00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b7bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55f7e00640 1 -- 172.21.15.82:0/3497377963 learned_addr learned my addr 172.21.15.82:0/3497377963 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fe800640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b77730 0x564256b83340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fde00640 1 -- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b77730 msgr2=0x564256b83340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fde00640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b77730 0x564256b83340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fde00640 1 -- 172.21.15.82:0/3497377963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 msgr2=0x564256b7c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fde00640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 0x564256b7c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55fde00640 1 -- 172.21.15.82:0/3497377963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564256a6c510 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.875+0000 7f55f7e00640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 0x564256b7c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f55fde00640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b7bdc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x564256b6e1b0 tx=0x7f55f00050c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf30846d17d076f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f55e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f55e7e00640 1 -- 172.21.15.82:0/3497377963 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0028070 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55f00043c0 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f55e7e00640 1 -- 172.21.15.82:0/3497377963 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f55f00054c0 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f55e7e00640 1 -- 172.21.15.82:0/3497377963 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55f0034050 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f5607c1a740 10 client.26035 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.876+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5642567e8210 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f55e7e00640 1 -- 172.21.15.82:0/3497377963 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f00043c0 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f55e7e00640 1 -- 172.21.15.82:0/3497377963 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f55f0004b30 con 0x564256b71bd0 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f5607c1a740 10 client.26035 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:31.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f5607c1a740 10 client.26035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f5607c1a740 20 client.26035 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f5607c1a740 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256b87670 0x564256b89a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f5607c1a740 4 client.26035 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564256ae3f90 con 0x564256b87670 2024-04-26T20:24:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.877+0000 7f55f7e00640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256b87670 0x564256b89a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.878+0000 7f55f7e00640 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256b87670 0x564256b89a60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a4510498f6663a server_cookie=40c0a9c14e901dce in_seq=0 out_seq=0 2024-04-26T20:24:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.878+0000 7f55e7e00640 10 client.26035 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f55e7e00640 1 -- 172.21.15.82:0/3497377963 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564256ae3f90 con 0x564256b87670 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f55e7e00640 10 client.26035 handle_command_reply: tid=0 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 client.26035 shutdown 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 msgr2=0x564256b7bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b7bdc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x564256b6e1b0 tx=0x7f55f00050c0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 shutdown_connections 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256b87670 0x564256b89a60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b77730 0x564256b83340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f55e7e00640 0 client.26035 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b725c0 0x564256b7c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 --2- 172.21.15.82:0/3497377963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b71bd0 0x564256b7bdc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 >> 172.21.15.82:0/3497377963 conn(0x564256b6d240 msgr2=0x564256b6c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 shutdown_connections 2024-04-26T20:24:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 1 -- 172.21.15.82:0/3497377963 wait complete. 2024-04-26T20:24:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.879+0000 7f5607c1a740 20 client.26035 trim_cache size 0 max 16384 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 Processor -- start 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 -- start start 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b71bd0 0x564256b70a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b725c0 0x564256b83300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b6c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56001b19c0 con 0x564256b77730 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.895+0000 7f5607c1a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56001b3500 con 0x564256b71bd0 2024-04-26T20:24:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f5607c1a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56001b2090 con 0x564256b725c0 2024-04-26T20:24:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b6c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b6c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40950/0 (socket says 172.21.15.82:40950) 2024-04-26T20:24:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 -- 172.21.15.82:0/583196182 learned_addr learned my addr 172.21.15.82:0/583196182 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55f7e00640 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b725c0 0x564256b83300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fde00640 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b71bd0 0x564256b70a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 -- 172.21.15.82:0/583196182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b725c0 msgr2=0x564256b83300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b725c0 0x564256b83300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 -- 172.21.15.82:0/583196182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b71bd0 msgr2=0x564256b70a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b71bd0 0x564256b70a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.896+0000 7f55fe800640 1 -- 172.21.15.82:0/583196182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564256b89dd0 con 0x564256b77730 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.897+0000 7f55fe800640 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b6c2c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009ca0 tx=0x7f55f8041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9758202bdbef1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.897+0000 7f55eea00640 1 -- 172.21.15.82:0/583196182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8003970 con 0x564256b77730 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.897+0000 7f55eea00640 1 -- 172.21.15.82:0/583196182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f8036040 con 0x564256b77730 2024-04-26T20:24:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.897+0000 7f55eea00640 1 -- 172.21.15.82:0/583196182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8004830 con 0x564256b77730 2024-04-26T20:24:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 -- 172.21.15.82:0/583196182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 msgr2=0x564256b6c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b6c2c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009ca0 tx=0x7f55f8041000 comp rx=0 tx=0).stop 2024-04-26T20:24:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 -- 172.21.15.82:0/583196182 shutdown_connections 2024-04-26T20:24:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b77730 0x564256b6c2c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b725c0 0x564256b83300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 --2- 172.21.15.82:0/583196182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b71bd0 0x564256b70a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 -- 172.21.15.82:0/583196182 >> 172.21.15.82:0/583196182 conn(0x564256b6d240 msgr2=0x564256b6bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 -- 172.21.15.82:0/583196182 shutdown_connections 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 -- 172.21.15.82:0/583196182 wait complete. 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 -- start start 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.898+0000 7f5607c1a740 1 Processor -- start 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 0x564256b80570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b80ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b77730 0x564256b81a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56001b2e30 con 0x564256b71bd0 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56001b2760 con 0x564256b725c0 2024-04-26T20:24:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56001af9a0 con 0x564256b77730 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f5607c1a740 10 client.0 _ll_register_callbacks cb 0x7f55e8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f55fde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 0x564256b80570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f55fe800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b77730 0x564256b81a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f55fde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 0x564256b80570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40964/0 (socket says 172.21.15.82:40964) 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f55fde00640 1 -- 172.21.15.82:0/2582510875 learned_addr learned my addr 172.21.15.82:0/2582510875 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.899+0000 7f55f7e00640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b80ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fde00640 1 -- 172.21.15.82:0/2582510875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b77730 msgr2=0x564256b81a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fde00640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b77730 0x564256b81a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fde00640 1 -- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 msgr2=0x564256b80ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fde00640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b80ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fde00640 1 -- 172.21.15.82:0/2582510875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642568b4620 con 0x564256b71bd0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fe800640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b77730 0x564256b81a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55fde00640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 0x564256b80570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f55f00058c0 tx=0x7f55f0005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8665014008d871e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55e7e00640 1 -- 172.21.15.82:0/2582510875 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0028050 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f55e7e00640 1 -- 172.21.15.82:0/2582510875 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f55f0004a40 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.900+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55f8036040 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f55e7e00640 1 -- 172.21.15.82:0/2582510875 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55f0046050 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 10 client.15912 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564256a90cb0 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f55e7e00640 1 -- 172.21.15.82:0/2582510875 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f8036040 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f55e7e00640 1 -- 172.21.15.82:0/2582510875 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f55f0003aa0 con 0x564256b71bd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 10 client.15912 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 20 client.15912 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256bedbd0 0x564256befff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 4 client.15912 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.901+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564256adde00 con 0x564256bedbd0 2024-04-26T20:24:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.902+0000 7f55f7e00640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256bedbd0 0x564256befff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:31.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.902+0000 7f55f7e00640 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256bedbd0 0x564256befff0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151a950233efb186 server_cookie=26943e4582b83b76 in_seq=0 out_seq=0 2024-04-26T20:24:31.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.902+0000 7f55e7e00640 10 client.15912 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.940+0000 7f55e7e00640 1 -- 172.21.15.82:0/2582510875 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564256adde00 con 0x564256bedbd0 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.940+0000 7f55e7e00640 10 client.15912 handle_command_reply: tid=0 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.940+0000 7f5607c1a740 1 client.15912 shutdown 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.940+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 msgr2=0x564256b80570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.940+0000 7f5607c1a740 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 0x564256b80570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f55f00058c0 tx=0x7f55f0005770 comp rx=0 tx=0).stop 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 shutdown_connections 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564256bedbd0 0x564256befff0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564256b77730 0x564256b81a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564256b725c0 0x564256b80ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f55e7e00640 0 client.15912 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 --2- 172.21.15.82:0/2582510875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564256b71bd0 0x564256b80570 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 >> 172.21.15.82:0/2582510875 conn(0x564256b6d240 msgr2=0x564256b6c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 shutdown_connections 2024-04-26T20:24:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 1 -- 172.21.15.82:0/2582510875 wait complete. 2024-04-26T20:24:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5607c1a740 20 client.15912 trim_cache size 0 max 16384 2024-04-26T20:24:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:24:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:24:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:24:31.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.941+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f55e00a3d70 msgr2=0x7f55e00a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f55e00a3d70 0x7f55e00a6230 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f55f8031b50 tx=0x7f55f8005d80 comp rx=0 tx=0).stop 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 msgr2=0x7f560019f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 0x7f560019f620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e9f0 tx=0x7f55e800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 shutdown_connections 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f55e00a3d70 0x7f55e00a6230 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560010ab70 0x7f56001a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f560010a1b0 0x7f560019f620 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 --2- 172.21.15.82:0/1676613551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5600108fc0 0x7f560019f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 >> 172.21.15.82:0/1676613551 conn(0x7f5600077f80 msgr2=0x7f560010d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 shutdown_connections 2024-04-26T20:24:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:31.942+0000 7f5604e00640 1 -- 172.21.15.82:0/1676613551 wait complete. 2024-04-26T20:24:32.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:31 smithi139 ceph-mon[32999]: pgmap v463: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:24:32.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:31 smithi135 ceph-mon[32816]: pgmap v463: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:24:32.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:31 smithi082 ceph-mon[28105]: pgmap v463: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-26T20:24:32.637 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether build environment is sane... yes 2024-04-26T20:24:32.665 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gawk... gawk 2024-04-26T20:24:32.702 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether make sets $(MAKE)... yes 2024-04-26T20:24:32.729 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc... gcc 2024-04-26T20:24:32.847 INFO:tasks.workunit.client.0.smithi082.stdout:checking for C compiler default output file name... a.out 2024-04-26T20:24:32.853 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether the C compiler works... yes 2024-04-26T20:24:32.857 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are cross compiling... no 2024-04-26T20:24:32.938 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of executables... 2024-04-26T20:24:33.022 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of object files... o 2024-04-26T20:24:33.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:32 smithi139 ceph-mon[32999]: pgmap v464: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-26T20:24:33.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:32 smithi135 ceph-mon[32816]: pgmap v464: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-26T20:24:33.119 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are using the GNU C compiler... yes 2024-04-26T20:24:33.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:32 smithi082 ceph-mon[28105]: pgmap v464: 129 pgs: 129 active+clean; 667 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-26T20:24:33.218 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc accepts -g... yes 2024-04-26T20:24:33.392 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc option to accept ANSI C... none needed 2024-04-26T20:24:33.490 INFO:tasks.workunit.client.0.smithi082.stdout:checking for style of include used by make... GNU 2024-04-26T20:24:33.698 INFO:tasks.workunit.client.0.smithi082.stdout:checking dependency style of gcc... gcc3 2024-04-26T20:24:33.698 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-26T20:24:33.865 INFO:tasks.workunit.client.0.smithi082.stdout:checking how to run the C preprocessor... gcc -E 2024-04-26T20:24:33.974 INFO:tasks.workunit.client.0.smithi082.stdout:checking for egrep... grep -E 2024-04-26T20:24:34.002 INFO:tasks.workunit.client.0.smithi082.stdout:checking for AIX... no 2024-04-26T20:24:34.143 INFO:tasks.workunit.client.0.smithi082.stdout:checking for library containing strerror... none required 2024-04-26T20:24:34.490 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ANSI C header files... yes 2024-04-26T20:24:34.589 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-26T20:24:34.710 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/types.h... yes 2024-04-26T20:24:34.838 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/stat.h... yes 2024-04-26T20:24:34.961 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdlib.h... yes 2024-04-26T20:24:35.091 INFO:tasks.workunit.client.0.smithi082.stdout:checking for string.h... yes 2024-04-26T20:24:35.231 INFO:tasks.workunit.client.0.smithi082.stdout:checking for memory.h... yes 2024-04-26T20:24:35.365 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strings.h... yes 2024-04-26T20:24:35.496 INFO:tasks.workunit.client.0.smithi082.stdout:checking for inttypes.h... yes 2024-04-26T20:24:35.627 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdint.h... yes 2024-04-26T20:24:35.763 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... yes 2024-04-26T20:24:35.792 INFO:tasks.workunit.client.0.smithi082.stdout:checking for memory.h... (cached) yes 2024-04-26T20:24:35.810 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strings.h... (cached) yes 2024-04-26T20:24:35.830 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... (cached) yes 2024-04-26T20:24:35.963 INFO:tasks.workunit.client.0.smithi082.stdout:checking locale.h usability... yes 2024-04-26T20:24:36.020 INFO:tasks.workunit.client.0.smithi082.stdout:checking locale.h presence... yes 2024-04-26T20:24:36.025 INFO:tasks.workunit.client.0.smithi082.stdout:checking for locale.h... yes 2024-04-26T20:24:36.059 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdlib.h... (cached) yes 2024-04-26T20:24:36.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:35 smithi139 ceph-mon[32999]: pgmap v465: 129 pgs: 129 active+clean; 868 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-04-26T20:24:36.080 INFO:tasks.workunit.client.0.smithi082.stdout:checking for string.h... (cached) yes 2024-04-26T20:24:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:35 smithi135 ceph-mon[32816]: pgmap v465: 129 pgs: 129 active+clean; 868 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-04-26T20:24:36.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:35 smithi082 ceph-mon[28105]: pgmap v465: 129 pgs: 129 active+clean; 868 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-04-26T20:24:36.222 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/socket.h usability... yes 2024-04-26T20:24:36.279 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/socket.h presence... yes 2024-04-26T20:24:36.282 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/socket.h... yes 2024-04-26T20:24:36.416 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h usability... yes 2024-04-26T20:24:36.457 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h presence... yes 2024-04-26T20:24:36.460 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/time.h... yes 2024-04-26T20:24:36.593 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h usability... yes 2024-04-26T20:24:36.649 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h presence... yes 2024-04-26T20:24:36.652 INFO:tasks.workunit.client.0.smithi082.stdout:checking for fcntl.h... yes 2024-04-26T20:24:36.792 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/fcntl.h usability... yes 2024-04-26T20:24:36.845 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/fcntl.h presence... yes 2024-04-26T20:24:36.848 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/fcntl.h... yes 2024-04-26T20:24:37.033 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/param.h usability... yes 2024-04-26T20:24:37.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:24:37.039 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:24:37.089 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/param.h presence... yes 2024-04-26T20:24:37.092 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/param.h... yes 2024-04-26T20:24:37.188 INFO:tasks.workunit.client.0.smithi082.stdout:checking ioctl.h usability... no 2024-04-26T20:24:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 -- 172.21.15.82:0/3199543826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 msgr2=0x7fd05810adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 --2- 172.21.15.82:0/3199543826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 0x7fd05810adc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ca0 tx=0x7fd05002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 -- 172.21.15.82:0/3199543826 shutdown_connections 2024-04-26T20:24:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 --2- 172.21.15.82:0/3199543826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 0x7fd05810adc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 --2- 172.21.15.82:0/3199543826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd058103b70 0x7fd058103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 --2- 172.21.15.82:0/3199543826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058102980 0x7fd058102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 -- 172.21.15.82:0/3199543826 >> 172.21.15.82:0/3199543826 conn(0x7fd0580fdf10 msgr2=0x7fd058100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 -- 172.21.15.82:0/3199543826 shutdown_connections 2024-04-26T20:24:37.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.238+0000 7fd05ca00640 1 -- 172.21.15.82:0/3199543826 wait complete. 2024-04-26T20:24:37.241 INFO:tasks.workunit.client.0.smithi082.stdout:checking ioctl.h presence... no 2024-04-26T20:24:37.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 Processor -- start 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 -- start start 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd058102980 0x7fd05819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 0x7fd05819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 0x7fd0581a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd05810e4b0 con 0x7fd058102980 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd05810e330 con 0x7fd058103b70 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.240+0000 7fd05ca00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd05810e630 con 0x7fd058104530 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 0x7fd05819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 0x7fd05819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60076/0 (socket says 172.21.15.82:60076) 2024-04-26T20:24:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 -- 172.21.15.82:0/547701454 learned_addr learned my addr 172.21.15.82:0/547701454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd055e00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd058102980 0x7fd05819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd056800640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 0x7fd0581a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 -- 172.21.15.82:0/547701454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 msgr2=0x7fd0581a2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 0x7fd0581a2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 -- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd058102980 msgr2=0x7fd05819adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd058102980 0x7fd05819adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 -- 172.21.15.82:0/547701454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0581a29c0 con 0x7fd058103b70 2024-04-26T20:24:37.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.241+0000 7fd04d400640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 0x7fd05819b2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd04000ea60 tx=0x7fd04000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.244 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ioctl.h... no 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.242+0000 7fd04f400640 1 -- 172.21.15.82:0/547701454 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04000cde0 con 0x7fd058103b70 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.242+0000 7fd04f400640 1 -- 172.21.15.82:0/547701454 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0400035f0 con 0x7fd058103b70 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.242+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581a2cb0 con 0x7fd058103b70 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.242+0000 7fd04f400640 1 -- 172.21.15.82:0/547701454 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040010690 con 0x7fd058103b70 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.242+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581a31b0 con 0x7fd058103b70 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.245+0000 7fd04f400640 1 -- 172.21.15.82:0/547701454 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd0400037a0 con 0x7fd058103b70 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.245+0000 7fd05f7ff740 1 Processor -- start 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.245+0000 7fd05f7ff740 1 -- start start 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 0x55b95522cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522d180 0x55b955231c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955234780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b95513d030 con 0x55b95522c790 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b9551587f0 con 0x55b9552322f0 2024-04-26T20:24:37.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b9551137e0 con 0x55b95522d180 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd04d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955234780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd056800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 0x55b95522cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd055e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522d180 0x55b955231c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd056800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 0x55b95522cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40978/0 (socket says 172.21.15.82:40978) 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd04d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955234780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60078/0 (socket says 172.21.15.82:60078) 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd04d400640 1 -- 172.21.15.82:0/2903714265 learned_addr learned my addr 172.21.15.82:0/2903714265 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.246+0000 7fd055e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522d180 0x55b955231c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48514/0 (socket says 172.21.15.82:48514) 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd056800640 1 -- 172.21.15.82:0/2903714265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522d180 msgr2=0x55b955231c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd056800640 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522d180 0x55b955231c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd056800640 1 -- 172.21.15.82:0/2903714265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 msgr2=0x55b955234780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd056800640 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955234780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd056800640 1 -- 172.21.15.82:0/2903714265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95511f050 con 0x55b95522c790 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd04d400640 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955234780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd04f400640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd03c0a3c40 0x7fd03c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd056800640 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 0x55b95522cbb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd050006010 tx=0x7fd050009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb2cd92dee30d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd04f400640 1 -- 172.21.15.82:0/547701454 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd0400d0ce0 con 0x7fd058103b70 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd055e00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd03c0a3c40 0x7fd03c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd047000640 1 -- 172.21.15.82:0/2903714265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050031450 con 0x55b95522c790 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd047000640 1 -- 172.21.15.82:0/2903714265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd050036040 con 0x55b95522c790 2024-04-26T20:24:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.247+0000 7fd047000640 1 -- 172.21.15.82:0/2903714265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050004510 con 0x55b95522c790 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 -- 172.21.15.82:0/2903714265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 msgr2=0x55b95522cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd055e00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd03c0a3c40 0x7fd03c0a6100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55b95522d580 tx=0x7fd048005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 0x55b95522cbb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd050006010 tx=0x7fd050009360 comp rx=0 tx=0).stop 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 -- 172.21.15.82:0/2903714265 shutdown_connections 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955234780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522d180 0x55b955231c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/2903714265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522c790 0x55b95522cbb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 -- 172.21.15.82:0/2903714265 >> 172.21.15.82:0/2903714265 conn(0x55b955227db0 msgr2=0x55b9552281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.248+0000 7fd05f7ff740 1 -- 172.21.15.82:0/2903714265 shutdown_connections 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.249+0000 7fd05f7ff740 1 -- 172.21.15.82:0/2903714265 wait complete. 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.249+0000 7fd05f7ff740 1 -- start start 2024-04-26T20:24:37.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.249+0000 7fd05f7ff740 1 Processor -- start 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522c790 0x55b955236580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b955236ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9552322f0 0x55b95523db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b955195200 con 0x55b95522d180 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b95518fee0 con 0x55b95522c790 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b95519ce70 con 0x55b9552322f0 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd05f7ff740 10 client.0 _ll_register_callbacks cb 0x55b955186270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b955236ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b955236ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40992/0 (socket says 172.21.15.82:40992) 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 -- 172.21.15.82:0/1027360136 learned_addr learned my addr 172.21.15.82:0/1027360136 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd056800640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9552322f0 0x55b95523db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd055e00640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522c790 0x55b955236580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 -- 172.21.15.82:0/1027360136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9552322f0 msgr2=0x55b95523db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9552322f0 0x55b95523db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 -- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522c790 msgr2=0x55b955236580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522c790 0x55b955236580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.250+0000 7fd04d400640 1 -- 172.21.15.82:0/1027360136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b954f6c7d0 con 0x55b95522d180 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd04d400640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b955236ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd04009ca70 tx=0x7fd040003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3b8187d07dc2a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd03b400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd03b400640 1 -- 172.21.15.82:0/1027360136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04009c620 con 0x55b95522d180 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd03b400640 1 -- 172.21.15.82:0/1027360136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd0400ce560 con 0x55b95522d180 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd050036040 con 0x55b95522d180 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd03b400640 1 -- 172.21.15.82:0/1027360136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd04009ac20 con 0x55b95522d180 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd05f7ff740 10 client.15924 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b954ea23f0 con 0x55b95522d180 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.251+0000 7fd03b400640 1 -- 172.21.15.82:0/1027360136 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd050036040 con 0x55b95522d180 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd03b400640 1 -- 172.21.15.82:0/1027360136 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd0400990c0 con 0x55b95522d180 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd05f7ff740 10 client.15924 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd05f7ff740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd05f7ff740 20 client.15924 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b955242010 0x55b955244440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd05f7ff740 4 client.15924 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b95519e7e0 con 0x55b955242010 2024-04-26T20:24:37.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.252+0000 7fd055e00640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b955242010 0x55b955244440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.253+0000 7fd055e00640 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b955242010 0x55b955244440 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9e5949a176b8492 server_cookie=9f0c327c375ebc2d in_seq=0 out_seq=0 2024-04-26T20:24:37.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.253+0000 7fd03b400640 10 client.15924 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:37.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd03b400640 1 -- 172.21.15.82:0/1027360136 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b95519e7e0 con 0x55b955242010 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd03b400640 10 client.15924 handle_command_reply: tid=0 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 client.15924 shutdown 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 msgr2=0x55b955236ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b955236ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd04009ca70 tx=0x7fd040003cf0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 shutdown_connections 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b955242010 0x55b955244440 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b9552322f0 0x55b95523db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b955236ac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd03b400640 0 client.15924 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/1027360136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522c790 0x55b955236580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 >> 172.21.15.82:0/1027360136 conn(0x55b955227db0 msgr2=0x55b955227040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 shutdown_connections 2024-04-26T20:24:37.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.254+0000 7fd05f7ff740 1 -- 172.21.15.82:0/1027360136 wait complete. 2024-04-26T20:24:37.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.255+0000 7fd05f7ff740 20 client.15924 trim_cache size 0 max 16384 2024-04-26T20:24:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 Processor -- start 2024-04-26T20:24:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 -- start start 2024-04-26T20:24:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b955222e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b95523dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955226ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581af250 con 0x55b95522d180 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581adde0 con 0x55b9552322f0 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581ae4b0 con 0x55b95522c790 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd04d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b95523dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd056800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955226ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd055e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b955222e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955226ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60090/0 (socket says 172.21.15.82:60090) 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 -- 172.21.15.82:0/560395766 learned_addr learned my addr 172.21.15.82:0/560395766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.274+0000 7fd04d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b95523dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41002/0 (socket says 172.21.15.82:41002) 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 -- 172.21.15.82:0/560395766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 msgr2=0x55b955222e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b955222e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 -- 172.21.15.82:0/560395766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 msgr2=0x55b95523dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b95523dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 -- 172.21.15.82:0/560395766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b954e620f0 con 0x55b9552322f0 2024-04-26T20:24:37.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd055e00640 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b955222e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:37.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd056800640 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955226ec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ca0 tx=0x7fd050009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7859b2c7b06bc982 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.275+0000 7fd046600640 1 -- 172.21.15.82:0/560395766 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050053070 con 0x55b9552322f0 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.276+0000 7fd046600640 1 -- 172.21.15.82:0/560395766 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd050036030 con 0x55b9552322f0 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.276+0000 7fd046600640 1 -- 172.21.15.82:0/560395766 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0500042b0 con 0x55b9552322f0 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 -- 172.21.15.82:0/560395766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 msgr2=0x55b955226ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955226ec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ca0 tx=0x7fd050009540 comp rx=0 tx=0).stop 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 -- 172.21.15.82:0/560395766 shutdown_connections 2024-04-26T20:24:37.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9552322f0 0x55b955226ec0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b95522d180 0x55b95523dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/560395766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b955222e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 -- 172.21.15.82:0/560395766 >> 172.21.15.82:0/560395766 conn(0x55b955227db0 msgr2=0x55b9552267b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 -- 172.21.15.82:0/560395766 shutdown_connections 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 -- 172.21.15.82:0/560395766 wait complete. 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.277+0000 7fd05f7ff740 1 -- start start 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 Processor -- start 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b95523b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522d180 0x55b95523bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 0x55b95523cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581ab6f0 con 0x55b9552322f0 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581aeb80 con 0x55b95522d180 2024-04-26T20:24:37.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581abd60 con 0x55b95522c790 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.278+0000 7fd05f7ff740 10 client.0 _ll_register_callbacks cb 0x7fd0400d44c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 0x55b95523cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 0x55b95523cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41006/0 (socket says 172.21.15.82:41006) 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 -- 172.21.15.82:0/3324643364 learned_addr learned my addr 172.21.15.82:0/3324643364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd04d400640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522d180 0x55b95523bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd055e00640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b95523b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 -- 172.21.15.82:0/3324643364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 msgr2=0x55b95523b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b95523b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 -- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522d180 msgr2=0x55b95523bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522d180 0x55b95523bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 -- 172.21.15.82:0/3324643364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b955158a30 con 0x55b9552322f0 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd04d400640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522d180 0x55b95523bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:37.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd055e00640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b95523b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd056800640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 0x55b95523cd80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd05002ade0 tx=0x7fd050009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5820a167ac08410f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.279+0000 7fd03b400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd03b400640 1 -- 172.21.15.82:0/3324643364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05005e060 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd050036030 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd03b400640 1 -- 172.21.15.82:0/3324643364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd050003970 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd03b400640 1 -- 172.21.15.82:0/3324643364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd050065050 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd05f7ff740 10 client.15930 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b9552a8a70 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd03b400640 1 -- 172.21.15.82:0/3324643364 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd050036030 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.280+0000 7fd03b400640 1 -- 172.21.15.82:0/3324643364 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd05004d070 con 0x55b9552322f0 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd05f7ff740 10 client.15930 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd05f7ff740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd05f7ff740 20 client.15930 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b9552a9020 0x55b9552ab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd05f7ff740 4 client.15930 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b955198650 con 0x55b9552a9020 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd055e00640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b9552a9020 0x55b9552ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd055e00640 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b9552a9020 0x55b9552ab410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a84e4eb8b97717 server_cookie=14f22e967bd8d224 in_seq=0 out_seq=0 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.281+0000 7fd03b400640 10 client.15930 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd03b400640 1 -- 172.21.15.82:0/3324643364 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b955198650 con 0x55b9552a9020 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd03b400640 10 client.15930 handle_command_reply: tid=0 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 client.15930 shutdown 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 msgr2=0x55b95523cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 0x55b95523cd80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd05002ade0 tx=0x7fd050009360 comp rx=0 tx=0).stop 2024-04-26T20:24:37.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 shutdown_connections 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b9552a9020 0x55b9552ab410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9552322f0 0x55b95523cd80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b95522d180 0x55b95523bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 --2- 172.21.15.82:0/3324643364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b95522c790 0x55b95523b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 >> 172.21.15.82:0/3324643364 conn(0x55b955227db0 msgr2=0x55b95522e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd03b400640 0 client.15930 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 shutdown_connections 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 1 -- 172.21.15.82:0/3324643364 wait complete. 2024-04-26T20:24:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.282+0000 7fd05f7ff740 20 client.15930 trim_cache size 0 max 16384 2024-04-26T20:24:37.289 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:24:37.289 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:24:37.289 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:24:37.289 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:24:37.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd03c0a3c40 msgr2=0x7fd03c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd03c0a3c40 0x7fd03c0a6100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55b95522d580 tx=0x7fd048005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 msgr2=0x7fd05819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 0x7fd05819b2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd04000ea60 tx=0x7fd04000ef20 comp rx=0 tx=0).stop 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 shutdown_connections 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd03c0a3c40 0x7fd03c0a6100 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd058104530 0x7fd0581a2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd058103b70 0x7fd05819b2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 --2- 172.21.15.82:0/547701454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd058102980 0x7fd05819adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 >> 172.21.15.82:0/547701454 conn(0x7fd0580fdf10 msgr2=0x7fd058074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 shutdown_connections 2024-04-26T20:24:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.283+0000 7fd05ca00640 1 -- 172.21.15.82:0/547701454 wait complete. 2024-04-26T20:24:37.301 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:24:37.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:37.343 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/ioctl.h usability... yes 2024-04-26T20:24:37.391 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/ioctl.h presence... yes 2024-04-26T20:24:37.393 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/ioctl.h... yes 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 -- 172.21.15.82:0/96974330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc103410 msgr2=0x7f1dbc105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 --2- 172.21.15.82:0/96974330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc103410 0x7f1dbc105800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009900 tx=0x7f1db002a410 comp rx=0 tx=0).stop 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 -- 172.21.15.82:0/96974330 shutdown_connections 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 --2- 172.21.15.82:0/96974330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc108670 0x7f1dbc10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 --2- 172.21.15.82:0/96974330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc105d40 0x7f1dbc108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 --2- 172.21.15.82:0/96974330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc103410 0x7f1dbc105800 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 -- 172.21.15.82:0/96974330 >> 172.21.15.82:0/96974330 conn(0x7f1dbc0fce20 msgr2=0x7f1dbc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 -- 172.21.15.82:0/96974330 shutdown_connections 2024-04-26T20:24:37.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.488+0000 7f1dc3800640 1 -- 172.21.15.82:0/96974330 wait complete. 2024-04-26T20:24:37.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.489+0000 7f1dc3800640 1 Processor -- start 2024-04-26T20:24:37.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.489+0000 7f1dc3800640 1 -- start start 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc3800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc103410 0x7f1dbc1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc3800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc105d40 0x7f1dbc196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc3800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 0x7f1dbc1a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc3800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc10e530 con 0x7f1dbc108670 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc3800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc10e3b0 con 0x7f1dbc105d40 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc3800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc10e6b0 con 0x7f1dbc103410 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc103410 0x7f1dbc1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 0x7f1dbc1a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc105d40 0x7f1dbc196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 0x7f1dbc1a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41032/0 (socket says 172.21.15.82:41032) 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 -- 172.21.15.82:0/2332748930 learned_addr learned my addr 172.21.15.82:0/2332748930 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:37.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc0e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc103410 0x7f1dbc1969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48558/0 (socket says 172.21.15.82:48558) 2024-04-26T20:24:37.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 -- 172.21.15.82:0/2332748930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc103410 msgr2=0x7f1dbc1969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc103410 0x7f1dbc1969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 -- 172.21.15.82:0/2332748930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc105d40 msgr2=0x7f1dbc196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc105d40 0x7f1dbc196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dc1800640 1 -- 172.21.15.82:0/2332748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc1a6df0 con 0x7f1dbc108670 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.490+0000 7f1dbbe00640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc105d40 0x7f1dbc196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.491+0000 7f1dc1800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 0x7f1dbc1a6860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1db400eb10 tx=0x7f1db400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.491+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4004b20 con 0x7f1dbc108670 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.491+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db4004cc0 con 0x7f1dbc108670 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.491+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc1a70e0 con 0x7f1dbc108670 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.491+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4010670 con 0x7f1dbc108670 2024-04-26T20:24:37.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.491+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc1a7630 con 0x7f1dbc108670 2024-04-26T20:24:37.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.493+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc10a1c0 con 0x7f1dbc108670 2024-04-26T20:24:37.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.495+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1db4005020 con 0x7f1dbc108670 2024-04-26T20:24:37.495 INFO:tasks.workunit.client.0.smithi082.stdout:checking return type of signal handlers... void 2024-04-26T20:24:37.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.496+0000 7f1db9600640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1da40a3c40 0x7f1da40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.496+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1db40d0e70 con 0x7f1dbc108670 2024-04-26T20:24:37.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.496+0000 7f1dc0e00640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1da40a3c40 0x7f1da40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.497+0000 7f1dc0e00640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1da40a3c40 0x7f1da40a6100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1db0031500 tx=0x7f1db0005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.501+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1db409d330 con 0x7f1dbc108670 2024-04-26T20:24:37.584 INFO:tasks.workunit.client.0.smithi082.stdout:checking for size_t... yes 2024-04-26T20:24:37.673 INFO:tasks.workunit.client.0.smithi082.stdout:checking for dev_t... yes 2024-04-26T20:24:37.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.748+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dbc063530 con 0x7f1dbc108670 2024-04-26T20:24:37.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.750+0000 7f1db9600640 1 -- 172.21.15.82:0/2332748930 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11951 (secure 0 0 0) 0x7f1db409cc30 con 0x7f1dbc108670 2024-04-26T20:24:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:24:37.751 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:22:49.242424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24550,24529,24454,24554,24584]},"id":1}]} 2024-04-26T20:24:37.751 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.753+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1da40a3c40 msgr2=0x7f1da40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.753+0000 7f1dc3800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1da40a3c40 0x7f1da40a6100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1db0031500 tx=0x7f1db0005a20 comp rx=0 tx=0).stop 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.753+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 msgr2=0x7f1dbc1a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 0x7f1dbc1a6860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1db400eb10 tx=0x7f1db400c2d0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 shutdown_connections 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1da40a3c40 0x7f1da40a6100 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dbc108670 0x7f1dbc1a6860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc105d40 0x7f1dbc196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 --2- 172.21.15.82:0/2332748930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dbc103410 0x7f1dbc1969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 >> 172.21.15.82:0/2332748930 conn(0x7f1dbc0fce20 msgr2=0x7f1dbc102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 shutdown_connections 2024-04-26T20:24:37.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:37.754+0000 7f1dc3800640 1 -- 172.21.15.82:0/2332748930 wait complete. 2024-04-26T20:24:37.772 INFO:tasks.workunit.client.0.smithi082.stdout:checking for short... yes 2024-04-26T20:24:37.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:24:37.916 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of short... 2 2024-04-26T20:24:38.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 -- 172.21.15.82:0/2457400858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c075390 msgr2=0x7ff76c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 --2- 172.21.15.82:0/2457400858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c075390 0x7ff76c075810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff758009930 tx=0x7ff75802a420 comp rx=0 tx=0).stop 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 -- 172.21.15.82:0/2457400858 shutdown_connections 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 --2- 172.21.15.82:0/2457400858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76c10ee90 0x7ff76c111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 --2- 172.21.15.82:0/2457400858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c075390 0x7ff76c075810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 --2- 172.21.15.82:0/2457400858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff76c076970 0x7ff76c074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 -- 172.21.15.82:0/2457400858 >> 172.21.15.82:0/2457400858 conn(0x7ff76c0fde30 msgr2=0x7ff76c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 -- 172.21.15.82:0/2457400858 shutdown_connections 2024-04-26T20:24:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.008+0000 7ff772600640 1 -- 172.21.15.82:0/2457400858 wait complete. 2024-04-26T20:24:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.009+0000 7ff772600640 1 Processor -- start 2024-04-26T20:24:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.009+0000 7ff772600640 1 -- start start 2024-04-26T20:24:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.009+0000 7ff772600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76c075390 0x7ff76c19f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.009+0000 7ff772600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff76c076970 0x7ff76c19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff772600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 0x7ff76c1a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff772600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1149a0 con 0x7ff76c075390 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff772600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c114820 con 0x7ff76c10ee90 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff772600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c114b20 con 0x7ff76c076970 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 0x7ff76c1a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 0x7ff76c1a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60152/0 (socket says 172.21.15.82:60152) 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 -- 172.21.15.82:0/3779104255 learned_addr learned my addr 172.21.15.82:0/3779104255 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771200640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76c075390 0x7ff76c19f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff76be00640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff76c076970 0x7ff76c19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 -- 172.21.15.82:0/3779104255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff76c076970 msgr2=0x7ff76c19f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff76c076970 0x7ff76c19f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 -- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76c075390 msgr2=0x7ff76c19f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76c075390 0x7ff76c19f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.010+0000 7ff771c00640 1 -- 172.21.15.82:0/3779104255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c1a6cf0 con 0x7ff76c10ee90 2024-04-26T20:24:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.011+0000 7ff771c00640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 0x7ff76c1a6680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff764009fd0 tx=0x7ff76400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.011+0000 7ff769600640 1 -- 172.21.15.82:0/3779104255 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764017070 con 0x7ff76c10ee90 2024-04-26T20:24:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.011+0000 7ff769600640 1 -- 172.21.15.82:0/3779104255 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff764003e20 con 0x7ff76c10ee90 2024-04-26T20:24:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.011+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c1a6fe0 con 0x7ff76c10ee90 2024-04-26T20:24:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.011+0000 7ff769600640 1 -- 172.21.15.82:0/3779104255 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764010460 con 0x7ff76c10ee90 2024-04-26T20:24:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.011+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c1a7450 con 0x7ff76c10ee90 2024-04-26T20:24:38.014 INFO:tasks.workunit.client.0.smithi082.stdout:checking for int... yes 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.014+0000 7ff7769f0740 1 Processor -- start 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff769600640 1 -- 172.21.15.82:0/3779104255 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff764003970 con 0x7ff76c10ee90 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 -- start start 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 0x55c3d9bb2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bb5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3d9b10c70 con 0x55c3d9bad050 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c3d9ac9980 con 0x55c3d9bada40 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff7769f0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c3d9b0cc30 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.015+0000 7ff771200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 0x55c3d9bb2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff76be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 0x55c3d9bb2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60154/0 (socket says 172.21.15.82:60154) 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 -- 172.21.15.82:0/3170683048 learned_addr learned my addr 172.21.15.82:0/3170683048 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff76be00640 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bb5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 -- 172.21.15.82:0/3170683048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 msgr2=0x55c3d9bb5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bb5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 -- 172.21.15.82:0/3170683048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 msgr2=0x55c3d9bad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 -- 172.21.15.82:0/3170683048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d9aa17b0 con 0x55c3d9bada40 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff76be00640 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bb5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff769600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff7540a3c40 0x7ff7540a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.016+0000 7ff771200640 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 0x55c3d9bb2540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff760009cf0 tx=0x7ff760011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f86af0ca882b329 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.017+0000 7ff769600640 1 -- 172.21.15.82:0/3779104255 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff7640d0650 con 0x7ff76c10ee90 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.017+0000 7ff76be00640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff7540a3c40 0x7ff7540a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.017+0000 7ff75e000640 1 -- 172.21.15.82:0/3170683048 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76001e070 con 0x55c3d9bada40 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.017+0000 7ff75e000640 1 -- 172.21.15.82:0/3170683048 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff760019ae0 con 0x55c3d9bada40 2024-04-26T20:24:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.017+0000 7ff75e000640 1 -- 172.21.15.82:0/3170683048 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76000e980 con 0x55c3d9bada40 2024-04-26T20:24:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 -- 172.21.15.82:0/3170683048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 msgr2=0x55c3d9bb2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff76be00640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff7540a3c40 0x7ff7540a6100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff758005ab0 tx=0x7ff758000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 0x55c3d9bb2540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff760009cf0 tx=0x7ff760011810 comp rx=0 tx=0).stop 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 -- 172.21.15.82:0/3170683048 shutdown_connections 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bb5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bada40 0x55c3d9bb2540 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3170683048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 -- 172.21.15.82:0/3170683048 >> 172.21.15.82:0/3170683048 conn(0x55c3d9ba86c0 msgr2=0x55c3d9ba8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 -- 172.21.15.82:0/3170683048 shutdown_connections 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 -- 172.21.15.82:0/3170683048 wait complete. 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.018+0000 7ff7769f0740 1 -- start start 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 Processor -- start 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 0x55c3d9bb7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3d9b0ff80 con 0x55c3d9bada40 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c3d9abd260 con 0x55c3d9bad050 2024-04-26T20:24:38.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c3d9b152a0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff7769f0740 10 client.0 _ll_register_callbacks cb 0x55c3d9b07960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff76be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 0x55c3d9bb7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff76be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 0x55c3d9bb7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41066/0 (socket says 172.21.15.82:41066) 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff76be00640 1 -- 172.21.15.82:0/3282940021 learned_addr learned my addr 172.21.15.82:0/3282940021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.019+0000 7ff771200640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff771c00640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff76be00640 1 -- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 msgr2=0x55c3d9bbe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff76be00640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff76be00640 1 -- 172.21.15.82:0/3282940021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 msgr2=0x55c3d9bb6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff76be00640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff76be00640 1 -- 172.21.15.82:0/3282940021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d9a9f1c0 con 0x55c3d9bada40 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff76be00640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 0x55c3d9bb7400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff758031500 tx=0x7ff75802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37ef5cada7cb2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.020+0000 7ff752a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff752a00640 1 -- 172.21.15.82:0/3282940021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758035070 con 0x55c3d9bada40 2024-04-26T20:24:38.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff752a00640 1 -- 172.21.15.82:0/3282940021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff7580317a0 con 0x55c3d9bada40 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff760019ae0 con 0x55c3d9bada40 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff752a00640 1 -- 172.21.15.82:0/3282940021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff75805a050 con 0x55c3d9bada40 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff7769f0740 10 client.15948 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3d98223f0 con 0x55c3d9bada40 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff752a00640 1 -- 172.21.15.82:0/3282940021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff760019ae0 con 0x55c3d9bada40 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.021+0000 7ff752a00640 1 -- 172.21.15.82:0/3282940021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff758044040 con 0x55c3d9bada40 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff7769f0740 10 client.15948 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff7769f0740 10 client.15948 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff7769f0740 20 client.15948 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9bc29f0 0x55c3d9bc4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff7769f0740 4 client.15948 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3d9b1e880 con 0x55c3d9bc29f0 2024-04-26T20:24:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.022+0000 7ff771200640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9bc29f0 0x55c3d9bc4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.023+0000 7ff752a00640 10 client.15948 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.023+0000 7ff771200640 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9bc29f0 0x55c3d9bc4e70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6420312a6a786316 server_cookie=b9ce3386b9fbc5ce in_seq=0 out_seq=0 2024-04-26T20:24:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.023+0000 7ff752a00640 1 -- 172.21.15.82:0/3282940021 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c3d9b1e880 con 0x55c3d9bc29f0 2024-04-26T20:24:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.023+0000 7ff752a00640 10 client.15948 handle_command_reply: tid=0 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.023+0000 7ff7769f0740 1 client.15948 shutdown 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 msgr2=0x55c3d9bb7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 0x55c3d9bb7400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff758031500 tx=0x7ff75802a420 comp rx=0 tx=0).stop 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 shutdown_connections 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9bc29f0 0x55c3d9bc4e70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bada40 0x55c3d9bb7400 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff752a00640 0 client.15948 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3282940021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 >> 172.21.15.82:0/3282940021 conn(0x55c3d9ba86c0 msgr2=0x55c3d9ba77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 shutdown_connections 2024-04-26T20:24:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 1 -- 172.21.15.82:0/3282940021 wait complete. 2024-04-26T20:24:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.024+0000 7ff7769f0740 20 client.15948 trim_cache size 0 max 16384 2024-04-26T20:24:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 Processor -- start 2024-04-26T20:24:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 -- start start 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b17c0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b3300 con 0x55c3d9bad050 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.039+0000 7ff7769f0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b1e90 con 0x55c3d9bada40 2024-04-26T20:24:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60180/0 (socket says 172.21.15.82:60180) 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 -- 172.21.15.82:0/4253293908 learned_addr learned my addr 172.21.15.82:0/4253293908 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff76be00640 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 -- 172.21.15.82:0/4253293908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 msgr2=0x55c3d9bbe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbe400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 -- 172.21.15.82:0/4253293908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bb2bb0 msgr2=0x55c3d9bae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 -- 172.21.15.82:0/4253293908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d98ec7d0 con 0x55c3d9bad050 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff76be00640 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.040+0000 7ff771200640 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb64e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff760009250 tx=0x7ff7600197c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b8a376850797db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff75d600640 1 -- 172.21.15.82:0/4253293908 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76001e040 con 0x55c3d9bad050 2024-04-26T20:24:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff75d600640 1 -- 172.21.15.82:0/4253293908 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff760019ab0 con 0x55c3d9bad050 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff75d600640 1 -- 172.21.15.82:0/4253293908 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760004c20 con 0x55c3d9bad050 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 -- 172.21.15.82:0/4253293908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 msgr2=0x55c3d9bb64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb64e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff760009250 tx=0x7ff7600197c0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 -- 172.21.15.82:0/4253293908 shutdown_connections 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 --2- 172.21.15.82:0/4253293908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bad050 0x55c3d9bb64e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.041+0000 7ff7769f0740 1 -- 172.21.15.82:0/4253293908 >> 172.21.15.82:0/4253293908 conn(0x55c3d9ba86c0 msgr2=0x55c3d9ba77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.042+0000 7ff7769f0740 1 -- 172.21.15.82:0/4253293908 shutdown_connections 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.042+0000 7ff7769f0740 1 -- 172.21.15.82:0/4253293908 wait complete. 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.042+0000 7ff7769f0740 1 -- start start 2024-04-26T20:24:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.042+0000 7ff7769f0740 1 Processor -- start 2024-04-26T20:24:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.042+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bbc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff7769f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff7769f0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b2c30 con 0x55c3d9bad050 2024-04-26T20:24:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff7769f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b2560 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff7769f0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1af7a0 con 0x55c3d9bada40 2024-04-26T20:24:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff7769f0740 10 client.0 _ll_register_callbacks cb 0x7ff758009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bbc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bbc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41090/0 (socket says 172.21.15.82:41090) 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771200640 1 -- 172.21.15.82:0/3173328098 learned_addr learned my addr 172.21.15.82:0/3173328098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff76be00640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771c00640 1 -- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 msgr2=0x55c3d9bbc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771c00640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771c00640 1 -- 172.21.15.82:0/3173328098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 msgr2=0x55c3d9bbc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771c00640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bbc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771c00640 1 -- 172.21.15.82:0/3173328098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d9ab72a0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.043+0000 7ff771200640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bbc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff771c00640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbd850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7640cdc40 tx=0x7ff76409a9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daa9ae1d8928ddcf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff752a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff752a00640 1 -- 172.21.15.82:0/3173328098 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764020040 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff752a00640 1 -- 172.21.15.82:0/3173328098 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff7640d02d0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff760019ab0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff752a00640 1 -- 172.21.15.82:0/3173328098 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff7640a5080 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 10 client.26048 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3d9c295a0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff752a00640 1 -- 172.21.15.82:0/3173328098 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff760019ab0 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff752a00640 1 -- 172.21.15.82:0/3173328098 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff7640b5b90 con 0x55c3d9bb2bb0 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 10 client.26048 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 10 client.26048 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 20 client.26048 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.044+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9c29f10 0x55c3d9c2c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.045+0000 7ff7769f0740 4 client.26048 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.045+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3d9b186f0 con 0x55c3d9c29f10 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.045+0000 7ff771200640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9c29f10 0x55c3d9c2c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.045+0000 7ff771200640 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9c29f10 0x55c3d9c2c330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=39f6233db52fa8ad server_cookie=f2d5b3198c70207 in_seq=0 out_seq=0 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.045+0000 7ff752a00640 10 client.26048 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff752a00640 1 -- 172.21.15.82:0/3173328098 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3d9b186f0 con 0x55c3d9c29f10 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff752a00640 10 client.26048 handle_command_reply: tid=0 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 client.26048 shutdown 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bb2bb0 msgr2=0x55c3d9bbd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbd850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff7640cdc40 tx=0x7ff76409a9d0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 shutdown_connections 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c3d9c29f10 0x55c3d9c2c330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3d9bb2bb0 0x55c3d9bbd850 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3d9bada40 0x55c3d9bbc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 --2- 172.21.15.82:0/3173328098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3d9bad050 0x55c3d9bbc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff752a00640 0 client.26048 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:24:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 >> 172.21.15.82:0/3173328098 conn(0x55c3d9ba86c0 msgr2=0x55c3d9bab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 shutdown_connections 2024-04-26T20:24:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 1 -- 172.21.15.82:0/3173328098 wait complete. 2024-04-26T20:24:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.046+0000 7ff7769f0740 20 client.26048 trim_cache size 0 max 16384 2024-04-26T20:24:38.054 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff7540a3c40 msgr2=0x7ff7540a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff7540a3c40 0x7ff7540a6100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff758005ab0 tx=0x7ff758000bc0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 msgr2=0x7ff76c1a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 0x7ff76c1a6680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff764009fd0 tx=0x7ff76400b260 comp rx=0 tx=0).stop 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 shutdown_connections 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff7540a3c40 0x7ff7540a6100 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff76c10ee90 0x7ff76c1a6680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff76c076970 0x7ff76c19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 --2- 172.21.15.82:0/3779104255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76c075390 0x7ff76c19f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 >> 172.21.15.82:0/3779104255 conn(0x7ff76c0fde30 msgr2=0x7ff76c102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 shutdown_connections 2024-04-26T20:24:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.047+0000 7ff772600640 1 -- 172.21.15.82:0/3779104255 wait complete. 2024-04-26T20:24:38.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:37 smithi082 ceph-mon[28105]: pgmap v466: 129 pgs: 129 active+clean; 878 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-26T20:24:38.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:24:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:37 smithi139 ceph-mon[32999]: pgmap v466: 129 pgs: 129 active+clean; 878 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-26T20:24:38.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:37 smithi135 ceph-mon[32816]: pgmap v466: 129 pgs: 129 active+clean; 878 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-26T20:24:38.136 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of int... 4 2024-04-26T20:24:38.235 INFO:tasks.workunit.client.0.smithi082.stdout:checking for long... yes 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 -- 172.21.15.82:0/27528465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4102980 msgr2=0x7f91f4102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 --2- 172.21.15.82:0/27528465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4102980 0x7f91f4102da0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009900 tx=0x7f91e402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 -- 172.21.15.82:0/27528465 shutdown_connections 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 --2- 172.21.15.82:0/27528465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4104530 0x7f91f410adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 --2- 172.21.15.82:0/27528465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4103b70 0x7f91f4103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 --2- 172.21.15.82:0/27528465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4102980 0x7f91f4102da0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 -- 172.21.15.82:0/27528465 >> 172.21.15.82:0/27528465 conn(0x7f91f40fdf10 msgr2=0x7f91f4100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 -- 172.21.15.82:0/27528465 shutdown_connections 2024-04-26T20:24:38.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.257+0000 7f91f8c00640 1 -- 172.21.15.82:0/27528465 wait complete. 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.258+0000 7f91f8c00640 1 Processor -- start 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 -- start start 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4102980 0x7f91f419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4103b70 0x7f91f419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4104530 0x7f91f41a2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410e480 con 0x7f91f4104530 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410e300 con 0x7f91f4103b70 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f8c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410e600 con 0x7f91f4102980 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4104530 0x7f91f41a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4102980 0x7f91f419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4103b70 0x7f91f419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4102980 0x7f91f419ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48624/0 (socket says 172.21.15.82:48624) 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4104530 0x7f91f41a2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41096/0 (socket says 172.21.15.82:41096) 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.259+0000 7f91f1e00640 1 -- 172.21.15.82:0/332106314 learned_addr learned my addr 172.21.15.82:0/332106314 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91ebe00640 1 -- 172.21.15.82:0/332106314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4102980 msgr2=0x7f91f419ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91ebe00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4102980 0x7f91f419ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91ebe00640 1 -- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4104530 msgr2=0x7f91f41a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91ebe00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4104530 0x7f91f41a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91ebe00640 1 -- 172.21.15.82:0/332106314 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f41a2a00 con 0x7f91f4103b70 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91ebe00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4103b70 0x7f91f419b320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00e9f0 tx=0x7f91dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91eaa00640 1 -- 172.21.15.82:0/332106314 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00cd80 con 0x7f91f4103b70 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91eaa00640 1 -- 172.21.15.82:0/332106314 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc0035f0 con 0x7f91f4103b70 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f41a2cf0 con 0x7f91f4103b70 2024-04-26T20:24:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.260+0000 7f91eaa00640 1 -- 172.21.15.82:0/332106314 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc010670 con 0x7f91f4103b70 2024-04-26T20:24:38.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.261+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f41a3230 con 0x7f91f4103b70 2024-04-26T20:24:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91eaa00640 1 -- 172.21.15.82:0/332106314 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f91dc0037a0 con 0x7f91f4103b70 2024-04-26T20:24:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 Processor -- start 2024-04-26T20:24:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 -- start start 2024-04-26T20:24:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6eea0 0x55a136a6f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a74390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a76e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1369d2c70 con 0x55a136a74a00 2024-04-26T20:24:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a13698b980 con 0x55a136a6eea0 2024-04-26T20:24:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.264+0000 7f91fbb95740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a1369cec30 con 0x55a136a6f890 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a74390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6eea0 0x55a136a6f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a74390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48632/0 (socket says 172.21.15.82:48632) 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 -- 172.21.15.82:0/3160928380 learned_addr learned my addr 172.21.15.82:0/3160928380 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91ebe00640 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a76e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 -- 172.21.15.82:0/3160928380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6eea0 msgr2=0x55a136a6f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6eea0 0x55a136a6f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 -- 172.21.15.82:0/3160928380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 msgr2=0x55a136a76e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a76e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 -- 172.21.15.82:0/3160928380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1369637b0 con 0x55a136a6f890 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f2800640 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6eea0 0x55a136a6f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91f1e00640 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a74390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005e20 tx=0x7f91e4005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a641adfdac68da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.265+0000 7f91eaa00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91d80a3cc0 0x7f91d80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91e3000640 1 -- 172.21.15.82:0/3160928380 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e4035030 con 0x55a136a6f890 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91eaa00640 1 -- 172.21.15.82:0/332106314 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f91dc0d0ab0 con 0x7f91f4103b70 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91e3000640 1 -- 172.21.15.82:0/3160928380 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91e4040070 con 0x55a136a6f890 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91e3000640 1 -- 172.21.15.82:0/3160928380 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e40039b0 con 0x55a136a6f890 2024-04-26T20:24:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91f2800640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91d80a3cc0 0x7f91d80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91fbb95740 1 -- 172.21.15.82:0/3160928380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 msgr2=0x55a136a74390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91fbb95740 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a74390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005e20 tx=0x7f91e4005e50 comp rx=0 tx=0).stop 2024-04-26T20:24:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91f2800640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91d80a3cc0 0x7f91d80a6180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55a136a700f0 tx=0x7f91ec009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91fbb95740 1 -- 172.21.15.82:0/3160928380 shutdown_connections 2024-04-26T20:24:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91fbb95740 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a76e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91fbb95740 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a74390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.266+0000 7f91fbb95740 1 --2- 172.21.15.82:0/3160928380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6eea0 0x55a136a6f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.267+0000 7f91fbb95740 1 -- 172.21.15.82:0/3160928380 >> 172.21.15.82:0/3160928380 conn(0x55a136a6a510 msgr2=0x55a136a6a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.267+0000 7f91fbb95740 1 -- 172.21.15.82:0/3160928380 shutdown_connections 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.267+0000 7f91fbb95740 1 -- 172.21.15.82:0/3160928380 wait complete. 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.267+0000 7f91fbb95740 1 -- start start 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.267+0000 7f91fbb95740 1 Processor -- start 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 0x55a136a78d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136a80310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1369d1f80 con 0x55a136a6eea0 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a13697f260 con 0x55a136a74a00 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a1369d72a0 con 0x55a136a6f890 2024-04-26T20:24:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91fbb95740 10 client.0 _ll_register_callbacks cb 0x55a1369c9960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 0x55a136a78d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 0x55a136a78d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41110/0 (socket says 172.21.15.82:41110) 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91f1e00640 1 -- 172.21.15.82:0/916653209 learned_addr learned my addr 172.21.15.82:0/916653209 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91ebe00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a792d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48644/0 (socket says 172.21.15.82:48644) 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.268+0000 7f91f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136a80310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91ebe00640 1 -- 172.21.15.82:0/916653209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 msgr2=0x55a136a80310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91ebe00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136a80310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91ebe00640 1 -- 172.21.15.82:0/916653209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 msgr2=0x55a136a78d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91ebe00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 0x55a136a78d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91ebe00640 1 -- 172.21.15.82:0/916653209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1369611c0 con 0x55a136a6f890 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91f1e00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 0x55a136a78d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91f2800640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136a80310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91ebe00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a792d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0ce0a0 tx=0x7f91dc09c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb7b603253e67399 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91d7400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91d7400640 1 -- 172.21.15.82:0/916653209 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc09cf70 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91e4040070 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91d7400640 1 -- 172.21.15.82:0/916653209 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f91dc009310 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91d7400640 1 -- 172.21.15.82:0/916653209 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f91dc09c870 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91fbb95740 10 client.26092 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.269+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a1366e43f0 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91d7400640 1 -- 172.21.15.82:0/916653209 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91e4040070 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91d7400640 1 -- 172.21.15.82:0/916653209 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f91dc0ce2f0 con 0x55a136a6f890 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91fbb95740 10 client.26092 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91fbb95740 10 client.26092 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:24:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91fbb95740 20 client.26092 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91fbb95740 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136a848c0 0x55a136a86d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91fbb95740 4 client.26092 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:38.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.270+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1369e0880 con 0x55a136a848c0 2024-04-26T20:24:38.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.271+0000 7f91f1e00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136a848c0 0x55a136a86d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.271+0000 7f91f1e00640 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136a848c0 0x55a136a86d10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bb945cdf246c04b5 server_cookie=1e6a09b58d9f5176 in_seq=0 out_seq=0 2024-04-26T20:24:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.271+0000 7f91d7400640 10 client.26092 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.272+0000 7f91d7400640 1 -- 172.21.15.82:0/916653209 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a1369e0880 con 0x55a136a848c0 2024-04-26T20:24:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.272+0000 7f91d7400640 10 client.26092 handle_command_reply: tid=0 2024-04-26T20:24:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.272+0000 7f91fbb95740 1 client.26092 shutdown 2024-04-26T20:24:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 msgr2=0x55a136a792d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a792d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0ce0a0 tx=0x7f91dc09c640 comp rx=0 tx=0).stop 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 shutdown_connections 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136a848c0 0x55a136a86d10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136a80310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6f890 0x55a136a792d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91d7400640 0 client.26092 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 --2- 172.21.15.82:0/916653209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6eea0 0x55a136a78d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 >> 172.21.15.82:0/916653209 conn(0x55a136a6a510 msgr2=0x55a136a69690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 shutdown_connections 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 1 -- 172.21.15.82:0/916653209 wait complete. 2024-04-26T20:24:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.273+0000 7f91fbb95740 20 client.26092 trim_cache size 0 max 16384 2024-04-26T20:24:38.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 Processor -- start 2024-04-26T20:24:38.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 -- start start 2024-04-26T20:24:38.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a69510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 0x55a136a69a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41ad630 con 0x55a136a74a00 2024-04-26T20:24:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41af170 con 0x55a136a6f890 2024-04-26T20:24:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91fbb95740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41add00 con 0x55a136a6eea0 2024-04-26T20:24:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 0x55a136a69a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a802d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41126/0 (socket says 172.21.15.82:41126) 2024-04-26T20:24:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.288+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a69510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91f2800640 1 -- 172.21.15.82:0/130438525 learned_addr learned my addr 172.21.15.82:0/130438525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 0x55a136a69a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60222/0 (socket says 172.21.15.82:60222) 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 -- 172.21.15.82:0/130438525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 msgr2=0x55a136a69510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a69510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 -- 172.21.15.82:0/130438525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 msgr2=0x55a136a802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a802d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 -- 172.21.15.82:0/130438525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1367ae7d0 con 0x55a136a6f890 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91ebe00640 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 0x55a136a69a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f91dc09c800 tx=0x7f91dc09c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a59ad47e1d3fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.289+0000 7f91e2600640 1 -- 172.21.15.82:0/130438525 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc09c3b0 con 0x55a136a6f890 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91e2600640 1 -- 172.21.15.82:0/130438525 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc09cf70 con 0x55a136a6f890 2024-04-26T20:24:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91e2600640 1 -- 172.21.15.82:0/130438525 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0871a0 con 0x55a136a6f890 2024-04-26T20:24:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 -- 172.21.15.82:0/130438525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 msgr2=0x55a136a69a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 0x55a136a69a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f91dc09c800 tx=0x7f91dc09c770 comp rx=0 tx=0).stop 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 -- 172.21.15.82:0/130438525 shutdown_connections 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a74a00 0x55a136a802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a6f890 0x55a136a69a50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 --2- 172.21.15.82:0/130438525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a69510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 -- 172.21.15.82:0/130438525 >> 172.21.15.82:0/130438525 conn(0x55a136a6a510 msgr2=0x55a136a68e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.290+0000 7f91fbb95740 1 -- 172.21.15.82:0/130438525 shutdown_connections 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.291+0000 7f91fbb95740 1 -- 172.21.15.82:0/130438525 wait complete. 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.291+0000 7f91fbb95740 1 -- start start 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.291+0000 7f91fbb95740 1 Processor -- start 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.291+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a7d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6f890 0x55a136a7d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91fbb95740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136ae8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91fbb95740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41aeaa0 con 0x55a136a6f890 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91fbb95740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41ae3d0 con 0x55a136a74a00 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91fbb95740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f91f41ab610 con 0x55a136a6eea0 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91fbb95740 10 client.0 _ll_register_callbacks cb 0x7f91dc0d4250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6f890 0x55a136a7d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6f890 0x55a136a7d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41132/0 (socket says 172.21.15.82:41132) 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f1e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a7d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91ebe00640 1 -- 172.21.15.82:0/338501077 learned_addr learned my addr 172.21.15.82:0/338501077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f2800640 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136ae8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f1e00640 1 -- 172.21.15.82:0/338501077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 msgr2=0x55a136ae8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f1e00640 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136ae8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f1e00640 1 -- 172.21.15.82:0/338501077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6f890 msgr2=0x55a136a7d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f1e00640 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6f890 0x55a136a7d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.292+0000 7f91f1e00640 1 -- 172.21.15.82:0/338501077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1369792a0 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91f1e00640 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a7d130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91e4006010 tx=0x7f91e4005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d40a35c284904e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91d7400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91d7400640 1 -- 172.21.15.82:0/338501077 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e4035040 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91dc09cf70 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91d7400640 1 -- 172.21.15.82:0/338501077 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f91e4050030 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91d7400640 1 -- 172.21.15.82:0/338501077 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f91e405f050 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91fbb95740 10 client.26098 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.293+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a136aea360 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91d7400640 1 -- 172.21.15.82:0/338501077 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc09cf70 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91d7400640 1 -- 172.21.15.82:0/338501077 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f91e40459a0 con 0x55a136a6eea0 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91fbb95740 10 client.26098 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91fbb95740 10 client.26098 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:24:38.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91fbb95740 20 client.26098 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91fbb95740 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136aea920 0x55a136aecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91fbb95740 4 client.26098 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:38.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1369da6f0 con 0x55a136aea920 2024-04-26T20:24:38.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.294+0000 7f91ebe00640 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136aea920 0x55a136aecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.295+0000 7f91d7400640 10 client.26098 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:38.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.295+0000 7f91ebe00640 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136aea920 0x55a136aecd10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7db6b44dd515d1be server_cookie=fed9859ffa4557cc in_seq=0 out_seq=0 2024-04-26T20:24:38.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.295+0000 7f91d7400640 1 -- 172.21.15.82:0/338501077 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1369da6f0 con 0x55a136aea920 2024-04-26T20:24:38.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.295+0000 7f91d7400640 10 client.26098 handle_command_reply: tid=0 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.295+0000 7f91fbb95740 1 client.26098 shutdown 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 msgr2=0x55a136a7d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a7d130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91e4006010 tx=0x7f91e4005bd0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 shutdown_connections 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55a136aea920 0x55a136aecd10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a136a74a00 0x55a136ae8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a136a6f890 0x55a136a7d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 --2- 172.21.15.82:0/338501077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a136a6eea0 0x55a136a7d130 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91d7400640 0 client.26098 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 >> 172.21.15.82:0/338501077 conn(0x55a136a6a510 msgr2=0x55a136a69690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 shutdown_connections 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 1 -- 172.21.15.82:0/338501077 wait complete. 2024-04-26T20:24:38.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.296+0000 7f91fbb95740 20 client.26098 trim_cache size 0 max 16384 2024-04-26T20:24:38.301 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:38.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91d80a3cc0 msgr2=0x7f91d80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91d80a3cc0 0x7f91d80a6180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55a136a700f0 tx=0x7f91ec009500 comp rx=0 tx=0).stop 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4103b70 msgr2=0x7f91f419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4103b70 0x7f91f419b320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00e9f0 tx=0x7f91dc00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 shutdown_connections 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f91d80a3cc0 0x7f91d80a6180 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f4104530 0x7f91f41a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91f4103b70 0x7f91f419b320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 --2- 172.21.15.82:0/332106314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91f4102980 0x7f91f419ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 >> 172.21.15.82:0/332106314 conn(0x7f91f40fdf10 msgr2=0x7f91f41093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 shutdown_connections 2024-04-26T20:24:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.297+0000 7f91f8c00640 1 -- 172.21.15.82:0/332106314 wait complete. 2024-04-26T20:24:38.315 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:24:38.369 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of long... 8 2024-04-26T20:24:38.466 INFO:tasks.workunit.client.0.smithi082.stdout:checking for long long... yes 2024-04-26T20:24:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 -- 172.21.15.82:0/2423714781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2541085e0 msgr2=0x7fb25410a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 --2- 172.21.15.82:0/2423714781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2541085e0 0x7fb25410a9d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb250009be0 tx=0x7fb25002a6c0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 -- 172.21.15.82:0/2423714781 shutdown_connections 2024-04-26T20:24:38.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 --2- 172.21.15.82:0/2423714781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2541085e0 0x7fb25410a9d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 --2- 172.21.15.82:0/2423714781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254105cb0 0x7fb2541080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 --2- 172.21.15.82:0/2423714781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb254103380 0x7fb254105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 -- 172.21.15.82:0/2423714781 >> 172.21.15.82:0/2423714781 conn(0x7fb2540fccd0 msgr2=0x7fb2540ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 -- 172.21.15.82:0/2423714781 shutdown_connections 2024-04-26T20:24:38.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.497+0000 7fb25b200640 1 -- 172.21.15.82:0/2423714781 wait complete. 2024-04-26T20:24:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.498+0000 7fb25b200640 1 Processor -- start 2024-04-26T20:24:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.498+0000 7fb25b200640 1 -- start start 2024-04-26T20:24:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.498+0000 7fb25b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 0x7fb25419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.498+0000 7fb25b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb254105cb0 0x7fb25419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.498+0000 7fb25b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2541085e0 0x7fb2541a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.498+0000 7fb25b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb25410e3a0 con 0x7fb2541085e0 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb25b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb25410e220 con 0x7fb254103380 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb25b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb25410e520 con 0x7fb254105cb0 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 0x7fb25419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 0x7fb25419ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60256/0 (socket says 172.21.15.82:60256) 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 -- 172.21.15.82:0/3210828987 learned_addr learned my addr 172.21.15.82:0/3210828987 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb25a800640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2541085e0 0x7fb2541a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259400640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb254105cb0 0x7fb25419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 -- 172.21.15.82:0/3210828987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb254105cb0 msgr2=0x7fb25419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb254105cb0 0x7fb25419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 -- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2541085e0 msgr2=0x7fb2541a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2541085e0 0x7fb2541a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 -- 172.21.15.82:0/3210828987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2541a2860 con 0x7fb254103380 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.499+0000 7fb259e00640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 0x7fb25419ac50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb24800e9c0 tx=0x7fb24800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.500+0000 7fb24ea00640 1 -- 172.21.15.82:0/3210828987 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24800ccc0 con 0x7fb254103380 2024-04-26T20:24:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.500+0000 7fb24ea00640 1 -- 172.21.15.82:0/3210828987 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2480054d0 con 0x7fb254103380 2024-04-26T20:24:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.500+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2541a2b50 con 0x7fb254103380 2024-04-26T20:24:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.500+0000 7fb24ea00640 1 -- 172.21.15.82:0/3210828987 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248010430 con 0x7fb254103380 2024-04-26T20:24:38.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.500+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2541a30a0 con 0x7fb254103380 2024-04-26T20:24:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.503+0000 7fb24ea00640 1 -- 172.21.15.82:0/3210828987 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb248004f80 con 0x7fb254103380 2024-04-26T20:24:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.503+0000 7fb25f67c740 1 Processor -- start 2024-04-26T20:24:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.503+0000 7fb25f67c740 1 -- start start 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.503+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f31e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.503+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 0x556d4f323540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f323bb0 0x556d4f326040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb25f67c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d4f281c70 con 0x556d4f31e050 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb25f67c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d4f23a980 con 0x556d4f31ea40 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb25f67c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d4f27dc30 con 0x556d4f323bb0 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 0x556d4f323540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb25a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f31e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 0x556d4f323540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60258/0 (socket says 172.21.15.82:60258) 2024-04-26T20:24:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 -- 172.21.15.82:0/2331370291 learned_addr learned my addr 172.21.15.82:0/2331370291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb25a800640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f31e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41156/0 (socket says 172.21.15.82:41156) 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259400640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f323bb0 0x556d4f326040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 -- 172.21.15.82:0/2331370291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f323bb0 msgr2=0x556d4f326040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f323bb0 0x556d4f326040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 -- 172.21.15.82:0/2331370291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 msgr2=0x556d4f31e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.504+0000 7fb259e00640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f31e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb259e00640 1 -- 172.21.15.82:0/2331370291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d4f2127b0 con 0x556d4f31ea40 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb259400640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f323bb0 0x556d4f326040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb25a800640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f31e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:38.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb259e00640 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 0x556d4f323540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb2480d4e00 tx=0x7fb2480d94b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4abc5d1efe1b1b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb24ea00640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb23c0a3c40 0x7fb23c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb243000640 1 -- 172.21.15.82:0/2331370291 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2480e4070 con 0x556d4f31ea40 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb243000640 1 -- 172.21.15.82:0/2331370291 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb24809d370 con 0x556d4f31ea40 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb243000640 1 -- 172.21.15.82:0/2331370291 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24809c5d0 con 0x556d4f31ea40 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb24ea00640 1 -- 172.21.15.82:0/3210828987 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb2480d0eb0 con 0x7fb254103380 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.505+0000 7fb25a800640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb23c0a3c40 0x7fb23c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 -- 172.21.15.82:0/2331370291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 msgr2=0x556d4f323540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 0x556d4f323540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb2480d4e00 tx=0x7fb2480d94b0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 -- 172.21.15.82:0/2331370291 shutdown_connections 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f323bb0 0x556d4f326040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31ea40 0x556d4f323540 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 --2- 172.21.15.82:0/2331370291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f31e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 -- 172.21.15.82:0/2331370291 >> 172.21.15.82:0/2331370291 conn(0x556d4f3196c0 msgr2=0x556d4f319ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 -- 172.21.15.82:0/2331370291 shutdown_connections 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25a800640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb23c0a3c40 0x7fb23c0a6100 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb250006010 tx=0x7fb250030970 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.506+0000 7fb25f67c740 1 -- 172.21.15.82:0/2331370291 wait complete. 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.507+0000 7fb25f67c740 1 -- start start 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.507+0000 7fb25f67c740 1 Processor -- start 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.507+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 0x556d4f327f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.507+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f328480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.507+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f323bb0 0x556d4f32f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb25f67c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d4f280f80 con 0x556d4f323bb0 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb25f67c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d4f22e260 con 0x556d4f31e050 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb25f67c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d4f2862a0 con 0x556d4f31ea40 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb25f67c740 10 client.0 _ll_register_callbacks cb 0x556d4f278960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 0x556d4f327f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 0x556d4f327f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60264/0 (socket says 172.21.15.82:60264) 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 -- 172.21.15.82:0/806965800 learned_addr learned my addr 172.21.15.82:0/806965800 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb25a800640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f323bb0 0x556d4f32f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259400640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f328480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 -- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 msgr2=0x556d4f328480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f328480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 -- 172.21.15.82:0/806965800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f323bb0 msgr2=0x556d4f32f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f323bb0 0x556d4f32f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.508+0000 7fb259e00640 1 -- 172.21.15.82:0/806965800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d4f2101c0 con 0x556d4f31e050 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb259e00640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 0x556d4f327f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb24809cbb0 tx=0x7fb248004a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6bd91fb14a9045 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb237400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb237400640 1 -- 172.21.15.82:0/806965800 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2480c8a10 con 0x556d4f31e050 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb237400640 1 -- 172.21.15.82:0/806965800 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb24809af70 con 0x556d4f31e050 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24809d370 con 0x556d4f31e050 2024-04-26T20:24:38.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb237400640 1 -- 172.21.15.82:0/806965800 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb2480c8f90 con 0x556d4f31e050 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb25f67c740 10 client.26078 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d4ef933f0 con 0x556d4f31e050 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb237400640 1 -- 172.21.15.82:0/806965800 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb24809d370 con 0x556d4f31e050 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb237400640 1 -- 172.21.15.82:0/806965800 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb2480ce6f0 con 0x556d4f31e050 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb25f67c740 10 client.26078 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.509+0000 7fb25f67c740 10 client.26078 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb25f67c740 20 client.26078 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb25f67c740 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f333620 0x556d4f335a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb25f67c740 4 client.26078 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d4f28f880 con 0x556d4f333620 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb259400640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f333620 0x556d4f335a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb259400640 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f333620 0x556d4f335a10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42a4ff25b2437e0 server_cookie=238948bc85e823bd in_seq=0 out_seq=0 2024-04-26T20:24:38.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.510+0000 7fb237400640 10 client.26078 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.511+0000 7fb237400640 1 -- 172.21.15.82:0/806965800 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d4f28f880 con 0x556d4f333620 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.511+0000 7fb237400640 10 client.26078 handle_command_reply: tid=0 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.511+0000 7fb25f67c740 1 client.26078 shutdown 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.511+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 msgr2=0x556d4f327f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.511+0000 7fb25f67c740 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 0x556d4f327f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb24809cbb0 tx=0x7fb248004a20 comp rx=0 tx=0).stop 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 shutdown_connections 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f333620 0x556d4f335a10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f323bb0 0x556d4f32f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f328480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb237400640 0 client.26078 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 --2- 172.21.15.82:0/806965800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f31e050 0x556d4f327f40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 >> 172.21.15.82:0/806965800 conn(0x556d4f3196c0 msgr2=0x556d4f3187b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 shutdown_connections 2024-04-26T20:24:38.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 1 -- 172.21.15.82:0/806965800 wait complete. 2024-04-26T20:24:38.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.512+0000 7fb25f67c740 20 client.26078 trim_cache size 0 max 16384 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.526+0000 7fb25f67c740 1 Processor -- start 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.526+0000 7fb25f67c740 1 -- start start 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31e050 0x556d4f31f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31ea40 0x556d4f32f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f31f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25f67c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541ad440 con 0x556d4f31ea40 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25f67c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541aef80 con 0x556d4f323bb0 2024-04-26T20:24:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25f67c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541adb10 con 0x556d4f31e050 2024-04-26T20:24:38.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f31f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb259400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31ea40 0x556d4f32f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f31f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60268/0 (socket says 172.21.15.82:60268) 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb25a800640 1 -- 172.21.15.82:0/1092907790 learned_addr learned my addr 172.21.15.82:0/1092907790 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb259e00640 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31e050 0x556d4f31f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb259400640 1 -- 172.21.15.82:0/1092907790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31e050 msgr2=0x556d4f31f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb259400640 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31e050 0x556d4f31f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb259400640 1 -- 172.21.15.82:0/1092907790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 msgr2=0x556d4f31f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.527+0000 7fb259400640 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f31f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.528+0000 7fb259400640 1 -- 172.21.15.82:0/1092907790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d4f05d7d0 con 0x556d4f31ea40 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.528+0000 7fb259400640 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31ea40 0x556d4f32f450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x556d4ef93530 tx=0x7fb244005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d693dad3afdb79a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.528+0000 7fb242600640 1 -- 172.21.15.82:0/1092907790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244025070 con 0x556d4f31ea40 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.528+0000 7fb242600640 1 -- 172.21.15.82:0/1092907790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb244003de0 con 0x556d4f31ea40 2024-04-26T20:24:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.528+0000 7fb242600640 1 -- 172.21.15.82:0/1092907790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244012920 con 0x556d4f31ea40 2024-04-26T20:24:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 -- 172.21.15.82:0/1092907790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31ea40 msgr2=0x556d4f32f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31ea40 0x556d4f32f450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x556d4ef93530 tx=0x7fb244005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 -- 172.21.15.82:0/1092907790 shutdown_connections 2024-04-26T20:24:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f31f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31ea40 0x556d4f32f450 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 --2- 172.21.15.82:0/1092907790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31e050 0x556d4f31f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 -- 172.21.15.82:0/1092907790 >> 172.21.15.82:0/1092907790 conn(0x556d4f3196c0 msgr2=0x556d4f3187b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 -- 172.21.15.82:0/1092907790 shutdown_connections 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.529+0000 7fb25f67c740 1 -- 172.21.15.82:0/1092907790 wait complete. 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 -- start start 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 Processor -- start 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f32c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f32ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f32da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541ae8b0 con 0x556d4f31e050 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541ae1e0 con 0x556d4f323bb0 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541ab420 con 0x556d4f31ea40 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb25f67c740 10 client.0 _ll_register_callbacks cb 0x7fb2480d4f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.530+0000 7fb259e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f32c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f32da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f32da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60272/0 (socket says 172.21.15.82:60272) 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 -- 172.21.15.82:0/4277709718 learned_addr learned my addr 172.21.15.82:0/4277709718 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb259400640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f32ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 -- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 msgr2=0x556d4f32ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f32ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 -- 172.21.15.82:0/4277709718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 msgr2=0x556d4f32c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f32c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 -- 172.21.15.82:0/4277709718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d4f2282a0 con 0x556d4f323bb0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb259400640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f32ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb25a800640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f32da90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb25002acb0 tx=0x7fb250009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=413c2749237eff9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.531+0000 7fb237400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb237400640 1 -- 172.21.15.82:0/4277709718 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250036040 con 0x556d4f323bb0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb244003de0 con 0x556d4f323bb0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb237400640 1 -- 172.21.15.82:0/4277709718 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb250004240 con 0x556d4f323bb0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb237400640 1 -- 172.21.15.82:0/4277709718 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb250004440 con 0x556d4f323bb0 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb25f67c740 10 client.26084 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d4f32f270 con 0x556d4f323bb0 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb237400640 1 -- 172.21.15.82:0/4277709718 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb244003de0 con 0x556d4f323bb0 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.532+0000 7fb237400640 1 -- 172.21.15.82:0/4277709718 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb250056c20 con 0x556d4f323bb0 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb25f67c740 10 client.26084 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb25f67c740 10 client.26084 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb25f67c740 20 client.26084 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb25f67c740 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f399a90 0x556d4f39beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb25f67c740 4 client.26084 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d4f2896f0 con 0x556d4f399a90 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb259e00640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f399a90 0x556d4f39beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb259e00640 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f399a90 0x556d4f39beb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74b9638a1b8823dd server_cookie=c3eaa2d9b32bb8d2 in_seq=0 out_seq=0 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.533+0000 7fb237400640 10 client.26084 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb237400640 1 -- 172.21.15.82:0/4277709718 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d4f2896f0 con 0x556d4f399a90 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb237400640 10 client.26084 handle_command_reply: tid=0 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 client.26084 shutdown 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 msgr2=0x556d4f32da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f32da90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb25002acb0 tx=0x7fb250009500 comp rx=0 tx=0).stop 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 shutdown_connections 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x556d4f399a90 0x556d4f39beb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4f323bb0 0x556d4f32da90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d4f31ea40 0x556d4f32ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb237400640 0 client.26084 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:24:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 --2- 172.21.15.82:0/4277709718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d4f31e050 0x556d4f32c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 >> 172.21.15.82:0/4277709718 conn(0x556d4f3196c0 msgr2=0x556d4f31c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 shutdown_connections 2024-04-26T20:24:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 1 -- 172.21.15.82:0/4277709718 wait complete. 2024-04-26T20:24:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.534+0000 7fb25f67c740 20 client.26084 trim_cache size 0 max 16384 2024-04-26T20:24:38.539 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb23c0a3c40 msgr2=0x7fb23c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb23c0a3c40 0x7fb23c0a6100 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb250006010 tx=0x7fb250030970 comp rx=0 tx=0).stop 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 msgr2=0x7fb25419ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 0x7fb25419ac50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb24800e9c0 tx=0x7fb24800ee80 comp rx=0 tx=0).stop 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 shutdown_connections 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb23c0a3c40 0x7fb23c0a6100 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2541085e0 0x7fb2541a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb254105cb0 0x7fb25419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 --2- 172.21.15.82:0/3210828987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb254103380 0x7fb25419ac50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 >> 172.21.15.82:0/3210828987 conn(0x7fb2540fccd0 msgr2=0x7fb254102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 shutdown_connections 2024-04-26T20:24:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.535+0000 7fb25b200640 1 -- 172.21.15.82:0/3210828987 wait complete. 2024-04-26T20:24:38.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:24:38.596 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of long long... 8 2024-04-26T20:24:38.688 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ssize_t... yes 2024-04-26T20:24:38.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 -- 172.21.15.82:0/1809704784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5528103ab0 msgr2=0x7f5528103f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 --2- 172.21.15.82:0/1809704784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5528103ab0 0x7f5528103f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5510009860 tx=0x7f551002a340 comp rx=0 tx=0).stop 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 -- 172.21.15.82:0/1809704784 shutdown_connections 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 --2- 172.21.15.82:0/1809704784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f552810ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 --2- 172.21.15.82:0/1809704784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5528103ab0 0x7f5528103f30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 --2- 172.21.15.82:0/1809704784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55281028c0 0x7f5528102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 -- 172.21.15.82:0/1809704784 >> 172.21.15.82:0/1809704784 conn(0x7f55280fde30 msgr2=0x7f5528100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 -- 172.21.15.82:0/1809704784 shutdown_connections 2024-04-26T20:24:38.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.736+0000 7f552d800640 1 -- 172.21.15.82:0/1809704784 wait complete. 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.737+0000 7f552d800640 1 Processor -- start 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.737+0000 7f552d800640 1 -- start start 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55281028c0 0x7f55280766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552d800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5528103ab0 0x7f5528074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552d800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f5528075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552d800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f552810e380 con 0x7f5528104470 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552d800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f552810e200 con 0x7f55281028c0 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552d800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f552810e500 con 0x7f5528103ab0 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f5528075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f5527e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55281028c0 0x7f55280766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f5528075260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41192/0 (socket says 172.21.15.82:41192) 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 -- 172.21.15.82:0/3370140200 learned_addr learned my addr 172.21.15.82:0/3370140200 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f551fe00640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5528103ab0 0x7f5528074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 -- 172.21.15.82:0/3370140200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5528103ab0 msgr2=0x7f5528074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5528103ab0 0x7f5528074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 -- 172.21.15.82:0/3370140200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55281028c0 msgr2=0x7f55280766e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55281028c0 0x7f55280766e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.738+0000 7f552ce00640 1 -- 172.21.15.82:0/3370140200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5528075af0 con 0x7f5528104470 2024-04-26T20:24:38.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.739+0000 7f552ce00640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f5528075260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f552000efc0 tx=0x7f552000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.739+0000 7f5525600640 1 -- 172.21.15.82:0/3370140200 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520003970 con 0x7f5528104470 2024-04-26T20:24:38.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.739+0000 7f5525600640 1 -- 172.21.15.82:0/3370140200 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5520004020 con 0x7f5528104470 2024-04-26T20:24:38.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.739+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55281a2c00 con 0x7f5528104470 2024-04-26T20:24:38.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.739+0000 7f5525600640 1 -- 172.21.15.82:0/3370140200 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552000b940 con 0x7f5528104470 2024-04-26T20:24:38.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.739+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55281a30d0 con 0x7f5528104470 2024-04-26T20:24:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.743+0000 7f5531b9f740 1 Processor -- start 2024-04-26T20:24:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.743+0000 7f5525600640 1 -- 172.21.15.82:0/3370140200 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5520003b10 con 0x7f5528104470 2024-04-26T20:24:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.743+0000 7f5531b9f740 1 -- start start 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7050 0x55929c2c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5531b9f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55929c22ac70 con 0x55929c2ccbb0 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5531b9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55929c1e3980 con 0x55929c2c7050 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5531b9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55929c226c30 con 0x55929c2c7a40 2024-04-26T20:24:38.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48724/0 (socket says 172.21.15.82:48724) 2024-04-26T20:24:38.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 -- 172.21.15.82:0/1551825105 learned_addr learned my addr 172.21.15.82:0/1551825105 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f551fe00640 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7050 0x55929c2c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f551fe00640 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 -- 172.21.15.82:0/1551825105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7050 msgr2=0x55929c2c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7050 0x55929c2c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 -- 172.21.15.82:0/1551825105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 msgr2=0x55929c2cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f5527e00640 1 -- 172.21.15.82:0/1551825105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929c1bb7b0 con 0x55929c2c7a40 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.744+0000 7f551fe00640 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f5525600640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f550c0a3c40 0x7f550c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f5527e00640 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2cc540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5518009ca0 tx=0x7f5518011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd8e92d6e05dda7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f5525600640 1 -- 172.21.15.82:0/3370140200 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f55200d0af0 con 0x7f5528104470 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f551fe00640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f550c0a3c40 0x7f550c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f551d600640 1 -- 172.21.15.82:0/1551825105 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518004220 con 0x55929c2c7a40 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f551d600640 1 -- 172.21.15.82:0/1551825105 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55180043c0 con 0x55929c2c7a40 2024-04-26T20:24:38.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.745+0000 7f551d600640 1 -- 172.21.15.82:0/1551825105 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55180197d0 con 0x55929c2c7a40 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 -- 172.21.15.82:0/1551825105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 msgr2=0x55929c2cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f551fe00640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f550c0a3c40 0x7f550c0a6100 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5510000c00 tx=0x7f551002a340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2cc540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5518009ca0 tx=0x7f5518011810 comp rx=0 tx=0).stop 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 -- 172.21.15.82:0/1551825105 shutdown_connections 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2cc540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1551825105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7050 0x55929c2c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 -- 172.21.15.82:0/1551825105 >> 172.21.15.82:0/1551825105 conn(0x55929c2c26c0 msgr2=0x55929c2c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 -- 172.21.15.82:0/1551825105 shutdown_connections 2024-04-26T20:24:38.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.746+0000 7f5531b9f740 1 -- 172.21.15.82:0/1551825105 wait complete. 2024-04-26T20:24:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 -- start start 2024-04-26T20:24:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 Processor -- start 2024-04-26T20:24:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2ccbb0 0x55929c2d8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55929c229f80 con 0x55929c2c7050 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55929c1d7260 con 0x55929c2c7a40 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55929c22f2a0 con 0x55929c2ccbb0 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.747+0000 7f5531b9f740 10 client.0 _ll_register_callbacks cb 0x55929c221960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60312/0 (socket says 172.21.15.82:60312) 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 -- 172.21.15.82:0/454676722 learned_addr learned my addr 172.21.15.82:0/454676722 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f5527e00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f552ce00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2ccbb0 0x55929c2d8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 -- 172.21.15.82:0/454676722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2ccbb0 msgr2=0x55929c2d8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2ccbb0 0x55929c2d8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 -- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 msgr2=0x55929c2d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 -- 172.21.15.82:0/454676722 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929c1b91c0 con 0x55929c2c7a40 2024-04-26T20:24:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f551fe00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d14a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5510031000 tx=0x7f5510005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df8bfcd5c0dc0da7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.748+0000 7f5516000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5516000640 1 -- 172.21.15.82:0/454676722 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510037040 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55180043c0 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5516000640 1 -- 172.21.15.82:0/454676722 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5510003a00 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5516000640 1 -- 172.21.15.82:0/454676722 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f551005c050 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5531b9f740 10 client.26096 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55929bf3c3f0 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.749+0000 7f5516000640 1 -- 172.21.15.82:0/454676722 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55180043c0 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5516000640 1 -- 172.21.15.82:0/454676722 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f551003d040 con 0x55929c2c7a40 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5531b9f740 10 client.26096 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5531b9f740 10 client.26096 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5531b9f740 20 client.26096 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5531b9f740 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c2dc970 0x55929c2dee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5531b9f740 4 client.26096 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55929c238880 con 0x55929c2dc970 2024-04-26T20:24:38.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.750+0000 7f5527e00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c2dc970 0x55929c2dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.751+0000 7f5527e00640 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c2dc970 0x55929c2dee10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e9c4605f10202d8 server_cookie=3bd7e56146c9f35e in_seq=0 out_seq=0 2024-04-26T20:24:38.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.751+0000 7f5516000640 10 client.26096 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5516000640 1 -- 172.21.15.82:0/454676722 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55929c238880 con 0x55929c2dc970 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5516000640 10 client.26096 handle_command_reply: tid=0 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 client.26096 shutdown 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 msgr2=0x55929c2d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d14a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5510031000 tx=0x7f5510005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 shutdown_connections 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c2dc970 0x55929c2dee10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2ccbb0 0x55929c2d8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d14a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 --2- 172.21.15.82:0/454676722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.752+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 >> 172.21.15.82:0/454676722 conn(0x55929c2c26c0 msgr2=0x55929c2c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.753+0000 7f5516000640 0 client.26096 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.753+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 shutdown_connections 2024-04-26T20:24:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.753+0000 7f5531b9f740 1 -- 172.21.15.82:0/454676722 wait complete. 2024-04-26T20:24:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.753+0000 7f5531b9f740 20 client.26096 trim_cache size 0 max 16384 2024-04-26T20:24:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 Processor -- start 2024-04-26T20:24:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 -- start start 2024-04-26T20:24:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2d8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 0x55929c2c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55281ad340 con 0x55929c2c7050 2024-04-26T20:24:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55281aee80 con 0x55929c2ccbb0 2024-04-26T20:24:38.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5531b9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55281ada10 con 0x55929c2c7a40 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f552ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 0x55929c2c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f552ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 0x55929c2c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60320/0 (socket says 172.21.15.82:60320) 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f552ce00640 1 -- 172.21.15.82:0/3671623691 learned_addr learned my addr 172.21.15.82:0/3671623691 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.771+0000 7f5527e00640 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f551fe00640 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2d8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f552ce00640 1 -- 172.21.15.82:0/3671623691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 msgr2=0x55929c2d8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f552ce00640 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2d8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f552ce00640 1 -- 172.21.15.82:0/3671623691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 msgr2=0x55929c2cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f552ce00640 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f552ce00640 1 -- 172.21.15.82:0/3671623691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929c0067d0 con 0x55929c2ccbb0 2024-04-26T20:24:38.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f552ce00640 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 0x55929c2c5ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5520009830 tx=0x7f5520087040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9c5d1f12db703a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f551cc00640 1 -- 172.21.15.82:0/3671623691 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55200a0c60 con 0x55929c2ccbb0 2024-04-26T20:24:38.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f551cc00640 1 -- 172.21.15.82:0/3671623691 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55200a5520 con 0x55929c2ccbb0 2024-04-26T20:24:38.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.772+0000 7f551cc00640 1 -- 172.21.15.82:0/3671623691 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55200042f0 con 0x55929c2ccbb0 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 -- 172.21.15.82:0/3671623691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 msgr2=0x55929c2c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 0x55929c2c5ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5520009830 tx=0x7f5520087040 comp rx=0 tx=0).stop 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 -- 172.21.15.82:0/3671623691 shutdown_connections 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2ccbb0 0x55929c2c5ce0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7a40 0x55929c2d8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 --2- 172.21.15.82:0/3671623691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2c7050 0x55929c2cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 -- 172.21.15.82:0/3671623691 >> 172.21.15.82:0/3671623691 conn(0x55929c2c26c0 msgr2=0x55929c2c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 -- 172.21.15.82:0/3671623691 shutdown_connections 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.773+0000 7f5531b9f740 1 -- 172.21.15.82:0/3671623691 wait complete. 2024-04-26T20:24:38.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 -- start start 2024-04-26T20:24:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 Processor -- start 2024-04-26T20:24:38.776 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sig_atomic_t... yes 2024-04-26T20:24:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7050 0x55929c2d5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55281ae7b0 con 0x55929c2ccbb0 2024-04-26T20:24:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55281ae0e0 con 0x55929c2c7a40 2024-04-26T20:24:38.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55281ab320 con 0x55929c2c7050 2024-04-26T20:24:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.774+0000 7f5531b9f740 10 client.0 _ll_register_callbacks cb 0x7f5520009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60324/0 (socket says 172.21.15.82:60324) 2024-04-26T20:24:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f552ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 -- 172.21.15.82:0/1466500028 learned_addr learned my addr 172.21.15.82:0/1466500028 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:38.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f5527e00640 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7050 0x55929c2d5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 -- 172.21.15.82:0/1466500028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7050 msgr2=0x55929c2d5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7050 0x55929c2d5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 -- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 msgr2=0x55929c2d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2d6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 -- 172.21.15.82:0/1466500028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929c1d12a0 con 0x55929c2c7a40 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f551fe00640 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d5dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5510030a80 tx=0x7f551004ffd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc4a10a8f41aaf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.775+0000 7f5516000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5516000640 1 -- 172.21.15.82:0/1466500028 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510037050 con 0x55929c2c7a40 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55200a5520 con 0x55929c2c7a40 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5516000640 1 -- 172.21.15.82:0/1466500028 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5510005450 con 0x55929c2c7a40 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5516000640 1 -- 172.21.15.82:0/1466500028 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f551004ee60 con 0x55929c2c7a40 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5531b9f740 10 client.26102 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:38.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55929c2d8590 con 0x55929c2c7a40 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.776+0000 7f5516000640 1 -- 172.21.15.82:0/1466500028 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55200a5520 con 0x55929c2c7a40 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5516000640 1 -- 172.21.15.82:0/1466500028 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f551003d040 con 0x55929c2c7a40 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5531b9f740 10 client.26102 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5531b9f740 10 client.26102 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5531b9f740 20 client.26102 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c343540 0x55929c345960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5531b9f740 4 client.26102 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55929c2326f0 con 0x55929c343540 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.777+0000 7f5527e00640 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c343540 0x55929c345960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5516000640 10 client.26102 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5527e00640 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c343540 0x55929c345960 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7a918169e384a2d server_cookie=dec0e9fb1b82ca2e in_seq=0 out_seq=0 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5516000640 1 -- 172.21.15.82:0/1466500028 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55929c2326f0 con 0x55929c343540 2024-04-26T20:24:38.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5516000640 10 client.26102 handle_command_reply: tid=0 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 client.26102 shutdown 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 msgr2=0x55929c2d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d5dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5510030a80 tx=0x7f551004ffd0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 shutdown_connections 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55929c343540 0x55929c345960 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55929c2ccbb0 0x55929c2d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55929c2c7a40 0x55929c2d5dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 --2- 172.21.15.82:0/1466500028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55929c2c7050 0x55929c2d5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5516000640 0 client.26102 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 >> 172.21.15.82:0/1466500028 conn(0x55929c2c26c0 msgr2=0x55929c2c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 shutdown_connections 2024-04-26T20:24:38.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.778+0000 7f5531b9f740 1 -- 172.21.15.82:0/1466500028 wait complete. 2024-04-26T20:24:38.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f5531b9f740 20 client.26102 trim_cache size 0 max 16384 2024-04-26T20:24:38.784 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f550c0a3c40 msgr2=0x7f550c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f550c0a3c40 0x7f550c0a6100 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5510000c00 tx=0x7f551002a340 comp rx=0 tx=0).stop 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 msgr2=0x7f5528075260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f5528075260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f552000efc0 tx=0x7f552000c800 comp rx=0 tx=0).stop 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 shutdown_connections 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f550c0a3c40 0x7f550c0a6100 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5528104470 0x7f5528075260 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5528103ab0 0x7f5528074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 --2- 172.21.15.82:0/3370140200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55281028c0 0x7f55280766e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.779+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 >> 172.21.15.82:0/3370140200 conn(0x7f55280fde30 msgr2=0x7f5528106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.780+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 shutdown_connections 2024-04-26T20:24:38.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:38.780+0000 7f552d800640 1 -- 172.21.15.82:0/3370140200 wait complete. 2024-04-26T20:24:38.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:24:38.857 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc needs -traditional... no 2024-04-26T20:24:38.932 INFO:tasks.workunit.client.0.smithi082.stdout:checking for an ANSI C-conforming const... yes 2024-04-26T20:24:39.002 INFO:tasks.workunit.client.0.smithi082.stdout:checking for inline... inline 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 -- 172.21.15.82:0/2811892915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24105c60 msgr2=0x7f0a241060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 --2- 172.21.15.82:0/2811892915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24105c60 0x7f0a241060e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009ca0 tx=0x7f0a0c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 -- 172.21.15.82:0/2811892915 shutdown_connections 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 --2- 172.21.15.82:0/2811892915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24106620 0x7f0a2410ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 --2- 172.21.15.82:0/2811892915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24105c60 0x7f0a241060e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 --2- 172.21.15.82:0/2811892915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 0x7f0a24104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.017+0000 7f0a23e00640 1 -- 172.21.15.82:0/2811892915 >> 172.21.15.82:0/2811892915 conn(0x7f0a240fffe0 msgr2=0x7f0a24102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.018+0000 7f0a23e00640 1 -- 172.21.15.82:0/2811892915 shutdown_connections 2024-04-26T20:24:39.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.018+0000 7f0a23e00640 1 -- 172.21.15.82:0/2811892915 wait complete. 2024-04-26T20:24:39.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 Processor -- start 2024-04-26T20:24:39.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 -- start start 2024-04-26T20:24:39.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 0x7f0a2419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24105c60 0x7f0a2419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 0x7f0a241a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241105f0 con 0x7f0a24104a70 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24110470 con 0x7f0a24106620 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.019+0000 7f0a23e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24110770 con 0x7f0a24105c60 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 0x7f0a2419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 0x7f0a241a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a22000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24105c60 0x7f0a2419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 0x7f0a241a2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60342/0 (socket says 172.21.15.82:60342) 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 0x7f0a2419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41258/0 (socket says 172.21.15.82:41258) 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 -- 172.21.15.82:0/3136298852 learned_addr learned my addr 172.21.15.82:0/3136298852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:39.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a22000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24105c60 0x7f0a2419b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48772/0 (socket says 172.21.15.82:48772) 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 -- 172.21.15.82:0/3136298852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24105c60 msgr2=0x7f0a2419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24105c60 0x7f0a2419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 -- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 msgr2=0x7f0a2419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 0x7f0a2419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.020+0000 7f0a23400640 1 -- 172.21.15.82:0/3136298852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a241a28c0 con 0x7f0a24106620 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.021+0000 7f0a23400640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 0x7f0a241a2220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e970 tx=0x7f0a1400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.021+0000 7f0a1b400640 1 -- 172.21.15.82:0/3136298852 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400ccc0 con 0x7f0a24106620 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.021+0000 7f0a1b400640 1 -- 172.21.15.82:0/3136298852 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1400ce60 con 0x7f0a24106620 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.021+0000 7f0a1b400640 1 -- 172.21.15.82:0/3136298852 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14010430 con 0x7f0a24106620 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.021+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a241a2bb0 con 0x7f0a24106620 2024-04-26T20:24:39.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.021+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a241a3080 con 0x7f0a24106620 2024-04-26T20:24:39.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.024+0000 7f0a2c43b740 1 Processor -- start 2024-04-26T20:24:39.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a1b400640 1 -- 172.21.15.82:0/3136298852 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0a14004f90 con 0x7f0a24106620 2024-04-26T20:24:39.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 -- start start 2024-04-26T20:24:39.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319050 0x55a5e1319470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319a40 0x55a5e131e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1321040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5e127cc70 con 0x55a5e1319a40 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a5e1235980 con 0x55a5e131ebb0 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.025+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a5e1278c30 con 0x55a5e1319050 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1321040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1321040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60354/0 (socket says 172.21.15.82:60354) 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 -- 172.21.15.82:0/1453023316 learned_addr learned my addr 172.21.15.82:0/1453023316 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22a00640 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319a40 0x55a5e131e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319050 0x55a5e1319470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 -- 172.21.15.82:0/1453023316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319050 msgr2=0x55a5e1319470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319050 0x55a5e1319470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 -- 172.21.15.82:0/1453023316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319a40 msgr2=0x55a5e131e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319a40 0x55a5e131e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 -- 172.21.15.82:0/1453023316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e120d7b0 con 0x55a5e131ebb0 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a22000640 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1321040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006010 tx=0x7f0a0c009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2cd09427b274a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.026+0000 7f0a1b400640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0a040a3cc0 0x7f0a040a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a13400640 1 -- 172.21.15.82:0/1453023316 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c032e20 con 0x55a5e131ebb0 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a13400640 1 -- 172.21.15.82:0/1453023316 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a0c036030 con 0x55a5e131ebb0 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a13400640 1 -- 172.21.15.82:0/1453023316 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c004290 con 0x55a5e131ebb0 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a1b400640 1 -- 172.21.15.82:0/3136298852 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0a140d0bf0 con 0x7f0a24106620 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a22a00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0a040a3cc0 0x7f0a040a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1453023316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 msgr2=0x55a5e1321040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1321040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006010 tx=0x7f0a0c009360 comp rx=0 tx=0).stop 2024-04-26T20:24:39.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.027+0000 7f0a22a00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0a040a3cc0 0x7f0a040a6180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55a5e1319e40 tx=0x7f0a1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1453023316 shutdown_connections 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1321040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319a40 0x55a5e131e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1453023316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319050 0x55a5e1319470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1453023316 >> 172.21.15.82:0/1453023316 conn(0x55a5e13146c0 msgr2=0x55a5e1314ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1453023316 shutdown_connections 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1453023316 wait complete. 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 -- start start 2024-04-26T20:24:39.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.028+0000 7f0a2c43b740 1 Processor -- start 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1322d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13232d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e132a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5e127bf80 con 0x55a5e131ebb0 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a5e1229260 con 0x55a5e1319050 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a5e12812a0 con 0x55a5e1319a40 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a2c43b740 10 client.0 _ll_register_callbacks cb 0x55a5e1273960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1322d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1322d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60366/0 (socket says 172.21.15.82:60366) 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a22a00640 1 -- 172.21.15.82:0/1189358749 learned_addr learned my addr 172.21.15.82:0/1189358749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:39.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a23400640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e132a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.029+0000 7f0a22000640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a22a00640 1 -- 172.21.15.82:0/1189358749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 msgr2=0x55a5e13232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a22a00640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a22a00640 1 -- 172.21.15.82:0/1189358749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 msgr2=0x55a5e132a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a22a00640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e132a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a22a00640 1 -- 172.21.15.82:0/1189358749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e120b1c0 con 0x55a5e1319050 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a22a00640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1322d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c013010 tx=0x7f0a1c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953f36ec7d634a7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a0be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a0be00640 1 -- 172.21.15.82:0/1189358749 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c005020 con 0x55a5e1319050 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a0be00640 1 -- 172.21.15.82:0/1189358749 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0a1c0051c0 con 0x55a5e1319050 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.030+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a0c036030 con 0x55a5e1319050 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a0be00640 1 -- 172.21.15.82:0/1189358749 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a1c0053c0 con 0x55a5e1319050 2024-04-26T20:24:39.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 10 client.26114 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5e0f8e3f0 con 0x55a5e1319050 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a0be00640 1 -- 172.21.15.82:0/1189358749 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a0c036030 con 0x55a5e1319050 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a0be00640 1 -- 172.21.15.82:0/1189358749 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0a1c027070 con 0x55a5e1319050 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 10 client.26114 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 10 client.26114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 20 client.26114 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e132e900 0x55a5e1330d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 4 client.26114 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.031+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5e128a880 con 0x55a5e132e900 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.032+0000 7f0a22000640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e132e900 0x55a5e1330d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.032+0000 7f0a22000640 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e132e900 0x55a5e1330d50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954d33f2a9e88049 server_cookie=337f6d5197c7062e in_seq=0 out_seq=0 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.032+0000 7f0a0be00640 10 client.26114 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:39.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a0be00640 1 -- 172.21.15.82:0/1189358749 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5e128a880 con 0x55a5e132e900 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a0be00640 10 client.26114 handle_command_reply: tid=0 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 client.26114 shutdown 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 msgr2=0x55a5e1322d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1322d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c013010 tx=0x7f0a1c004730 comp rx=0 tx=0).stop 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 shutdown_connections 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e132e900 0x55a5e1330d50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e132a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/1189358749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1322d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a0be00640 0 client.26114 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:39.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 >> 172.21.15.82:0/1189358749 conn(0x55a5e13146c0 msgr2=0x55a5e13137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 shutdown_connections 2024-04-26T20:24:39.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.033+0000 7f0a2c43b740 1 -- 172.21.15.82:0/1189358749 wait complete. 2024-04-26T20:24:39.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.034+0000 7f0a2c43b740 20 client.26114 trim_cache size 0 max 16384 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 Processor -- start 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 -- start start 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1323010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e132a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e131a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ad500 con 0x55a5e131ebb0 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241af040 con 0x55a5e1319050 2024-04-26T20:24:39.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.048+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241adbd0 con 0x55a5e1319a40 2024-04-26T20:24:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1323010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a23400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e131a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1323010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60368/0 (socket says 172.21.15.82:60368) 2024-04-26T20:24:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 -- 172.21.15.82:0/975793803 learned_addr learned my addr 172.21.15.82:0/975793803 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22000640 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e132a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 -- 172.21.15.82:0/975793803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 msgr2=0x55a5e132a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e132a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 -- 172.21.15.82:0/975793803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 msgr2=0x55a5e131a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e131a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a22a00640 1 -- 172.21.15.82:0/975793803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e10587d0 con 0x55a5e1319050 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.049+0000 7f0a23400640 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e131a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.050+0000 7f0a22a00640 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1323010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c01eb70 tx=0x7f0a1c003f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58791d918d2561e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.050+0000 7f0a12a00640 1 -- 172.21.15.82:0/975793803 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c01e680 con 0x55a5e1319050 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.050+0000 7f0a12a00640 1 -- 172.21.15.82:0/975793803 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c01ebf0 con 0x55a5e1319050 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.050+0000 7f0a12a00640 1 -- 172.21.15.82:0/975793803 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c01f400 con 0x55a5e1319050 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 -- 172.21.15.82:0/975793803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 msgr2=0x55a5e1323010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1323010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c01eb70 tx=0x7f0a1c003f70 comp rx=0 tx=0).stop 2024-04-26T20:24:39.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 -- 172.21.15.82:0/975793803 shutdown_connections 2024-04-26T20:24:39.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e131ebb0 0x55a5e131a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e132a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/975793803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e1319050 0x55a5e1323010 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 -- 172.21.15.82:0/975793803 >> 172.21.15.82:0/975793803 conn(0x55a5e13146c0 msgr2=0x55a5e13137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 -- 172.21.15.82:0/975793803 shutdown_connections 2024-04-26T20:24:39.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 -- 172.21.15.82:0/975793803 wait complete. 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.051+0000 7f0a2c43b740 1 -- start start 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 Processor -- start 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319050 0x55a5e13273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13278e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1328880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ae970 con 0x55a5e1319050 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ae2a0 con 0x55a5e131ebb0 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ab4e0 con 0x55a5e1319a40 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a2c43b740 10 client.0 _ll_register_callbacks cb 0x7f0a1c009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1328880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a22000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a22a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319050 0x55a5e13273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1328880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60384/0 (socket says 172.21.15.82:60384) 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.052+0000 7f0a22000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13278e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48814/0 (socket says 172.21.15.82:48814) 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 -- 172.21.15.82:0/860112597 learned_addr learned my addr 172.21.15.82:0/860112597 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 -- 172.21.15.82:0/860112597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 msgr2=0x55a5e13278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13278e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 -- 172.21.15.82:0/860112597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319050 msgr2=0x55a5e13273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319050 0x55a5e13273a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 -- 172.21.15.82:0/860112597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e12232a0 con 0x55a5e131ebb0 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a22a00640 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319050 0x55a5e13273a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a23400640 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1328880 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a1409c710 tx=0x7f0a140056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac34a377b6e024df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a0be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a0be00640 1 -- 172.21.15.82:0/860112597 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140bbdd0 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a0be00640 1 -- 172.21.15.82:0/860112597 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0a140a51f0 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.053+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a1c01ebf0 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a0be00640 1 -- 172.21.15.82:0/860112597 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a14080050 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 10 client.26120 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5e132a010 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a0be00640 1 -- 172.21.15.82:0/860112597 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a1c01ebf0 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a0be00640 1 -- 172.21.15.82:0/860112597 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0a14098760 con 0x55a5e131ebb0 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 10 client.26120 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 10 client.26120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 20 client.26120 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e1395090 0x55a5e13974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 4 client.26120 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5e12846f0 con 0x55a5e1395090 2024-04-26T20:24:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.054+0000 7f0a22a00640 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e1395090 0x55a5e13974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a22a00640 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e1395090 0x55a5e13974b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8836b74adf9eb3f2 server_cookie=c15a109f7a8d81c7 in_seq=0 out_seq=0 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a0be00640 10 client.26120 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a0be00640 1 -- 172.21.15.82:0/860112597 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5e12846f0 con 0x55a5e1395090 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a0be00640 10 client.26120 handle_command_reply: tid=0 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 client.26120 shutdown 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 msgr2=0x55a5e1328880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1328880 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a1409c710 tx=0x7f0a140056b0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 shutdown_connections 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a5e1395090 0x55a5e13974b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a5e131ebb0 0x55a5e1328880 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5e1319a40 0x55a5e13278e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a0be00640 0 client.26120 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 --2- 172.21.15.82:0/860112597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5e1319050 0x55a5e13273a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.055+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 >> 172.21.15.82:0/860112597 conn(0x55a5e13146c0 msgr2=0x55a5e13137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 shutdown_connections 2024-04-26T20:24:39.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a2c43b740 1 -- 172.21.15.82:0/860112597 wait complete. 2024-04-26T20:24:39.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a2c43b740 20 client.26120 trim_cache size 0 max 16384 2024-04-26T20:24:39.061 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:24:39.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0a040a3cc0 msgr2=0x7f0a040a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0a040a3cc0 0x7f0a040a6180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55a5e1319e40 tx=0x7f0a1c005f90 comp rx=0 tx=0).stop 2024-04-26T20:24:39.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 msgr2=0x7f0a241a2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 0x7f0a241a2220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e970 tx=0x7f0a1400ed70 comp rx=0 tx=0).stop 2024-04-26T20:24:39.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 shutdown_connections 2024-04-26T20:24:39.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0a040a3cc0 0x7f0a040a6180 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a24106620 0x7f0a241a2220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a24105c60 0x7f0a2419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 --2- 172.21.15.82:0/3136298852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a24104a70 0x7f0a2419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.056+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 >> 172.21.15.82:0/3136298852 conn(0x7f0a240fffe0 msgr2=0x7f0a24109000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.057+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 shutdown_connections 2024-04-26T20:24:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:39.057+0000 7f0a23e00640 1 -- 172.21.15.82:0/3136298852 wait complete. 2024-04-26T20:24:39.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:38 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2332748930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:39.075 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:38 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2332748930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:39.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:38 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2332748930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:24:39.119 INFO:tasks.workunit.client.0.smithi082.stdout:checking for working alloca.h... yes 2024-04-26T20:24:39.235 INFO:tasks.workunit.client.0.smithi082.stdout:checking for alloca... yes 2024-04-26T20:24:39.380 INFO:tasks.workunit.client.0.smithi082.stdout:checking for working memcmp... yes 2024-04-26T20:24:39.516 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strftime... yes 2024-04-26T20:24:39.679 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-04-26T20:24:39.814 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether stat accepts an empty string... no 2024-04-26T20:24:39.975 INFO:tasks.workunit.client.0.smithi082.stdout:checking for vprintf... yes 2024-04-26T20:24:40.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:39 smithi139 ceph-mon[32999]: pgmap v467: 129 pgs: 129 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 188 KiB/s wr, 37 op/s 2024-04-26T20:24:40.078 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:24:40.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:24:40.078 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:24:40.094 INFO:tasks.workunit.client.0.smithi082.stdout:checking for _doprnt... no 2024-04-26T20:24:40.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:39 smithi135 ceph-mon[32816]: pgmap v467: 129 pgs: 129 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 188 KiB/s wr, 37 op/s 2024-04-26T20:24:40.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:39 smithi082 ceph-mon[28105]: pgmap v467: 129 pgs: 129 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 188 KiB/s wr, 37 op/s 2024-04-26T20:24:40.150 INFO:tasks.workunit.client.0.smithi082.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-26T20:24:40.183 INFO:tasks.workunit.client.0.smithi082.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-26T20:24:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 -- 172.21.15.82:0/565591607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 msgr2=0x7f361c101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 --2- 172.21.15.82:0/565591607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c101b60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3614009ca0 tx=0x7f361402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 -- 172.21.15.82:0/565591607 shutdown_connections 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 --2- 172.21.15.82:0/565591607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f361c1032f0 0x7f361c109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 --2- 172.21.15.82:0/565591607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c102930 0x7f361c102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 --2- 172.21.15.82:0/565591607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c101b60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 -- 172.21.15.82:0/565591607 >> 172.21.15.82:0/565591607 conn(0x7f361c0fccd0 msgr2=0x7f361c0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 -- 172.21.15.82:0/565591607 shutdown_connections 2024-04-26T20:24:40.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.259+0000 7f361be00640 1 -- 172.21.15.82:0/565591607 wait complete. 2024-04-26T20:24:40.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 Processor -- start 2024-04-26T20:24:40.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 -- start start 2024-04-26T20:24:40.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f361c102930 0x7f361c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c1032f0 0x7f361c1a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f361c10d290 con 0x7f361c101740 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f361c10d110 con 0x7f361c1032f0 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.260+0000 7f361be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f361c10d410 con 0x7f361c102930 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41328/0 (socket says 172.21.15.82:41328) 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 -- 172.21.15.82:0/4137838005 learned_addr learned my addr 172.21.15.82:0/4137838005 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361b400640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c1032f0 0x7f361c1a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361a000640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f361c102930 0x7f361c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 -- 172.21.15.82:0/4137838005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f361c102930 msgr2=0x7f361c19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f361c102930 0x7f361c19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 -- 172.21.15.82:0/4137838005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c1032f0 msgr2=0x7f361c1a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c1032f0 0x7f361c1a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 -- 172.21.15.82:0/4137838005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c1a2930 con 0x7f361c101740 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361b400640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c1032f0 0x7f361c1a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.261+0000 7f361aa00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c19ad20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3614000f80 tx=0x7f3614003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.262+0000 7f3613400640 1 -- 172.21.15.82:0/4137838005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361402f380 con 0x7f361c101740 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.262+0000 7f3613400640 1 -- 172.21.15.82:0/4137838005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36140317c0 con 0x7f361c101740 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.262+0000 7f3613400640 1 -- 172.21.15.82:0/4137838005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361402fc50 con 0x7f361c101740 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.262+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361c1a2bc0 con 0x7f361c101740 2024-04-26T20:24:40.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.262+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361c1a3110 con 0x7f361c101740 2024-04-26T20:24:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.265+0000 7f36245c1740 1 Processor -- start 2024-04-26T20:24:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.265+0000 7f36245c1740 1 -- start start 2024-04-26T20:24:40.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f36245c1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f36245c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e194f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f36245c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e197a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f36245c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55737e0f4980 con 0x55737e190460 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f36245c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55737e091220 con 0x55737e1955d0 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f36245c1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55737e0f0940 con 0x55737e18fa70 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48840/0 (socket says 172.21.15.82:48840) 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 -- 172.21.15.82:0/379491238 learned_addr learned my addr 172.21.15.82:0/379491238 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361a000640 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 -- 172.21.15.82:0/379491238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 msgr2=0x55737e197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 -- 172.21.15.82:0/379491238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 msgr2=0x55737e194f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e194f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.266+0000 7f361b400640 1 -- 172.21.15.82:0/379491238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55737dece7e0 con 0x55737e18fa70 2024-04-26T20:24:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.267+0000 7f3613400640 1 -- 172.21.15.82:0/4137838005 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3614004040 con 0x7f361c101740 2024-04-26T20:24:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.267+0000 7f361b400640 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18fe90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f360c010400 tx=0x7f360c0108c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc8f83a73201dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.267+0000 7f360b400640 1 -- 172.21.15.82:0/379491238 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c004230 con 0x55737e18fa70 2024-04-26T20:24:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.267+0000 7f360b400640 1 -- 172.21.15.82:0/379491238 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360c0043d0 con 0x55737e18fa70 2024-04-26T20:24:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.267+0000 7f360b400640 1 -- 172.21.15.82:0/379491238 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c003a60 con 0x55737e18fa70 2024-04-26T20:24:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f3613400640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36000a3c40 0x7f36000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 -- 172.21.15.82:0/379491238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 msgr2=0x55737e18fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18fe90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f360c010400 tx=0x7f360c0108c0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f3613400640 1 -- 172.21.15.82:0/4137838005 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f36140f1d60 con 0x7f361c101740 2024-04-26T20:24:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 -- 172.21.15.82:0/379491238 shutdown_connections 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e194f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 --2- 172.21.15.82:0/379491238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18fe90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.268+0000 7f36245c1740 1 -- 172.21.15.82:0/379491238 >> 172.21.15.82:0/379491238 conn(0x55737e18b0e0 msgr2=0x55737e18b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.269+0000 7f361aa00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36000a3c40 0x7f36000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.269+0000 7f36245c1740 1 -- 172.21.15.82:0/379491238 shutdown_connections 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.269+0000 7f36245c1740 1 -- 172.21.15.82:0/379491238 wait complete. 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.269+0000 7f36245c1740 1 -- start start 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.269+0000 7f361aa00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36000a3c40 0x7f36000a6100 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55737e190860 tx=0x7f361402f780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.269+0000 7f36245c1740 1 Processor -- start 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e18fa70 0x55737e199f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e19a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e1955d0 0x55737e1a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55737e198580 con 0x55737e190460 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55737e07c170 con 0x55737e18fa70 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55737e198700 con 0x55737e1955d0 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f36245c1740 10 client.0 _ll_register_callbacks cb 0x55737e0eb770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f361a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f361b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e18fa70 0x55737e199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f361a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41340/0 (socket says 172.21.15.82:41340) 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f361a000640 1 -- 172.21.15.82:0/3394543574 learned_addr learned my addr 172.21.15.82:0/3394543574 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.270+0000 7f361b400640 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e1955d0 0x55737e1a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f361a000640 1 -- 172.21.15.82:0/3394543574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e1955d0 msgr2=0x55737e1a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f361a000640 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e1955d0 0x55737e1a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f361a000640 1 -- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e18fa70 msgr2=0x55737e199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f361a000640 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e18fa70 0x55737e199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f361a000640 1 -- 172.21.15.82:0/3394543574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55737df2ef70 con 0x55737e190460 2024-04-26T20:24:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f361a000640 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e19a450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f36040126e0 tx=0x7f3604012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a4f8d81906cc3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f35ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f35ffe00640 1 -- 172.21.15.82:0/3394543574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604012190 con 0x55737e190460 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f35ffe00640 1 -- 172.21.15.82:0/3394543574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f360400f8c0 con 0x55737e190460 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.271+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f360c0043d0 con 0x55737e190460 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f35ffe00640 1 -- 172.21.15.82:0/3394543574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f360400fac0 con 0x55737e190460 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f36245c1740 10 client.16035 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55737ddc6170 con 0x55737e190460 2024-04-26T20:24:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f35ffe00640 1 -- 172.21.15.82:0/3394543574 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360c0043d0 con 0x55737e190460 2024-04-26T20:24:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f35ffe00640 1 -- 172.21.15.82:0/3394543574 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3604010c20 con 0x55737e190460 2024-04-26T20:24:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f36245c1740 10 client.16035 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f36245c1740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.272+0000 7f36245c1740 20 client.16035 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.273+0000 7f36245c1740 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e1a5a90 0x55737e1a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.273+0000 7f36245c1740 4 client.16035 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.273+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55737e102590 con 0x55737e1a5a90 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.273+0000 7f361b400640 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e1a5a90 0x55737e1a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.273+0000 7f361b400640 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e1a5a90 0x55737e1a7f10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d33526c74038b54e server_cookie=dfdb4b55ecf43ef8 in_seq=0 out_seq=0 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.273+0000 7f35ffe00640 10 client.16035 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f35ffe00640 1 -- 172.21.15.82:0/3394543574 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55737e102590 con 0x55737e1a5a90 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f35ffe00640 10 client.16035 handle_command_reply: tid=0 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 client.16035 shutdown 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 msgr2=0x55737e19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e19a450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f36040126e0 tx=0x7f3604012ba0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 shutdown_connections 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e1a5a90 0x55737e1a7f10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e1955d0 0x55737e1a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e19a450 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f35ffe00640 0 client.16035 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 --2- 172.21.15.82:0/3394543574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e18fa70 0x55737e199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.274+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 >> 172.21.15.82:0/3394543574 conn(0x55737e18b0e0 msgr2=0x55737e18a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.275+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 shutdown_connections 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.275+0000 7f36245c1740 1 -- 172.21.15.82:0/3394543574 wait complete. 2024-04-26T20:24:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.275+0000 7f36245c1740 20 client.16035 trim_cache size 0 max 16384 2024-04-26T20:24:40.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.295+0000 7f36245c1740 1 Processor -- start 2024-04-26T20:24:40.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.295+0000 7f36245c1740 1 -- start start 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f36245c1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f36245c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e18a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f36245c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f36245c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1ad440 con 0x55737e190460 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f36245c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1aef80 con 0x55737e1955d0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f36245c1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1adb10 con 0x55737e18fa70 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e18a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e1a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60422/0 (socket says 172.21.15.82:60422) 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 -- 172.21.15.82:0/1343661346 learned_addr learned my addr 172.21.15.82:0/1343661346 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 -- 172.21.15.82:0/1343661346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 msgr2=0x55737e18a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 -- 172.21.15.82:0/1343661346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 msgr2=0x55737e18a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e18a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.296+0000 7f361b400640 1 -- 172.21.15.82:0/1343661346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55737e19adb0 con 0x55737e1955d0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.297+0000 7f361b400640 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e1a1450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f360c000c00 tx=0x7f360c005cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f9f2df6988b1dad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.297+0000 7f360aa00640 1 -- 172.21.15.82:0/1343661346 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c011900 con 0x55737e1955d0 2024-04-26T20:24:40.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.297+0000 7f360aa00640 1 -- 172.21.15.82:0/1343661346 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360c005500 con 0x55737e1955d0 2024-04-26T20:24:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.297+0000 7f360aa00640 1 -- 172.21.15.82:0/1343661346 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c003cb0 con 0x55737e1955d0 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 -- 172.21.15.82:0/1343661346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 msgr2=0x55737e1a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e1a1450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f360c000c00 tx=0x7f360c005cc0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 -- 172.21.15.82:0/1343661346 shutdown_connections 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e1a1450 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e190460 0x55737e18a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 --2- 172.21.15.82:0/1343661346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e18fa70 0x55737e18a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 -- 172.21.15.82:0/1343661346 >> 172.21.15.82:0/1343661346 conn(0x55737e18b0e0 msgr2=0x55737e189a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 -- 172.21.15.82:0/1343661346 shutdown_connections 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.298+0000 7f36245c1740 1 -- 172.21.15.82:0/1343661346 wait complete. 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 -- start start 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 Processor -- start 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e18fa70 0x55737e1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 0x55737e1a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e19f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1ae8b0 con 0x55737e18fa70 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1ae1e0 con 0x55737e1955d0 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f361c1ab420 con 0x55737e190460 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.299+0000 7f36245c1740 10 client.0 _ll_register_callbacks cb 0x7f3604009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e18fa70 0x55737e1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 0x55737e1a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 0x55737e1a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48872/0 (socket says 172.21.15.82:48872) 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 -- 172.21.15.82:0/1094651239 learned_addr learned my addr 172.21.15.82:0/1094651239 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e18fa70 0x55737e1a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41362/0 (socket says 172.21.15.82:41362) 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361b400640 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e19f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 -- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 msgr2=0x55737e19f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e19f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 -- 172.21.15.82:0/1094651239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e18fa70 msgr2=0x55737e1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e18fa70 0x55737e1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.300+0000 7f361a000640 1 -- 172.21.15.82:0/1094651239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55737e19fad0 con 0x55737e190460 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f361a000640 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 0x55737e1a1290 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f360401c6e0 tx=0x7f36040123c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb689c50b4765dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f35ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f35ffe00640 1 -- 172.21.15.82:0/1094651239 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360402f060 con 0x55737e190460 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f360c005500 con 0x55737e190460 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f35ffe00640 1 -- 172.21.15.82:0/1094651239 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f36040050d0 con 0x55737e190460 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f35ffe00640 1 -- 172.21.15.82:0/1094651239 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36040052d0 con 0x55737e190460 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f36245c1740 10 client.26170 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:40.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55737e20cb60 con 0x55737e190460 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.301+0000 7f35ffe00640 1 -- 172.21.15.82:0/1094651239 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f360c005500 con 0x55737e190460 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f35ffe00640 1 -- 172.21.15.82:0/1094651239 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f36040035f0 con 0x55737e190460 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f36245c1740 10 client.26170 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f36245c1740 10 client.26170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f36245c1740 20 client.26170 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f36245c1740 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e20d540 0x55737e20f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f36245c1740 4 client.26170 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55737e0fc400 con 0x55737e20d540 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f361b400640 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e20d540 0x55737e20f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.302+0000 7f361b400640 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e20d540 0x55737e20f960 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e559b0c9316d987 server_cookie=7fe8c41d15a5947a in_seq=0 out_seq=0 2024-04-26T20:24:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.303+0000 7f35ffe00640 10 client.26170 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.303+0000 7f35ffe00640 1 -- 172.21.15.82:0/1094651239 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55737e0fc400 con 0x55737e20d540 2024-04-26T20:24:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.303+0000 7f35ffe00640 10 client.26170 handle_command_reply: tid=0 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.303+0000 7f36245c1740 1 client.26170 shutdown 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 msgr2=0x55737e1a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 0x55737e1a1290 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f360401c6e0 tx=0x7f36040123c0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 shutdown_connections 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55737e20d540 0x55737e20f960 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55737e1955d0 0x55737e19f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55737e190460 0x55737e1a1290 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 --2- 172.21.15.82:0/1094651239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55737e18fa70 0x55737e1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f35ffe00640 0 client.26170 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 >> 172.21.15.82:0/1094651239 conn(0x55737e18b0e0 msgr2=0x55737e18a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 shutdown_connections 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 1 -- 172.21.15.82:0/1094651239 wait complete. 2024-04-26T20:24:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.304+0000 7f36245c1740 20 client.26170 trim_cache size 0 max 16384 2024-04-26T20:24:40.309 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:24:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:24:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "29fa1fc9-57bc-4a52-a60f-dde4cff32af6", 2024-04-26T20:24:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:24:40.309 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36000a3c40 msgr2=0x7f36000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36000a3c40 0x7f36000a6100 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55737e190860 tx=0x7f361402f780 comp rx=0 tx=0).stop 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 msgr2=0x7f361c19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c19ad20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3614000f80 tx=0x7f3614003ba0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 shutdown_connections 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f36000a3c40 0x7f36000a6100 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f361c1032f0 0x7f361c1a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f361c102930 0x7f361c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 --2- 172.21.15.82:0/4137838005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361c101740 0x7f361c19ad20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 >> 172.21.15.82:0/4137838005 conn(0x7f361c0fccd0 msgr2=0x7f361c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 shutdown_connections 2024-04-26T20:24:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.305+0000 7f361be00640 1 -- 172.21.15.82:0/4137838005 wait complete. 2024-04-26T20:24:40.311 INFO:tasks.workunit.client.0.smithi082.stdout:checking for the pthreads library -lpthreads... no 2024-04-26T20:24:40.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:24:40.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:24:40.419 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether pthreads work without any flags... yes 2024-04-26T20:24:40.523 INFO:tasks.workunit.client.0.smithi082.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-04-26T20:24:40.523 INFO:tasks.workunit.client.0.smithi082.stdout:checking if more special flags are required for pthreads... no 2024-04-26T20:24:40.523 INFO:tasks.workunit.client.0.smithi082.stdout:checking for cc_r... gcc 2024-04-26T20:24:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 -- 172.21.15.82:0/3094639027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 msgr2=0x7f7764102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 --2- 172.21.15.82:0/3094639027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f7764102ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7754009900 tx=0x7f775402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 -- 172.21.15.82:0/3094639027 shutdown_connections 2024-04-26T20:24:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 --2- 172.21.15.82:0/3094639027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764104470 0x7f776410ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 --2- 172.21.15.82:0/3094639027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764103ab0 0x7f7764103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 --2- 172.21.15.82:0/3094639027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f7764102ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 -- 172.21.15.82:0/3094639027 >> 172.21.15.82:0/3094639027 conn(0x7f77640fde30 msgr2=0x7f7764100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.557+0000 7f7769600640 1 -- 172.21.15.82:0/3094639027 shutdown_connections 2024-04-26T20:24:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.558+0000 7f7769600640 1 -- 172.21.15.82:0/3094639027 wait complete. 2024-04-26T20:24:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 Processor -- start 2024-04-26T20:24:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 -- start start 2024-04-26T20:24:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f77640766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764103ab0 0x7f7764074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764104470 0x7f7764075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f776410e3d0 con 0x7f7764103ab0 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f776410e250 con 0x7f7764104470 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.559+0000 7f7769600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f776410e550 con 0x7f77641028c0 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f77640766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f77640766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48886/0 (socket says 172.21.15.82:48886) 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 -- 172.21.15.82:0/1732682515 learned_addr learned my addr 172.21.15.82:0/1732682515 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7768c00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764104470 0x7f7764075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763400640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764103ab0 0x7f7764074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 -- 172.21.15.82:0/1732682515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764104470 msgr2=0x7f7764075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764104470 0x7f7764075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 -- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764103ab0 msgr2=0x7f7764074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764103ab0 0x7f7764074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 -- 172.21.15.82:0/1732682515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7764075af0 con 0x7f77641028c0 2024-04-26T20:24:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.560+0000 7f7763e00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f77640766e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7754031500 tx=0x7f7754003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.561+0000 7f7760c00640 1 -- 172.21.15.82:0/1732682515 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775403f070 con 0x7f77641028c0 2024-04-26T20:24:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.561+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77641a2b50 con 0x7f77641028c0 2024-04-26T20:24:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.561+0000 7f7760c00640 1 -- 172.21.15.82:0/1732682515 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7754031c50 con 0x7f77641028c0 2024-04-26T20:24:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.561+0000 7f7760c00640 1 -- 172.21.15.82:0/1732682515 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754035030 con 0x7f77641028c0 2024-04-26T20:24:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.561+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77641a30a0 con 0x7f77641028c0 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.564+0000 7f776d97d740 1 Processor -- start 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.564+0000 7f776d97d740 1 -- start start 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.564+0000 7f7760c00640 1 -- 172.21.15.82:0/1732682515 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7754042070 con 0x7f77641028c0 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.564+0000 7f776d97d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474872cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.564+0000 7f776d97d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56474872d350 0x564748731e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f776d97d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647487324c0 0x564748734950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f776d97d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56474863d030 con 0x56474872d350 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f776d97d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647486587f0 con 0x5647487324c0 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f776d97d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5647486137e0 con 0x56474872c960 2024-04-26T20:24:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474872cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7763e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56474872d350 0x564748731e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474872cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48896/0 (socket says 172.21.15.82:48896) 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 -- 172.21.15.82:0/2011953786 learned_addr learned my addr 172.21.15.82:0/2011953786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7763400640 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647487324c0 0x564748734950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 -- 172.21.15.82:0/2011953786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647487324c0 msgr2=0x564748734950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647487324c0 0x564748734950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 -- 172.21.15.82:0/2011953786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56474872d350 msgr2=0x564748731e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56474872d350 0x564748731e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.565+0000 7f7768c00640 1 -- 172.21.15.82:0/2011953786 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474861f050 con 0x56474872c960 2024-04-26T20:24:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.566+0000 7f7768c00640 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474872cd80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f775c009fd0 tx=0x7f775c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b05a53f3331a03a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.566+0000 7f7759200640 1 -- 172.21.15.82:0/2011953786 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c004d20 con 0x56474872c960 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.566+0000 7f7759200640 1 -- 172.21.15.82:0/2011953786 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c004050 con 0x56474872c960 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.566+0000 7f7759200640 1 -- 172.21.15.82:0/2011953786 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c005280 con 0x56474872c960 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.566+0000 7f7760c00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f77480a3c40 0x7f77480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f7760c00640 1 -- 172.21.15.82:0/1732682515 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f77540f1100 con 0x7f77641028c0 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f7763e00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f77480a3c40 0x7f77480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 -- 172.21.15.82:0/2011953786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 msgr2=0x56474872cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474872cd80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f775c009fd0 tx=0x7f775c0118d0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 -- 172.21.15.82:0/2011953786 shutdown_connections 2024-04-26T20:24:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647487324c0 0x564748734950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56474872d350 0x564748731e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 --2- 172.21.15.82:0/2011953786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474872cd80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 -- 172.21.15.82:0/2011953786 >> 172.21.15.82:0/2011953786 conn(0x564748727fd0 msgr2=0x5647487283d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 -- 172.21.15.82:0/2011953786 shutdown_connections 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f7763e00640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f77480a3c40 0x7f77480a6100 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x56474872d750 tx=0x7f77540f4bb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.567+0000 7f776d97d740 1 -- 172.21.15.82:0/2011953786 wait complete. 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 -- start start 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 Processor -- start 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x5647487367f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x564748736d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647487324c0 0x56474873dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564748695200 con 0x5647487324c0 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56474868fee0 con 0x56474872c960 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56474869ce70 con 0x56474872d350 2024-04-26T20:24:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.568+0000 7f776d97d740 10 client.0 _ll_register_callbacks cb 0x564748686270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x564748736d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x564748736d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48898/0 (socket says 172.21.15.82:48898) 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 -- 172.21.15.82:0/2578776301 learned_addr learned my addr 172.21.15.82:0/2578776301 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7768c00640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x5647487367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7768c00640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647487324c0 0x56474873dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 -- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 msgr2=0x5647487367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x5647487367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 -- 172.21.15.82:0/2578776301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647487324c0 msgr2=0x56474873dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647487324c0 0x56474873dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 -- 172.21.15.82:0/2578776301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474846c7d0 con 0x56474872d350 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f7763400640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x564748736d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7750012700 tx=0x7f7750012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47427f8a207dcb95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.569+0000 7f774d600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f774d600640 1 -- 172.21.15.82:0/2578776301 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750011c10 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f774d600640 1 -- 172.21.15.82:0/2578776301 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f7750011db0 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775c004050 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f774d600640 1 -- 172.21.15.82:0/2578776301 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f775000f460 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f776d97d740 10 client.26182 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647483a23f0 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f774d600640 1 -- 172.21.15.82:0/2578776301 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c004050 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.570+0000 7f774d600640 1 -- 172.21.15.82:0/2578776301 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f775001c5e0 con 0x56474872d350 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f776d97d740 10 client.26182 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f776d97d740 10 client.26182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f776d97d740 20 client.26182 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f776d97d740 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564748742460 0x564748744880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f776d97d740 4 client.26182 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:40.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56474869e7e0 con 0x564748742460 2024-04-26T20:24:40.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.571+0000 7f7768c00640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564748742460 0x564748744880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.572+0000 7f7768c00640 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564748742460 0x564748744880 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7fb15ba8ab570e8 server_cookie=e399ddb386f0abfc in_seq=0 out_seq=0 2024-04-26T20:24:40.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.572+0000 7f774d600640 10 client.26182 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f774d600640 1 -- 172.21.15.82:0/2578776301 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56474869e7e0 con 0x564748742460 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f774d600640 10 client.26182 handle_command_reply: tid=0 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 client.26182 shutdown 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 msgr2=0x564748736d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x564748736d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7750012700 tx=0x7f7750012bc0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 shutdown_connections 2024-04-26T20:24:40.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564748742460 0x564748744880 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647487324c0 0x56474873dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x564748736d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 --2- 172.21.15.82:0/2578776301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x5647487367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f774d600640 0 client.26182 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 >> 172.21.15.82:0/2578776301 conn(0x564748727fd0 msgr2=0x5647487271f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 shutdown_connections 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.573+0000 7f776d97d740 1 -- 172.21.15.82:0/2578776301 wait complete. 2024-04-26T20:24:40.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.574+0000 7f776d97d740 20 client.26182 trim_cache size 0 max 16384 2024-04-26T20:24:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 Processor -- start 2024-04-26T20:24:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 -- start start 2024-04-26T20:24:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x5647487367f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474873dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872d350 0x56474872e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77641aef40 con 0x564748727fd0 2024-04-26T20:24:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77641adad0 con 0x56474872d350 2024-04-26T20:24:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f776d97d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f77641ae1a0 con 0x56474872c960 2024-04-26T20:24:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f7763400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474873dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.593+0000 7f7768c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x5647487367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474873dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48908/0 (socket says 172.21.15.82:48908) 2024-04-26T20:24:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 -- 172.21.15.82:0/1018685597 learned_addr learned my addr 172.21.15.82:0/1018685597 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7768c00640 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872d350 0x56474872e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 -- 172.21.15.82:0/1018685597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872d350 msgr2=0x56474872e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872d350 0x56474872e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 -- 172.21.15.82:0/1018685597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 msgr2=0x5647487367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x5647487367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 -- 172.21.15.82:0/1018685597 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564748723850 con 0x56474872c960 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.594+0000 7f7763400640 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474873dd30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77500126d0 tx=0x7f7750009d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b12a921dff1a740 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.595+0000 7f774fe00640 1 -- 172.21.15.82:0/1018685597 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750011c10 con 0x56474872c960 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.595+0000 7f774fe00640 1 -- 172.21.15.82:0/1018685597 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7750011db0 con 0x56474872c960 2024-04-26T20:24:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.595+0000 7f774fe00640 1 -- 172.21.15.82:0/1018685597 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750004680 con 0x56474872c960 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.595+0000 7f776d97d740 1 -- 172.21.15.82:0/1018685597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 msgr2=0x56474873dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.595+0000 7f776d97d740 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474873dd30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77500126d0 tx=0x7f7750009d90 comp rx=0 tx=0).stop 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 -- 172.21.15.82:0/1018685597 shutdown_connections 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872d350 0x56474872e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872c960 0x56474873dd30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 --2- 172.21.15.82:0/1018685597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x5647487367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 -- 172.21.15.82:0/1018685597 >> 172.21.15.82:0/1018685597 conn(0x564748735a00 msgr2=0x56474872ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 -- 172.21.15.82:0/1018685597 shutdown_connections 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 -- 172.21.15.82:0/1018685597 wait complete. 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 -- start start 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.596+0000 7f776d97d740 1 Processor -- start 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x56474873b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x56474873beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x56474873cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77641ab3e0 con 0x564748727fd0 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77641ae870 con 0x56474872c960 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f77641aba50 con 0x56474872d350 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f776d97d740 10 client.0 _ll_register_callbacks cb 0x7f77500097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x56474873b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x56474873b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41412/0 (socket says 172.21.15.82:41412) 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 -- 172.21.15.82:0/2535258107 learned_addr learned my addr 172.21.15.82:0/2535258107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7763400640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x56474873beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x56474873cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 -- 172.21.15.82:0/2535258107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 msgr2=0x56474873cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x56474873cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 -- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 msgr2=0x56474873beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x56474873beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.597+0000 7f7768c00640 1 -- 172.21.15.82:0/2535258107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647483620f0 con 0x564748727fd0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f7768c00640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x56474873b970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f775c011dd0 tx=0x7f775c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a401a484425d1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f774d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f774d600640 1 -- 172.21.15.82:0/2535258107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c02ae60 con 0x564748727fd0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f774d600640 1 -- 172.21.15.82:0/2535258107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f775c02a4e0 con 0x564748727fd0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7750011db0 con 0x564748727fd0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f774d600640 1 -- 172.21.15.82:0/2535258107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f775c03c050 con 0x564748727fd0 2024-04-26T20:24:40.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f776d97d740 10 client.16059 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.598+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564748658a30 con 0x564748727fd0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f774d600640 1 -- 172.21.15.82:0/2535258107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7750011db0 con 0x564748727fd0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f774d600640 1 -- 172.21.15.82:0/2535258107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f775c005780 con 0x564748727fd0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f776d97d740 10 client.16059 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f776d97d740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f776d97d740 20 client.16059 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f776d97d740 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5647487324c0 0x5647487ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f776d97d740 4 client.16059 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564748698650 con 0x5647487324c0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.599+0000 7f7763400640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5647487324c0 0x5647487ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f7763400640 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5647487324c0 0x5647487ab450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd580c12e9a4999d server_cookie=d99e3d69e12e6e5a in_seq=0 out_seq=0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f774d600640 10 client.16059 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f774d600640 1 -- 172.21.15.82:0/2535258107 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564748698650 con 0x5647487324c0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f774d600640 10 client.16059 handle_command_reply: tid=0 2024-04-26T20:24:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 client.16059 shutdown 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 msgr2=0x56474873b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x56474873b970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f775c011dd0 tx=0x7f775c009500 comp rx=0 tx=0).stop 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 shutdown_connections 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5647487324c0 0x5647487ab450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56474872d350 0x56474873cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f774d600640 0 client.16059 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56474872c960 0x56474873beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 --2- 172.21.15.82:0/2535258107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564748727fd0 0x56474873b970 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.600+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 >> 172.21.15.82:0/2535258107 conn(0x564748735a00 msgr2=0x56474872ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 shutdown_connections 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f776d97d740 1 -- 172.21.15.82:0/2535258107 wait complete. 2024-04-26T20:24:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f776d97d740 20 client.16059 trim_cache size 0 max 16384 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: "29fa1fc9-57bc-4a52-a60f-dde4cff32af6": { 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "29fa1fc9-57bc-4a52-a60f-dde4cff32af6", 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:24:40.606 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f77480a3c40 msgr2=0x7f77480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f7769600640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f77480a3c40 0x7f77480a6100 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x56474872d750 tx=0x7f77540f4bb0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 msgr2=0x7f77640766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.601+0000 7f7769600640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f77640766e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7754031500 tx=0x7f7754003c10 comp rx=0 tx=0).stop 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 shutdown_connections 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f77480a3c40 0x7f77480a6100 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7764104470 0x7f7764075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7764103ab0 0x7f7764074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 --2- 172.21.15.82:0/1732682515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77641028c0 0x7f77640766e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 >> 172.21.15.82:0/1732682515 conn(0x7f77640fde30 msgr2=0x7f7764106e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 shutdown_connections 2024-04-26T20:24:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:24:40.602+0000 7f7769600640 1 -- 172.21.15.82:0/1732682515 wait complete. 2024-04-26T20:24:40.622 INFO:tasks.cephfs.filesystem:scrub status for tag:29fa1fc9-57bc-4a52-a60f-dde4cff32af6 - {'path': '/', 'tag': '29fa1fc9-57bc-4a52-a60f-dde4cff32af6', 'options': 'recursive,force'} 2024-04-26T20:24:40.669 INFO:tasks.workunit.client.0.smithi082.stdout:checking for setrlimit... yes 2024-04-26T20:24:40.789 INFO:tasks.workunit.client.0.smithi082.stdout:checking for setproctitle... no 2024-04-26T20:24:40.914 INFO:tasks.workunit.client.0.smithi082.stdout:checking for getopt_long... yes 2024-04-26T20:24:41.056 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strtoull... yes 2024-04-26T20:24:41.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:40 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:40 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:40 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:41.195 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strtoq... yes 2024-04-26T20:24:41.332 INFO:tasks.workunit.client.0.smithi082.stdout:checking for snprintf... yes 2024-04-26T20:24:41.482 INFO:tasks.workunit.client.0.smithi082.stdout:checking for vsnprintf... yes 2024-04-26T20:24:41.599 INFO:tasks.workunit.client.0.smithi082.stdout:checking for vfprintf... yes 2024-04-26T20:24:41.728 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gethostname... yes 2024-04-26T20:24:41.866 INFO:tasks.workunit.client.0.smithi082.stdout:checking for setlocale... yes 2024-04-26T20:24:41.987 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sync... yes 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: pgmap v468: 129 pgs: 129 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 203 KiB/s wr, 40 op/s 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:42.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:41 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:24:42.118 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether snprintf is C99 conformant... done 2024-04-26T20:24:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:24:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:42.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:24:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: pgmap v468: 129 pgs: 129 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 203 KiB/s wr, 40 op/s 2024-04-26T20:24:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:24:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:42.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:41 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:24:42.149 INFO:tasks.workunit.client.0.smithi082.stdout:configure: creating ./config.status 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: pgmap v468: 129 pgs: 129 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 203 KiB/s wr, 40 op/s 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:42.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:41 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:24:42.593 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating Makefile 2024-04-26T20:24:42.650 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating src/Makefile 2024-04-26T20:24:42.707 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating man/Makefile 2024-04-26T20:24:42.733 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating config.h 2024-04-26T20:24:42.870 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: executing depfiles commands 2024-04-26T20:24:43.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:42 smithi139 ceph-mon[32999]: pgmap v469: 129 pgs: 129 active+clean; 3.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 229 KiB/s wr, 53 op/s 2024-04-26T20:24:43.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:42 smithi135 ceph-mon[32816]: pgmap v469: 129 pgs: 129 active+clean; 3.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 229 KiB/s wr, 53 op/s 2024-04-26T20:24:43.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:42 smithi082 ceph-mon[28105]: pgmap v469: 129 pgs: 129 active+clean; 3.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 229 KiB/s wr, 53 op/s 2024-04-26T20:24:43.315 INFO:tasks.workunit.client.0.smithi082.stderr:+ make 2024-04-26T20:24:43.332 INFO:tasks.workunit.client.0.smithi082.stdout:make all-recursive 2024-04-26T20:24:43.338 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-26T20:24:43.347 INFO:tasks.workunit.client.0.smithi082.stdout:Making all in src 2024-04-26T20:24:43.357 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-04-26T20:24:43.357 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-04-26T20:24:43.357 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-04-26T20:24:43.612 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-04-26T20:24:43.612 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-04-26T20:24:43.797 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-04-26T20:24:43.797 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-04-26T20:24:43.978 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-04-26T20:24:43.978 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-04-26T20:24:44.138 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-04-26T20:24:44.138 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-04-26T20:24:44.317 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-04-26T20:24:44.317 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-04-26T20:24:44.482 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-04-26T20:24:44.482 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-04-26T20:24:44.679 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-04-26T20:24:44.679 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-04-26T20:24:44.813 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-04-26T20:24:44.813 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-04-26T20:24:44.965 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-04-26T20:24:44.966 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-04-26T20:24:45.064 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 -- 172.21.15.82:0/3730935482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 msgr2=0x7f510c075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 --2- 172.21.15.82:0/3730935482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c075770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009860 tx=0x7f50f802a3d0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 -- 172.21.15.82:0/3730935482 shutdown_connections 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 --2- 172.21.15.82:0/3730935482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 0x7f510c10ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 --2- 172.21.15.82:0/3730935482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c075770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 --2- 172.21.15.82:0/3730935482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 0x7f510c074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 -- 172.21.15.82:0/3730935482 >> 172.21.15.82:0/3730935482 conn(0x7f510c0fdf20 msgr2=0x7f510c100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 -- 172.21.15.82:0/3730935482 shutdown_connections 2024-04-26T20:24:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.070+0000 7f5111400640 1 -- 172.21.15.82:0/3730935482 wait complete. 2024-04-26T20:24:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.071+0000 7f5111400640 1 Processor -- start 2024-04-26T20:24:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 -- start start 2024-04-26T20:24:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 0x7f510c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 0x7f510c1a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f510c110710 con 0x7f510c10a840 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f510c110590 con 0x7f510c0768f0 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5111400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f510c110890 con 0x7f510c075310 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5109e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 0x7f510c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f510a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5109e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 0x7f510c19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34252/0 (socket says 172.21.15.82:34252) 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f510a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c19ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50856/0 (socket says 172.21.15.82:50856) 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f5109e00640 1 -- 172.21.15.82:0/3647878138 learned_addr learned my addr 172.21.15.82:0/3647878138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.072+0000 7f510b200640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 0x7f510c1a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510a800640 1 -- 172.21.15.82:0/3647878138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 msgr2=0x7f510c19b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510a800640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 0x7f510c19b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510a800640 1 -- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 msgr2=0x7f510c1a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510a800640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 0x7f510c1a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510a800640 1 -- 172.21.15.82:0/3647878138 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c1a2940 con 0x7f510c075310 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510b200640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 0x7f510c1a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f510a800640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c19ad30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e9f0 tx=0x7f50fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f5103400640 1 -- 172.21.15.82:0/3647878138 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00ccc0 con 0x7f510c075310 2024-04-26T20:24:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f5103400640 1 -- 172.21.15.82:0/3647878138 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc005020 con 0x7f510c075310 2024-04-26T20:24:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f5103400640 1 -- 172.21.15.82:0/3647878138 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004a00 con 0x7f510c075310 2024-04-26T20:24:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.073+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c1a2c30 con 0x7f510c075310 2024-04-26T20:24:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.074+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1a3130 con 0x7f510c075310 2024-04-26T20:24:45.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 Processor -- start 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5103400640 1 -- 172.21.15.82:0/3647878138 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f50fc004ba0 con 0x7f510c075310 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 -- start start 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513637ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575136385c0 0x55751363d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55751363d730 0x55751363fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55751359c380 con 0x5575136385c0 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557513538c30 con 0x557513637bd0 2024-04-26T20:24:45.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.077+0000 7f5114265740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557513598340 con 0x55751363d730 2024-04-26T20:24:45.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513637ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575136385c0 0x55751363d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513637ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34264/0 (socket says 172.21.15.82:34264) 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 -- 172.21.15.82:0/4055363528 learned_addr learned my addr 172.21.15.82:0/4055363528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f5109e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55751363d730 0x55751363fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 -- 172.21.15.82:0/4055363528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55751363d730 msgr2=0x55751363fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55751363d730 0x55751363fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 -- 172.21.15.82:0/4055363528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575136385c0 msgr2=0x55751363d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575136385c0 0x55751363d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 -- 172.21.15.82:0/4055363528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55751355a940 con 0x557513637bd0 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.078+0000 7f510b200640 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513637ff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f510400f480 tx=0x7f510400f940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30102af42aa7fb21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.079+0000 7f5103400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50f00a3d70 0x7f50f00a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.079+0000 7f50f7400640 1 -- 172.21.15.82:0/4055363528 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510401d070 con 0x557513637bd0 2024-04-26T20:24:45.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.079+0000 7f50f7400640 1 -- 172.21.15.82:0/4055363528 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f510400cc30 con 0x557513637bd0 2024-04-26T20:24:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.079+0000 7f50f7400640 1 -- 172.21.15.82:0/4055363528 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104018cd0 con 0x557513637bd0 2024-04-26T20:24:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.079+0000 7f5103400640 1 -- 172.21.15.82:0/3647878138 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f50fc0d0910 con 0x7f510c075310 2024-04-26T20:24:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.079+0000 7f510a800640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50f00a3d70 0x7f50f00a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 -- 172.21.15.82:0/4055363528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 msgr2=0x557513637ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f510a800640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50f00a3d70 0x7f50f00a6230 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5575136389c0 tx=0x7f50fc0d6530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513637ff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f510400f480 tx=0x7f510400f940 comp rx=0 tx=0).stop 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 -- 172.21.15.82:0/4055363528 shutdown_connections 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55751363d730 0x55751363fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5575136385c0 0x55751363d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 --2- 172.21.15.82:0/4055363528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513637ff0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 -- 172.21.15.82:0/4055363528 >> 172.21.15.82:0/4055363528 conn(0x557513633240 msgr2=0x557513633640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 -- 172.21.15.82:0/4055363528 shutdown_connections 2024-04-26T20:24:45.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.080+0000 7f5114265740 1 -- 172.21.15.82:0/4055363528 wait complete. 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.081+0000 7f5114265740 1 -- start start 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.081+0000 7f5114265740 1 Processor -- start 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55751363d730 0x557513649360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5575136406e0 con 0x557513637bd0 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557513523c60 con 0x55751363d730 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557513640860 con 0x5575136385c0 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5114265740 10 client.0 _ll_register_callbacks cb 0x55751354fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f510b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f510b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59438/0 (socket says 172.21.15.82:59438) 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f510b200640 1 -- 172.21.15.82:0/1891435111 learned_addr learned my addr 172.21.15.82:0/1891435111 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5109e00640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f510b200640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55751363d730 0x557513649360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5109e00640 1 -- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55751363d730 msgr2=0x557513649360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5109e00640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55751363d730 0x557513649360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5109e00640 1 -- 172.21.15.82:0/1891435111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 msgr2=0x557513641e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5109e00640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f5109e00640 1 -- 172.21.15.82:0/1891435111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557513532510 con 0x5575136385c0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.082+0000 7f510b200640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f5109e00640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513642390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009830 tx=0x7f50f8030cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d28466889ac3344 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f50ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f50ebe00640 1 -- 172.21.15.82:0/1891435111 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8004050 con 0x5575136385c0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f510400cc30 con 0x5575136385c0 2024-04-26T20:24:45.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f50ebe00640 1 -- 172.21.15.82:0/1891435111 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f50f80041f0 con 0x5575136385c0 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f50ebe00640 1 -- 172.21.15.82:0/1891435111 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50f804e050 con 0x5575136385c0 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f5114265740 10 client.26200 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.083+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5575132ae210 con 0x5575136385c0 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f50ebe00640 1 -- 172.21.15.82:0/1891435111 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f510400cc30 con 0x5575136385c0 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f50ebe00640 1 -- 172.21.15.82:0/1891435111 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f50f8004a30 con 0x5575136385c0 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f5114265740 10 client.26200 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f5114265740 10 client.26200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f5114265740 20 client.26200 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f5114265740 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x55751364fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f5114265740 4 client.26200 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.084+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575135a9f90 con 0x55751364d900 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.085+0000 7f510b200640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x55751364fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.085+0000 7f510b200640 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x55751364fd50 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a97a4db1131ec332 server_cookie=b7309b3f538127f4 in_seq=0 out_seq=0 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.085+0000 7f50ebe00640 10 client.26200 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f50ebe00640 1 -- 172.21.15.82:0/1891435111 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5575135a9f90 con 0x55751364d900 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f50ebe00640 10 client.26200 handle_command_reply: tid=0 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 client.26200 shutdown 2024-04-26T20:24:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 msgr2=0x557513642390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513642390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009830 tx=0x7f50f8030cb0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 shutdown_connections 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x55751364fd50 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55751363d730 0x557513649360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f50ebe00640 0 client.26200 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 --2- 172.21.15.82:0/1891435111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 >> 172.21.15.82:0/1891435111 conn(0x557513633240 msgr2=0x557513632440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 shutdown_connections 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.086+0000 7f5114265740 1 -- 172.21.15.82:0/1891435111 wait complete. 2024-04-26T20:24:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.087+0000 7f5114265740 20 client.26200 trim_cache size 0 max 16384 2024-04-26T20:24:45.102 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-04-26T20:24:45.103 INFO:tasks.workunit.client.0.smithi082.stdout:Making all in man 2024-04-26T20:24:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 Processor -- start 2024-04-26T20:24:45.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 -- start start 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513635fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ad460 con 0x55751363d730 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1aefa0 con 0x5575136385c0 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5114265740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1adb30 con 0x557513637bd0 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f5109e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.103+0000 7f510b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34284/0 (socket says 172.21.15.82:34284) 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 -- 172.21.15.82:0/4181027821 learned_addr learned my addr 172.21.15.82:0/4181027821 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f510b200640 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513635fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 -- 172.21.15.82:0/4181027821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557513637bd0 msgr2=0x557513641e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 -- 172.21.15.82:0/4181027821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 msgr2=0x557513635fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513635fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 -- 172.21.15.82:0/4181027821 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55751337a620 con 0x5575136385c0 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f510b200640 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513635fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f5109e00640 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 0x557513642390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009780 tx=0x7f50f8003800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c44cb269fd86f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.104+0000 7f50f6a00640 1 -- 172.21.15.82:0/4181027821 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8005c90 con 0x5575136385c0 2024-04-26T20:24:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f50f6a00640 1 -- 172.21.15.82:0/4181027821 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f804b070 con 0x5575136385c0 2024-04-26T20:24:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f50f6a00640 1 -- 172.21.15.82:0/4181027821 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8005410 con 0x5575136385c0 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 -- 172.21.15.82:0/4181027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 msgr2=0x557513642390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 0x557513642390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009780 tx=0x7f50f8003800 comp rx=0 tx=0).stop 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 -- 172.21.15.82:0/4181027821 shutdown_connections 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513635fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575136385c0 0x557513642390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 --2- 172.21.15.82:0/4181027821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557513637bd0 0x557513641e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.105+0000 7f5114265740 1 -- 172.21.15.82:0/4181027821 >> 172.21.15.82:0/4181027821 conn(0x557513633240 msgr2=0x557513633620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.106+0000 7f5114265740 1 -- 172.21.15.82:0/4181027821 shutdown_connections 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.106+0000 7f5114265740 1 -- 172.21.15.82:0/4181027821 wait complete. 2024-04-26T20:24:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.106+0000 7f5114265740 1 -- start start 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.106+0000 7f5114265740 1 Processor -- start 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.106+0000 7f5114265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513645f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.106+0000 7f5114265740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513646480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5114265740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513647490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5114265740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ae8d0 con 0x55751363d730 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5114265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ae200 con 0x557513637bd0 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5114265740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ab440 con 0x5575136385c0 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5114265740 10 client.0 _ll_register_callbacks cb 0x7f50f80096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f510b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513645f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f510b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513647490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513646480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f510b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513647490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59448/0 (socket says 172.21.15.82:59448) 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513646480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50880/0 (socket says 172.21.15.82:50880) 2024-04-26T20:24:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f510b200640 1 -- 172.21.15.82:0/3749684690 learned_addr learned my addr 172.21.15.82:0/3749684690 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 -- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 msgr2=0x557513645f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513645f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 -- 172.21.15.82:0/3749684690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 msgr2=0x557513647490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513647490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.107+0000 7f5109e00640 1 -- 172.21.15.82:0/3749684690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557513556cb0 con 0x5575136385c0 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f5109e00640 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513646480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f50f8004ec0 tx=0x7f50f80048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae10de6ef2eaac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f50ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:45.112 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-04-26T20:24:45.112 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Nothing to be done for 'all'. 2024-04-26T20:24:45.112 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f50ebe00640 1 -- 172.21.15.82:0/3749684690 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f805f070 con 0x5575136385c0 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f50ebe00640 1 -- 172.21.15.82:0/3749684690 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f50f8005320 con 0x5575136385c0 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50f804b070 con 0x5575136385c0 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f50ebe00640 1 -- 172.21.15.82:0/3749684690 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50f806b050 con 0x5575136385c0 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f5114265740 10 client.26206 fetch_fsmap learned FSMap version 29 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.108+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557513648bc0 con 0x5575136385c0 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f50ebe00640 1 -- 172.21.15.82:0/3749684690 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f804b070 con 0x5575136385c0 2024-04-26T20:24:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f50ebe00640 1 -- 172.21.15.82:0/3749684690 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f50f80648f0 con 0x5575136385c0 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f5114265740 10 client.26206 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f5114265740 10 client.26206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f5114265740 20 client.26206 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f5114265740 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x5575136b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f5114265740 4 client.26206 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575135a3e00 con 0x55751364d900 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.109+0000 7f510b200640 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x5575136b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.110+0000 7f50ebe00640 10 client.26206 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.110+0000 7f510b200640 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x5575136b6610 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20aa658aa337de57 server_cookie=4830c986d53b6506 in_seq=0 out_seq=0 2024-04-26T20:24:45.116 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-26T20:24:45.116 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-26T20:24:45.116 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-26T20:24:45.117 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd src 2024-04-26T20:24:45.132 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir blogtest_in 2024-04-26T20:24:45.154 INFO:tasks.workunit.client.0.smithi082.stdout:running blogbench 2024-04-26T20:24:45.154 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'running blogbench' 2024-04-26T20:24:45.154 INFO:tasks.workunit.client.0.smithi082.stderr:+ ./blogbench -d blogtest_in 2024-04-26T20:24:45.156 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-04-26T20:24:45.156 INFO:tasks.workunit.client.0.smithi082.stdout:Frequency = 10 secs 2024-04-26T20:24:45.156 INFO:tasks.workunit.client.0.smithi082.stdout:Scratch dir = [blogtest_in] 2024-04-26T20:24:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.156+0000 7f50ebe00640 1 -- 172.21.15.82:0/3749684690 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575135a3e00 con 0x55751364d900 2024-04-26T20:24:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.156+0000 7f50ebe00640 10 client.26206 handle_command_reply: tid=0 2024-04-26T20:24:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.156+0000 7f5114265740 1 client.26206 shutdown 2024-04-26T20:24:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.156+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 msgr2=0x557513646480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.156+0000 7f5114265740 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513646480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f50f8004ec0 tx=0x7f50f80048f0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 shutdown_connections 2024-04-26T20:24:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f5114265740 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55751364d900 0x5575136b6610 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f5114265740 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55751363d730 0x557513647490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f5114265740 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5575136385c0 0x557513646480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f5114265740 1 --2- 172.21.15.82:0/3749684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557513637bd0 0x557513645f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 >> 172.21.15.82:0/3749684690 conn(0x557513633240 msgr2=0x557513639840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.157+0000 7f50ebe00640 0 client.26206 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.158+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 shutdown_connections 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.159+0000 7f5114265740 1 -- 172.21.15.82:0/3749684690 wait complete. 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.159+0000 7f5114265740 20 client.26206 trim_cache size 0 max 16384 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:24:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:24:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50f00a3d70 msgr2=0x7f50f00a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50f00a3d70 0x7f50f00a6230 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5575136389c0 tx=0x7f50fc0d6530 comp rx=0 tx=0).stop 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 msgr2=0x7f510c19ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c19ad30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e9f0 tx=0x7f50fc00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 shutdown_connections 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f50f00a3d70 0x7f50f00a6230 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f510c10a840 0x7f510c1a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f510c0768f0 0x7f510c19b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 --2- 172.21.15.82:0/3647878138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f510c075310 0x7f510c19ad30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 >> 172.21.15.82:0/3647878138 conn(0x7f510c0fdf20 msgr2=0x7f510c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:45.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 shutdown_connections 2024-04-26T20:24:45.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:45.160+0000 7f5111400640 1 -- 172.21.15.82:0/3647878138 wait complete. 2024-04-26T20:24:46.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:45 smithi139 ceph-mon[32999]: pgmap v470: 129 pgs: 129 active+clean; 4.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 348 KiB/s wr, 62 op/s 2024-04-26T20:24:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:45 smithi135 ceph-mon[32816]: pgmap v470: 129 pgs: 129 active+clean; 4.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 348 KiB/s wr, 62 op/s 2024-04-26T20:24:46.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:45 smithi082 ceph-mon[28105]: pgmap v470: 129 pgs: 129 active+clean; 4.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 348 KiB/s wr, 62 op/s 2024-04-26T20:24:46.981 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 3 writers... 2024-04-26T20:24:46.982 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 1 rewriters... 2024-04-26T20:24:46.982 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 5 commenters... 2024-04-26T20:24:46.982 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 100 readers... 2024-04-26T20:24:46.990 INFO:tasks.workunit.client.0.smithi082.stdout:Benchmarking for 30 iterations. 2024-04-26T20:24:46.990 INFO:tasks.workunit.client.0.smithi082.stdout:The test will run during 5 minutes. 2024-04-26T20:24:46.990 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-04-26T20:24:46.990 INFO:tasks.workunit.client.0.smithi082.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-04-26T20:24:48.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:47 smithi139 ceph-mon[32999]: pgmap v471: 129 pgs: 129 active+clean; 4.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 359 KiB/s wr, 70 op/s 2024-04-26T20:24:48.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:47 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:24:48.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:47 smithi135 ceph-mon[32816]: pgmap v471: 129 pgs: 129 active+clean; 4.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 359 KiB/s wr, 70 op/s 2024-04-26T20:24:48.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:47 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:24:48.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:47 smithi082 ceph-mon[28105]: pgmap v471: 129 pgs: 129 active+clean; 4.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 359 KiB/s wr, 70 op/s 2024-04-26T20:24:48.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:47 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:24:50.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:49 smithi139 ceph-mon[32999]: pgmap v472: 129 pgs: 129 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 413 KiB/s wr, 89 op/s 2024-04-26T20:24:50.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:49 smithi135 ceph-mon[32816]: pgmap v472: 129 pgs: 129 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 413 KiB/s wr, 89 op/s 2024-04-26T20:24:50.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:49 smithi082 ceph-mon[28105]: pgmap v472: 129 pgs: 129 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 413 KiB/s wr, 89 op/s 2024-04-26T20:24:51.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:50 smithi139 ceph-mon[32999]: pgmap v473: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 258 KiB/s wr, 87 op/s 2024-04-26T20:24:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:50 smithi135 ceph-mon[32816]: pgmap v473: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 258 KiB/s wr, 87 op/s 2024-04-26T20:24:51.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:50 smithi082 ceph-mon[28105]: pgmap v473: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 258 KiB/s wr, 87 op/s 2024-04-26T20:24:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:52 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:24:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:52 smithi139 ceph-mon[32999]: pgmap v474: 129 pgs: 129 active+clean; 9.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 718 KiB/s wr, 91 op/s 2024-04-26T20:24:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:52 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:24:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:52 smithi135 ceph-mon[32816]: pgmap v474: 129 pgs: 129 active+clean; 9.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 718 KiB/s wr, 91 op/s 2024-04-26T20:24:53.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:52 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:24:53.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:52 smithi082 ceph-mon[28105]: pgmap v474: 129 pgs: 129 active+clean; 9.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 718 KiB/s wr, 91 op/s 2024-04-26T20:24:56.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:55 smithi139 ceph-mon[32999]: pgmap v475: 129 pgs: 129 active+clean; 13 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1016 KiB/s wr, 106 op/s 2024-04-26T20:24:56.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:55 smithi135 ceph-mon[32816]: pgmap v475: 129 pgs: 129 active+clean; 13 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1016 KiB/s wr, 106 op/s 2024-04-26T20:24:56.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:55 smithi082 ceph-mon[28105]: pgmap v475: 129 pgs: 129 active+clean; 13 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1016 KiB/s wr, 106 op/s 2024-04-26T20:24:56.990 INFO:tasks.workunit.client.0.smithi082.stdout: 6 94294 604 56444 513 40417 748 2024-04-26T20:24:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:57 smithi139 ceph-mon[32999]: pgmap v476: 129 pgs: 129 active+clean; 24 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.9 MiB/s wr, 137 op/s 2024-04-26T20:24:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:57 smithi135 ceph-mon[32816]: pgmap v476: 129 pgs: 129 active+clean; 24 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.9 MiB/s wr, 137 op/s 2024-04-26T20:24:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:57 smithi082 ceph-mon[28105]: pgmap v476: 129 pgs: 129 active+clean; 24 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.9 MiB/s wr, 137 op/s 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 -- 172.21.15.82:0/1929739266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c104370 msgr2=0x7ffb7c10ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 --2- 172.21.15.82:0/1929739266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c104370 0x7ffb7c10ac00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009ca0 tx=0x7ffb7402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 -- 172.21.15.82:0/1929739266 shutdown_connections 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 --2- 172.21.15.82:0/1929739266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c104370 0x7ffb7c10ac00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 --2- 172.21.15.82:0/1929739266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c1039b0 0x7ffb7c103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 --2- 172.21.15.82:0/1929739266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 -- 172.21.15.82:0/1929739266 >> 172.21.15.82:0/1929739266 conn(0x7ffb7c0fdd30 msgr2=0x7ffb7c100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 -- 172.21.15.82:0/1929739266 shutdown_connections 2024-04-26T20:24:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.342+0000 7ffb7b200640 1 -- 172.21.15.82:0/1929739266 wait complete. 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.343+0000 7ffb7b200640 1 Processor -- start 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.343+0000 7ffb7b200640 1 -- start start 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1039b0 0x7ffb7c19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c104370 0x7ffb7c1a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c10e320 con 0x7ffb7c1027c0 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c10e1a0 con 0x7ffb7c104370 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c10e4a0 con 0x7ffb7c1039b0 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb79e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb79e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54940/0 (socket says 172.21.15.82:54940) 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb79e00640 1 -- 172.21.15.82:0/3374815570 learned_addr learned my addr 172.21.15.82:0/3374815570 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb79400640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1039b0 0x7ffb7c19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.344+0000 7ffb7a800640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c104370 0x7ffb7c1a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79e00640 1 -- 172.21.15.82:0/3374815570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1039b0 msgr2=0x7ffb7c19b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79e00640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1039b0 0x7ffb7c19b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79e00640 1 -- 172.21.15.82:0/3374815570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c104370 msgr2=0x7ffb7c1a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79e00640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c104370 0x7ffb7c1a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79e00640 1 -- 172.21.15.82:0/3374815570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c1a2800 con 0x7ffb7c1027c0 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79400640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1039b0 0x7ffb7c19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:24:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb7a800640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c104370 0x7ffb7c1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb79e00640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c19abe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00e9c0 tx=0x7ffb6c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb72a00640 1 -- 172.21.15.82:0/3374815570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00cde0 con 0x7ffb7c1027c0 2024-04-26T20:24:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb72a00640 1 -- 172.21.15.82:0/3374815570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb6c0108e0 con 0x7ffb7c1027c0 2024-04-26T20:24:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.345+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c1a2af0 con 0x7ffb7c1027c0 2024-04-26T20:24:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.346+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c1a3090 con 0x7ffb7c1027c0 2024-04-26T20:24:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.346+0000 7ffb72a00640 1 -- 172.21.15.82:0/3374815570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c018960 con 0x7ffb7c1027c0 2024-04-26T20:24:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.349+0000 7ffb83ba4740 1 Processor -- start 2024-04-26T20:24:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 -- start start 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 0x55a7a5b56200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b567d0 0x55a7a5b5b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b5ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a7a5aba380 con 0x55a7a5b567d0 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7a5a56c30 con 0x55a7a5b5b940 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a7a5ab6340 con 0x55a7a5b55de0 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.350+0000 7ffb72a00640 1 -- 172.21.15.82:0/3374815570 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ffb6c01f020 con 0x7ffb7c1027c0 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 0x55a7a5b56200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 0x55a7a5b56200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47760/0 (socket says 172.21.15.82:47760) 2024-04-26T20:24:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 -- 172.21.15.82:0/115813325 learned_addr learned my addr 172.21.15.82:0/115813325 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb79400640 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b5ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb79e00640 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b567d0 0x55a7a5b5b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 -- 172.21.15.82:0/115813325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 msgr2=0x55a7a5b5ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b5ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 -- 172.21.15.82:0/115813325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b567d0 msgr2=0x55a7a5b5b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b567d0 0x55a7a5b5b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb7a800640 1 -- 172.21.15.82:0/115813325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a5a78940 con 0x55a7a5b55de0 2024-04-26T20:24:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.351+0000 7ffb79400640 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b5ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.352+0000 7ffb7a800640 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 0x55a7a5b56200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffb74005e30 tx=0x7ffb74005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973ac2cbc8ad19a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.352+0000 7ffb67000640 1 -- 172.21.15.82:0/115813325 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74031650 con 0x55a7a5b55de0 2024-04-26T20:24:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.352+0000 7ffb67000640 1 -- 172.21.15.82:0/115813325 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb74036040 con 0x55a7a5b55de0 2024-04-26T20:24:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.352+0000 7ffb67000640 1 -- 172.21.15.82:0/115813325 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74004700 con 0x55a7a5b55de0 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb72a00640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffb600a3cb0 0x7ffb600a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 -- 172.21.15.82:0/115813325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 msgr2=0x55a7a5b56200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 0x55a7a5b56200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffb74005e30 tx=0x7ffb74005f70 comp rx=0 tx=0).stop 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb72a00640 1 -- 172.21.15.82:0/3374815570 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ffb6c0d0b40 con 0x7ffb7c1027c0 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 -- 172.21.15.82:0/115813325 shutdown_connections 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b5ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b567d0 0x55a7a5b5b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/115813325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b55de0 0x55a7a5b56200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb83ba4740 1 -- 172.21.15.82:0/115813325 >> 172.21.15.82:0/115813325 conn(0x55a7a5b51450 msgr2=0x55a7a5b51850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.353+0000 7ffb79e00640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffb600a3cb0 0x7ffb600a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.354+0000 7ffb83ba4740 1 -- 172.21.15.82:0/115813325 shutdown_connections 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.354+0000 7ffb83ba4740 1 -- 172.21.15.82:0/115813325 wait complete. 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.354+0000 7ffb79e00640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffb600a3cb0 0x7ffb600a6170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55a7a5b56bd0 tx=0x7ffb6c00efb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.354+0000 7ffb83ba4740 1 -- start start 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 Processor -- start 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b68800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b68d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a7a5b5e890 con 0x55a7a5b55de0 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7a5a41c60 con 0x55a7a5b5b940 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a7a5b5ea10 con 0x55a7a5b567d0 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.355+0000 7ffb83ba4740 10 client.0 _ll_register_callbacks cb 0x55a7a5a6de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b68d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b68d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47764/0 (socket says 172.21.15.82:47764) 2024-04-26T20:24:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 -- 172.21.15.82:0/2614499428 learned_addr learned my addr 172.21.15.82:0/2614499428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b68800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 -- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 msgr2=0x55a7a5b6fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 -- 172.21.15.82:0/2614499428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 msgr2=0x55a7a5b68800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b68800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 -- 172.21.15.82:0/2614499428 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a5a50510 con 0x55a7a5b567d0 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb79400640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b68d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb68012d20 tx=0x7ffb6800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fae6f0b2b3fc072 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.356+0000 7ffb5b400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:24:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.357+0000 7ffb5b400640 1 -- 172.21.15.82:0/2614499428 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb680120d0 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.357+0000 7ffb5b400640 1 -- 172.21.15.82:0/2614499428 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ffb68005020 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.357+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb74036040 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.357+0000 7ffb5b400640 1 -- 172.21.15.82:0/2614499428 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffb68025050 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.357+0000 7ffb83ba4740 10 client.26218 fetch_fsmap learned FSMap version 31 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.357+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a7a57cc210 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb5b400640 1 -- 172.21.15.82:0/2614499428 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb74036040 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb5b400640 1 -- 172.21.15.82:0/2614499428 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7ffb6801c470 con 0x55a7a5b567d0 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb83ba4740 10 client.26218 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb83ba4740 10 client.26218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb83ba4740 20 client.26218 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5b74440 0x55a7a5b768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb83ba4740 4 client.26218 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7a5ac7f90 con 0x55a7a5b74440 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.358+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5b74440 0x55a7a5b768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.359+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5b74440 0x55a7a5b768a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704c20366a7eeeb0 server_cookie=6fe239141a9b76ca in_seq=0 out_seq=0 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.359+0000 7ffb5b400640 10 client.26218 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb5b400640 1 -- 172.21.15.82:0/2614499428 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a7a5ac7f90 con 0x55a7a5b74440 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb5b400640 10 client.26218 handle_command_reply: tid=0 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 client.26218 shutdown 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 msgr2=0x55a7a5b68d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b68d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb68012d20 tx=0x7ffb6800f790 comp rx=0 tx=0).stop 2024-04-26T20:24:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 shutdown_connections 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5b74440 0x55a7a5b768a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b68d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2614499428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b68800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb5b400640 0 client.26218 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 >> 172.21.15.82:0/2614499428 conn(0x55a7a5b51450 msgr2=0x55a7a5b50650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 shutdown_connections 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.360+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2614499428 wait complete. 2024-04-26T20:24:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.361+0000 7ffb83ba4740 20 client.26218 trim_cache size 0 max 16384 2024-04-26T20:24:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 Processor -- start 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 -- start start 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c00fa50 con 0x55a7a5b55de0 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c011650 con 0x55a7a5b5b940 2024-04-26T20:24:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.379+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c010120 con 0x55a7a5b567d0 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb7a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb79400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb7a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54964/0 (socket says 172.21.15.82:54964) 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb7a800640 1 -- 172.21.15.82:0/2349767087 learned_addr learned my addr 172.21.15.82:0/2349767087 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b54a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb79400640 1 -- 172.21.15.82:0/2349767087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 msgr2=0x55a7a5b54a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb79400640 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b54a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb79400640 1 -- 172.21.15.82:0/2349767087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 msgr2=0x55a7a5b544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb79400640 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb79400640 1 -- 172.21.15.82:0/2349767087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a5898620 con 0x55a7a5b567d0 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.380+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b54a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.381+0000 7ffb79400640 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6fd40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb6801ca50 tx=0x7ffb68012990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb138d61750385f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.381+0000 7ffb66600640 1 -- 172.21.15.82:0/2349767087 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6802e070 con 0x55a7a5b567d0 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.381+0000 7ffb66600640 1 -- 172.21.15.82:0/2349767087 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb68005580 con 0x55a7a5b567d0 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.381+0000 7ffb66600640 1 -- 172.21.15.82:0/2349767087 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6801cad0 con 0x55a7a5b567d0 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2349767087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 msgr2=0x55a7a5b6fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6fd40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb6801ca50 tx=0x7ffb68012990 comp rx=0 tx=0).stop 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2349767087 shutdown_connections 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b5b940 0x55a7a5b54a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6fd40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2349767087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b55de0 0x55a7a5b544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2349767087 >> 172.21.15.82:0/2349767087 conn(0x55a7a5b51450 msgr2=0x55a7a5b57970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2349767087 shutdown_connections 2024-04-26T20:24:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.382+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2349767087 wait complete. 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 -- start start 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 Processor -- start 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 0x55a7a5b6d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c010ec0 con 0x55a7a5b5b940 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c0107f0 con 0x55a7a5b55de0 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.383+0000 7ffb83ba4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c00da30 con 0x55a7a5b567d0 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb83ba4740 10 client.0 _ll_register_callbacks cb 0x7ffb68009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 0x55a7a5b6d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 0x55a7a5b6d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45198/0 (socket says 172.21.15.82:45198) 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 -- 172.21.15.82:0/2887740659 learned_addr learned my addr 172.21.15.82:0/2887740659 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:24:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb79400640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 -- 172.21.15.82:0/2887740659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 msgr2=0x55a7a5b6d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 -- 172.21.15.82:0/2887740659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b5b940 msgr2=0x55a7a5b6e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.384+0000 7ffb7a800640 1 -- 172.21.15.82:0/2887740659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a5a74cb0 con 0x55a7a5b55de0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb7a800640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 0x55a7a5b6d170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009a60 tx=0x7ffb74005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4a6a7acc0287e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb5b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb5b400640 1 -- 172.21.15.82:0/2887740659 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74003a30 con 0x55a7a5b55de0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb68005580 con 0x55a7a5b55de0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb5b400640 1 -- 172.21.15.82:0/2887740659 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ffb7402f770 con 0x55a7a5b55de0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb5b400640 1 -- 172.21.15.82:0/2887740659 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffb7402f970 con 0x55a7a5b55de0 2024-04-26T20:24:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb83ba4740 10 client.26189 fetch_fsmap learned FSMap version 31 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.385+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a7a5b6fe10 con 0x55a7a5b55de0 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb5b400640 1 -- 172.21.15.82:0/2887740659 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb68005580 con 0x55a7a5b55de0 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb5b400640 1 -- 172.21.15.82:0/2887740659 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7ffb74030ba0 con 0x55a7a5b55de0 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb83ba4740 10 client.26189 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb83ba4740 10 client.26189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb83ba4740 20 client.26189 populate_metadata read hostname 'smithi082' 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5bdaaa0 0x55a7a5bdcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb83ba4740 4 client.26189 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:24:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.386+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7a5ac1e00 con 0x55a7a5bdaaa0 2024-04-26T20:24:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.387+0000 7ffb79400640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5bdaaa0 0x55a7a5bdcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.387+0000 7ffb79400640 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5bdaaa0 0x55a7a5bdcec0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55cc8a62f7f20839 server_cookie=28bd39661b127692 in_seq=0 out_seq=0 2024-04-26T20:24:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.387+0000 7ffb5b400640 10 client.26189 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.409+0000 7ffb5b400640 1 -- 172.21.15.82:0/2887740659 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7a5ac1e00 con 0x55a7a5bdaaa0 2024-04-26T20:24:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.409+0000 7ffb5b400640 10 client.26189 handle_command_reply: tid=0 2024-04-26T20:24:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.409+0000 7ffb83ba4740 1 client.26189 shutdown 2024-04-26T20:24:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 msgr2=0x55a7a5b6d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 0x55a7a5b6d170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009a60 tx=0x7ffb74005da0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 shutdown_connections 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a7a5bdaaa0 0x55a7a5bdcec0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a7a5b5b940 0x55a7a5b6e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7a5b567d0 0x55a7a5b6d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 --2- 172.21.15.82:0/2887740659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a5b55de0 0x55a7a5b6d170 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb5b400640 0 client.26189 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 >> 172.21.15.82:0/2887740659 conn(0x55a7a5b51450 msgr2=0x55a7a5b544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 shutdown_connections 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 1 -- 172.21.15.82:0/2887740659 wait complete. 2024-04-26T20:24:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.410+0000 7ffb83ba4740 20 client.26189 trim_cache size 0 max 16384 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffb600a3cb0 msgr2=0x7ffb600a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffb600a3cb0 0x7ffb600a6170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55a7a5b56bd0 tx=0x7ffb6c00efb0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 msgr2=0x7ffb7c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c19abe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00e9c0 tx=0x7ffb6c00ee80 comp rx=0 tx=0).stop 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 shutdown_connections 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ffb600a3cb0 0x7ffb600a6170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c104370 0x7ffb7c1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1039b0 0x7ffb7c19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 --2- 172.21.15.82:0/3374815570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb7c1027c0 0x7ffb7c19abe0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 >> 172.21.15.82:0/3374815570 conn(0x7ffb7c0fdd30 msgr2=0x7ffb7c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 shutdown_connections 2024-04-26T20:24:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:24:58.411+0000 7ffb7b200640 1 -- 172.21.15.82:0/3374815570 wait complete. 2024-04-26T20:25:00.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:24:59 smithi139 ceph-mon[32999]: pgmap v477: 129 pgs: 129 active+clean; 28 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-04-26T20:25:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:24:59 smithi135 ceph-mon[32816]: pgmap v477: 129 pgs: 129 active+clean; 28 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-04-26T20:25:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:24:59 smithi082 ceph-mon[28105]: pgmap v477: 129 pgs: 129 active+clean; 28 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-04-26T20:25:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:00 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:00 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:01.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:00 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:02.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:01 smithi139 ceph-mon[32999]: pgmap v478: 129 pgs: 129 active+clean; 28 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T20:25:02.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:01 smithi135 ceph-mon[32816]: pgmap v478: 129 pgs: 129 active+clean; 28 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T20:25:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:01 smithi082 ceph-mon[28105]: pgmap v478: 129 pgs: 129 active+clean; 28 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T20:25:03.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:02 smithi139 ceph-mon[32999]: pgmap v479: 129 pgs: 129 active+clean; 34 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 167 op/s 2024-04-26T20:25:03.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:02 smithi135 ceph-mon[32816]: pgmap v479: 129 pgs: 129 active+clean; 34 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 167 op/s 2024-04-26T20:25:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:02 smithi082 ceph-mon[28105]: pgmap v479: 129 pgs: 129 active+clean; 34 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 167 op/s 2024-04-26T20:25:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:05 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:05.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:05 smithi139 ceph-mon[32999]: pgmap v480: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 180 op/s 2024-04-26T20:25:05.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:05 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:05.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:05 smithi135 ceph-mon[32816]: pgmap v480: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 180 op/s 2024-04-26T20:25:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:05 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:05 smithi082 ceph-mon[28105]: pgmap v480: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 180 op/s 2024-04-26T20:25:06.990 INFO:tasks.workunit.client.0.smithi082.stdout: 14 62996 421 42293 292 18677 534 2024-04-26T20:25:08.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:07 smithi139 ceph-mon[32999]: pgmap v481: 129 pgs: 129 active+clean; 46 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 189 op/s 2024-04-26T20:25:08.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:07 smithi135 ceph-mon[32816]: pgmap v481: 129 pgs: 129 active+clean; 46 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 189 op/s 2024-04-26T20:25:08.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:07 smithi082 ceph-mon[28105]: pgmap v481: 129 pgs: 129 active+clean; 46 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 189 op/s 2024-04-26T20:25:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:09 smithi139 ceph-mon[32999]: pgmap v482: 129 pgs: 129 active+clean; 53 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 2.8 MiB/s wr, 181 op/s 2024-04-26T20:25:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:09 smithi135 ceph-mon[32816]: pgmap v482: 129 pgs: 129 active+clean; 53 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 2.8 MiB/s wr, 181 op/s 2024-04-26T20:25:10.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:09 smithi082 ceph-mon[28105]: pgmap v482: 129 pgs: 129 active+clean; 53 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 2.8 MiB/s wr, 181 op/s 2024-04-26T20:25:10.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:25:10.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 -- 172.21.15.82:0/1192389849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30101110 msgr2=0x7fea30101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 --2- 172.21.15.82:0/1192389849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30101110 0x7fea30101530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea24009900 tx=0x7fea2402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 -- 172.21.15.82:0/1192389849 shutdown_connections 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 --2- 172.21.15.82:0/1192389849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30102410 0x7fea30102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 --2- 172.21.15.82:0/1192389849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea30101a70 0x7fea30101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 --2- 172.21.15.82:0/1192389849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30101110 0x7fea30101530 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 -- 172.21.15.82:0/1192389849 >> 172.21.15.82:0/1192389849 conn(0x7fea300fccd0 msgr2=0x7fea300ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 -- 172.21.15.82:0/1192389849 shutdown_connections 2024-04-26T20:25:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.826+0000 7fea36200640 1 -- 172.21.15.82:0/1192389849 wait complete. 2024-04-26T20:25:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.828+0000 7fea36200640 1 Processor -- start 2024-04-26T20:25:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.828+0000 7fea36200640 1 -- start start 2024-04-26T20:25:10.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea36200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea30101110 0x7fea3019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea36200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 0x7fea3019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea36200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30102410 0x7fea301a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea36200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea30110580 con 0x7fea30101a70 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea36200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea30110400 con 0x7fea30102410 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea36200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea30110700 con 0x7fea30101110 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 0x7fea3019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea34e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea30101110 0x7fea3019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 0x7fea3019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50690/0 (socket says 172.21.15.82:50690) 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea2fe00640 1 -- 172.21.15.82:0/3210362967 learned_addr learned my addr 172.21.15.82:0/3210362967 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea35800640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30102410 0x7fea301a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea2fe00640 1 -- 172.21.15.82:0/3210362967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea30101110 msgr2=0x7fea3019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea2fe00640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea30101110 0x7fea3019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.829+0000 7fea2fe00640 1 -- 172.21.15.82:0/3210362967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30102410 msgr2=0x7fea301a21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea2fe00640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30102410 0x7fea301a21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea2fe00640 1 -- 172.21.15.82:0/3210362967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea301a2850 con 0x7fea30101a70 2024-04-26T20:25:10.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea2fe00640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 0x7fea3019b180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00d950 tx=0x7fea1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:10.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea2d600640 1 -- 172.21.15.82:0/3210362967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c017030 con 0x7fea30101a70 2024-04-26T20:25:10.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea301a2b40 con 0x7fea30101a70 2024-04-26T20:25:10.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea2d600640 1 -- 172.21.15.82:0/3210362967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1c004020 con 0x7fea30101a70 2024-04-26T20:25:10.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea2d600640 1 -- 172.21.15.82:0/3210362967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0047a0 con 0x7fea30101a70 2024-04-26T20:25:10.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.830+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea301a30b0 con 0x7fea30101a70 2024-04-26T20:25:10.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.834+0000 7fea3a64e740 1 Processor -- start 2024-04-26T20:25:10.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.834+0000 7fea3a64e740 1 -- start start 2024-04-26T20:25:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 0x5623e3736d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e373be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e373c4c0 0x5623e373e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea3a64e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623e3647030 con 0x5623e373c4c0 2024-04-26T20:25:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea3a64e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623e36627f0 con 0x5623e3736960 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea3a64e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5623e361d7e0 con 0x5623e3737350 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea35800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 0x5623e3736d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea35800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 0x5623e3736d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41926/0 (socket says 172.21.15.82:41926) 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea35800640 1 -- 172.21.15.82:0/1508390477 learned_addr learned my addr 172.21.15.82:0/1508390477 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea34e00640 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e373be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea2d600640 1 -- 172.21.15.82:0/3210362967 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fea1c009a30 con 0x7fea30101a70 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea35800640 1 -- 172.21.15.82:0/1508390477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 msgr2=0x5623e373be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea35800640 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e373be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.835+0000 7fea35800640 1 -- 172.21.15.82:0/1508390477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e373c4c0 msgr2=0x5623e373e950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea2fe00640 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e373c4c0 0x5623e373e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea35800640 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e373c4c0 0x5623e373e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea35800640 1 -- 172.21.15.82:0/1508390477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e3629050 con 0x5623e3736960 2024-04-26T20:25:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea2fe00640 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e373c4c0 0x5623e373e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea35800640 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 0x5623e3736d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea28009f50 tx=0x7fea280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36d193111700ffd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea22000640 1 -- 172.21.15.82:0/1508390477 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28004d20 con 0x5623e3736960 2024-04-26T20:25:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea22000640 1 -- 172.21.15.82:0/1508390477 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea28004050 con 0x5623e3736960 2024-04-26T20:25:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.836+0000 7fea22000640 1 -- 172.21.15.82:0/1508390477 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28005280 con 0x5623e3736960 2024-04-26T20:25:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea2d600640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea180a3cc0 0x7fea180a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 -- 172.21.15.82:0/1508390477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 msgr2=0x5623e3736d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 0x5623e3736d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea28009f50 tx=0x7fea280118d0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea2d600640 1 -- 172.21.15.82:0/3210362967 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fea1c0d0310 con 0x7fea30101a70 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea34e00640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea180a3cc0 0x7fea180a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 -- 172.21.15.82:0/1508390477 shutdown_connections 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e373c4c0 0x5623e373e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e373be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1508390477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e3736960 0x5623e3736d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.837+0000 7fea3a64e740 1 -- 172.21.15.82:0/1508390477 >> 172.21.15.82:0/1508390477 conn(0x5623e3731fd0 msgr2=0x5623e37323d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.838+0000 7fea3a64e740 1 -- 172.21.15.82:0/1508390477 shutdown_connections 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.838+0000 7fea3a64e740 1 -- 172.21.15.82:0/1508390477 wait complete. 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.838+0000 7fea34e00640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea180a3cc0 0x7fea180a6180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fea24031500 tx=0x7fea24005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.838+0000 7fea3a64e740 1 -- start start 2024-04-26T20:25:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 Processor -- start 2024-04-26T20:25:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3740720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3740c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3747ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623e369f200 con 0x5623e3737350 2024-04-26T20:25:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623e3699ee0 con 0x5623e373c4c0 2024-04-26T20:25:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5623e36a6e70 con 0x5623e3736960 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.839+0000 7fea3a64e740 10 client.0 _ll_register_callbacks cb 0x5623e3690270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3740c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea35800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3747ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3740720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3740720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50056/0 (socket says 172.21.15.82:50056) 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 -- 172.21.15.82:0/3942507084 learned_addr learned my addr 172.21.15.82:0/3942507084 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3740c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50708/0 (socket says 172.21.15.82:50708) 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 -- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 msgr2=0x5623e3747ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3747ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 -- 172.21.15.82:0/3942507084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 msgr2=0x5623e3740c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3740c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.840+0000 7fea34e00640 1 -- 172.21.15.82:0/3942507084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e34767d0 con 0x5623e3736960 2024-04-26T20:25:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea34e00640 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3740720 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fea24033000 tx=0x7fea24009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1780c503b3beeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea16a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea16a00640 1 -- 172.21.15.82:0/3942507084 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24035040 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea16a00640 1 -- 172.21.15.82:0/3942507084 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fea240319b0 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea28004050 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea16a00640 1 -- 172.21.15.82:0/3942507084 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fea24031bb0 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea3a64e740 10 client.26236 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.841+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5623e33ac3f0 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea16a00640 1 -- 172.21.15.82:0/3942507084 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea28004050 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea16a00640 1 -- 172.21.15.82:0/3942507084 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fea24044030 con 0x5623e3736960 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea3a64e740 10 client.26236 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea3a64e740 10 client.26236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea3a64e740 20 client.26236 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea3a64e740 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e374c1b0 0x5623e374e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea3a64e740 4 client.26236 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.842+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e36a87e0 con 0x5623e374c1b0 2024-04-26T20:25:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.843+0000 7fea2fe00640 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e374c1b0 0x5623e374e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.843+0000 7fea16a00640 10 client.26236 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.843+0000 7fea2fe00640 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e374c1b0 0x5623e374e650 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791598280d1c3802 server_cookie=f2603ce04efc4526 in_seq=0 out_seq=0 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.844+0000 7fea16a00640 1 -- 172.21.15.82:0/3942507084 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5623e36a87e0 con 0x5623e374c1b0 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.844+0000 7fea16a00640 10 client.26236 handle_command_reply: tid=0 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.844+0000 7fea3a64e740 1 client.26236 shutdown 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 msgr2=0x5623e3740720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3740720 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fea24033000 tx=0x7fea24009260 comp rx=0 tx=0).stop 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 shutdown_connections 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e374c1b0 0x5623e374e650 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3747ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3740c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 --2- 172.21.15.82:0/3942507084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3740720 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 >> 172.21.15.82:0/3942507084 conn(0x5623e3731fd0 msgr2=0x5623e37311f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea16a00640 0 client.26236 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 shutdown_connections 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.845+0000 7fea3a64e740 1 -- 172.21.15.82:0/3942507084 wait complete. 2024-04-26T20:25:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.847+0000 7fea3a64e740 20 client.26236 trim_cache size 0 max 16384 2024-04-26T20:25:10.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 Processor -- start 2024-04-26T20:25:10.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 -- start start 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 0x5623e3731070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e3747c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3737d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea301af050 con 0x5623e3736960 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ada60 con 0x5623e373c4c0 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.884+0000 7fea3a64e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ae130 con 0x5623e3737350 2024-04-26T20:25:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea34e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 0x5623e3731070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e3747c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea34e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 0x5623e3731070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50714/0 (socket says 172.21.15.82:50714) 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea34e00640 1 -- 172.21.15.82:0/419199464 learned_addr learned my addr 172.21.15.82:0/419199464 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea35800640 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3737d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea2fe00640 1 -- 172.21.15.82:0/419199464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 msgr2=0x5623e3737d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea2fe00640 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3737d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea2fe00640 1 -- 172.21.15.82:0/419199464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 msgr2=0x5623e3731070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea2fe00640 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 0x5623e3731070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea2fe00640 1 -- 172.21.15.82:0/419199464 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e372d850 con 0x5623e3737350 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.885+0000 7fea34e00640 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 0x5623e3731070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.886+0000 7fea2fe00640 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e3747c30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0cd960 tx=0x7fea1c0044d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4df547740c785a18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.886+0000 7fea21600640 1 -- 172.21.15.82:0/419199464 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0d0170 con 0x5623e3737350 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.886+0000 7fea21600640 1 -- 172.21.15.82:0/419199464 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1c0a04e0 con 0x5623e3737350 2024-04-26T20:25:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.886+0000 7fea21600640 1 -- 172.21.15.82:0/419199464 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0cdbb0 con 0x5623e3737350 2024-04-26T20:25:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 -- 172.21.15.82:0/419199464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 msgr2=0x5623e3747c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e3747c30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0cd960 tx=0x7fea1c0044d0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 -- 172.21.15.82:0/419199464 shutdown_connections 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3737d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3737350 0x5623e3747c30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 --2- 172.21.15.82:0/419199464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3736960 0x5623e3731070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 -- 172.21.15.82:0/419199464 >> 172.21.15.82:0/419199464 conn(0x5623e3731fd0 msgr2=0x5623e3730960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 -- 172.21.15.82:0/419199464 shutdown_connections 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.887+0000 7fea3a64e740 1 -- 172.21.15.82:0/419199464 wait complete. 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.888+0000 7fea3a64e740 1 -- start start 2024-04-26T20:25:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.888+0000 7fea3a64e740 1 Processor -- start 2024-04-26T20:25:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.889+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3745120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.889+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3745660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.889+0000 7fea3a64e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3746670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea34e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3745120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea34e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3745120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50064/0 (socket says 172.21.15.82:50064) 2024-04-26T20:25:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea35800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3746670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3745660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea35800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3746670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41940/0 (socket says 172.21.15.82:41940) 2024-04-26T20:25:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3745660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50726/0 (socket says 172.21.15.82:50726) 2024-04-26T20:25:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea34e00640 1 -- 172.21.15.82:0/1177883164 learned_addr learned my addr 172.21.15.82:0/1177883164 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ab370 con 0x5623e3737350 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ae8c0 con 0x5623e373c4c0 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea301ab9e0 con 0x5623e3736960 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.890+0000 7fea3a64e740 10 client.0 _ll_register_callbacks cb 0x7fea24004450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea34e00640 1 -- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 msgr2=0x5623e3746670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea34e00640 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3746670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea34e00640 1 -- 172.21.15.82:0/1177883164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 msgr2=0x5623e3745660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea34e00640 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3745660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea34e00640 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e336c0f0 con 0x5623e3736960 2024-04-26T20:25:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea34e00640 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3745120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea2402a9e0 tx=0x7fea2403d8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e21582705f690d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea16a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea16a00640 1 -- 172.21.15.82:0/1177883164 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24063060 con 0x5623e3736960 2024-04-26T20:25:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.891+0000 7fea16a00640 1 -- 172.21.15.82:0/1177883164 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fea24051470 con 0x5623e3736960 2024-04-26T20:25:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.892+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea1c0a04e0 con 0x5623e3736960 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.892+0000 7fea16a00640 1 -- 172.21.15.82:0/1177883164 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fea24035040 con 0x5623e3736960 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.892+0000 7fea3a64e740 10 client.26242 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.892+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5623e3662a30 con 0x5623e3736960 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea16a00640 1 -- 172.21.15.82:0/1177883164 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1c0a04e0 con 0x5623e3736960 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea16a00640 1 -- 172.21.15.82:0/1177883164 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fea24044040 con 0x5623e3736960 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea3a64e740 10 client.26242 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea3a64e740 10 client.26242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea3a64e740 20 client.26242 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e37b2ce0 0x5623e37b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea3a64e740 4 client.26242 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:25:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.893+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5623e36a2650 con 0x5623e37b2ce0 2024-04-26T20:25:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.894+0000 7fea2fe00640 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e37b2ce0 0x5623e37b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea16a00640 10 client.26242 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea2fe00640 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e37b2ce0 0x5623e37b5100 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac50248b51e0b0c4 server_cookie=9c0c218250a9e2d5 in_seq=0 out_seq=0 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea16a00640 1 -- 172.21.15.82:0/1177883164 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5623e36a2650 con 0x5623e37b2ce0 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea16a00640 10 client.26242 handle_command_reply: tid=0 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea3a64e740 1 client.26242 shutdown 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 msgr2=0x5623e3745120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.895+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3745120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea2402a9e0 tx=0x7fea2403d8a0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 shutdown_connections 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5623e37b2ce0 0x5623e37b5100 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e373c4c0 0x5623e3746670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623e3737350 0x5623e3745660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 --2- 172.21.15.82:0/1177883164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623e3736960 0x5623e3745120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 >> 172.21.15.82:0/1177883164 conn(0x5623e3731fd0 msgr2=0x5623e37355e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea16a00640 0 client.26242 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 shutdown_connections 2024-04-26T20:25:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 1 -- 172.21.15.82:0/1177883164 wait complete. 2024-04-26T20:25:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.896+0000 7fea3a64e740 20 client.26242 trim_cache size 0 max 16384 2024-04-26T20:25:10.899 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:25:10.899 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:25:10.899 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:25:10.899 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:25:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.899+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea180a3cc0 msgr2=0x7fea180a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.899+0000 7fea36200640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea180a3cc0 0x7fea180a6180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fea24031500 tx=0x7fea24005a20 comp rx=0 tx=0).stop 2024-04-26T20:25:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.899+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 msgr2=0x7fea3019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.899+0000 7fea36200640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 0x7fea3019b180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00d950 tx=0x7fea1c00de10 comp rx=0 tx=0).stop 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 shutdown_connections 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea180a3cc0 0x7fea180a6180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea30102410 0x7fea301a21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea30101a70 0x7fea3019b180 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 --2- 172.21.15.82:0/3210362967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea30101110 0x7fea3019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 >> 172.21.15.82:0/3210362967 conn(0x7fea300fccd0 msgr2=0x7fea300fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:10.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.901+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 shutdown_connections 2024-04-26T20:25:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:10.902+0000 7fea36200640 1 -- 172.21.15.82:0/3210362967 wait complete. 2024-04-26T20:25:10.924 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:25:10.924 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:10.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:10 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:11.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:10 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:11.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:10 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 -- 172.21.15.82:0/2188544174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 msgr2=0x7f59ec110c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 --2- 172.21.15.82:0/2188544174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec110c70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009860 tx=0x7f59d402a340 comp rx=0 tx=0).stop 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 -- 172.21.15.82:0/2188544174 shutdown_connections 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 --2- 172.21.15.82:0/2188544174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59ec1111b0 0x7f59ec1135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 --2- 172.21.15.82:0/2188544174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec110c70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 --2- 172.21.15.82:0/2188544174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59ec109930 0x7f59ec109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 -- 172.21.15.82:0/2188544174 >> 172.21.15.82:0/2188544174 conn(0x7f59ec06f7c0 msgr2=0x7f59ec071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 -- 172.21.15.82:0/2188544174 shutdown_connections 2024-04-26T20:25:11.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.128+0000 7f59f2800640 1 -- 172.21.15.82:0/2188544174 wait complete. 2024-04-26T20:25:11.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 Processor -- start 2024-04-26T20:25:11.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 -- start start 2024-04-26T20:25:11.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59ec109930 0x7f59ec1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59ec1111b0 0x7f59ec1a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec116c90 con 0x7f59ec109930 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec116b10 con 0x7f59ec10a290 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.130+0000 7f59f2800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec116e10 con 0x7f59ec1111b0 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec1a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41960/0 (socket says 172.21.15.82:41960) 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 -- 172.21.15.82:0/1001837407 learned_addr learned my addr 172.21.15.82:0/1001837407 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eb400640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59ec109930 0x7f59ec1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59ebe00640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59ec1111b0 0x7f59ec1a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 -- 172.21.15.82:0/1001837407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59ec1111b0 msgr2=0x7f59ec1a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59ec1111b0 0x7f59ec1a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 -- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59ec109930 msgr2=0x7f59ec1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59ec109930 0x7f59ec1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.131+0000 7f59eaa00640 1 -- 172.21.15.82:0/1001837407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec1a8f90 con 0x7f59ec10a290 2024-04-26T20:25:11.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.132+0000 7f59eaa00640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec1a18b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f59d40057c0 tx=0x7f59d4032eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.132+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4037040 con 0x7f59ec10a290 2024-04-26T20:25:11.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.132+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59d4030cd0 con 0x7f59ec10a290 2024-04-26T20:25:11.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.132+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec1a9220 con 0x7f59ec10a290 2024-04-26T20:25:11.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.132+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4005350 con 0x7f59ec10a290 2024-04-26T20:25:11.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.132+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec1a96b0 con 0x7f59ec10a290 2024-04-26T20:25:11.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.134+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec110370 con 0x7f59ec10a290 2024-04-26T20:25:11.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.139+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f59d4043020 con 0x7f59ec10a290 2024-04-26T20:25:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.141+0000 7f59e3e00640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f59d00a3c40 0x7f59d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.142+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f59d40eff20 con 0x7f59ec10a290 2024-04-26T20:25:11.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.142+0000 7f59eb400640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f59d00a3c40 0x7f59d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.143+0000 7f59eb400640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f59d00a3c40 0x7f59d00a6100 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f59dc005fd0 tx=0x7f59dc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.145+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f59d404a020 con 0x7f59ec10a290 2024-04-26T20:25:11.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.418+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59ec02dd20 con 0x7f59ec10a290 2024-04-26T20:25:11.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.419+0000 7f59e3e00640 1 -- 172.21.15.82:0/1001837407 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7f59d40bc550 con 0x7f59ec10a290 2024-04-26T20:25:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:25:11.420 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:25:09.261942+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24584,24554,24454,24550,24529]},"id":1}]} 2024-04-26T20:25:11.420 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 34 2024-04-26T20:25:11.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.422+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f59d00a3c40 msgr2=0x7f59d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f59d00a3c40 0x7f59d00a6100 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f59dc005fd0 tx=0x7f59dc00b390 comp rx=0 tx=0).stop 2024-04-26T20:25:11.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 msgr2=0x7f59ec1a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec1a18b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f59d40057c0 tx=0x7f59d4032eb0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 shutdown_connections 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f59d00a3c40 0x7f59d00a6100 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f59ec1111b0 0x7f59ec1a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59ec10a290 0x7f59ec1a18b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 --2- 172.21.15.82:0/1001837407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59ec109930 0x7f59ec1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 >> 172.21.15.82:0/1001837407 conn(0x7f59ec06f7c0 msgr2=0x7f59ec071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 shutdown_connections 2024-04-26T20:25:11.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.423+0000 7f59f2800640 1 -- 172.21.15.82:0/1001837407 wait complete. 2024-04-26T20:25:11.443 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:25:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 -- 172.21.15.82:0/3235563344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 msgr2=0x7fed68106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 --2- 172.21.15.82:0/3235563344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed68106230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fed54009900 tx=0x7fed5402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 -- 172.21.15.82:0/3235563344 shutdown_connections 2024-04-26T20:25:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 --2- 172.21.15.82:0/3235563344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68106770 0x7fed6810d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 --2- 172.21.15.82:0/3235563344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed68106230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 --2- 172.21.15.82:0/3235563344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68104bc0 0x7fed68104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 -- 172.21.15.82:0/3235563344 >> 172.21.15.82:0/3235563344 conn(0x7fed68100150 msgr2=0x7fed68102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 -- 172.21.15.82:0/3235563344 shutdown_connections 2024-04-26T20:25:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.604+0000 7fed70000640 1 -- 172.21.15.82:0/3235563344 wait complete. 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 Processor -- start 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 -- start start 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 0x7fed6819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed6819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68106770 0x7fed681a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed68110740 con 0x7fed68104bc0 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed681105c0 con 0x7fed68105db0 2024-04-26T20:25:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.606+0000 7fed70000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fed681108c0 con 0x7fed68106770 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 0x7fed6819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed6819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed6819b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41978/0 (socket says 172.21.15.82:41978) 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 0x7fed6819ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50766/0 (socket says 172.21.15.82:50766) 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6cc00640 1 -- 172.21.15.82:0/2009774060 learned_addr learned my addr 172.21.15.82:0/2009774060 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6e000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68106770 0x7fed681a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6e000640 1 -- 172.21.15.82:0/2009774060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 msgr2=0x7fed6819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6e000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed6819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6e000640 1 -- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 msgr2=0x7fed6819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6e000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 0x7fed6819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.607+0000 7fed6e000640 1 -- 172.21.15.82:0/2009774060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed681a29b0 con 0x7fed68106770 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed6d600640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 0x7fed6819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed6e000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68106770 0x7fed681a2310 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fed60007440 tx=0x7fed60007900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed66000640 1 -- 172.21.15.82:0/2009774060 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60003970 con 0x7fed68106770 2024-04-26T20:25:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed66000640 1 -- 172.21.15.82:0/2009774060 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed60004030 con 0x7fed68106770 2024-04-26T20:25:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed68076dd0 con 0x7fed68106770 2024-04-26T20:25:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed66000640 1 -- 172.21.15.82:0/2009774060 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6001f7f0 con 0x7fed68106770 2024-04-26T20:25:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.608+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed680772d0 con 0x7fed68106770 2024-04-26T20:25:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.613+0000 7fed66000640 1 -- 172.21.15.82:0/2009774060 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fed60003b10 con 0x7fed68106770 2024-04-26T20:25:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.613+0000 7fed72e1e740 1 Processor -- start 2024-04-26T20:25:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.613+0000 7fed72e1e740 1 -- start start 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b115bd0 0x55a42b115ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b11b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b11dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed72e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a42b07a380 con 0x55a42b1165c0 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed72e1e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a42b016c30 con 0x55a42b115bd0 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed72e1e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a42b076340 con 0x55a42b11b730 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b11dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b11dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50098/0 (socket says 172.21.15.82:50098) 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed6cc00640 1 -- 172.21.15.82:0/161432420 learned_addr learned my addr 172.21.15.82:0/161432420 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.614+0000 7fed6cc00640 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b115bd0 0x55a42b115ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed6cc00640 1 -- 172.21.15.82:0/161432420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b115bd0 msgr2=0x55a42b115ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed66000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fed500a3cf0 0x7fed500a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed6cc00640 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b115bd0 0x55a42b115ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed6cc00640 1 -- 172.21.15.82:0/161432420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 msgr2=0x55a42b11b0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed6cc00640 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b11b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed6cc00640 1 -- 172.21.15.82:0/161432420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a42b038940 con 0x55a42b11b730 2024-04-26T20:25:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.615+0000 7fed66000640 1 -- 172.21.15.82:0/2009774060 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fed600d8aa0 con 0x7fed68106770 2024-04-26T20:25:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.616+0000 7fed6e000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fed500a3cf0 0x7fed500a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.616+0000 7fed6cc00640 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b11dbc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fed5402a9e0 tx=0x7fed54009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e870eab0f94e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.616+0000 7fed6e000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fed500a3cf0 0x7fed500a61b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed600a0c90 tx=0x7fed60005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.617+0000 7fed5a600640 1 -- 172.21.15.82:0/161432420 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54035040 con 0x55a42b11b730 2024-04-26T20:25:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.617+0000 7fed5a600640 1 -- 172.21.15.82:0/161432420 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed54003aa0 con 0x55a42b11b730 2024-04-26T20:25:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.617+0000 7fed5a600640 1 -- 172.21.15.82:0/161432420 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5403d910 con 0x55a42b11b730 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 -- 172.21.15.82:0/161432420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 msgr2=0x55a42b11dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b11dbc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fed5402a9e0 tx=0x7fed54009260 comp rx=0 tx=0).stop 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 -- 172.21.15.82:0/161432420 shutdown_connections 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b11dbc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b11b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 --2- 172.21.15.82:0/161432420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b115bd0 0x55a42b115ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 -- 172.21.15.82:0/161432420 >> 172.21.15.82:0/161432420 conn(0x55a42b111240 msgr2=0x55a42b111640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 -- 172.21.15.82:0/161432420 shutdown_connections 2024-04-26T20:25:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.618+0000 7fed72e1e740 1 -- 172.21.15.82:0/161432420 wait complete. 2024-04-26T20:25:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.619+0000 7fed72e1e740 1 -- start start 2024-04-26T20:25:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.619+0000 7fed72e1e740 1 Processor -- start 2024-04-26T20:25:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b127360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a42b11e680 con 0x55a42b1165c0 2024-04-26T20:25:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a42b001c60 con 0x55a42b11b730 2024-04-26T20:25:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a42b11e800 con 0x55a42b115bd0 2024-04-26T20:25:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed72e1e740 10 client.0 _ll_register_callbacks cb 0x55a42b02de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed6d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed6d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50780/0 (socket says 172.21.15.82:50780) 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed6d600640 1 -- 172.21.15.82:0/2562360303 learned_addr learned my addr 172.21.15.82:0/2562360303 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.620+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6d600640 1 -- 172.21.15.82:0/2562360303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b115bd0 msgr2=0x55a42b11fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6d600640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6d600640 1 -- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 msgr2=0x55a42b127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6d600640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b127360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6d600640 1 -- 172.21.15.82:0/2562360303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a42b010510 con 0x55a42b1165c0 2024-04-26T20:25:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.621+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b127360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.622+0000 7fed6d600640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b120320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fed5c011800 tx=0x7fed5c011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6ad48adfa858e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.622+0000 7fed4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.622+0000 7fed4ea00640 1 -- 172.21.15.82:0/2562360303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00fd90 con 0x55a42b1165c0 2024-04-26T20:25:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.622+0000 7fed4ea00640 1 -- 172.21.15.82:0/2562360303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fed5c004030 con 0x55a42b1165c0 2024-04-26T20:25:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.623+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed54003aa0 con 0x55a42b1165c0 2024-04-26T20:25:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed4ea00640 1 -- 172.21.15.82:0/2562360303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed5c004230 con 0x55a42b1165c0 2024-04-26T20:25:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed72e1e740 10 client.16125 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a42ad8c210 con 0x55a42b1165c0 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed4ea00640 1 -- 172.21.15.82:0/2562360303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed54003aa0 con 0x55a42b1165c0 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed4ea00640 1 -- 172.21.15.82:0/2562360303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fed5c019420 con 0x55a42b1165c0 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed72e1e740 10 client.16125 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.624+0000 7fed72e1e740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.625+0000 7fed72e1e740 20 client.16125 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.625+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b12b860 0x55a42b12dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.625+0000 7fed72e1e740 4 client.16125 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.625+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a42b087f90 con 0x55a42b12b860 2024-04-26T20:25:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.625+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b12b860 0x55a42b12dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.626+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b12b860 0x55a42b12dca0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cca49b2562fc6bbe server_cookie=998177c71fba1f2c in_seq=0 out_seq=0 2024-04-26T20:25:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.626+0000 7fed4ea00640 10 client.16125 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed4ea00640 1 -- 172.21.15.82:0/2562360303 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a42b087f90 con 0x55a42b12b860 2024-04-26T20:25:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed4ea00640 10 client.16125 handle_command_reply: tid=0 2024-04-26T20:25:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 client.16125 shutdown 2024-04-26T20:25:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 msgr2=0x55a42b120320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b120320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fed5c011800 tx=0x7fed5c011cc0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 shutdown_connections 2024-04-26T20:25:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b12b860 0x55a42b12dca0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b127360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.627+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2562360303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.628+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 >> 172.21.15.82:0/2562360303 conn(0x55a42b111240 msgr2=0x55a42b110440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.628+0000 7fed4ea00640 0 client.16125 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.628+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 shutdown_connections 2024-04-26T20:25:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.628+0000 7fed72e1e740 1 -- 172.21.15.82:0/2562360303 wait complete. 2024-04-26T20:25:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.628+0000 7fed72e1e740 20 client.16125 trim_cache size 0 max 16384 2024-04-26T20:25:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.660+0000 7fed72e1e740 1 Processor -- start 2024-04-26T20:25:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.660+0000 7fed72e1e740 1 -- start start 2024-04-26T20:25:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b127320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed72e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed681a9130 con 0x55a42b115bd0 2024-04-26T20:25:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50794/0 (socket says 172.21.15.82:50794) 2024-04-26T20:25:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed6cc00640 1 -- 172.21.15.82:0/2182744095 learned_addr learned my addr 172.21.15.82:0/2182744095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aadf0 con 0x55a42b1165c0 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fed681a9800 con 0x55a42b11b730 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b127320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.661+0000 7fed6d600640 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed6cc00640 1 -- 172.21.15.82:0/2182744095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 msgr2=0x55a42b127320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b127320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed6cc00640 1 -- 172.21.15.82:0/2182744095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b1165c0 msgr2=0x55a42b120320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed6cc00640 1 -- 172.21.15.82:0/2182744095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a42ae58620 con 0x55a42b115bd0 2024-04-26T20:25:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed6cc00640 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed54006010 tx=0x7fed5402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28961a488adab4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed59c00640 1 -- 172.21.15.82:0/2182744095 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54035040 con 0x55a42b115bd0 2024-04-26T20:25:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed59c00640 1 -- 172.21.15.82:0/2182744095 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5404e020 con 0x55a42b115bd0 2024-04-26T20:25:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.662+0000 7fed59c00640 1 -- 172.21.15.82:0/2182744095 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54053560 con 0x55a42b115bd0 2024-04-26T20:25:11.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 -- 172.21.15.82:0/2554422075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14106760 msgr2=0x7f5c1410cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 --2- 172.21.15.82:0/2554422075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14106760 0x7f5c1410cff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009be0 tx=0x7f5c0c02a6d0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 msgr2=0x55a42b11fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed54006010 tx=0x7fed5402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 shutdown_connections 2024-04-26T20:25:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 -- 172.21.15.82:0/2554422075 shutdown_connections 2024-04-26T20:25:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 --2- 172.21.15.82:0/2554422075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14106760 0x7f5c1410cff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 --2- 172.21.15.82:0/2554422075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c14105da0 0x7f5c14106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 --2- 172.21.15.82:0/2554422075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14104bb0 0x7f5c14104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.663+0000 7f5c1b400640 1 -- 172.21.15.82:0/2554422075 >> 172.21.15.82:0/2554422075 conn(0x7f5c14100120 msgr2=0x7f5c14102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b11b730 0x55a42b127320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b1165c0 0x55a42b120320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 --2- 172.21.15.82:0/2182744095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b11fde0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 >> 172.21.15.82:0/2182744095 conn(0x55a42b111240 msgr2=0x55a42b111620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.664+0000 7f5c1b400640 1 -- 172.21.15.82:0/2554422075 shutdown_connections 2024-04-26T20:25:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.664+0000 7f5c1b400640 1 -- 172.21.15.82:0/2554422075 wait complete. 2024-04-26T20:25:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 shutdown_connections 2024-04-26T20:25:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.664+0000 7fed72e1e740 1 -- 172.21.15.82:0/2182744095 wait complete. 2024-04-26T20:25:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.665+0000 7fed72e1e740 1 -- start start 2024-04-26T20:25:11.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.665+0000 7f5c1b400640 1 Processor -- start 2024-04-26T20:25:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.665+0000 7fed72e1e740 1 Processor -- start 2024-04-26T20:25:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 -- start start 2024-04-26T20:25:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14104bb0 0x7f5c1419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14105da0 0x7f5c1419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c14106760 0x7f5c141a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141106c0 con 0x7f5c14106760 2024-04-26T20:25:11.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c14110540 con 0x7f5c14105da0 2024-04-26T20:25:11.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c1b400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c14110840 con 0x7f5c14104bb0 2024-04-26T20:25:11.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14104bb0 0x7f5c1419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b124510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 0x55a42b124a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b125a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aa660 con 0x55a42b115bd0 2024-04-26T20:25:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed681a9ed0 con 0x55a42b11b730 2024-04-26T20:25:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fed681a7130 con 0x55a42b1165c0 2024-04-26T20:25:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.666+0000 7fed72e1e740 10 client.0 _ll_register_callbacks cb 0x7fed5c005a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c0be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14105da0 0x7f5c1419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14104bb0 0x7f5c1419ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50140/0 (socket says 172.21.15.82:50140) 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.666+0000 7f5c18a00640 1 -- 172.21.15.82:0/3544841632 learned_addr learned my addr 172.21.15.82:0/3544841632 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c19400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c14106760 0x7f5c141a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c0be00640 1 -- 172.21.15.82:0/3544841632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14104bb0 msgr2=0x7f5c1419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c0be00640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14104bb0 0x7f5c1419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c0be00640 1 -- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c14106760 msgr2=0x7f5c141a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c0be00640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c14106760 0x7f5c141a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c0be00640 1 -- 172.21.15.82:0/3544841632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c141a2960 con 0x7f5c14105da0 2024-04-26T20:25:11.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c0be00640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14105da0 0x7f5c1419b280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00e9f0 tx=0x7f5bfc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.667+0000 7fed6d600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 0x55a42b124a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.667+0000 7fed6d600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 0x55a42b124a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50146/0 (socket says 172.21.15.82:50146) 2024-04-26T20:25:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.667+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b124510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.667+0000 7f5c12000640 1 -- 172.21.15.82:0/3544841632 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00cd80 con 0x7f5c14105da0 2024-04-26T20:25:11.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.668+0000 7f5c12000640 1 -- 172.21.15.82:0/3544841632 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bfc0035f0 con 0x7f5c14105da0 2024-04-26T20:25:11.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.668+0000 7f5c12000640 1 -- 172.21.15.82:0/3544841632 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc010670 con 0x7f5c14105da0 2024-04-26T20:25:11.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.668+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c141a2c50 con 0x7f5c14105da0 2024-04-26T20:25:11.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.668+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c141a3150 con 0x7f5c14105da0 2024-04-26T20:25:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.667+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b124510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50824/0 (socket says 172.21.15.82:50824) 2024-04-26T20:25:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.667+0000 7fed6cc00640 1 -- 172.21.15.82:0/1322265798 learned_addr learned my addr 172.21.15.82:0/1322265798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.668+0000 7fed6cc00640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b125a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.669+0000 7fed6d600640 1 -- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 msgr2=0x55a42b125a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.669+0000 7fed6d600640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b125a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.669+0000 7fed6d600640 1 -- 172.21.15.82:0/1322265798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 msgr2=0x55a42b124510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.669+0000 7fed6d600640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b124510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.669+0000 7fed6d600640 1 -- 172.21.15.82:0/1322265798 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a42b034cb0 con 0x55a42b1165c0 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.669+0000 7fed6cc00640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b125a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.670+0000 7fed6d600640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 0x55a42b124a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0198e0 tx=0x7fed5c005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2484e9da9219605 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.670+0000 7fed4ea00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.670+0000 7fed4ea00640 1 -- 172.21.15.82:0/1322265798 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c019630 con 0x55a42b1165c0 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.670+0000 7fed4ea00640 1 -- 172.21.15.82:0/1322265798 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fed5c00fb90 con 0x55a42b1165c0 2024-04-26T20:25:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.671+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed5404e020 con 0x55a42b1165c0 2024-04-26T20:25:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.671+0000 7fed4ea00640 1 -- 172.21.15.82:0/1322265798 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed5c00fd90 con 0x55a42b1165c0 2024-04-26T20:25:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.672+0000 7fed72e1e740 10 client.26272 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.672+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a42b127190 con 0x55a42b1165c0 2024-04-26T20:25:11.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 Processor -- start 2024-04-26T20:25:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed4ea00640 1 -- 172.21.15.82:0/1322265798 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed5404e020 con 0x55a42b1165c0 2024-04-26T20:25:11.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 -- start start 2024-04-26T20:25:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed4ea00640 1 -- 172.21.15.82:0/1322265798 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fed5c010a40 con 0x55a42b1165c0 2024-04-26T20:25:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed72e1e740 10 client.26272 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed72e1e740 10 client.26272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed72e1e740 20 client.26272 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed72e1e740 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b1a3210 0x55a42b1a5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed72e1e740 4 client.26272 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:25:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.673+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a42b081e00 con 0x55a42b1a3210 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa693fea0 0x563fa69402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 0x563fa6945390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6945a00 0x563fa6947e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563fa68a3c70 con 0x563fa6945a00 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563fa685c980 con 0x563fa6940890 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.673+0000 7f5c1e171740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563fa689fc30 con 0x563fa693fea0 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 0x563fa6945390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 0x563fa6945390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42030/0 (socket says 172.21.15.82:42030) 2024-04-26T20:25:11.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 -- 172.21.15.82:0/1662821424 learned_addr learned my addr 172.21.15.82:0/1662821424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.674+0000 7fed6cc00640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b1a3210 0x55a42b1a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c12000640 1 -- 172.21.15.82:0/3544841632 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5bfc0108d0 con 0x7f5c14105da0 2024-04-26T20:25:11.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 -- 172.21.15.82:0/1662821424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa693fea0 msgr2=0x563fa69402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa693fea0 0x563fa69402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 -- 172.21.15.82:0/1662821424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6945a00 msgr2=0x563fa6947e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:11.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6945a00 0x563fa6947e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.674+0000 7f5c18a00640 1 -- 172.21.15.82:0/1662821424 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa68347b0 con 0x563fa6940890 2024-04-26T20:25:11.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.675+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 0x563fa6945390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400bdb0 tx=0x7f5c040107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46bb3c5cc2041763 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.675+0000 7f5c09c00640 1 -- 172.21.15.82:0/1662821424 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04004220 con 0x563fa6940890 2024-04-26T20:25:11.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.675+0000 7f5c09c00640 1 -- 172.21.15.82:0/1662821424 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040043c0 con 0x563fa6940890 2024-04-26T20:25:11.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.675+0000 7f5c09c00640 1 -- 172.21.15.82:0/1662821424 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04011840 con 0x563fa6940890 2024-04-26T20:25:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.675+0000 7fed4ea00640 10 client.26272 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.676+0000 7fed6cc00640 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b1a3210 0x55a42b1a5630 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47f80e38bcff287 server_cookie=75df693f6571ac02 in_seq=0 out_seq=0 2024-04-26T20:25:11.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.676+0000 7f5c12000640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5bf80a3cc0 0x7f5bf80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.676+0000 7f5c1e171740 1 -- 172.21.15.82:0/1662821424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 msgr2=0x563fa6945390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.676+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 0x563fa6945390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400bdb0 tx=0x7f5c040107a0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.676+0000 7f5c12000640 1 -- 172.21.15.82:0/3544841632 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5bfc0d0b80 con 0x7f5c14105da0 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c19400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5bf80a3cc0 0x7f5bf80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c1e171740 1 -- 172.21.15.82:0/1662821424 shutdown_connections 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6945a00 0x563fa6947e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6940890 0x563fa6945390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1662821424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa693fea0 0x563fa69402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c1e171740 1 -- 172.21.15.82:0/1662821424 >> 172.21.15.82:0/1662821424 conn(0x563fa693b510 msgr2=0x563fa693b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.677+0000 7f5c1e171740 1 -- 172.21.15.82:0/1662821424 shutdown_connections 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.678+0000 7f5c19400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5bf80a3cc0 0x7f5bf80a6180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c02abf0 tx=0x7f5c0c009330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.678+0000 7f5c1e171740 1 -- 172.21.15.82:0/1662821424 wait complete. 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.678+0000 7f5c1e171740 1 -- start start 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.679+0000 7f5c1e171740 1 Processor -- start 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.679+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa69523c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6952900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa6959940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c1e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563fa68a2f80 con 0x563fa693fea0 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c1e171740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563fa6850260 con 0x563fa6945a00 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c1e171740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563fa68a82a0 con 0x563fa6940890 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c1e171740 10 client.0 _ll_register_callbacks cb 0x563fa689a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c0be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6952900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c0be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6952900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50170/0 (socket says 172.21.15.82:50170) 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c0be00640 1 -- 172.21.15.82:0/1254498669 learned_addr learned my addr 172.21.15.82:0/1254498669 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.680+0000 7f5c19400640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa6959940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.681+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa69523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.681+0000 7f5c19400640 1 -- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 msgr2=0x563fa6952900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.681+0000 7f5c19400640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6952900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.681+0000 7f5c19400640 1 -- 172.21.15.82:0/1254498669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 msgr2=0x563fa69523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.681+0000 7f5c19400640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa69523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.682+0000 7f5c19400640 1 -- 172.21.15.82:0/1254498669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa68321c0 con 0x563fa6945a00 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.682+0000 7f5c0be00640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6952900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.682+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa69523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.682+0000 7f5c02000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.682+0000 7f5c19400640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa6959940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c034040 tx=0x7f5c0c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d1e608b36300cd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.683+0000 7f5c02000640 1 -- 172.21.15.82:0/1254498669 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c042070 con 0x563fa6945a00 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.683+0000 7f5c02000640 1 -- 172.21.15.82:0/1254498669 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5c0c004040 con 0x563fa6945a00 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.683+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c040043c0 con 0x563fa6945a00 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.683+0000 7f5c02000640 1 -- 172.21.15.82:0/1254498669 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5c0c036040 con 0x563fa6945a00 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.683+0000 7f5c1e171740 10 client.26240 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.683+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563fa65b53f0 con 0x563fa6945a00 2024-04-26T20:25:11.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.684+0000 7f5c02000640 1 -- 172.21.15.82:0/1254498669 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040043c0 con 0x563fa6945a00 2024-04-26T20:25:11.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.685+0000 7f5c02000640 1 -- 172.21.15.82:0/1254498669 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f5c0c049710 con 0x563fa6945a00 2024-04-26T20:25:11.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.685+0000 7f5c1e171740 10 client.26240 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:11.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.685+0000 7f5c1e171740 10 client.26240 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:25:11.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.686+0000 7f5c1e171740 20 client.26240 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:11.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.686+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa695de60 0x563fa69602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.686+0000 7f5c1e171740 4 client.26240 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:11.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.686+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fa68b1880 con 0x563fa695de60 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.686+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa695de60 0x563fa69602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.687+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa695de60 0x563fa69602a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ce45168efa871668 server_cookie=d2edb1181a57e1c9 in_seq=0 out_seq=0 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.687+0000 7f5c02000640 10 client.26240 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.688+0000 7f5c02000640 1 -- 172.21.15.82:0/1254498669 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563fa68b1880 con 0x563fa695de60 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.688+0000 7f5c02000640 10 client.26240 handle_command_reply: tid=0 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.688+0000 7f5c1e171740 1 client.26240 shutdown 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.688+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 msgr2=0x563fa6959940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.688+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa6959940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c034040 tx=0x7f5c0c02a6d0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 shutdown_connections 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa695de60 0x563fa69602a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa6959940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6952900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1254498669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa69523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 >> 172.21.15.82:0/1254498669 conn(0x563fa693b510 msgr2=0x563fa693a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c02000640 0 client.26240 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:11.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 shutdown_connections 2024-04-26T20:25:11.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 1 -- 172.21.15.82:0/1254498669 wait complete. 2024-04-26T20:25:11.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.689+0000 7f5c1e171740 20 client.26240 trim_cache size 0 max 16384 2024-04-26T20:25:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.693+0000 7fed4ea00640 1 -- 172.21.15.82:0/1322265798 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a42b081e00 con 0x55a42b1a3210 2024-04-26T20:25:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.693+0000 7fed4ea00640 10 client.26272 handle_command_reply: tid=0 2024-04-26T20:25:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.693+0000 7fed72e1e740 1 client.26272 shutdown 2024-04-26T20:25:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 msgr2=0x55a42b124a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 0x55a42b124a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0198e0 tx=0x7fed5c005610 comp rx=0 tx=0).stop 2024-04-26T20:25:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 shutdown_connections 2024-04-26T20:25:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a42b1a3210 0x55a42b1a5630 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed4ea00640 0 client.26272 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a42b11b730 0x55a42b125a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a42b1165c0 0x55a42b124a50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 --2- 172.21.15.82:0/1322265798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a42b115bd0 0x55a42b124510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.695+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 >> 172.21.15.82:0/1322265798 conn(0x55a42b111240 msgr2=0x55a42b1177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.696+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 shutdown_connections 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.696+0000 7fed72e1e740 1 -- 172.21.15.82:0/1322265798 wait complete. 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.696+0000 7fed72e1e740 20 client.26272 trim_cache size 0 max 16384 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:25:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:25:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:25:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fed500a3cf0 msgr2=0x7fed500a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fed500a3cf0 0x7fed500a61b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed600a0c90 tx=0x7fed60005f50 comp rx=0 tx=0).stop 2024-04-26T20:25:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68106770 msgr2=0x7fed681a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68106770 0x7fed681a2310 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fed60007440 tx=0x7fed60007900 comp rx=0 tx=0).stop 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 shutdown_connections 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fed500a3cf0 0x7fed500a61b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed68106770 0x7fed681a2310 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed68105db0 0x7fed6819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 --2- 172.21.15.82:0/2009774060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed68104bc0 0x7fed6819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 >> 172.21.15.82:0/2009774060 conn(0x7fed68100150 msgr2=0x7fed681090b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 shutdown_connections 2024-04-26T20:25:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:11.697+0000 7fed70000640 1 -- 172.21.15.82:0/2009774060 wait complete. 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.712+0000 7f5c1e171740 1 Processor -- start 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 -- start start 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa6936650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6959900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa693eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141a9270 con 0x563fa693fea0 2024-04-26T20:25:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141aaf30 con 0x563fa6945a00 2024-04-26T20:25:11.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c1e171740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141a9940 con 0x563fa6940890 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa6936650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa6936650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50836/0 (socket says 172.21.15.82:50836) 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c18a00640 1 -- 172.21.15.82:0/916829752 learned_addr learned my addr 172.21.15.82:0/916829752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.713+0000 7f5c19400640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa693eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c18a00640 1 -- 172.21.15.82:0/916829752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 msgr2=0x563fa6959900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c0be00640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6959900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c18a00640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6959900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c18a00640 1 -- 172.21.15.82:0/916829752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 msgr2=0x563fa693eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c18a00640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa693eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c18a00640 1 -- 172.21.15.82:0/916829752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa667f7d0 con 0x563fa693fea0 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c19400640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa693eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c0be00640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6959900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.714+0000 7f5c18a00640 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa6936650 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c04003f80 tx=0x7f5c04003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd5d4569f7b5c3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.715+0000 7f5c09200640 1 -- 172.21.15.82:0/916829752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04004230 con 0x563fa693fea0 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.715+0000 7f5c09200640 1 -- 172.21.15.82:0/916829752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c0402d070 con 0x563fa693fea0 2024-04-26T20:25:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.715+0000 7f5c09200640 1 -- 172.21.15.82:0/916829752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04003b00 con 0x563fa693fea0 2024-04-26T20:25:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 -- 172.21.15.82:0/916829752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 msgr2=0x563fa6936650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa6936650 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c04003f80 tx=0x7f5c04003f10 comp rx=0 tx=0).stop 2024-04-26T20:25:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 -- 172.21.15.82:0/916829752 shutdown_connections 2024-04-26T20:25:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa6945a00 0x563fa693eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6940890 0x563fa6959900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 --2- 172.21.15.82:0/916829752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa693fea0 0x563fa6936650 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 -- 172.21.15.82:0/916829752 >> 172.21.15.82:0/916829752 conn(0x563fa693b510 msgr2=0x563fa693e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 -- 172.21.15.82:0/916829752 shutdown_connections 2024-04-26T20:25:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.716+0000 7f5c1e171740 1 -- 172.21.15.82:0/916829752 wait complete. 2024-04-26T20:25:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 -- start start 2024-04-26T20:25:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 Processor -- start 2024-04-26T20:25:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa693fea0 0x563fa6956d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6940890 0x563fa69572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6945a00 0x563fa69582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141aa7a0 con 0x563fa6940890 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141aa010 con 0x563fa693fea0 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141a7250 con 0x563fa6945a00 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.717+0000 7f5c1e171740 10 client.0 _ll_register_callbacks cb 0x7f5c0c034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6940890 0x563fa69572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa693fea0 0x563fa6956d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c0be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6940890 0x563fa69572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50852/0 (socket says 172.21.15.82:50852) 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c0be00640 1 -- 172.21.15.82:0/1340718024 learned_addr learned my addr 172.21.15.82:0/1340718024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c19400640 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6945a00 0x563fa69582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 -- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6945a00 msgr2=0x563fa69582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6945a00 0x563fa69582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 -- 172.21.15.82:0/1340718024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6940890 msgr2=0x563fa69572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6940890 0x563fa69572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 -- 172.21.15.82:0/1340718024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa684a2a0 con 0x563fa693fea0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c18a00640 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa693fea0 0x563fa6956d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400b970 tx=0x7f5c0400b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710f02ecdcd7dbb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.718+0000 7f5c02000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c02000640 1 -- 172.21.15.82:0/1340718024 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04047060 con 0x563fa693fea0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c0402d070 con 0x563fa693fea0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c02000640 1 -- 172.21.15.82:0/1340718024 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5c04003c50 con 0x563fa693fea0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c02000640 1 -- 172.21.15.82:0/1340718024 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5c04004360 con 0x563fa693fea0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c1e171740 10 client.26246 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563fa6959970 con 0x563fa693fea0 2024-04-26T20:25:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.719+0000 7f5c02000640 1 -- 172.21.15.82:0/1340718024 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c0402d070 con 0x563fa693fea0 2024-04-26T20:25:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c02000640 1 -- 172.21.15.82:0/1340718024 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f5c04004cd0 con 0x563fa693fea0 2024-04-26T20:25:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c1e171740 10 client.26246 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c1e171740 10 client.26246 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:25:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c1e171740 20 client.26246 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa69c46d0 0x563fa69c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c1e171740 4 client.26246 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563fa68ab6f0 con 0x563fa69c46d0 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.720+0000 7f5c0be00640 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa69c46d0 0x563fa69c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c0be00640 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa69c46d0 0x563fa69c6af0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=507e92ab89a5813d server_cookie=99968f0f70bcb211 in_seq=0 out_seq=0 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c02000640 10 client.26246 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c02000640 1 -- 172.21.15.82:0/1340718024 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563fa68ab6f0 con 0x563fa69c46d0 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c02000640 10 client.26246 handle_command_reply: tid=0 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 client.26246 shutdown 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa693fea0 msgr2=0x563fa6956d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa693fea0 0x563fa6956d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400b970 tx=0x7f5c0400b9f0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 shutdown_connections 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x563fa69c46d0 0x563fa69c6af0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563fa6945a00 0x563fa69582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fa6940890 0x563fa69572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c02000640 0 client.26246 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:11.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 --2- 172.21.15.82:0/1340718024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563fa693fea0 0x563fa6956d90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.721+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 >> 172.21.15.82:0/1340718024 conn(0x563fa693b510 msgr2=0x563fa693e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.722+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 shutdown_connections 2024-04-26T20:25:11.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.722+0000 7f5c1e171740 1 -- 172.21.15.82:0/1340718024 wait complete. 2024-04-26T20:25:11.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.722+0000 7f5c1e171740 20 client.26246 trim_cache size 0 max 16384 2024-04-26T20:25:11.725 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5bf80a3cc0 msgr2=0x7f5bf80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5bf80a3cc0 0x7f5bf80a6180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c02abf0 tx=0x7f5c0c009330 comp rx=0 tx=0).stop 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14105da0 msgr2=0x7f5c1419b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14105da0 0x7f5c1419b280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00e9f0 tx=0x7f5bfc00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 shutdown_connections 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5bf80a3cc0 0x7f5bf80a6180 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c14106760 0x7f5c141a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c14105da0 0x7f5c1419b280 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 --2- 172.21.15.82:0/3544841632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c14104bb0 0x7f5c1419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 >> 172.21.15.82:0/3544841632 conn(0x7f5c14100120 msgr2=0x7f5c14109170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 shutdown_connections 2024-04-26T20:25:11.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.723+0000 7f5c1b400640 1 -- 172.21.15.82:0/3544841632 wait complete. 2024-04-26T20:25:11.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:25:11.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.992+0000 7f871b200640 1 -- 172.21.15.82:0/3141252592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 msgr2=0x7f871c074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.992+0000 7f871b200640 1 --2- 172.21.15.82:0/3141252592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c074dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f870c009ca0 tx=0x7f870c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 -- 172.21.15.82:0/3141252592 shutdown_connections 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 --2- 172.21.15.82:0/3141252592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f871c10ee90 0x7f871c111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 --2- 172.21.15.82:0/3141252592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871c075390 0x7f871c075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 --2- 172.21.15.82:0/3141252592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c074dc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 -- 172.21.15.82:0/3141252592 >> 172.21.15.82:0/3141252592 conn(0x7f871c0fde30 msgr2=0x7f871c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 -- 172.21.15.82:0/3141252592 shutdown_connections 2024-04-26T20:25:11.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.993+0000 7f871b200640 1 -- 172.21.15.82:0/3141252592 wait complete. 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.994+0000 7f871b200640 1 Processor -- start 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.994+0000 7f871b200640 1 -- start start 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f871c075390 0x7f871c19f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871c10ee90 0x7f871c1a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1149a0 con 0x7f871c075390 2024-04-26T20:25:11.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f871c114820 con 0x7f871c10ee90 2024-04-26T20:25:11.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f871c114b20 con 0x7f871c076970 2024-04-26T20:25:11.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f8719400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f8719400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50212/0 (socket says 172.21.15.82:50212) 2024-04-26T20:25:11.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f8719400640 1 -- 172.21.15.82:0/3984342863 learned_addr learned my addr 172.21.15.82:0/3984342863 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f8719e00640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f871c075390 0x7f871c19f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.995+0000 7f871a800640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871c10ee90 0x7f871c1a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.996+0000 7f8719400640 1 -- 172.21.15.82:0/3984342863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871c10ee90 msgr2=0x7f871c1a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.996+0000 7f8719400640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871c10ee90 0x7f871c1a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.996+0000 7f8719400640 1 -- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f871c075390 msgr2=0x7f871c19f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.996+0000 7f8719400640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f871c075390 0x7f871c19f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.996+0000 7f8719400640 1 -- 172.21.15.82:0/3984342863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c1a6ce0 con 0x7f871c076970 2024-04-26T20:25:11.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.996+0000 7f8719400640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c19f600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f870800e9f0 tx=0x7f870800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:11.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.997+0000 7f8712a00640 1 -- 172.21.15.82:0/3984342863 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870800cd80 con 0x7f871c076970 2024-04-26T20:25:11.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.997+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871c1a6fd0 con 0x7f871c076970 2024-04-26T20:25:11.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.997+0000 7f8712a00640 1 -- 172.21.15.82:0/3984342863 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080108e0 con 0x7f871c076970 2024-04-26T20:25:11.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.997+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f871c1a74e0 con 0x7f871c076970 2024-04-26T20:25:11.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:11.997+0000 7f8712a00640 1 -- 172.21.15.82:0/3984342863 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708018980 con 0x7f871c076970 2024-04-26T20:25:12.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.001+0000 7f8723bf6740 1 Processor -- start 2024-04-26T20:25:12.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.001+0000 7f8712a00640 1 -- 172.21.15.82:0/3984342863 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8708010430 con 0x7f871c076970 2024-04-26T20:25:12.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.001+0000 7f8723bf6740 1 -- start start 2024-04-26T20:25:12.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658d050 0x55ee4658d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee46592540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 0x55ee46595040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8723bf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ee464f0c70 con 0x55ee4658d050 2024-04-26T20:25:12.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8723bf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ee464a9980 con 0x55ee46592bb0 2024-04-26T20:25:12.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8723bf6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee464ecc30 con 0x55ee4658da40 2024-04-26T20:25:12.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.002+0000 7f8719400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 0x55ee46595040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 0x55ee46595040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42076/0 (socket says 172.21.15.82:42076) 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 -- 172.21.15.82:0/4028362159 learned_addr learned my addr 172.21.15.82:0/4028362159 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 -- 172.21.15.82:0/4028362159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 msgr2=0x55ee46592540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee46592540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 -- 172.21.15.82:0/4028362159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658d050 msgr2=0x55ee4658d470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658d050 0x55ee4658d470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8719400640 1 -- 172.21.15.82:0/4028362159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee464817b0 con 0x55ee46592bb0 2024-04-26T20:25:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.003+0000 7f8712a00640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f87000a3c40 0x7f87000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.004+0000 7f8712a00640 1 -- 172.21.15.82:0/3984342863 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f87080d0c70 con 0x7f871c076970 2024-04-26T20:25:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.004+0000 7f8719400640 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 0x55ee46595040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87080ce200 tx=0x7f87080d97d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75b77270e698a8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.004+0000 7f871a800640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f87000a3c40 0x7f87000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.005+0000 7f8707400640 1 -- 172.21.15.82:0/4028362159 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708098d30 con 0x55ee46592bb0 2024-04-26T20:25:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.005+0000 7f8707400640 1 -- 172.21.15.82:0/4028362159 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8708010720 con 0x55ee46592bb0 2024-04-26T20:25:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.005+0000 7f8707400640 1 -- 172.21.15.82:0/4028362159 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870809c3f0 con 0x55ee46592bb0 2024-04-26T20:25:12.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 -- 172.21.15.82:0/4028362159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 msgr2=0x55ee46595040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 0x55ee46595040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87080ce200 tx=0x7f87080d97d0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f871a800640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f87000a3c40 0x7f87000a6100 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55ee4658e2a0 tx=0x7f8714005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 -- 172.21.15.82:0/4028362159 shutdown_connections 2024-04-26T20:25:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee46592bb0 0x55ee46595040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee46592540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 --2- 172.21.15.82:0/4028362159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658d050 0x55ee4658d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 -- 172.21.15.82:0/4028362159 >> 172.21.15.82:0/4028362159 conn(0x55ee465886c0 msgr2=0x55ee46588ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 -- 172.21.15.82:0/4028362159 shutdown_connections 2024-04-26T20:25:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.006+0000 7f8723bf6740 1 -- 172.21.15.82:0/4028362159 wait complete. 2024-04-26T20:25:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 -- start start 2024-04-26T20:25:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 Processor -- start 2024-04-26T20:25:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee46596f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658da40 0x55ee465974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee46592bb0 0x55ee4659e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ee464eff80 con 0x55ee4658da40 2024-04-26T20:25:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ee4649d260 con 0x55ee4658d050 2024-04-26T20:25:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee464f52a0 con 0x55ee46592bb0 2024-04-26T20:25:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.007+0000 7f8723bf6740 10 client.0 _ll_register_callbacks cb 0x55ee464e7960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee46596f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee46596f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42082/0 (socket says 172.21.15.82:42082) 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 -- 172.21.15.82:0/2200380678 learned_addr learned my addr 172.21.15.82:0/2200380678 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 -- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee46592bb0 msgr2=0x55ee4659e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee46592bb0 0x55ee4659e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 -- 172.21.15.82:0/2200380678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658da40 msgr2=0x55ee465974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658da40 0x55ee465974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 -- 172.21.15.82:0/2200380678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4647f1c0 con 0x55ee4658d050 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f8719e00640 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee46596f60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f870c031a10 tx=0x7f870c02f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8482f325d048ccce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.008+0000 7f86fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.009+0000 7f86fbe00640 1 -- 172.21.15.82:0/2200380678 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c003970 con 0x55ee4658d050 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.009+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee464fe880 con 0x55ee4658d050 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.009+0000 7f86fbe00640 1 -- 172.21.15.82:0/2200380678 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f870c003b10 con 0x55ee4658d050 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.009+0000 7f86fbe00640 1 -- 172.21.15.82:0/2200380678 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f870c003d10 con 0x55ee4658d050 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.009+0000 7f8723bf6740 10 client.26258 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.009+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee462023f0 con 0x55ee4658d050 2024-04-26T20:25:12.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f86fbe00640 1 -- 172.21.15.82:0/2200380678 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ee464fe880 con 0x55ee4658d050 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f86fbe00640 1 -- 172.21.15.82:0/2200380678 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f870c043070 con 0x55ee4658d050 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8723bf6740 10 client.26258 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8723bf6740 10 client.26258 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8723bf6740 20 client.26258 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8723bf6740 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee465a2a20 0x55ee465a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8723bf6740 4 client.26258 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee464f86f0 con 0x55ee465a2a20 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.010+0000 7f8719400640 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee465a2a20 0x55ee465a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.011+0000 7f8719400640 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee465a2a20 0x55ee465a4ee0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=42e89ef8609826ea server_cookie=f34de852b26b2b0d in_seq=0 out_seq=0 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.011+0000 7f86fbe00640 10 client.26258 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f86fbe00640 1 -- 172.21.15.82:0/2200380678 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ee464f86f0 con 0x55ee465a2a20 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f86fbe00640 10 client.26258 handle_command_reply: tid=0 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 client.26258 shutdown 2024-04-26T20:25:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 msgr2=0x55ee46596f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee46596f60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f870c031a10 tx=0x7f870c02f3a0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 shutdown_connections 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee46592bb0 0x55ee4659e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee4658da40 0x55ee465974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee465a2a20 0x55ee465a4ee0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 --2- 172.21.15.82:0/2200380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee46596f60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f86fbe00640 0 client.26258 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 >> 172.21.15.82:0/2200380678 conn(0x55ee465886c0 msgr2=0x55ee465877b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 shutdown_connections 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.012+0000 7f8723bf6740 1 -- 172.21.15.82:0/2200380678 wait complete. 2024-04-26T20:25:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.013+0000 7f8723bf6740 20 client.26258 trim_cache size 0 max 16384 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 Processor -- start 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 -- start start 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658d050 0x55ee4658bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 0x55ee4659e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4658c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1b18f0 con 0x55ee46592bb0 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1b35b0 con 0x55ee4658da40 2024-04-26T20:25:12.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.029+0000 7f8723bf6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1b1fc0 con 0x55ee4658d050 2024-04-26T20:25:12.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 0x55ee4659e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 0x55ee4659e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42098/0 (socket says 172.21.15.82:42098) 2024-04-26T20:25:12.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 -- 172.21.15.82:0/3903772724 learned_addr learned my addr 172.21.15.82:0/3903772724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719e00640 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658d050 0x55ee4658bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f871a800640 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4658c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 -- 172.21.15.82:0/3903772724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658d050 msgr2=0x55ee4658bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658d050 0x55ee4658bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 -- 172.21.15.82:0/3903772724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 msgr2=0x55ee4658c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4658c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719400640 1 -- 172.21.15.82:0/3903772724 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee462cc7d0 con 0x55ee4658da40 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.030+0000 7f8719e00640 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658d050 0x55ee4658bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.031+0000 7f8719400640 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 0x55ee4659e4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8708098ef0 tx=0x7f87080d47c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25b949aeb87cef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.031+0000 7f8706a00640 1 -- 172.21.15.82:0/3903772724 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870809c5d0 con 0x55ee4658da40 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.031+0000 7f8706a00640 1 -- 172.21.15.82:0/3903772724 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870809d190 con 0x55ee4658da40 2024-04-26T20:25:12.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.031+0000 7f8706a00640 1 -- 172.21.15.82:0/3903772724 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870809c860 con 0x55ee4658da40 2024-04-26T20:25:12.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 -- 172.21.15.82:0/3903772724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 msgr2=0x55ee4659e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 0x55ee4659e4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8708098ef0 tx=0x7f87080d47c0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 -- 172.21.15.82:0/3903772724 shutdown_connections 2024-04-26T20:25:12.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4658c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658da40 0x55ee4659e4a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3903772724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658d050 0x55ee4658bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 -- 172.21.15.82:0/3903772724 >> 172.21.15.82:0/3903772724 conn(0x55ee465886c0 msgr2=0x55ee4658b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 -- 172.21.15.82:0/3903772724 shutdown_connections 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 -- 172.21.15.82:0/3903772724 wait complete. 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.032+0000 7f8723bf6740 1 -- start start 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 Processor -- start 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee4659e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee4659ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4659b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1b2e20 con 0x55ee46592bb0 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1b2690 con 0x55ee4658d050 2024-04-26T20:25:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f871c1af8d0 con 0x55ee4658da40 2024-04-26T20:25:12.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.033+0000 7f8723bf6740 10 client.0 _ll_register_callbacks cb 0x7f8708005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee4659ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee4659ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50234/0 (socket says 172.21.15.82:50234) 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 -- 172.21.15.82:0/3398487313 learned_addr learned my addr 172.21.15.82:0/3398487313 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 -- 172.21.15.82:0/3398487313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 msgr2=0x55ee4659e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee4659e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 -- 172.21.15.82:0/3398487313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 msgr2=0x55ee4659b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4659b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 -- 172.21.15.82:0/3398487313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee464972a0 con 0x55ee4658da40 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8719400640 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee4659ae50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87080d9c10 tx=0x7f8708009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684ed5fd7e4c4704 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f86fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f86fbe00640 1 -- 172.21.15.82:0/3398487313 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870809c860 con 0x55ee4658da40 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870809d190 con 0x55ee4658da40 2024-04-26T20:25:12.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.034+0000 7f86fbe00640 1 -- 172.21.15.82:0/3398487313 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f87080ce510 con 0x55ee4658da40 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.035+0000 7f86fbe00640 1 -- 172.21.15.82:0/3398487313 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f870809c5d0 con 0x55ee4658da40 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.035+0000 7f8723bf6740 10 client.26290 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.035+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee466080e0 con 0x55ee4658da40 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.035+0000 7f86fbe00640 1 -- 172.21.15.82:0/3398487313 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870809d190 con 0x55ee4658da40 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f86fbe00640 1 -- 172.21.15.82:0/3398487313 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f87080d5040 con 0x55ee4658da40 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8723bf6740 10 client.26290 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8723bf6740 10 client.26290 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8723bf6740 20 client.26290 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee466085d0 0x55ee4660a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8723bf6740 4 client.26290 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee464734d0 con 0x55ee466085d0 2024-04-26T20:25:12.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.036+0000 7f8719e00640 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee466085d0 0x55ee4660a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8719e00640 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee466085d0 0x55ee4660a9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=95589fd6056b1a98 server_cookie=23e4a2c9df64d2dc in_seq=0 out_seq=0 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f86fbe00640 10 client.26290 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f86fbe00640 1 -- 172.21.15.82:0/3398487313 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee464734d0 con 0x55ee466085d0 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f86fbe00640 10 client.26290 handle_command_reply: tid=0 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 client.26290 shutdown 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 msgr2=0x55ee4659ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee4659ae50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87080d9c10 tx=0x7f8708009310 comp rx=0 tx=0).stop 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 shutdown_connections 2024-04-26T20:25:12.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee46592bb0 0x55ee4659b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4658da40 0x55ee4659ae50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.037+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x55ee466085d0 0x55ee4660a9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.038+0000 7f8723bf6740 1 --2- 172.21.15.82:0/3398487313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4658d050 0x55ee4659e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.038+0000 7f86fbe00640 0 client.26290 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.038+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 >> 172.21.15.82:0/3398487313 conn(0x55ee465886c0 msgr2=0x55ee4658bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.038+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 shutdown_connections 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.038+0000 7f8723bf6740 1 -- 172.21.15.82:0/3398487313 wait complete. 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.038+0000 7f8723bf6740 20 client.26290 trim_cache size 0 max 16384 2024-04-26T20:25:12.041 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f87000a3c40 msgr2=0x7f87000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f87000a3c40 0x7f87000a6100 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55ee4658e2a0 tx=0x7f8714005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 msgr2=0x7f871c19f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c19f600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f870800e9f0 tx=0x7f870800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 shutdown_connections 2024-04-26T20:25:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f87000a3c40 0x7f87000a6100 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871c10ee90 0x7f871c1a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f871c076970 0x7f871c19f600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 --2- 172.21.15.82:0/3984342863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f871c075390 0x7f871c19f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 >> 172.21.15.82:0/3984342863 conn(0x7f871c0fde30 msgr2=0x7f871c102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 shutdown_connections 2024-04-26T20:25:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.039+0000 7f871b200640 1 -- 172.21.15.82:0/3984342863 wait complete. 2024-04-26T20:25:12.057 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:11 smithi082 ceph-mon[28105]: pgmap v483: 129 pgs: 129 active+clean; 58 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 2.9 MiB/s wr, 178 op/s 2024-04-26T20:25:12.057 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:11 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1001837407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:12.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:25:12.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:11 smithi139 ceph-mon[32999]: pgmap v483: 129 pgs: 129 active+clean; 58 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 2.9 MiB/s wr, 178 op/s 2024-04-26T20:25:12.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:11 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1001837407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:11 smithi135 ceph-mon[32816]: pgmap v483: 129 pgs: 129 active+clean; 58 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 2.9 MiB/s wr, 178 op/s 2024-04-26T20:25:12.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:11 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1001837407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:12.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 -- 172.21.15.82:0/755252011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540103400 msgr2=0x7f05401057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 --2- 172.21.15.82:0/755252011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540103400 0x7f05401057f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0530009900 tx=0x7f053002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 -- 172.21.15.82:0/755252011 shutdown_connections 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 --2- 172.21.15.82:0/755252011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540108660 0x7f054010aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 --2- 172.21.15.82:0/755252011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f0540108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 --2- 172.21.15.82:0/755252011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540103400 0x7f05401057f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 -- 172.21.15.82:0/755252011 >> 172.21.15.82:0/755252011 conn(0x7f05400fcdf0 msgr2=0x7f05400ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 -- 172.21.15.82:0/755252011 shutdown_connections 2024-04-26T20:25:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.275+0000 7f0544a00640 1 -- 172.21.15.82:0/755252011 wait complete. 2024-04-26T20:25:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.276+0000 7f0544a00640 1 Processor -- start 2024-04-26T20:25:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.276+0000 7f0544a00640 1 -- start start 2024-04-26T20:25:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f0544a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540103400 0x7f054019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f0544a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f054019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f0544a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540108660 0x7f05401a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f0544a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f054010e520 con 0x7f0540105d30 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f0544a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f054010e3a0 con 0x7f0540103400 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f0544a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f054010e6a0 con 0x7f0540108660 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f053d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f054019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f053de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540103400 0x7f054019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f053d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f054019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50900/0 (socket says 172.21.15.82:50900) 2024-04-26T20:25:12.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f053d400640 1 -- 172.21.15.82:0/2812460291 learned_addr learned my addr 172.21.15.82:0/2812460291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.277+0000 7f053e800640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540108660 0x7f05401a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053de00640 1 -- 172.21.15.82:0/2812460291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540108660 msgr2=0x7f05401a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053de00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540108660 0x7f05401a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053de00640 1 -- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 msgr2=0x7f054019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053de00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f054019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053de00640 1 -- 172.21.15.82:0/2812460291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05401a2a10 con 0x7f0540103400 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053d400640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f054019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053e800640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540108660 0x7f05401a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f053de00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540103400 0x7f054019adf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f053002aa00 tx=0x7f0530003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f0536a00640 1 -- 172.21.15.82:0/2812460291 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053003f070 con 0x7f0540103400 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f0536a00640 1 -- 172.21.15.82:0/2812460291 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0530031c50 con 0x7f0540103400 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.278+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05401a2ca0 con 0x7f0540103400 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.279+0000 7f0536a00640 1 -- 172.21.15.82:0/2812460291 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530035030 con 0x7f0540103400 2024-04-26T20:25:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.279+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05401a3160 con 0x7f0540103400 2024-04-26T20:25:12.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.282+0000 7f0536a00640 1 -- 172.21.15.82:0/2812460291 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0530042070 con 0x7f0540103400 2024-04-26T20:25:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.283+0000 7f05479a5740 1 Processor -- start 2024-04-26T20:25:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 -- start start 2024-04-26T20:25:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb68390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb6ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56016bac6c70 con 0x56016bb63890 2024-04-26T20:25:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56016ba7f980 con 0x56016bb62ea0 2024-04-26T20:25:12.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f05479a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56016bac2c30 con 0x56016bb68a00 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f053de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb68390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f0536a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f05240a3c40 0x7f05240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f053de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb68390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50902/0 (socket says 172.21.15.82:50902) 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f053e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.284+0000 7f053de00640 1 -- 172.21.15.82:0/2137244088 learned_addr learned my addr 172.21.15.82:0/2137244088 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053d400640 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb6ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f0536a00640 1 -- 172.21.15.82:0/2812460291 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f05300f1060 con 0x7f0540103400 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053e800640 1 -- 172.21.15.82:0/2137244088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 msgr2=0x56016bb6ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053e800640 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb6ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053e800640 1 -- 172.21.15.82:0/2137244088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 msgr2=0x56016bb68390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053e800640 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb68390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053e800640 1 -- 172.21.15.82:0/2137244088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016ba577b0 con 0x56016bb62ea0 2024-04-26T20:25:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053de00640 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb68390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.285+0000 7f053e800640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f05240a3c40 0x7f05240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.286+0000 7f053e800640 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb632c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f05380124c0 tx=0x7f0538012980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87639eef1d56a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.286+0000 7f052b000640 1 -- 172.21.15.82:0/2137244088 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053801caf0 con 0x56016bb62ea0 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.286+0000 7f052b000640 1 -- 172.21.15.82:0/2137244088 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f053801cc90 con 0x56016bb62ea0 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.286+0000 7f052b000640 1 -- 172.21.15.82:0/2137244088 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053801b380 con 0x56016bb62ea0 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.286+0000 7f053e800640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f05240a3c40 0x7f05240a6100 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0538021000 tx=0x7f053801e030 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 -- 172.21.15.82:0/2137244088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 msgr2=0x56016bb632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb632c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f05380124c0 tx=0x7f0538012980 comp rx=0 tx=0).stop 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 -- 172.21.15.82:0/2137244088 shutdown_connections 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb6ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb68390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 --2- 172.21.15.82:0/2137244088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb632c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.287+0000 7f05479a5740 1 -- 172.21.15.82:0/2137244088 >> 172.21.15.82:0/2137244088 conn(0x56016bb5e510 msgr2=0x56016bb5e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.288+0000 7f05479a5740 1 -- 172.21.15.82:0/2137244088 shutdown_connections 2024-04-26T20:25:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.288+0000 7f05479a5740 1 -- 172.21.15.82:0/2137244088 wait complete. 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.288+0000 7f05479a5740 1 -- start start 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.288+0000 7f05479a5740 1 Processor -- start 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb6cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb6d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56016bac5f80 con 0x56016bb63890 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56016ba73260 con 0x56016bb62ea0 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56016bacb2a0 con 0x56016bb68a00 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f05479a5740 10 client.0 _ll_register_callbacks cb 0x56016babd960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f053e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f053e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb742a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50270/0 (socket says 172.21.15.82:50270) 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f053e800640 1 -- 172.21.15.82:0/2505290352 learned_addr learned my addr 172.21.15.82:0/2505290352 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f053de00640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb6cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.289+0000 7f053d400640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb6d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f053e800640 1 -- 172.21.15.82:0/2505290352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 msgr2=0x56016bb6cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f053e800640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb6cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f053e800640 1 -- 172.21.15.82:0/2505290352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 msgr2=0x56016bb6d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f053e800640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb6d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f053e800640 1 -- 172.21.15.82:0/2505290352 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016ba551c0 con 0x56016bb68a00 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f053e800640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb742a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0538009700 tx=0x7f0538014fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8153a776b0e25bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f051f400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f051f400640 1 -- 172.21.15.82:0/2505290352 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053801ca80 con 0x56016bb68a00 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f051f400640 1 -- 172.21.15.82:0/2505290352 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f05380049e0 con 0x56016bb68a00 2024-04-26T20:25:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.290+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f053801cc90 con 0x56016bb68a00 2024-04-26T20:25:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f051f400640 1 -- 172.21.15.82:0/2505290352 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f053803c050 con 0x56016bb68a00 2024-04-26T20:25:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f05479a5740 10 client.26302 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56016b7d83f0 con 0x56016bb68a00 2024-04-26T20:25:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f051f400640 1 -- 172.21.15.82:0/2505290352 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f053801cc90 con 0x56016bb68a00 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f051f400640 1 -- 172.21.15.82:0/2505290352 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f0538005160 con 0x56016bb68a00 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f05479a5740 10 client.26302 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f05479a5740 10 client.26302 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.291+0000 7f05479a5740 20 client.26302 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.292+0000 7f05479a5740 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bb78650 0x56016bb7aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.292+0000 7f05479a5740 4 client.26302 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.292+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56016bad4880 con 0x56016bb78650 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.292+0000 7f053de00640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bb78650 0x56016bb7aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.293+0000 7f053de00640 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bb78650 0x56016bb7aab0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69653ee6c675d67b server_cookie=8ba7fba95458d64b in_seq=0 out_seq=0 2024-04-26T20:25:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.293+0000 7f051f400640 10 client.26302 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f051f400640 1 -- 172.21.15.82:0/2505290352 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56016bad4880 con 0x56016bb78650 2024-04-26T20:25:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f051f400640 10 client.26302 handle_command_reply: tid=0 2024-04-26T20:25:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 client.26302 shutdown 2024-04-26T20:25:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 msgr2=0x56016bb742a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb742a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0538009700 tx=0x7f0538014fd0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 shutdown_connections 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bb78650 0x56016bb7aab0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb742a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb63890 0x56016bb6d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 --2- 172.21.15.82:0/2505290352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb62ea0 0x56016bb6cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f051f400640 0 client.26302 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.294+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 >> 172.21.15.82:0/2505290352 conn(0x56016bb5e510 msgr2=0x56016bb5d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.295+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 shutdown_connections 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.295+0000 7f05479a5740 1 -- 172.21.15.82:0/2505290352 wait complete. 2024-04-26T20:25:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.295+0000 7f05479a5740 20 client.26302 trim_cache size 0 max 16384 2024-04-26T20:25:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 Processor -- start 2024-04-26T20:25:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 -- start start 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb62ea0 0x56016bb61b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb62070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb74260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05401ad610 con 0x56016bb62ea0 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05401af2d0 con 0x56016bb63890 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.324+0000 7f05479a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f05401adce0 con 0x56016bb68a00 2024-04-26T20:25:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb62070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb62ea0 0x56016bb61b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb62070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42148/0 (socket says 172.21.15.82:42148) 2024-04-26T20:25:12.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 -- 172.21.15.82:0/2799050938 learned_addr learned my addr 172.21.15.82:0/2799050938 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053e800640 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb74260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 -- 172.21.15.82:0/2799050938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 msgr2=0x56016bb74260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb74260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 -- 172.21.15.82:0/2799050938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb62ea0 msgr2=0x56016bb61b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb62ea0 0x56016bb61b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.325+0000 7f053d400640 1 -- 172.21.15.82:0/2799050938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016b8a27d0 con 0x56016bb63890 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.326+0000 7f053d400640 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb62070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f052c010530 tx=0x7f052c0109f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69051c93f91c77c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.326+0000 7f052a600640 1 -- 172.21.15.82:0/2799050938 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c021070 con 0x56016bb63890 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.326+0000 7f052a600640 1 -- 172.21.15.82:0/2799050938 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f052c004310 con 0x56016bb63890 2024-04-26T20:25:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.326+0000 7f052a600640 1 -- 172.21.15.82:0/2799050938 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c00f940 con 0x56016bb63890 2024-04-26T20:25:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 -- 172.21.15.82:0/2799050938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 msgr2=0x56016bb62070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb62070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f052c010530 tx=0x7f052c0109f0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 -- 172.21.15.82:0/2799050938 shutdown_connections 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb68a00 0x56016bb74260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb62070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 --2- 172.21.15.82:0/2799050938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb62ea0 0x56016bb61b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 -- 172.21.15.82:0/2799050938 >> 172.21.15.82:0/2799050938 conn(0x56016bb5e510 msgr2=0x56016bb61420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 -- 172.21.15.82:0/2799050938 shutdown_connections 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.327+0000 7f05479a5740 1 -- 172.21.15.82:0/2799050938 wait complete. 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.328+0000 7f05479a5740 1 -- start start 2024-04-26T20:25:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.328+0000 7f05479a5740 1 Processor -- start 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb62ea0 0x56016bb71b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb72040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb68a00 0x56016bb73050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05401aeb40 con 0x56016bb68a00 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05401ae3b0 con 0x56016bb63890 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f05401ab5f0 con 0x56016bb62ea0 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f05479a5740 10 client.0 _ll_register_callbacks cb 0x7f05300bcc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb72040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb68a00 0x56016bb73050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053de00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb62ea0 0x56016bb71b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb72040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42164/0 (socket says 172.21.15.82:42164) 2024-04-26T20:25:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053d400640 1 -- 172.21.15.82:0/3395137313 learned_addr learned my addr 172.21.15.82:0/3395137313 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053d400640 1 -- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb62ea0 msgr2=0x56016bb71b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053d400640 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb62ea0 0x56016bb71b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.329+0000 7f053d400640 1 -- 172.21.15.82:0/3395137313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb68a00 msgr2=0x56016bb73050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f053d400640 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb68a00 0x56016bb73050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f053d400640 1 -- 172.21.15.82:0/3395137313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016ba6d2a0 con 0x56016bb63890 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f053e800640 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb68a00 0x56016bb73050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f053d400640 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb72040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f052c000c00 tx=0x7f052c003c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc8e68446089067f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f051f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f051f400640 1 -- 172.21.15.82:0/3395137313 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c021070 con 0x56016bb63890 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f051f400640 1 -- 172.21.15.82:0/3395137313 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f052c005240 con 0x56016bb63890 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f052c004310 con 0x56016bb63890 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.330+0000 7f051f400640 1 -- 172.21.15.82:0/3395137313 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f052c031050 con 0x56016bb63890 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 10 client.26279 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56016bbdebf0 con 0x56016bb63890 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f051f400640 1 -- 172.21.15.82:0/3395137313 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f052c004310 con 0x56016bb63890 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f051f400640 1 -- 172.21.15.82:0/3395137313 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f052c01b030 con 0x56016bb63890 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 10 client.26279 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 10 client.26279 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 20 client.26279 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bbdf430 0x56016bbe1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 4 client.26279 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56016bace6f0 con 0x56016bbdf430 2024-04-26T20:25:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.331+0000 7f053de00640 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bbdf430 0x56016bbe1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.332+0000 7f051f400640 10 client.26279 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.332+0000 7f053de00640 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bbdf430 0x56016bbe1850 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ae90f790a49c13b server_cookie=70adf52496bc45e0 in_seq=0 out_seq=0 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.332+0000 7f051f400640 1 -- 172.21.15.82:0/3395137313 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56016bace6f0 con 0x56016bbdf430 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.332+0000 7f051f400640 10 client.26279 handle_command_reply: tid=0 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.332+0000 7f05479a5740 1 client.26279 shutdown 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 msgr2=0x56016bb72040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb72040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f052c000c00 tx=0x7f052c003c50 comp rx=0 tx=0).stop 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 shutdown_connections 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x56016bbdf430 0x56016bbe1850 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016bb68a00 0x56016bb73050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016bb63890 0x56016bb72040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f051f400640 0 client.26279 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 --2- 172.21.15.82:0/3395137313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016bb62ea0 0x56016bb71b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 >> 172.21.15.82:0/3395137313 conn(0x56016bb5e510 msgr2=0x56016bb61cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 shutdown_connections 2024-04-26T20:25:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 1 -- 172.21.15.82:0/3395137313 wait complete. 2024-04-26T20:25:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.333+0000 7f05479a5740 20 client.26279 trim_cache size 0 max 16384 2024-04-26T20:25:12.337 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f05240a3c40 msgr2=0x7f05240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f05240a3c40 0x7f05240a6100 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0538021000 tx=0x7f053801e030 comp rx=0 tx=0).stop 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540103400 msgr2=0x7f054019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540103400 0x7f054019adf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f053002aa00 tx=0x7f0530003c10 comp rx=0 tx=0).stop 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 shutdown_connections 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f05240a3c40 0x7f05240a6100 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0540108660 0x7f05401a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0540105d30 0x7f054019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 --2- 172.21.15.82:0/2812460291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0540103400 0x7f054019adf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 >> 172.21.15.82:0/2812460291 conn(0x7f05400fcdf0 msgr2=0x7f0540102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 shutdown_connections 2024-04-26T20:25:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.334+0000 7f0544a00640 1 -- 172.21.15.82:0/2812460291 wait complete. 2024-04-26T20:25:12.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:25:12.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.759+0000 7fc3e5400640 1 -- 172.21.15.82:0/1502105700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0103210 msgr2=0x7fc3e0105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.759+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1502105700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0103210 0x7fc3e0105600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a420 comp rx=0 tx=0).stop 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 -- 172.21.15.82:0/1502105700 shutdown_connections 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1502105700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e010a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1502105700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e0105b40 0x7fc3e0107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1502105700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0103210 0x7fc3e0105600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 -- 172.21.15.82:0/1502105700 >> 172.21.15.82:0/1502105700 conn(0x7fc3e00fcc40 msgr2=0x7fc3e00ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 -- 172.21.15.82:0/1502105700 shutdown_connections 2024-04-26T20:25:12.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.760+0000 7fc3e5400640 1 -- 172.21.15.82:0/1502105700 wait complete. 2024-04-26T20:25:12.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.762+0000 7fc3e5400640 1 Processor -- start 2024-04-26T20:25:12.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.764+0000 7fc3e5400640 1 -- start start 2024-04-26T20:25:12.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3e5400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0105b40 0x7fc3e01969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3e5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e0196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3e5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e01a4780 0x7fc3e01a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3e5400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e010e330 con 0x7fc3e01a4780 2024-04-26T20:25:12.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3e5400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e010e1b0 con 0x7fc3e0108470 2024-04-26T20:25:12.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3e5400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e010e4b0 con 0x7fc3e0105b40 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3dde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e0196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3dde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e0196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42194/0 (socket says 172.21.15.82:42194) 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.765+0000 7fc3dde00640 1 -- 172.21.15.82:0/1806079738 learned_addr learned my addr 172.21.15.82:0/1806079738 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3df200640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e01a4780 0x7fc3e01a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3dde00640 1 -- 172.21.15.82:0/1806079738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0105b40 msgr2=0x7fc3e01969d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3dde00640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0105b40 0x7fc3e01969d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3dde00640 1 -- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e01a4780 msgr2=0x7fc3e01a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3dde00640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e01a4780 0x7fc3e01a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3dde00640 1 -- 172.21.15.82:0/1806079738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e01a71e0 con 0x7fc3e0108470 2024-04-26T20:25:12.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.766+0000 7fc3dde00640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e0196f10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e9c0 tx=0x7fc3cc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.767+0000 7fc3d7400640 1 -- 172.21.15.82:0/1806079738 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00cd80 con 0x7fc3e0108470 2024-04-26T20:25:12.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.767+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e01a74d0 con 0x7fc3e0108470 2024-04-26T20:25:12.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.767+0000 7fc3d7400640 1 -- 172.21.15.82:0/1806079738 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3cc0054d0 con 0x7fc3e0108470 2024-04-26T20:25:12.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.767+0000 7fc3d7400640 1 -- 172.21.15.82:0/1806079738 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc010430 con 0x7fc3e0108470 2024-04-26T20:25:12.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.767+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01a7a70 con 0x7fc3e0108470 2024-04-26T20:25:12.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.770+0000 7fc3e83b4740 1 Processor -- start 2024-04-26T20:25:12.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.773+0000 7fc3d7400640 1 -- 172.21.15.82:0/1806079738 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc3cc004fd0 con 0x7fc3e0108470 2024-04-26T20:25:12.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.774+0000 7fc3d7400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3c40a3cc0 0x7fc3c40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.774+0000 7fc3d7400640 1 -- 172.21.15.82:0/1806079738 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc3cc0d0ea0 con 0x7fc3e0108470 2024-04-26T20:25:12.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 -- start start 2024-04-26T20:25:12.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fcd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da57f2bc70 con 0x55da57fc80a0 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da57ee4980 con 0x55da57fcdc00 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55da57f27c30 con 0x55da57fc8a90 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.775+0000 7fc3df200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.776+0000 7fc3df200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42206/0 (socket says 172.21.15.82:42206) 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.776+0000 7fc3df200640 1 -- 172.21.15.82:0/1643173689 learned_addr learned my addr 172.21.15.82:0/1643173689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.776+0000 7fc3de800640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.776+0000 7fc3df200640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3c40a3cc0 0x7fc3c40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.776+0000 7fc3dde00640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fcd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 -- 172.21.15.82:0/1643173689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 msgr2=0x55da57fcd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fcd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 -- 172.21.15.82:0/1643173689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 msgr2=0x55da57fc84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 -- 172.21.15.82:0/1643173689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da57ebc7b0 con 0x55da57fcdc00 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3de800640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3c40a3cc0 0x7fc3c40a6180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8010bb0 tx=0x7fc3d800a9c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3dde00640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fcd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:12.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.777+0000 7fc3df200640 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd0090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8000bf0 tx=0x7fc3d801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f6f2d6aba84c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.778+0000 7fc3cb400640 1 -- 172.21.15.82:0/1643173689 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800c760 con 0x55da57fcdc00 2024-04-26T20:25:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.778+0000 7fc3cb400640 1 -- 172.21.15.82:0/1643173689 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3d800cdb0 con 0x55da57fcdc00 2024-04-26T20:25:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.779+0000 7fc3cb400640 1 -- 172.21.15.82:0/1643173689 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d801da30 con 0x55da57fcdc00 2024-04-26T20:25:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.779+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1643173689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 msgr2=0x55da57fd0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.779+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd0090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8000bf0 tx=0x7fc3d801c000 comp rx=0 tx=0).stop 2024-04-26T20:25:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1643173689 shutdown_connections 2024-04-26T20:25:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd0090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fcd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1643173689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1643173689 >> 172.21.15.82:0/1643173689 conn(0x55da57fc3710 msgr2=0x55da57fc3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1643173689 shutdown_connections 2024-04-26T20:25:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1643173689 wait complete. 2024-04-26T20:25:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.780+0000 7fc3e83b4740 1 -- start start 2024-04-26T20:25:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.781+0000 7fc3e83b4740 1 Processor -- start 2024-04-26T20:25:12.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3de800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3de800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42222/0 (socket says 172.21.15.82:42222) 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3de800640 1 -- 172.21.15.82:0/2551287207 learned_addr learned my addr 172.21.15.82:0/2551287207 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3df200640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.782+0000 7fc3dde00640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da57f2af80 con 0x55da57fc8a90 2024-04-26T20:25:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da57ed8260 con 0x55da57fc80a0 2024-04-26T20:25:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55da57f302a0 con 0x55da57fcdc00 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3e83b4740 10 client.0 _ll_register_callbacks cb 0x55da57f22960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3df200640 1 -- 172.21.15.82:0/2551287207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 msgr2=0x55da57fd1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3df200640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3df200640 1 -- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 msgr2=0x55da57fd24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3df200640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.783+0000 7fc3df200640 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da57eba1c0 con 0x55da57fcdc00 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.784+0000 7fc3de800640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.784+0000 7fc3dde00640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.784+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d800cdb0 con 0x55da57fcdc00 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.784+0000 7fc3df200640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd9490 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80016d0 tx=0x7fc3d800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6addd3df678c52f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.784+0000 7fc3bfe00640 10 client.26314 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.785+0000 7fc3bfe00640 1 -- 172.21.15.82:0/2551287207 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d801d7b0 con 0x55da57fcdc00 2024-04-26T20:25:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.785+0000 7fc3bfe00640 1 -- 172.21.15.82:0/2551287207 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc3d801d950 con 0x55da57fcdc00 2024-04-26T20:25:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.785+0000 7fc3bfe00640 1 -- 172.21.15.82:0/2551287207 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc3d801db90 con 0x55da57fcdc00 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.785+0000 7fc3e83b4740 10 client.26314 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.785+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55da57c3d3f0 con 0x55da57fcdc00 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3bfe00640 1 -- 172.21.15.82:0/2551287207 <== mon.1 v2:172.21.15.139:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fc3d803a420 con 0x55da57fcdc00 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3e83b4740 10 client.26314 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3e83b4740 10 client.26314 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3e83b4740 20 client.26314 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da57fdd680 0x55da57fdfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3e83b4740 4 client.26314 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da57f39880 con 0x55da57fdd680 2024-04-26T20:25:12.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.786+0000 7fc3de800640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da57fdd680 0x55da57fdfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.787+0000 7fc3de800640 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da57fdd680 0x55da57fdfaa0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bdb7f0f2777a8d64 server_cookie=cd6a8482e29cba10 in_seq=0 out_seq=0 2024-04-26T20:25:12.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.787+0000 7fc3bfe00640 10 client.26314 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:12.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.793+0000 7fc3bfe00640 1 -- 172.21.15.82:0/2551287207 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55da57f39880 con 0x55da57fdd680 2024-04-26T20:25:12.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.793+0000 7fc3bfe00640 10 client.26314 handle_command_reply: tid=0 2024-04-26T20:25:12.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.793+0000 7fc3e83b4740 1 client.26314 shutdown 2024-04-26T20:25:12.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.793+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 msgr2=0x55da57fd9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.793+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd9490 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80016d0 tx=0x7fc3d800c990 comp rx=0 tx=0).stop 2024-04-26T20:25:12.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 shutdown_connections 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da57fdd680 0x55da57fdfaa0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd9490 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/2551287207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 >> 172.21.15.82:0/2551287207 conn(0x55da57fc3710 msgr2=0x55da57fc2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3bfe00640 0 client.26314 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 shutdown_connections 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 1 -- 172.21.15.82:0/2551287207 wait complete. 2024-04-26T20:25:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.794+0000 7fc3e83b4740 20 client.26314 trim_cache size 0 max 16384 2024-04-26T20:25:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.816+0000 7fc3e83b4740 1 Processor -- start 2024-04-26T20:25:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 -- start start 2024-04-26T20:25:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fc2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b1db0 con 0x55da57fc80a0 2024-04-26T20:25:12.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b3a70 con 0x55da57fcdc00 2024-04-26T20:25:12.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b2480 con 0x55da57fc8a90 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3dde00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fc2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3df200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3df200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42236/0 (socket says 172.21.15.82:42236) 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3df200640 1 -- 172.21.15.82:0/1076422339 learned_addr learned my addr 172.21.15.82:0/1076422339 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.817+0000 7fc3de800640 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3df200640 1 -- 172.21.15.82:0/1076422339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 msgr2=0x55da57fc2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3df200640 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fc2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3df200640 1 -- 172.21.15.82:0/1076422339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 msgr2=0x55da57fc2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3df200640 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3df200640 1 -- 172.21.15.82:0/1076422339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da57d077d0 con 0x55da57fcdc00 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3de800640 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3df200640 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd9450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800dff0 tx=0x7fc3d800f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa6e3bf32c8d6940 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.818+0000 7fc3caa00640 1 -- 172.21.15.82:0/1076422339 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8041070 con 0x55da57fcdc00 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.819+0000 7fc3caa00640 1 -- 172.21.15.82:0/1076422339 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3d800cdb0 con 0x55da57fcdc00 2024-04-26T20:25:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.819+0000 7fc3caa00640 1 -- 172.21.15.82:0/1076422339 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800abf0 con 0x55da57fcdc00 2024-04-26T20:25:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.819+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1076422339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 msgr2=0x55da57fd9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.819+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd9450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800dff0 tx=0x7fc3d800f000 comp rx=0 tx=0).stop 2024-04-26T20:25:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1076422339 shutdown_connections 2024-04-26T20:25:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fcdc00 0x55da57fd9450 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fc8a90 0x55da57fc2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/1076422339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc80a0 0x55da57fc2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1076422339 >> 172.21.15.82:0/1076422339 conn(0x55da57fc3710 msgr2=0x55da57fc2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1076422339 shutdown_connections 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 -- 172.21.15.82:0/1076422339 wait complete. 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 -- start start 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.820+0000 7fc3e83b4740 1 Processor -- start 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b32e0 con 0x55da57fc8a90 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b2b50 con 0x55da57fc80a0 2024-04-26T20:25:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01afd90 con 0x55da57fcdc00 2024-04-26T20:25:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3e83b4740 10 client.0 _ll_register_callbacks cb 0x7fc3d8001420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3dde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3dde00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50992/0 (socket says 172.21.15.82:50992) 2024-04-26T20:25:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3dde00640 1 -- 172.21.15.82:0/3746058350 learned_addr learned my addr 172.21.15.82:0/3746058350 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3de800640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3df200640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3de800640 1 -- 172.21.15.82:0/3746058350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 msgr2=0x55da57fd7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3de800640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3de800640 1 -- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 msgr2=0x55da57fd6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3de800640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3de800640 1 -- 172.21.15.82:0/3746058350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da57ed22a0 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.821+0000 7fc3dde00640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.822+0000 7fc3de800640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd6630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0000c00 tx=0x7fc3d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48ba566160122de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.822+0000 7fc3bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.822+0000 7fc3bfe00640 1 -- 172.21.15.82:0/3746058350 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0000e60 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.822+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d800cdb0 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.822+0000 7fc3bfe00640 1 -- 172.21.15.82:0/3746058350 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc3d0046bc0 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.823+0000 7fc3bfe00640 1 -- 172.21.15.82:0/3746058350 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc3d0055050 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.823+0000 7fc3e83b4740 10 client.26297 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.823+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55da57fd9270 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.823+0000 7fc3bfe00640 1 -- 172.21.15.82:0/3746058350 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3d800cdb0 con 0x55da57fc80a0 2024-04-26T20:25:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3bfe00640 1 -- 172.21.15.82:0/3746058350 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fc3d0046250 con 0x55da57fc80a0 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3e83b4740 10 client.26297 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3e83b4740 10 client.26297 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3e83b4740 20 client.26297 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da58043e80 0x55da58046270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3e83b4740 4 client.26297 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da57f336f0 con 0x55da58043e80 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.824+0000 7fc3dde00640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da58043e80 0x55da58046270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.825+0000 7fc3bfe00640 10 client.26297 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.825+0000 7fc3dde00640 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da58043e80 0x55da58046270 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86d818028ec28e15 server_cookie=c8c45e55850c63a4 in_seq=0 out_seq=0 2024-04-26T20:25:12.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.840+0000 7fc3bfe00640 1 -- 172.21.15.82:0/3746058350 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da57f336f0 con 0x55da58043e80 2024-04-26T20:25:12.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.840+0000 7fc3bfe00640 10 client.26297 handle_command_reply: tid=0 2024-04-26T20:25:12.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.840+0000 7fc3e83b4740 1 client.26297 shutdown 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 msgr2=0x55da57fd6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd6630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0000c00 tx=0x7fc3d0004750 comp rx=0 tx=0).stop 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 shutdown_connections 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55da58043e80 0x55da58046270 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55da57fcdc00 0x55da57fd7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da57fc8a90 0x55da57fd6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 --2- 172.21.15.82:0/3746058350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da57fc80a0 0x55da57fd6630 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 >> 172.21.15.82:0/3746058350 conn(0x55da57fc3710 msgr2=0x55da57fc2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3bfe00640 0 client.26297 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 shutdown_connections 2024-04-26T20:25:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.841+0000 7fc3e83b4740 1 -- 172.21.15.82:0/3746058350 wait complete. 2024-04-26T20:25:12.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e83b4740 20 client.26297 trim_cache size 0 max 16384 2024-04-26T20:25:12.843 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:12.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3c40a3cc0 msgr2=0x7fc3c40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3c40a3cc0 0x7fc3c40a6180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8010bb0 tx=0x7fc3d800a9c0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 msgr2=0x7fc3e0196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e0196f10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e9c0 tx=0x7fc3cc00ee80 comp rx=0 tx=0).stop 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 shutdown_connections 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc3c40a3cc0 0x7fc3c40a6180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e01a4780 0x7fc3e01a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3e0108470 0x7fc3e0196f10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 --2- 172.21.15.82:0/1806079738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3e0105b40 0x7fc3e01969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.842+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 >> 172.21.15.82:0/1806079738 conn(0x7fc3e00fcc40 msgr2=0x7fc3e0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.843+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 shutdown_connections 2024-04-26T20:25:12.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:12.843+0000 7fc3e5400640 1 -- 172.21.15.82:0/1806079738 wait complete. 2024-04-26T20:25:12.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 -- 172.21.15.82:0/1648869760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 msgr2=0x7f79bc075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 --2- 172.21.15.82:0/1648869760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 0x7f79bc075770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009900 tx=0x7f79a802a480 comp rx=0 tx=0).stop 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 -- 172.21.15.82:0/1648869760 shutdown_connections 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 --2- 172.21.15.82:0/1648869760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79bc10a820 0x7f79bc10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 --2- 172.21.15.82:0/1648869760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 0x7f79bc075770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 --2- 172.21.15.82:0/1648869760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc0768f0 0x7f79bc074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.224+0000 7f79c3400640 1 -- 172.21.15.82:0/1648869760 >> 172.21.15.82:0/1648869760 conn(0x7f79bc0fdee0 msgr2=0x7f79bc100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.225+0000 7f79c3400640 1 -- 172.21.15.82:0/1648869760 shutdown_connections 2024-04-26T20:25:13.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.225+0000 7f79c3400640 1 -- 172.21.15.82:0/1648869760 wait complete. 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 Processor -- start 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 -- start start 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 0x7f79bc19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79bc0768f0 0x7f79bc19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 0x7f79bc1a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc1106d0 con 0x7f79bc0768f0 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc110550 con 0x7f79bc10a820 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.226+0000 7f79c3400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc110850 con 0x7f79bc075310 2024-04-26T20:25:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 0x7f79bc1a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 0x7f79bc1a23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42264/0 (socket says 172.21.15.82:42264) 2024-04-26T20:25:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 -- 172.21.15.82:0/3139619404 learned_addr learned my addr 172.21.15.82:0/3139619404 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c0a00640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 0x7f79bc19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79bbe00640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79bc0768f0 0x7f79bc19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 -- 172.21.15.82:0/3139619404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 msgr2=0x7f79bc19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 0x7f79bc19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 -- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79bc0768f0 msgr2=0x7f79bc19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79bc0768f0 0x7f79bc19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.227+0000 7f79c1400640 1 -- 172.21.15.82:0/3139619404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79bc1a2a10 con 0x7f79bc10a820 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.228+0000 7f79c1400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 0x7f79bc1a23a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f79b400eaa0 tx=0x7f79b400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.228+0000 7f79b9600640 1 -- 172.21.15.82:0/3139619404 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b400cdb0 con 0x7f79bc10a820 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.228+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79bc1a2d00 con 0x7f79bc10a820 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.228+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79bc1a31d0 con 0x7f79bc10a820 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.228+0000 7f79b9600640 1 -- 172.21.15.82:0/3139619404 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b4005020 con 0x7f79bc10a820 2024-04-26T20:25:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.228+0000 7f79b9600640 1 -- 172.21.15.82:0/3139619404 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b401f060 con 0x7f79bc10a820 2024-04-26T20:25:13.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.232+0000 7f79c6167740 1 Processor -- start 2024-04-26T20:25:13.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79b9600640 1 -- 172.21.15.82:0/3139619404 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f79b4004a40 con 0x7f79bc10a820 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 -- start start 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 0x5621d3d2fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d34ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5621d3c8ac70 con 0x5621d3d300a0 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5621d3c43980 con 0x5621d3d35210 2024-04-26T20:25:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.233+0000 7f79c6167740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5621d3c86c30 con 0x5621d3d2f6b0 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.234+0000 7f79bbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 0x5621d3d2fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.234+0000 7f79bbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 0x5621d3d2fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50366/0 (socket says 172.21.15.82:50366) 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.234+0000 7f79bbe00640 1 -- 172.21.15.82:0/1358072385 learned_addr learned my addr 172.21.15.82:0/1358072385 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.234+0000 7f79bbe00640 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.234+0000 7f79c0a00640 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d34ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.235+0000 7f79bbe00640 1 -- 172.21.15.82:0/1358072385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 msgr2=0x5621d3d376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.235+0000 7f79bbe00640 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.235+0000 7f79bbe00640 1 -- 172.21.15.82:0/1358072385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 msgr2=0x5621d3d34ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.235+0000 7f79bbe00640 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d34ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.235+0000 7f79bbe00640 1 -- 172.21.15.82:0/1358072385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d3c1b7b0 con 0x5621d3d2f6b0 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.235+0000 7f79bbe00640 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 0x5621d3d2fad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009230 tx=0x7f79a8005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67ae688cb7ebd0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.236+0000 7f79adc00640 1 -- 172.21.15.82:0/1358072385 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8035030 con 0x5621d3d2f6b0 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.236+0000 7f79b9600640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79a40a3cc0 0x7f79a40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.236+0000 7f79adc00640 1 -- 172.21.15.82:0/1358072385 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79a8005510 con 0x5621d3d2f6b0 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.236+0000 7f79adc00640 1 -- 172.21.15.82:0/1358072385 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8003970 con 0x5621d3d2f6b0 2024-04-26T20:25:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.236+0000 7f79b9600640 1 -- 172.21.15.82:0/3139619404 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f79b40d09d0 con 0x7f79bc10a820 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 -- 172.21.15.82:0/1358072385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 msgr2=0x5621d3d2fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 0x5621d3d2fad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009230 tx=0x7f79a8005b50 comp rx=0 tx=0).stop 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c0a00640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79a40a3cc0 0x7f79a40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 -- 172.21.15.82:0/1358072385 shutdown_connections 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d34ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 --2- 172.21.15.82:0/1358072385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d2f6b0 0x5621d3d2fad0 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009230 tx=0x7f79a8005b50 comp rx=0 tx=0).stop 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 -- 172.21.15.82:0/1358072385 >> 172.21.15.82:0/1358072385 conn(0x5621d3d2ad20 msgr2=0x5621d3d2b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c0a00640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79a40a3cc0 0x7f79a40a6180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5621d3d2bbf0 tx=0x7f79b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.237+0000 7f79c6167740 1 -- 172.21.15.82:0/1358072385 shutdown_connections 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.238+0000 7f79c6167740 1 -- 172.21.15.82:0/1358072385 wait complete. 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.238+0000 7f79c6167740 1 -- start start 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 Processor -- start 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d35210 0x5621d3d39cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d3ed20 0x5621d3d41110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5621d3c89f80 con 0x5621d3d300a0 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5621d3c37260 con 0x5621d3d3ed20 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5621d3c8f2a0 con 0x5621d3d35210 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c6167740 10 client.0 _ll_register_callbacks cb 0x5621d3c81960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51034/0 (socket says 172.21.15.82:51034) 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.239+0000 7f79c0a00640 1 -- 172.21.15.82:0/1070456781 learned_addr learned my addr 172.21.15.82:0/1070456781 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d3ed20 0x5621d3d41110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 -- 172.21.15.82:0/1070456781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d35210 msgr2=0x5621d3d39cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:13.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d35210 0x5621d3d39cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 -- 172.21.15.82:0/1070456781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 msgr2=0x5621d3d397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 -- 172.21.15.82:0/1070456781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d3c191c0 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c0a00640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79c1400640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d3ed20 0x5621d3d41110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f79b40cdfc0 tx=0x7f79b409cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e478f407f13242 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79a2000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.240+0000 7f79a2000640 1 -- 172.21.15.82:0/1070456781 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40a5400 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79a2000640 1 -- 172.21.15.82:0/1070456781 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f79b4098e00 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79a8005510 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79a2000640 1 -- 172.21.15.82:0/1070456781 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f79b409bbe0 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 10 client.26309 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5621d399c3f0 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79a2000640 1 -- 172.21.15.82:0/1070456781 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79a8005510 con 0x5621d3d3ed20 2024-04-26T20:25:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79a2000640 1 -- 172.21.15.82:0/1070456781 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f79b400f040 con 0x5621d3d3ed20 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 10 client.26309 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 10 client.26309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 20 client.26309 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3d456f0 0x5621d3d47bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 4 client.26309 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.241+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621d3c98880 con 0x5621d3d456f0 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.242+0000 7f79c0a00640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3d456f0 0x5621d3d47bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.242+0000 7f79c0a00640 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3d456f0 0x5621d3d47bb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67986634ee94029 server_cookie=1c574477d9439169 in_seq=0 out_seq=0 2024-04-26T20:25:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.242+0000 7f79a2000640 10 client.26309 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:13.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79a2000640 1 -- 172.21.15.82:0/1070456781 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621d3c98880 con 0x5621d3d456f0 2024-04-26T20:25:13.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79a2000640 10 client.26309 handle_command_reply: tid=0 2024-04-26T20:25:13.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 client.26309 shutdown 2024-04-26T20:25:13.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d3ed20 msgr2=0x5621d3d41110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d3ed20 0x5621d3d41110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f79b40cdfc0 tx=0x7f79b409cf50 comp rx=0 tx=0).stop 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 shutdown_connections 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3d456f0 0x5621d3d47bb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d3ed20 0x5621d3d41110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d35210 0x5621d3d39cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 --2- 172.21.15.82:0/1070456781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 >> 172.21.15.82:0/1070456781 conn(0x5621d3d2ad20 msgr2=0x5621d3d21690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.243+0000 7f79a2000640 0 client.26309 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.244+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 shutdown_connections 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.244+0000 7f79c6167740 1 -- 172.21.15.82:0/1070456781 wait complete. 2024-04-26T20:25:13.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.244+0000 7f79c6167740 20 client.26309 trim_cache size 0 max 16384 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.260+0000 7f79c6167740 1 Processor -- start 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 -- start start 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 0x5621d3d30a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d30f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d3ed20 0x5621d3d31490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f799c00fad0 con 0x5621d3d3ed20 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f799c011790 con 0x5621d3d35210 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c6167740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f799c0101a0 con 0x5621d3d300a0 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 0x5621d3d30a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 0x5621d3d30a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50394/0 (socket says 172.21.15.82:50394) 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 -- 172.21.15.82:0/2320343060 learned_addr learned my addr 172.21.15.82:0/2320343060 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c1400640 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d3ed20 0x5621d3d31490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79bbe00640 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d30f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 -- 172.21.15.82:0/2320343060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 msgr2=0x5621d3d30f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d30f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 -- 172.21.15.82:0/2320343060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d3ed20 msgr2=0x5621d3d31490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.261+0000 7f79c0a00640 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d3ed20 0x5621d3d31490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.262+0000 7f79c0a00640 1 -- 172.21.15.82:0/2320343060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d3a667d0 con 0x5621d3d300a0 2024-04-26T20:25:13.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.262+0000 7f79c0a00640 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 0x5621d3d30a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5621d3d48460 tx=0x7f79b001b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924feba830b3782f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.262+0000 7f79ad200640 1 -- 172.21.15.82:0/2320343060 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0005020 con 0x5621d3d300a0 2024-04-26T20:25:13.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.262+0000 7f79ad200640 1 -- 172.21.15.82:0/2320343060 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b0032030 con 0x5621d3d300a0 2024-04-26T20:25:13.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.262+0000 7f79ad200640 1 -- 172.21.15.82:0/2320343060 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b002e330 con 0x5621d3d300a0 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 -- 172.21.15.82:0/2320343060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 msgr2=0x5621d3d30a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 0x5621d3d30a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5621d3d48460 tx=0x7f79b001b000 comp rx=0 tx=0).stop 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 -- 172.21.15.82:0/2320343060 shutdown_connections 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d3ed20 0x5621d3d31490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d30f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 --2- 172.21.15.82:0/2320343060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d300a0 0x5621d3d30a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.263+0000 7f79c6167740 1 -- 172.21.15.82:0/2320343060 >> 172.21.15.82:0/2320343060 conn(0x5621d3d2ad20 msgr2=0x5621d3d21690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.264+0000 7f79c6167740 1 -- 172.21.15.82:0/2320343060 shutdown_connections 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.264+0000 7f79c6167740 1 -- 172.21.15.82:0/2320343060 wait complete. 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.264+0000 7f79c6167740 1 -- start start 2024-04-26T20:25:13.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.264+0000 7f79c6167740 1 Processor -- start 2024-04-26T20:25:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d56cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d57230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 0x5621d3d58240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f799c011000 con 0x5621d3d300a0 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f799c010870 con 0x5621d3d35210 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f799c00dab0 con 0x5621d3d3ed20 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c6167740 10 client.0 _ll_register_callbacks cb 0x7f79b4098370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 0x5621d3d58240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 0x5621d3d58240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50396/0 (socket says 172.21.15.82:50396) 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 -- 172.21.15.82:0/4124623285 learned_addr learned my addr 172.21.15.82:0/4124623285 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79bbe00640 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d57230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 -- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 msgr2=0x5621d3d57230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d57230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 -- 172.21.15.82:0/4124623285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 msgr2=0x5621d3d56cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d56cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.265+0000 7f79c1400640 1 -- 172.21.15.82:0/4124623285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d3c312a0 con 0x5621d3d3ed20 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.266+0000 7f79c1400640 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 0x5621d3d58240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79b409aa40 tx=0x7f79b4005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60896977b8b24e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:13.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.266+0000 7f79a2000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.266+0000 7f79a2000640 1 -- 172.21.15.82:0/4124623285 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4098a30 con 0x5621d3d3ed20 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.266+0000 7f79a2000640 1 -- 172.21.15.82:0/4124623285 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f79b409bd80 con 0x5621d3d3ed20 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.266+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b0032030 con 0x5621d3d3ed20 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.266+0000 7f79a2000640 1 -- 172.21.15.82:0/4124623285 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f79b409c2d0 con 0x5621d3d3ed20 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.267+0000 7f79c6167740 10 client.26335 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.267+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5621d3dabc60 con 0x5621d3d3ed20 2024-04-26T20:25:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.267+0000 7f79a2000640 1 -- 172.21.15.82:0/4124623285 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b0032030 con 0x5621d3d3ed20 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79a2000640 1 -- 172.21.15.82:0/4124623285 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f79b40984e0 con 0x5621d3d3ed20 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c6167740 10 client.26335 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c6167740 10 client.26335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c6167740 20 client.26335 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c6167740 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3dac4d0 0x5621d3dae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c6167740 4 client.26335 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621d3c926f0 con 0x5621d3dac4d0 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.268+0000 7f79c0a00640 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3dac4d0 0x5621d3dae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c0a00640 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3dac4d0 0x5621d3dae8f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3c62f244192fdd server_cookie=326cc7193d5450e5 in_seq=0 out_seq=0 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79a2000640 10 client.26335 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79a2000640 1 -- 172.21.15.82:0/4124623285 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621d3c926f0 con 0x5621d3dac4d0 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79a2000640 10 client.26335 handle_command_reply: tid=0 2024-04-26T20:25:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 client.26335 shutdown 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 msgr2=0x5621d3d58240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 0x5621d3d58240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79b409aa40 tx=0x7f79b4005e80 comp rx=0 tx=0).stop 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 shutdown_connections 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5621d3dac4d0 0x5621d3dae8f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621d3d3ed20 0x5621d3d58240 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d35210 0x5621d3d57230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 --2- 172.21.15.82:0/4124623285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621d3d300a0 0x5621d3d56cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 >> 172.21.15.82:0/4124623285 conn(0x5621d3d2ad20 msgr2=0x5621d3d21690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.269+0000 7f79a2000640 0 client.26335 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.270+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 shutdown_connections 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.270+0000 7f79c6167740 1 -- 172.21.15.82:0/4124623285 wait complete. 2024-04-26T20:25:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.270+0000 7f79c6167740 20 client.26335 trim_cache size 0 max 16384 2024-04-26T20:25:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79a40a3cc0 msgr2=0x7f79a40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79a40a3cc0 0x7f79a40a6180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5621d3d2bbf0 tx=0x7f79b0005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 msgr2=0x7f79bc1a23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 0x7f79bc1a23a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f79b400eaa0 tx=0x7f79b400ef60 comp rx=0 tx=0).stop 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 shutdown_connections 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79a40a3cc0 0x7f79a40a6180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79bc10a820 0x7f79bc1a23a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79bc0768f0 0x7f79bc19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 --2- 172.21.15.82:0/3139619404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79bc075310 0x7f79bc19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 >> 172.21.15.82:0/3139619404 conn(0x7f79bc0fdee0 msgr2=0x7f79bc1067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 shutdown_connections 2024-04-26T20:25:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:13.271+0000 7f79c3400640 1 -- 172.21.15.82:0/3139619404 wait complete. 2024-04-26T20:25:14.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:13 smithi139 ceph-mon[32999]: pgmap v484: 129 pgs: 129 active+clean; 68 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 229 op/s 2024-04-26T20:25:14.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:13 smithi135 ceph-mon[32816]: pgmap v484: 129 pgs: 129 active+clean; 68 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 229 op/s 2024-04-26T20:25:14.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:13 smithi082 ceph-mon[28105]: pgmap v484: 129 pgs: 129 active+clean; 68 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 229 op/s 2024-04-26T20:25:14.294 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:25:14.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:25:14.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 -- 172.21.15.82:0/1541671568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac0104470 msgr2=0x7fbac010ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 --2- 172.21.15.82:0/1541671568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac0104470 0x7fbac010ad00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009ca0 tx=0x7fbab802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 -- 172.21.15.82:0/1541671568 shutdown_connections 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 --2- 172.21.15.82:0/1541671568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac0104470 0x7fbac010ad00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 --2- 172.21.15.82:0/1541671568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0103ab0 0x7fbac0103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 --2- 172.21.15.82:0/1541671568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac01028c0 0x7fbac0102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 -- 172.21.15.82:0/1541671568 >> 172.21.15.82:0/1541671568 conn(0x7fbac00fde30 msgr2=0x7fbac0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 -- 172.21.15.82:0/1541671568 shutdown_connections 2024-04-26T20:25:14.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.528+0000 7fbac6600640 1 -- 172.21.15.82:0/1541671568 wait complete. 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.529+0000 7fbac6600640 1 Processor -- start 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.529+0000 7fbac6600640 1 -- start start 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac6600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 0x7fbac00766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103ab0 0x7fbac0074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac6600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0104470 0x7fbac0075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010e3d0 con 0x7fbac0103ab0 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac6600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010e250 con 0x7fbac0104470 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac6600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010e550 con 0x7fbac01028c0 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 0x7fbac00766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbab7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103ab0 0x7fbac0074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 0x7fbac00766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50418/0 (socket says 172.21.15.82:50418) 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 -- 172.21.15.82:0/1464466764 learned_addr learned my addr 172.21.15.82:0/1464466764 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5c00640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0104470 0x7fbac0075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 -- 172.21.15.82:0/1464466764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0104470 msgr2=0x7fbac0075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0104470 0x7fbac0075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 -- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103ab0 msgr2=0x7fbac0074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103ab0 0x7fbac0074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5200640 1 -- 172.21.15.82:0/1464466764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac0075af0 con 0x7fbac01028c0 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.530+0000 7fbac5c00640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0104470 0x7fbac0075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.531+0000 7fbac5200640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 0x7fbac00766e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbab000e9c0 tx=0x7fbab000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.531+0000 7fbabe000640 1 -- 172.21.15.82:0/1464466764 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab000cd80 con 0x7fbac01028c0 2024-04-26T20:25:14.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.531+0000 7fbabe000640 1 -- 172.21.15.82:0/1464466764 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab00035f0 con 0x7fbac01028c0 2024-04-26T20:25:14.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.531+0000 7fbabe000640 1 -- 172.21.15.82:0/1464466764 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0010690 con 0x7fbac01028c0 2024-04-26T20:25:14.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.531+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac01a2b70 con 0x7fbac01028c0 2024-04-26T20:25:14.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.531+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac01a3110 con 0x7fbac01028c0 2024-04-26T20:25:14.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.534+0000 7fbabe000640 1 -- 172.21.15.82:0/1464466764 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbab00037a0 con 0x7fbac01028c0 2024-04-26T20:25:14.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 Processor -- start 2024-04-26T20:25:14.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 -- start start 2024-04-26T20:25:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b42a70 0x55f5d0b42e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b43460 0x55f5d0b47f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b4aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f5d0aa7980 con 0x55f5d0b485d0 2024-04-26T20:25:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f5d0a44220 con 0x55f5d0b42a70 2024-04-26T20:25:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.535+0000 7fbacabd4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f5d0aa3940 con 0x55f5d0b43460 2024-04-26T20:25:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbac5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b42a70 0x55f5d0b42e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbab7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b4aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbac5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b42a70 0x55f5d0b42e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42322/0 (socket says 172.21.15.82:42322) 2024-04-26T20:25:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbac5c00640 1 -- 172.21.15.82:0/1303512257 learned_addr learned my addr 172.21.15.82:0/1303512257 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbac5200640 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b43460 0x55f5d0b47f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbab7e00640 1 -- 172.21.15.82:0/1303512257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b43460 msgr2=0x55f5d0b47f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbab7e00640 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b43460 0x55f5d0b47f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbab7e00640 1 -- 172.21.15.82:0/1303512257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b42a70 msgr2=0x55f5d0b42e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbabe000640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbaa40a3cc0 0x7fbaa40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbab7e00640 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b42a70 0x55f5d0b42e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.536+0000 7fbab7e00640 1 -- 172.21.15.82:0/1303512257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d08817e0 con 0x55f5d0b485d0 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.537+0000 7fbabe000640 1 -- 172.21.15.82:0/1464466764 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbab00d0d40 con 0x7fbac01028c0 2024-04-26T20:25:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.537+0000 7fbab7e00640 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b4aa60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009bd0 tx=0x7fbaa8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a97c60d1a4536f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.537+0000 7fbac5c00640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbaa40a3cc0 0x7fbaa40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.537+0000 7fbab6000640 1 -- 172.21.15.82:0/1303512257 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8004230 con 0x55f5d0b485d0 2024-04-26T20:25:14.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.537+0000 7fbab6000640 1 -- 172.21.15.82:0/1303512257 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa8009e40 con 0x55f5d0b485d0 2024-04-26T20:25:14.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.537+0000 7fbab6000640 1 -- 172.21.15.82:0/1303512257 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8004ca0 con 0x55f5d0b485d0 2024-04-26T20:25:14.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbac5c00640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbaa40a3cc0 0x7fbaa40a6180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbab8031b50 tx=0x7fbab80095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 -- 172.21.15.82:0/1303512257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 msgr2=0x55f5d0b4aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b4aa60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009bd0 tx=0x7fbaa8011810 comp rx=0 tx=0).stop 2024-04-26T20:25:14.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 -- 172.21.15.82:0/1303512257 shutdown_connections 2024-04-26T20:25:14.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b4aa60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b43460 0x55f5d0b47f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 --2- 172.21.15.82:0/1303512257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b42a70 0x55f5d0b42e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.538+0000 7fbacabd4740 1 -- 172.21.15.82:0/1303512257 >> 172.21.15.82:0/1303512257 conn(0x55f5d0b3e0e0 msgr2=0x55f5d0b3e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.539+0000 7fbacabd4740 1 -- 172.21.15.82:0/1303512257 shutdown_connections 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.539+0000 7fbacabd4740 1 -- 172.21.15.82:0/1303512257 wait complete. 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.539+0000 7fbacabd4740 1 -- start start 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.539+0000 7fbacabd4740 1 Processor -- start 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b4d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b54450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f5d0b4b580 con 0x55f5d0b43460 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f5d0a2f170 con 0x55f5d0b485d0 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f5d0b4b700 con 0x55f5d0b42a70 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbacabd4740 10 client.0 _ll_register_callbacks cb 0x55f5d0a9e770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:14.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbab7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b4d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b4ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50428/0 (socket says 172.21.15.82:50428) 2024-04-26T20:25:14.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbac5200640 1 -- 172.21.15.82:0/3439367127 learned_addr learned my addr 172.21.15.82:0/3439367127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbab7e00640 1 -- 172.21.15.82:0/3439367127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 msgr2=0x55f5d0b4ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbab7e00640 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b4ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbab7e00640 1 -- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 msgr2=0x55f5d0b54450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbab7e00640 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b54450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.540+0000 7fbab7e00640 1 -- 172.21.15.82:0/3439367127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d08e1f70 con 0x55f5d0b43460 2024-04-26T20:25:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.541+0000 7fbab7e00640 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b4d410 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009bd0 tx=0x7fbaa8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed0aed571cc9b22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.541+0000 7fbaaea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.541+0000 7fbaaea00640 1 -- 172.21.15.82:0/3439367127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8027020 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.541+0000 7fbaaea00640 1 -- 172.21.15.82:0/3439367127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbaa8003b90 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.541+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f5d0ab5590 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.541+0000 7fbaaea00640 1 -- 172.21.15.82:0/3439367127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbaa8032050 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.542+0000 7fbacabd4740 10 client.16218 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.542+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f5d0779170 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.542+0000 7fbaaea00640 1 -- 172.21.15.82:0/3439367127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f5d0ab5590 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbaaea00640 1 -- 172.21.15.82:0/3439367127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fbaa8018070 con 0x55f5d0b43460 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbacabd4740 10 client.16218 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbacabd4740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbacabd4740 20 client.16218 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbacabd4740 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0b58750 0x55f5d0b5ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbacabd4740 4 client.16218 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:14.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5d0aaf400 con 0x55f5d0b58750 2024-04-26T20:25:14.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.543+0000 7fbac5200640 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0b58750 0x55f5d0b5ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.544+0000 7fbaaea00640 10 client.16218 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.544+0000 7fbac5200640 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0b58750 0x55f5d0b5ab60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f6e11f489020220 server_cookie=a71c7b31e148a969 in_seq=0 out_seq=0 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.544+0000 7fbaaea00640 1 -- 172.21.15.82:0/3439367127 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f5d0aaf400 con 0x55f5d0b58750 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.544+0000 7fbaaea00640 10 client.16218 handle_command_reply: tid=0 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.544+0000 7fbacabd4740 1 client.16218 shutdown 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 msgr2=0x55f5d0b4d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b4d410 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009bd0 tx=0x7fbaa8003820 comp rx=0 tx=0).stop 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 shutdown_connections 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0b58750 0x55f5d0b5ab60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b54450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b4d410 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 --2- 172.21.15.82:0/3439367127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b4ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbaaea00640 0 client.16218 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 >> 172.21.15.82:0/3439367127 conn(0x55f5d0b3e0e0 msgr2=0x55f5d0b3d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 shutdown_connections 2024-04-26T20:25:14.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 1 -- 172.21.15.82:0/3439367127 wait complete. 2024-04-26T20:25:14.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.545+0000 7fbacabd4740 20 client.16218 trim_cache size 0 max 16384 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 Processor -- start 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 -- start start 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b54410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01ad480 con 0x55f5d0b43460 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01af140 con 0x55f5d0b485d0 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.573+0000 7fbacabd4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01adb50 con 0x55f5d0b42a70 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b41090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50430/0 (socket says 172.21.15.82:50430) 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 -- 172.21.15.82:0/2940551328 learned_addr learned my addr 172.21.15.82:0/2940551328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbab7e00640 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b54410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5c00640 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 -- 172.21.15.82:0/2940551328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 msgr2=0x55f5d0b415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 -- 172.21.15.82:0/2940551328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 msgr2=0x55f5d0b54410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b54410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 -- 172.21.15.82:0/2940551328 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d0b4ccc0 con 0x55f5d0b42a70 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5c00640 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbac5200640 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b41090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbab000cfd0 tx=0x7fbab00d47f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a5c5bf2a1f958c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbab5600640 1 -- 172.21.15.82:0/2940551328 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab009c640 con 0x55f5d0b42a70 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbab5600640 1 -- 172.21.15.82:0/2940551328 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab009d200 con 0x55f5d0b42a70 2024-04-26T20:25:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.574+0000 7fbab5600640 1 -- 172.21.15.82:0/2940551328 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab009c460 con 0x55f5d0b42a70 2024-04-26T20:25:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.575+0000 7fbacabd4740 1 -- 172.21.15.82:0/2940551328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 msgr2=0x55f5d0b41090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.575+0000 7fbacabd4740 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b41090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbab000cfd0 tx=0x7fbab00d47f0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 -- 172.21.15.82:0/2940551328 shutdown_connections 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b485d0 0x55f5d0b415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b43460 0x55f5d0b54410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 --2- 172.21.15.82:0/2940551328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b41090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 -- 172.21.15.82:0/2940551328 >> 172.21.15.82:0/2940551328 conn(0x55f5d0b3e0e0 msgr2=0x55f5d0b44880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 -- 172.21.15.82:0/2940551328 shutdown_connections 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 -- 172.21.15.82:0/2940551328 wait complete. 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 -- start start 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.576+0000 7fbacabd4740 1 Processor -- start 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b51a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b43460 0x55f5d0b51f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b52f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01ae9b0 con 0x55f5d0b485d0 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01ae220 con 0x55f5d0b43460 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01ab460 con 0x55f5d0b42a70 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbacabd4740 10 client.0 _ll_register_callbacks cb 0x7fbab0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b51a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbac5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b51a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50442/0 (socket says 172.21.15.82:50442) 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbac5200640 1 -- 172.21.15.82:0/719912927 learned_addr learned my addr 172.21.15.82:0/719912927 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbab7e00640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b43460 0x55f5d0b51f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.577+0000 7fbac5c00640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b52f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5200640 1 -- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b43460 msgr2=0x55f5d0b51f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5200640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b43460 0x55f5d0b51f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5200640 1 -- 172.21.15.82:0/719912927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 msgr2=0x55f5d0b52f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5200640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b52f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5200640 1 -- 172.21.15.82:0/719912927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d0b53540 con 0x55f5d0b42a70 2024-04-26T20:25:14.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5c00640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b52f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbac5200640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b51a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbab0098f60 tx=0x7fbab009c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33bea622842065d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbaaea00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbaaea00640 1 -- 172.21.15.82:0/719912927 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00a0eb0 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab009d200 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbaaea00640 1 -- 172.21.15.82:0/719912927 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbab0099170 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbaaea00640 1 -- 172.21.15.82:0/719912927 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbab00a5770 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbacabd4740 10 client.26353 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f5d0bbece0 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.578+0000 7fbaaea00640 1 -- 172.21.15.82:0/719912927 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab009d200 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbaaea00640 1 -- 172.21.15.82:0/719912927 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fbab0098850 con 0x55f5d0b42a70 2024-04-26T20:25:14.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbacabd4740 10 client.26353 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbacabd4740 10 client.26353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbacabd4740 20 client.26353 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbacabd4740 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0bbf5a0 0x55f5d0bc19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbacabd4740 4 client.26353 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f5d0a2a980 con 0x55f5d0bbf5a0 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbab7e00640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0bbf5a0 0x55f5d0bc19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbab7e00640 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0bbf5a0 0x55f5d0bc19c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12072b86e158fe2b server_cookie=eb700b1ce416d105 in_seq=0 out_seq=0 2024-04-26T20:25:14.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.579+0000 7fbaaea00640 10 client.26353 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.580+0000 7fbaaea00640 1 -- 172.21.15.82:0/719912927 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f5d0a2a980 con 0x55f5d0bbf5a0 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.580+0000 7fbaaea00640 10 client.26353 handle_command_reply: tid=0 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.580+0000 7fbacabd4740 1 client.26353 shutdown 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.580+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 msgr2=0x55f5d0b51a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.580+0000 7fbacabd4740 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b51a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbab0098f60 tx=0x7fbab009c4f0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 shutdown_connections 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f5d0bbf5a0 0x55f5d0bc19c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f5d0b485d0 0x55f5d0b52f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f5d0b43460 0x55f5d0b51f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 --2- 172.21.15.82:0/719912927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f5d0b42a70 0x55f5d0b51a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbaaea00640 0 client.26353 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 >> 172.21.15.82:0/719912927 conn(0x55f5d0b3e0e0 msgr2=0x55f5d0b3ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 shutdown_connections 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 1 -- 172.21.15.82:0/719912927 wait complete. 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.581+0000 7fbacabd4740 20 client.26353 trim_cache size 0 max 16384 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:25:14.585 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "965d07d9-c64a-465a-ba10-59710f39cf6b", 2024-04-26T20:25:14.586 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:25:14.586 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:25:14.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbaa40a3cc0 msgr2=0x7fbaa40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbaa40a3cc0 0x7fbaa40a6180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbab8031b50 tx=0x7fbab80095c0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 msgr2=0x7fbac00766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 0x7fbac00766e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbab000e9c0 tx=0x7fbab000ee80 comp rx=0 tx=0).stop 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 shutdown_connections 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbaa40a3cc0 0x7fbaa40a6180 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac0104470 0x7fbac0075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103ab0 0x7fbac0074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 --2- 172.21.15.82:0/1464466764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbac01028c0 0x7fbac00766e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 >> 172.21.15.82:0/1464466764 conn(0x7fbac00fde30 msgr2=0x7fbac0106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 shutdown_connections 2024-04-26T20:25:14.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.582+0000 7fbac6600640 1 -- 172.21.15.82:0/1464466764 wait complete. 2024-04-26T20:25:14.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:25:14.600 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:25:14.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 -- 172.21.15.82:0/1030158708 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634101a70 msgr2=0x7f8634101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 --2- 172.21.15.82:0/1030158708 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634101a70 0x7f8634101ed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8620009860 tx=0x7f862002a340 comp rx=0 tx=0).stop 2024-04-26T20:25:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 -- 172.21.15.82:0/1030158708 shutdown_connections 2024-04-26T20:25:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 --2- 172.21.15.82:0/1030158708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8634102410 0x7f8634102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 --2- 172.21.15.82:0/1030158708 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634101a70 0x7f8634101ed0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 --2- 172.21.15.82:0/1030158708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f8634101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.797+0000 7f8633200640 1 -- 172.21.15.82:0/1030158708 >> 172.21.15.82:0/1030158708 conn(0x7f86340fccd0 msgr2=0x7f86340ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.798+0000 7f8633200640 1 -- 172.21.15.82:0/1030158708 shutdown_connections 2024-04-26T20:25:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.798+0000 7f8633200640 1 -- 172.21.15.82:0/1030158708 wait complete. 2024-04-26T20:25:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 Processor -- start 2024-04-26T20:25:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 -- start start 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f863419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8634101a70 0x7f863419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634102410 0x7f86341a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86341105d0 con 0x7f8634101a70 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8634110450 con 0x7f8634101110 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.799+0000 7f8633200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8634110750 con 0x7f8634102410 2024-04-26T20:25:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f863419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f863419acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42362/0 (socket says 172.21.15.82:42362) 2024-04-26T20:25:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 -- 172.21.15.82:0/3586107111 learned_addr learned my addr 172.21.15.82:0/3586107111 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8632800640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634102410 0x7f86341a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631400640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8634101a70 0x7f863419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 -- 172.21.15.82:0/3586107111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634102410 msgr2=0x7f86341a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634102410 0x7f86341a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 -- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8634101a70 msgr2=0x7f863419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8634101a70 0x7f863419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8631e00640 1 -- 172.21.15.82:0/3586107111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86341a2900 con 0x7f8634101110 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.800+0000 7f8632800640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634102410 0x7f86341a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.801+0000 7f8631e00640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f863419acf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f862400e9f0 tx=0x7f862400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.801+0000 7f862aa00640 1 -- 172.21.15.82:0/3586107111 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862400ccc0 con 0x7f8634101110 2024-04-26T20:25:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.801+0000 7f862aa00640 1 -- 172.21.15.82:0/3586107111 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86240054d0 con 0x7f8634101110 2024-04-26T20:25:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.801+0000 7f862aa00640 1 -- 172.21.15.82:0/3586107111 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624010430 con 0x7f8634101110 2024-04-26T20:25:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.801+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86341a2bf0 con 0x7f8634101110 2024-04-26T20:25:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.801+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86341a30f0 con 0x7f8634101110 2024-04-26T20:25:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.805+0000 7f862aa00640 1 -- 172.21.15.82:0/3586107111 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f86240046c0 con 0x7f8634101110 2024-04-26T20:25:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.807+0000 7f862aa00640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86180a3cc0 0x7f86180a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.807+0000 7f862aa00640 1 -- 172.21.15.82:0/3586107111 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f86240d0be0 con 0x7f8634101110 2024-04-26T20:25:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.807+0000 7f8631400640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86180a3cc0 0x7f86180a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 Processor -- start 2024-04-26T20:25:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 -- start start 2024-04-26T20:25:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 0x55f358641590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641b60 0x55f358646660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358649160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f358549030 con 0x55f358646cd0 2024-04-26T20:25:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f3585647f0 con 0x55f358641170 2024-04-26T20:25:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.808+0000 7f863bfa0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f35851f7e0 con 0x55f358641b60 2024-04-26T20:25:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 0x55f358641590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8632800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358649160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 0x55f358641590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42366/0 (socket says 172.21.15.82:42366) 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631400640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86180a3cc0 0x7f86180a6180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f862002a930 tx=0x7f8620030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 -- 172.21.15.82:0/3161232452 learned_addr learned my addr 172.21.15.82:0/3161232452 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631400640 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641b60 0x55f358646660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 -- 172.21.15.82:0/3161232452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641b60 msgr2=0x55f358646660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641b60 0x55f358646660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 -- 172.21.15.82:0/3161232452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 msgr2=0x55f358649160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358649160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.809+0000 7f8631e00640 1 -- 172.21.15.82:0/3161232452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f35852b050 con 0x55f358641170 2024-04-26T20:25:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.810+0000 7f8631e00640 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 0x55f358641590 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86240a50e0 tx=0x7f862409c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd765e9556a0a73f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.810+0000 7f861f400640 1 -- 172.21.15.82:0/3161232452 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862409c9a0 con 0x55f358641170 2024-04-26T20:25:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.810+0000 7f861f400640 1 -- 172.21.15.82:0/3161232452 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86240a0d50 con 0x55f358641170 2024-04-26T20:25:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 -- 172.21.15.82:0/3161232452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 msgr2=0x55f358641590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 0x55f358641590 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86240a50e0 tx=0x7f862409c8a0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 -- 172.21.15.82:0/3161232452 shutdown_connections 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358649160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641b60 0x55f358646660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3161232452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641170 0x55f358641590 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 -- 172.21.15.82:0/3161232452 >> 172.21.15.82:0/3161232452 conn(0x55f358633fd0 msgr2=0x55f3586343d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 -- 172.21.15.82:0/3161232452 shutdown_connections 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.811+0000 7f863bfa0740 1 -- 172.21.15.82:0/3161232452 wait complete. 2024-04-26T20:25:14.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 -- start start 2024-04-26T20:25:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 Processor -- start 2024-04-26T20:25:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358641b60 0x55f35864b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358646cd0 0x55f358652490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f3585a1200 con 0x55f358641b60 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f35859bee0 con 0x55f358646cd0 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.812+0000 7f863bfa0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f3585a8e70 con 0x55f358641170 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358641b60 0x55f35864b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8632800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358646cd0 0x55f358652490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50470/0 (socket says 172.21.15.82:50470) 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8632800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358646cd0 0x55f358652490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:42370/0 (socket says 172.21.15.82:42370) 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 -- 172.21.15.82:0/1160429684 learned_addr learned my addr 172.21.15.82:0/1160429684 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f863bfa0740 10 client.0 _ll_register_callbacks cb 0x55f358592270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 -- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358646cd0 msgr2=0x55f358652490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358646cd0 0x55f358652490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 -- 172.21.15.82:0/1160429684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358641b60 msgr2=0x55f35864b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358641b60 0x55f35864b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 -- 172.21.15.82:0/1160429684 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3583787d0 con 0x55f358641170 2024-04-26T20:25:14.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8631e00640 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864af10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8624098d70 tx=0x7f8624009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1da8fa8e0dd60f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.813+0000 7f8613e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:14.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f8613e00640 1 -- 172.21.15.82:0/1160429684 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86240aa060 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f8613e00640 1 -- 172.21.15.82:0/1160429684 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8624005200 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86240a0d50 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f8613e00640 1 -- 172.21.15.82:0/1160429684 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f86240a5610 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f863bfa0740 10 client.26365 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f3582ae3f0 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f8613e00640 1 -- 172.21.15.82:0/1160429684 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86240a0d50 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f8613e00640 1 -- 172.21.15.82:0/1160429684 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f8624098660 con 0x55f358641170 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f863bfa0740 10 client.26365 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.814+0000 7f863bfa0740 10 client.26365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f863bfa0740 20 client.26365 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f863bfa0740 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f358638d50 0x55f35863b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f863bfa0740 4 client.26365 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3585aa7e0 con 0x55f358638d50 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f8631400640 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f358638d50 0x55f35863b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f8631400640 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f358638d50 0x55f35863b1f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3bc18633519838 server_cookie=b103feb2367f7837 in_seq=0 out_seq=0 2024-04-26T20:25:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.815+0000 7f8613e00640 10 client.26365 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.816+0000 7f8613e00640 1 -- 172.21.15.82:0/1160429684 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f3585aa7e0 con 0x55f358638d50 2024-04-26T20:25:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.816+0000 7f8613e00640 10 client.26365 handle_command_reply: tid=0 2024-04-26T20:25:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.816+0000 7f863bfa0740 1 client.26365 shutdown 2024-04-26T20:25:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 msgr2=0x55f35864af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864af10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8624098d70 tx=0x7f8624009f50 comp rx=0 tx=0).stop 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 shutdown_connections 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f358638d50 0x55f35863b1f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358646cd0 0x55f358652490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358641b60 0x55f35864b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 --2- 172.21.15.82:0/1160429684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864af10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f8613e00640 0 client.26365 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 >> 172.21.15.82:0/1160429684 conn(0x55f358633fd0 msgr2=0x55f3586331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 shutdown_connections 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 1 -- 172.21.15.82:0/1160429684 wait complete. 2024-04-26T20:25:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.817+0000 7f863bfa0740 20 client.26365 trim_cache size 0 max 16384 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.841+0000 7f863bfa0740 1 Processor -- start 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 -- start start 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358652420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358632960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86341aad00 con 0x55f358646cd0 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86341a9710 con 0x55f358641b60 2024-04-26T20:25:14.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f863bfa0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86341a9de0 con 0x55f358641170 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f8631e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f8632800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358632960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f8631e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50484/0 (socket says 172.21.15.82:50484) 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f8631e00640 1 -- 172.21.15.82:0/3714864664 learned_addr learned my addr 172.21.15.82:0/3714864664 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.842+0000 7f8631400640 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358652420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f8631e00640 1 -- 172.21.15.82:0/3714864664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 msgr2=0x55f358652420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f8631e00640 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358652420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f8631e00640 1 -- 172.21.15.82:0/3714864664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 msgr2=0x55f358632960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f8631e00640 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358632960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f8631e00640 1 -- 172.21.15.82:0/3714864664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f35826e0f0 con 0x55f358641170 2024-04-26T20:25:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f8631e00640 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864b3b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8624098a50 tx=0x7f862409c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e3c4fb53a3a62a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f861ea00640 1 -- 172.21.15.82:0/3714864664 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86240aa070 con 0x55f358641170 2024-04-26T20:25:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f861ea00640 1 -- 172.21.15.82:0/3714864664 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86240a0d50 con 0x55f358641170 2024-04-26T20:25:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.843+0000 7f861ea00640 1 -- 172.21.15.82:0/3714864664 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862409c9a0 con 0x55f358641170 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 -- 172.21.15.82:0/3714864664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 msgr2=0x55f35864b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864b3b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8624098a50 tx=0x7f862409c870 comp rx=0 tx=0).stop 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 -- 172.21.15.82:0/3714864664 shutdown_connections 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358632960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358652420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 --2- 172.21.15.82:0/3714864664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864b3b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 -- 172.21.15.82:0/3714864664 >> 172.21.15.82:0/3714864664 conn(0x55f358633fd0 msgr2=0x55f358640120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 -- 172.21.15.82:0/3714864664 shutdown_connections 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.844+0000 7f863bfa0740 1 -- 172.21.15.82:0/3714864664 wait complete. 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.845+0000 7f863bfa0740 1 -- start start 2024-04-26T20:25:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.845+0000 7f863bfa0740 1 Processor -- start 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358650030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358651040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86341a7020 con 0x55f358646cd0 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86341aa570 con 0x55f358641b60 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86341a7690 con 0x55f358641170 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f863bfa0740 10 client.0 _ll_register_callbacks cb 0x7f86240b4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f8632800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358651040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f8632800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358651040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51168/0 (socket says 172.21.15.82:51168) 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f8632800640 1 -- 172.21.15.82:0/184356940 learned_addr learned my addr 172.21.15.82:0/184356940 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f8631e00640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.846+0000 7f8631400640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358650030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8631e00640 1 -- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 msgr2=0x55f358650030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8631e00640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358650030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8631e00640 1 -- 172.21.15.82:0/184356940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 msgr2=0x55f358651040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8631e00640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358651040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8631e00640 1 -- 172.21.15.82:0/184356940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f358564a30 con 0x55f358641170 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8631e00640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864faf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f86240bd190 tx=0x7f8624004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4370a308a1fdc5bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8613e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8613e00640 1 -- 172.21.15.82:0/184356940 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86240aa070 con 0x55f358641170 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f8613e00640 1 -- 172.21.15.82:0/184356940 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8624005000 con 0x55f358641170 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.847+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86240a0d50 con 0x55f358641170 2024-04-26T20:25:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f8613e00640 1 -- 172.21.15.82:0/184356940 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f862409c9a0 con 0x55f358641170 2024-04-26T20:25:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 10 client.26371 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f358564a30 con 0x55f358641170 2024-04-26T20:25:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f8613e00640 1 -- 172.21.15.82:0/184356940 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86240a0d50 con 0x55f358641170 2024-04-26T20:25:14.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f8613e00640 1 -- 172.21.15.82:0/184356940 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f86240a1ee0 con 0x55f358641170 2024-04-26T20:25:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 10 client.26371 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:14.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 10 client.26371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 20 client.26371 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f3586c55b0 0x55f3586c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 4 client.26371 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.848+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f3585a4650 con 0x55f3586c55b0 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f8631400640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f3586c55b0 0x55f3586c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f8631400640 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f3586c55b0 0x55f3586c79d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc82e209778301cd server_cookie=d5603208676c3b51 in_seq=0 out_seq=0 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f8613e00640 10 client.26371 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f8613e00640 1 -- 172.21.15.82:0/184356940 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55f3585a4650 con 0x55f3586c55b0 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f8613e00640 10 client.26371 handle_command_reply: tid=0 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f863bfa0740 1 client.26371 shutdown 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 msgr2=0x55f35864faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.849+0000 7f863bfa0740 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864faf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f86240bd190 tx=0x7f8624004a60 comp rx=0 tx=0).stop 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 shutdown_connections 2024-04-26T20:25:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f3586c55b0 0x55f3586c79d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f358646cd0 0x55f358651040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f358641b60 0x55f358650030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 --2- 172.21.15.82:0/184356940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f358641170 0x55f35864faf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 >> 172.21.15.82:0/184356940 conn(0x55f358633fd0 msgr2=0x55f358632960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f8613e00640 0 client.26371 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 shutdown_connections 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 1 -- 172.21.15.82:0/184356940 wait complete. 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.850+0000 7f863bfa0740 20 client.26371 trim_cache size 0 max 16384 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (0 inodes in the stack)", 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:25:14.853 INFO:teuthology.orchestra.run.smithi082.stdout: "965d07d9-c64a-465a-ba10-59710f39cf6b": { 2024-04-26T20:25:14.854 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:25:14.854 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "965d07d9-c64a-465a-ba10-59710f39cf6b", 2024-04-26T20:25:14.854 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:25:14.854 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:25:14.854 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:25:14.854 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86180a3cc0 msgr2=0x7f86180a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86180a3cc0 0x7f86180a6180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f862002a930 tx=0x7f8620030450 comp rx=0 tx=0).stop 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 msgr2=0x7f863419acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f863419acf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f862400e9f0 tx=0x7f862400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 shutdown_connections 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f86180a3cc0 0x7f86180a6180 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8634102410 0x7f86341a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8634101a70 0x7f863419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 --2- 172.21.15.82:0/3586107111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8634101110 0x7f863419acf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 >> 172.21.15.82:0/3586107111 conn(0x7f86340fccd0 msgr2=0x7f86340fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 shutdown_connections 2024-04-26T20:25:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:14.851+0000 7f8633200640 1 -- 172.21.15.82:0/3586107111 wait complete. 2024-04-26T20:25:14.868 INFO:tasks.cephfs.filesystem:scrub status for tag:965d07d9-c64a-465a-ba10-59710f39cf6b - {'path': '/', 'tag': '965d07d9-c64a-465a-ba10-59710f39cf6b', 'options': 'recursive,force'} 2024-04-26T20:25:14.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:14 smithi082 ceph-mon[28105]: pgmap v485: 129 pgs: 129 active+clean; 71 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 3.4 MiB/s wr, 210 op/s 2024-04-26T20:25:15.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:14 smithi135 ceph-mon[32816]: pgmap v485: 129 pgs: 129 active+clean; 71 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 3.4 MiB/s wr, 210 op/s 2024-04-26T20:25:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:14 smithi139 ceph-mon[32999]: pgmap v485: 129 pgs: 129 active+clean; 71 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 3.4 MiB/s wr, 210 op/s 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:16.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:15 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:25:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:15 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:15 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:16.991 INFO:tasks.workunit.client.0.smithi082.stdout: 24 108710 534 78160 639 36563 547 2024-04-26T20:25:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:16 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:16 smithi135 ceph-mon[32816]: pgmap v486: 129 pgs: 129 active+clean; 73 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 206 op/s 2024-04-26T20:25:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:16 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:16 smithi082 ceph-mon[28105]: pgmap v486: 129 pgs: 129 active+clean; 73 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 206 op/s 2024-04-26T20:25:17.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:16 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:17.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:16 smithi139 ceph-mon[32999]: pgmap v486: 129 pgs: 129 active+clean; 73 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 206 op/s 2024-04-26T20:25:18.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:17 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:18.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:17 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:18.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:17 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:18 smithi135 ceph-mon[32816]: pgmap v487: 129 pgs: 129 active+clean; 78 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 188 op/s 2024-04-26T20:25:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:18 smithi082 ceph-mon[28105]: pgmap v487: 129 pgs: 129 active+clean; 78 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 188 op/s 2024-04-26T20:25:19.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:18 smithi139 ceph-mon[32999]: pgmap v487: 129 pgs: 129 active+clean; 78 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 188 op/s 2024-04-26T20:25:22.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:21 smithi139 ceph-mon[32999]: pgmap v488: 129 pgs: 129 active+clean; 78 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 163 op/s 2024-04-26T20:25:22.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:21 smithi135 ceph-mon[32816]: pgmap v488: 129 pgs: 129 active+clean; 78 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 163 op/s 2024-04-26T20:25:22.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:21 smithi082 ceph-mon[28105]: pgmap v488: 129 pgs: 129 active+clean; 78 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 163 op/s 2024-04-26T20:25:24.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:23 smithi139 ceph-mon[32999]: pgmap v489: 129 pgs: 129 active+clean; 78 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-04-26T20:25:24.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:23 smithi135 ceph-mon[32816]: pgmap v489: 129 pgs: 129 active+clean; 78 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-04-26T20:25:24.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:23 smithi082 ceph-mon[28105]: pgmap v489: 129 pgs: 129 active+clean; 78 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 -- 172.21.15.82:0/2170762863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 msgr2=0x7fc7e4102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/2170762863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 0x7fc7e4102db0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009900 tx=0x7fc7d802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 -- 172.21.15.82:0/2170762863 shutdown_connections 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/2170762863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7e4104540 0x7fc7e410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/2170762863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e4104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/2170762863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 0x7fc7e4102db0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 -- 172.21.15.82:0/2170762863 >> 172.21.15.82:0/2170762863 conn(0x7fc7e40fdf20 msgr2=0x7fc7e4100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.842+0000 7fc7ebe00640 1 -- 172.21.15.82:0/2170762863 shutdown_connections 2024-04-26T20:25:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.843+0000 7fc7ebe00640 1 -- 172.21.15.82:0/2170762863 wait complete. 2024-04-26T20:25:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 Processor -- start 2024-04-26T20:25:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 -- start start 2024-04-26T20:25:24.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 0x7fc7e419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7e4104540 0x7fc7e41a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e410e510 con 0x7fc7e4102990 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e410e390 con 0x7fc7e4103b80 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e410e690 con 0x7fc7e4104540 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.844+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e419f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40204/0 (socket says 172.21.15.82:40204) 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 0x7fc7e419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 -- 172.21.15.82:0/3448714016 learned_addr learned my addr 172.21.15.82:0/3448714016 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7e4104540 0x7fc7e41a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 -- 172.21.15.82:0/3448714016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7e4104540 msgr2=0x7fc7e41a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7e4104540 0x7fc7e41a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 -- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 msgr2=0x7fc7e419f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 0x7fc7e419f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 -- 172.21.15.82:0/3448714016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e41a6d00 con 0x7fc7e4103b80 2024-04-26T20:25:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e419f620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000e9f0 tx=0x7fc7d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.845+0000 7fc7e2000640 1 -- 172.21.15.82:0/3448714016 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000cd80 con 0x7fc7e4103b80 2024-04-26T20:25:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.846+0000 7fc7e2000640 1 -- 172.21.15.82:0/3448714016 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d00108e0 con 0x7fc7e4103b80 2024-04-26T20:25:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.846+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e41a6ff0 con 0x7fc7e4103b80 2024-04-26T20:25:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.846+0000 7fc7e2000640 1 -- 172.21.15.82:0/3448714016 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0018980 con 0x7fc7e4103b80 2024-04-26T20:25:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.846+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41a74b0 con 0x7fc7e4103b80 2024-04-26T20:25:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.849+0000 7fc7e2000640 1 -- 172.21.15.82:0/3448714016 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc7d0010430 con 0x7fc7e4103b80 2024-04-26T20:25:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.850+0000 7fc7eeb89740 1 Processor -- start 2024-04-26T20:25:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.850+0000 7fc7eeb89740 1 -- start start 2024-04-26T20:25:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.850+0000 7fc7e2000640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7cc0a3cf0 0x7fc7cc0a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 0x55c739d57ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e2000640 1 -- 172.21.15.82:0/3448714016 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc7d00d0c00 con 0x7fc7e4103b80 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d585c0 0x55c739d5d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d5d730 0x55c739d5fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c739cbc380 con 0x55c739d585c0 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c739c58c30 con 0x55c739d5d730 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c739cb8340 con 0x55c739d57bd0 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7cc0a3cf0 0x7fc7cc0a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 0x55c739d57ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 0x55c739d57ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43218/0 (socket says 172.21.15.82:43218) 2024-04-26T20:25:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9400640 1 -- 172.21.15.82:0/1654064802 learned_addr learned my addr 172.21.15.82:0/1654064802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d5d730 0x55c739d5fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9400640 1 -- 172.21.15.82:0/1654064802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d5d730 msgr2=0x55c739d5fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9400640 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d5d730 0x55c739d5fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.851+0000 7fc7e9400640 1 -- 172.21.15.82:0/1654064802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d585c0 msgr2=0x55c739d5d0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.852+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d585c0 0x55c739d5d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.852+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7cc0a3cf0 0x7fc7cc0a61b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009fd0 tx=0x7fc7dc013b80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.852+0000 7fc7e9400640 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d585c0 0x55c739d5d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.852+0000 7fc7e9400640 1 -- 172.21.15.82:0/1654064802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c739c7a940 con 0x55c739d57bd0 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.852+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d585c0 0x55c739d5d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.852+0000 7fc7e9400640 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 0x55c739d57ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8006010 tx=0x7fc7d8005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4d291e485a4924 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.853+0000 7fc7d6600640 1 -- 172.21.15.82:0/1654064802 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8035030 con 0x55c739d57bd0 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.853+0000 7fc7d6600640 1 -- 172.21.15.82:0/1654064802 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d8040070 con 0x55c739d57bd0 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.853+0000 7fc7d6600640 1 -- 172.21.15.82:0/1654064802 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80318d0 con 0x55c739d57bd0 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.853+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1654064802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 msgr2=0x55c739d57ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 0x55c739d57ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8006010 tx=0x7fc7d8005be0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1654064802 shutdown_connections 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d5d730 0x55c739d5fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d585c0 0x55c739d5d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1654064802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d57bd0 0x55c739d57ff0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1654064802 >> 172.21.15.82:0/1654064802 conn(0x55c739d53240 msgr2=0x55c739d53640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1654064802 shutdown_connections 2024-04-26T20:25:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1654064802 wait complete. 2024-04-26T20:25:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.854+0000 7fc7eeb89740 1 -- start start 2024-04-26T20:25:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.855+0000 7fc7eeb89740 1 Processor -- start 2024-04-26T20:25:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 0x55c739d61d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d585c0 0x55c739d622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 0x55c739d61d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 0x55c739d61d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51412/0 (socket says 172.21.15.82:51412) 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d5d730 0x55c739d69300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7e9400640 1 -- 172.21.15.82:0/2915072884 learned_addr learned my addr 172.21.15.82:0/2915072884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c739d60680 con 0x55c739d57bd0 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c739c43c60 con 0x55c739d585c0 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c739d60800 con 0x55c739d5d730 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.856+0000 7fc7eeb89740 10 client.0 _ll_register_callbacks cb 0x55c739c6fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d585c0 0x55c739d622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d5d730 0x55c739d69300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9400640 1 -- 172.21.15.82:0/2915072884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d5d730 msgr2=0x55c739d69300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9400640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d5d730 0x55c739d69300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9400640 1 -- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d585c0 msgr2=0x55c739d622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9400640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d585c0 0x55c739d622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9400640 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c739c52510 con 0x55c739d57bd0 2024-04-26T20:25:24.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d585c0 0x55c739d622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7e9400640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 0x55c739d61d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8003fd0 tx=0x7fc7d80043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf19958f550a61b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.857+0000 7fc7caa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.858+0000 7fc7caa00640 1 -- 172.21.15.82:0/2915072884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8053060 con 0x55c739d57bd0 2024-04-26T20:25:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.858+0000 7fc7caa00640 1 -- 172.21.15.82:0/2915072884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc7d8003ac0 con 0x55c739d57bd0 2024-04-26T20:25:24.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.858+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d8040070 con 0x55c739d57bd0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.858+0000 7fc7caa00640 1 -- 172.21.15.82:0/2915072884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc7d805a050 con 0x55c739d57bd0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.858+0000 7fc7eeb89740 10 client.16245 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.858+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c7399ce210 con 0x55c739d57bd0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7caa00640 1 -- 172.21.15.82:0/2915072884 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d8040070 con 0x55c739d57bd0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7caa00640 1 -- 172.21.15.82:0/2915072884 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fc7d804d030 con 0x55c739d57bd0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7eeb89740 10 client.16245 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7eeb89740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7eeb89740 20 client.16245 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739d6d3d0 0x55c739d6f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7eeb89740 4 client.16245 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c739cc9f90 con 0x55c739d6d3d0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.859+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739d6d3d0 0x55c739d6f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.860+0000 7fc7caa00640 10 client.16245 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:24.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.860+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739d6d3d0 0x55c739d6f7e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9b4c36f0e6ed31 server_cookie=7ae48caafa0df0bb in_seq=0 out_seq=0 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.860+0000 7fc7caa00640 1 -- 172.21.15.82:0/2915072884 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c739cc9f90 con 0x55c739d6d3d0 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.860+0000 7fc7caa00640 10 client.16245 handle_command_reply: tid=0 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 client.16245 shutdown 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 msgr2=0x55c739d61d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 0x55c739d61d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8003fd0 tx=0x7fc7d80043f0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 shutdown_connections 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739d6d3d0 0x55c739d6f7e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d5d730 0x55c739d69300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d585c0 0x55c739d622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2915072884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d57bd0 0x55c739d61d80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7caa00640 0 client.16245 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 >> 172.21.15.82:0/2915072884 conn(0x55c739d53240 msgr2=0x55c739d52440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:24.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.861+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 shutdown_connections 2024-04-26T20:25:24.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.862+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2915072884 wait complete. 2024-04-26T20:25:24.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.862+0000 7fc7eeb89740 20 client.16245 trim_cache size 0 max 16384 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.878+0000 7fc7eeb89740 1 Processor -- start 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.878+0000 7fc7eeb89740 1 -- start start 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d56850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d692c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b1900 con 0x55c739d5d730 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b35c0 con 0x55c739d53a80 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b1fd0 con 0x55c739d585c0 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51418/0 (socket says 172.21.15.82:51418) 2024-04-26T20:25:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 -- 172.21.15.82:0/1389721643 learned_addr learned my addr 172.21.15.82:0/1389721643 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e9400640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d56850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 -- 172.21.15.82:0/1389721643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 msgr2=0x55c739d56850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d56850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 -- 172.21.15.82:0/1389721643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 msgr2=0x55c739d522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e8a00640 1 -- 172.21.15.82:0/1389721643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c739a9a620 con 0x55c739d5d730 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.879+0000 7fc7e9400640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d56850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.880+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d692c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc7d009ca00 tx=0x7fc7d0018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdb1e7b8df1569b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.880+0000 7fc7d5c00640 1 -- 172.21.15.82:0/1389721643 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0010a90 con 0x55c739d5d730 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.880+0000 7fc7d5c00640 1 -- 172.21.15.82:0/1389721643 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d00ce440 con 0x55c739d5d730 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.880+0000 7fc7d5c00640 1 -- 172.21.15.82:0/1389721643 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0018b20 con 0x55c739d5d730 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1389721643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 msgr2=0x55c739d692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d692c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc7d009ca00 tx=0x7fc7d0018420 comp rx=0 tx=0).stop 2024-04-26T20:25:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1389721643 shutdown_connections 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d692c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/1389721643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d56850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1389721643 >> 172.21.15.82:0/1389721643 conn(0x55c739d53240 msgr2=0x55c739d51bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1389721643 shutdown_connections 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.881+0000 7fc7eeb89740 1 -- 172.21.15.82:0/1389721643 wait complete. 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 -- start start 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 Processor -- start 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d66890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d66dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d67de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b2e30 con 0x55c739d5d730 2024-04-26T20:25:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b26a0 con 0x55c739d53a80 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41af8e0 con 0x55c739d585c0 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.882+0000 7fc7eeb89740 10 client.0 _ll_register_callbacks cb 0x7fc7d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d66890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d66890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40238/0 (socket says 172.21.15.82:40238) 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 -- 172.21.15.82:0/2715219756 learned_addr learned my addr 172.21.15.82:0/2715219756 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d66dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d67de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 -- 172.21.15.82:0/2715219756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 msgr2=0x55c739d66dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d66dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 -- 172.21.15.82:0/2715219756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 msgr2=0x55c739d67de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d67de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 -- 172.21.15.82:0/2715219756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c739c76cb0 con 0x55c739d53a80 2024-04-26T20:25:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9e00640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d67de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d66dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7e9400640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d66890 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005ab0 tx=0x7fc7d8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b66c050a01d7896 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.883+0000 7fc7caa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7caa00640 1 -- 172.21.15.82:0/2715219756 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8035070 con 0x55c739d53a80 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7caa00640 1 -- 172.21.15.82:0/2715219756 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc7d8003ac0 con 0x55c739d53a80 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d00ce440 con 0x55c739d53a80 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7caa00640 1 -- 172.21.15.82:0/2715219756 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc7d8045470 con 0x55c739d53a80 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 10 client.26363 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c739d69580 con 0x55c739d53a80 2024-04-26T20:25:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7caa00640 1 -- 172.21.15.82:0/2715219756 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d00ce440 con 0x55c739d53a80 2024-04-26T20:25:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7caa00640 1 -- 172.21.15.82:0/2715219756 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fc7d804d070 con 0x55c739d53a80 2024-04-26T20:25:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 10 client.26363 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 10 client.26363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 20 client.26363 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739dd3ed0 0x55c739dd62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 4 client.26363 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:25:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.884+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c739cc3e00 con 0x55c739dd3ed0 2024-04-26T20:25:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.885+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739dd3ed0 0x55c739dd62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.885+0000 7fc7e8a00640 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739dd3ed0 0x55c739dd62f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da40daedc6ca8329 server_cookie=8d4e1d00516e0022 in_seq=0 out_seq=0 2024-04-26T20:25:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:24.885+0000 7fc7caa00640 10 client.26363 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.373+0000 7fc7caa00640 1 -- 172.21.15.82:0/2715219756 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c739cc3e00 con 0x55c739dd3ed0 2024-04-26T20:25:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.373+0000 7fc7caa00640 10 client.26363 handle_command_reply: tid=0 2024-04-26T20:25:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.373+0000 7fc7eeb89740 1 client.26363 shutdown 2024-04-26T20:25:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.373+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 msgr2=0x55c739d66890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.373+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d66890 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005ab0 tx=0x7fc7d8000bc0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 shutdown_connections 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55c739dd3ed0 0x55c739dd62f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c739d5d730 0x55c739d67de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c739d585c0 0x55c739d66dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 --2- 172.21.15.82:0/2715219756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c739d53a80 0x55c739d66890 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7caa00640 0 client.26363 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 >> 172.21.15.82:0/2715219756 conn(0x55c739d53240 msgr2=0x55c739d566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 shutdown_connections 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 1 -- 172.21.15.82:0/2715219756 wait complete. 2024-04-26T20:25:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.374+0000 7fc7eeb89740 20 client.26363 trim_cache size 0 max 16384 2024-04-26T20:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:25:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7cc0a3cf0 msgr2=0x7fc7cc0a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7cc0a3cf0 0x7fc7cc0a61b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009fd0 tx=0x7fc7dc013b80 comp rx=0 tx=0).stop 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 msgr2=0x7fc7e419f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e419f620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000e9f0 tx=0x7fc7d000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 shutdown_connections 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7cc0a3cf0 0x7fc7cc0a61b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7e4104540 0x7fc7e41a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4103b80 0x7fc7e419f620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 --2- 172.21.15.82:0/3448714016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e4102990 0x7fc7e419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 >> 172.21.15.82:0/3448714016 conn(0x7fc7e40fdf20 msgr2=0x7fc7e4104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.375+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 shutdown_connections 2024-04-26T20:25:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:25.376+0000 7fc7ebe00640 1 -- 172.21.15.82:0/3448714016 wait complete. 2024-04-26T20:25:26.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:25 smithi139 ceph-mon[32999]: pgmap v490: 129 pgs: 129 active+clean; 94 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 136 op/s 2024-04-26T20:25:26.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:25 smithi135 ceph-mon[32816]: pgmap v490: 129 pgs: 129 active+clean; 94 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 136 op/s 2024-04-26T20:25:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:25 smithi082 ceph-mon[28105]: pgmap v490: 129 pgs: 129 active+clean; 94 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 136 op/s 2024-04-26T20:25:26.991 INFO:tasks.workunit.client.0.smithi082.stdout: 38 117896 724 83886 659 35317 7 2024-04-26T20:25:27.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:26 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:25:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:26 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:25:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:26 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:25:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:26 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:25:27.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:26 smithi139 ceph-mon[32999]: pgmap v491: 129 pgs: 129 active+clean; 117 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 253 op/s 2024-04-26T20:25:27.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:26 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:25:27.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:26 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:25:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:26 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:25:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:26 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:25:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:26 smithi135 ceph-mon[32816]: pgmap v491: 129 pgs: 129 active+clean; 117 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 253 op/s 2024-04-26T20:25:27.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:26 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:25:27.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:26 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:25:27.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:26 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:25:27.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:26 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:25:27.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:26 smithi082 ceph-mon[28105]: pgmap v491: 129 pgs: 129 active+clean; 117 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 253 op/s 2024-04-26T20:25:28.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:27 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:25:28.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:27 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:25:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:27 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:25:29.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:28 smithi139 ceph-mon[32999]: pgmap v492: 129 pgs: 129 active+clean; 135 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-04-26T20:25:29.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:28 smithi135 ceph-mon[32816]: pgmap v492: 129 pgs: 129 active+clean; 135 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-04-26T20:25:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:28 smithi082 ceph-mon[28105]: pgmap v492: 129 pgs: 129 active+clean; 135 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-04-26T20:25:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:30 smithi135 ceph-mon[32816]: pgmap v493: 129 pgs: 129 active+clean; 142 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 5.7 MiB/s wr, 407 op/s 2024-04-26T20:25:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:30 smithi082 ceph-mon[28105]: pgmap v493: 129 pgs: 129 active+clean; 142 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 5.7 MiB/s wr, 407 op/s 2024-04-26T20:25:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:30 smithi139 ceph-mon[32999]: pgmap v493: 129 pgs: 129 active+clean; 142 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 5.7 MiB/s wr, 407 op/s 2024-04-26T20:25:34.024 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:33 smithi139 ceph-mon[32999]: pgmap v494: 129 pgs: 129 active+clean; 160 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.2 MiB/s wr, 469 op/s 2024-04-26T20:25:34.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:33 smithi135 ceph-mon[32816]: pgmap v494: 129 pgs: 129 active+clean; 160 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.2 MiB/s wr, 469 op/s 2024-04-26T20:25:34.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:33 smithi082 ceph-mon[28105]: pgmap v494: 129 pgs: 129 active+clean; 160 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.2 MiB/s wr, 469 op/s 2024-04-26T20:25:36.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:35 smithi139 ceph-mon[32999]: pgmap v495: 129 pgs: 129 active+clean; 164 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.5 MiB/s wr, 486 op/s 2024-04-26T20:25:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:35 smithi135 ceph-mon[32816]: pgmap v495: 129 pgs: 129 active+clean; 164 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.5 MiB/s wr, 486 op/s 2024-04-26T20:25:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:35 smithi082 ceph-mon[28105]: pgmap v495: 129 pgs: 129 active+clean; 164 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.5 MiB/s wr, 486 op/s 2024-04-26T20:25:37.004 INFO:tasks.workunit.client.0.smithi082.stdout: 49 519481 670 363748 691 103108 96 2024-04-26T20:25:37.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:36 smithi139 ceph-mon[32999]: pgmap v496: 129 pgs: 129 active+clean; 165 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.3 MiB/s wr, 445 op/s 2024-04-26T20:25:37.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:36 smithi135 ceph-mon[32816]: pgmap v496: 129 pgs: 129 active+clean; 165 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.3 MiB/s wr, 445 op/s 2024-04-26T20:25:37.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:36 smithi082 ceph-mon[28105]: pgmap v496: 129 pgs: 129 active+clean; 165 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.3 MiB/s wr, 445 op/s 2024-04-26T20:25:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.902+0000 7f9080000640 1 -- 172.21.15.82:0/1884441889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9078109930 msgr2=0x7f907810bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.902+0000 7f9080000640 1 --2- 172.21.15.82:0/1884441889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9078109930 0x7f907810bd60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f906c009900 tx=0x7f906c02a410 comp rx=0 tx=0).stop 2024-04-26T20:25:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.904+0000 7f9080000640 1 -- 172.21.15.82:0/1884441889 shutdown_connections 2024-04-26T20:25:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.904+0000 7f9080000640 1 --2- 172.21.15.82:0/1884441889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f907810ec50 0x7f907810f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.904+0000 7f9080000640 1 --2- 172.21.15.82:0/1884441889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 0x7f907810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.904+0000 7f9080000640 1 --2- 172.21.15.82:0/1884441889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9078109930 0x7f907810bd60 secure :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f906c009900 tx=0x7f906c02a410 comp rx=0 tx=0).stop 2024-04-26T20:25:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.904+0000 7f9080000640 1 -- 172.21.15.82:0/1884441889 >> 172.21.15.82:0/1884441889 conn(0x7f907806f9a0 msgr2=0x7f9078071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.905+0000 7f9080000640 1 -- 172.21.15.82:0/1884441889 shutdown_connections 2024-04-26T20:25:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.905+0000 7f9080000640 1 -- 172.21.15.82:0/1884441889 wait complete. 2024-04-26T20:25:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.906+0000 7f9080000640 1 Processor -- start 2024-04-26T20:25:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.908+0000 7f9080000640 1 -- start start 2024-04-26T20:25:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.908+0000 7f9080000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 0x7f90781a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.908+0000 7f9080000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f907810ec50 0x7f90781a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.908+0000 7f9080000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90781ad0a0 0x7f90781af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f9080000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f907811d2e0 con 0x7f90781ad0a0 2024-04-26T20:25:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f9080000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f907811d160 con 0x7f907810c2a0 2024-04-26T20:25:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f9080000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f907811d460 con 0x7f907810ec50 2024-04-26T20:25:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f907e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90781ad0a0 0x7f90781af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f907d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 0x7f90781a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f907e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90781ad0a0 0x7f90781af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33058/0 (socket says 172.21.15.82:33058) 2024-04-26T20:25:38.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f907e000640 1 -- 172.21.15.82:0/149671484 learned_addr learned my addr 172.21.15.82:0/149671484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:38.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.909+0000 7f907cc00640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f907810ec50 0x7f90781a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.911+0000 7f907d600640 1 -- 172.21.15.82:0/149671484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f907810ec50 msgr2=0x7f90781a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.911+0000 7f907d600640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f907810ec50 0x7f90781a8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.911+0000 7f907d600640 1 -- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90781ad0a0 msgr2=0x7f90781af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.911+0000 7f907d600640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90781ad0a0 0x7f90781af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.911+0000 7f907d600640 1 -- 172.21.15.82:0/149671484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9078111190 con 0x7f907810c2a0 2024-04-26T20:25:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.911+0000 7f907d600640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 0x7f90781a7b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f906c008000 tx=0x7f906c003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.917+0000 7f9076000640 1 -- 172.21.15.82:0/149671484 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c03f020 con 0x7f907810c2a0 2024-04-26T20:25:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.917+0000 7f9076000640 1 -- 172.21.15.82:0/149671484 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906c031c50 con 0x7f907810c2a0 2024-04-26T20:25:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.917+0000 7f9076000640 1 -- 172.21.15.82:0/149671484 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c035070 con 0x7f907810c2a0 2024-04-26T20:25:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.918+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9078111420 con 0x7f907810c2a0 2024-04-26T20:25:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.918+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9078111890 con 0x7f907810c2a0 2024-04-26T20:25:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.926+0000 7f9082dae740 1 Processor -- start 2024-04-26T20:25:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.926+0000 7f9082dae740 1 -- start start 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.930+0000 7f9082dae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.930+0000 7f9082dae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.930+0000 7f9082dae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.930+0000 7f9082dae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556454754380 con 0x5564547f05d0 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.930+0000 7f9082dae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564546f0c30 con 0x5564547efbe0 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.930+0000 7f9082dae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556454750340 con 0x5564547f5740 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58616/0 (socket says 172.21.15.82:58616) 2024-04-26T20:25:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 -- 172.21.15.82:0/689734569 learned_addr learned my addr 172.21.15.82:0/689734569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907cc00640 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 -- 172.21.15.82:0/689734569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 msgr2=0x5564547f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 -- 172.21.15.82:0/689734569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 msgr2=0x5564547f50d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547f50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.931+0000 7f907e000640 1 -- 172.21.15.82:0/689734569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556454712940 con 0x5564547efbe0 2024-04-26T20:25:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.932+0000 7f907e000640 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f0000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9070011570 tx=0x7f9070011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e9702b29e3c8ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.933+0000 7f9076000640 1 -- 172.21.15.82:0/149671484 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f906c042020 con 0x7f907810c2a0 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.933+0000 7f906a600640 1 -- 172.21.15.82:0/689734569 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070004b20 con 0x5564547efbe0 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.933+0000 7f906a600640 1 -- 172.21.15.82:0/689734569 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9070004cc0 con 0x5564547efbe0 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.933+0000 7f906a600640 1 -- 172.21.15.82:0/689734569 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070005490 con 0x5564547efbe0 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.935+0000 7f9082dae740 1 -- 172.21.15.82:0/689734569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 msgr2=0x5564547f0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.935+0000 7f9082dae740 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f0000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9070011570 tx=0x7f9070011a30 comp rx=0 tx=0).stop 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.937+0000 7f9076000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90600a3e80 0x7f90600a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.937+0000 7f9076000640 1 -- 172.21.15.82:0/149671484 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f906c0f0d60 con 0x7f907810c2a0 2024-04-26T20:25:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.942+0000 7f907d600640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90600a3e80 0x7f90600a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.943+0000 7f907d600640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90600a3e80 0x7f90600a6340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5564547f1040 tx=0x7f906c0046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.944+0000 7f9082dae740 1 -- 172.21.15.82:0/689734569 shutdown_connections 2024-04-26T20:25:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.944+0000 7f9082dae740 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.944+0000 7f9082dae740 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.944+0000 7f9082dae740 1 --2- 172.21.15.82:0/689734569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f0000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.944+0000 7f9082dae740 1 -- 172.21.15.82:0/689734569 >> 172.21.15.82:0/689734569 conn(0x5564547eb250 msgr2=0x5564547eb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.948+0000 7f9082dae740 1 -- 172.21.15.82:0/689734569 shutdown_connections 2024-04-26T20:25:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.953+0000 7f9082dae740 1 -- 172.21.15.82:0/689734569 wait complete. 2024-04-26T20:25:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.953+0000 7f9082dae740 1 -- start start 2024-04-26T20:25:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.953+0000 7f9082dae740 1 Processor -- start 2024-04-26T20:25:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.957+0000 7f9082dae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.959+0000 7f9082dae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547fa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547fa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33074/0 (socket says 172.21.15.82:33074) 2024-04-26T20:25:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 -- 172.21.15.82:0/1513257520 learned_addr learned my addr 172.21.15.82:0/1513257520 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x556454801350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5564547f86f0 con 0x5564547f05d0 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564546dbc60 con 0x5564547efbe0 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564547f8870 con 0x5564547f5740 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f9082dae740 10 client.0 _ll_register_callbacks cb 0x556454707e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 -- 172.21.15.82:0/1513257520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 msgr2=0x556454801350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x556454801350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 -- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 msgr2=0x5564547f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.961+0000 7f907cc00640 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564546ea510 con 0x5564547f05d0 2024-04-26T20:25:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.962+0000 7f907cc00640 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547fa310 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9064012700 tx=0x7f9064012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212f9794f254bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.962+0000 7f905ea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.967+0000 7f905ea00640 1 -- 172.21.15.82:0/1513257520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906400f8c0 con 0x5564547f05d0 2024-04-26T20:25:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.967+0000 7f905ea00640 1 -- 172.21.15.82:0/1513257520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f906400fa60 con 0x5564547f05d0 2024-04-26T20:25:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.967+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9070004cc0 con 0x5564547f05d0 2024-04-26T20:25:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.967+0000 7f905ea00640 1 -- 172.21.15.82:0/1513257520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f906400fc60 con 0x5564547f05d0 2024-04-26T20:25:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.968+0000 7f9082dae740 10 client.16260 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.968+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556454466210 con 0x5564547f05d0 2024-04-26T20:25:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.968+0000 7f905ea00640 1 -- 172.21.15.82:0/1513257520 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f906400fe00 con 0x5564547f05d0 2024-04-26T20:25:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.970+0000 7f905ea00640 1 -- 172.21.15.82:0/1513257520 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f90640104c0 con 0x5564547f05d0 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.970+0000 7f9082dae740 10 client.16260 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.970+0000 7f9082dae740 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.970+0000 7f9082dae740 20 client.16260 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.970+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5564548059c0 0x556454807e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.971+0000 7f9082dae740 4 client.16260 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.971+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9070004cc0 con 0x5564548059c0 2024-04-26T20:25:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.971+0000 7f907e000640 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5564548059c0 0x556454807e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:38.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.972+0000 7f905ea00640 10 client.16260 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:38.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.972+0000 7f907e000640 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5564548059c0 0x556454807e60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621b6bd1e41b0bef server_cookie=6b56a2a25c45e0d2 in_seq=0 out_seq=0 2024-04-26T20:25:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.973+0000 7f905ea00640 1 -- 172.21.15.82:0/1513257520 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f9070004cc0 con 0x5564548059c0 2024-04-26T20:25:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.973+0000 7f905ea00640 10 client.16260 handle_command_reply: tid=0 2024-04-26T20:25:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.973+0000 7f9082dae740 1 client.16260 shutdown 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.973+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 msgr2=0x5564547fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.973+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547fa310 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9064012700 tx=0x7f9064012bc0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 shutdown_connections 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5564548059c0 0x556454807e60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x556454801350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f05d0 0x5564547fa310 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 --2- 172.21.15.82:0/1513257520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 >> 172.21.15.82:0/1513257520 conn(0x5564547eb250 msgr2=0x5564547ea470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f905ea00640 0 client.16260 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.974+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 shutdown_connections 2024-04-26T20:25:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.975+0000 7f9082dae740 1 -- 172.21.15.82:0/1513257520 wait complete. 2024-04-26T20:25:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:38.975+0000 7f9082dae740 20 client.16260 trim_cache size 0 max 16384 2024-04-26T20:25:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.052+0000 7f9082dae740 1 Processor -- start 2024-04-26T20:25:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.052+0000 7f9082dae740 1 -- start start 2024-04-26T20:25:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.053+0000 7f9082dae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 0x5564547eb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f907e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 0x5564547eb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f907e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 0x5564547eb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33078/0 (socket says 172.21.15.82:33078) 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f9082dae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x556454801310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f9082dae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547f9dd0 0x5564547fa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f9082dae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90781c2f60 con 0x5564547efbe0 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f9082dae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90781c4c20 con 0x5564547f9dd0 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f9082dae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f90781c3630 con 0x5564547f5740 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.054+0000 7f907e000640 1 -- 172.21.15.82:0/3643938249 learned_addr learned my addr 172.21.15.82:0/3643938249 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.055+0000 7f907e000640 1 -- 172.21.15.82:0/3643938249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 msgr2=0x556454801310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.055+0000 7f907e000640 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x556454801310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.055+0000 7f907e000640 1 -- 172.21.15.82:0/3643938249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547f9dd0 msgr2=0x5564547fa280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.055+0000 7f907e000640 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547f9dd0 0x5564547fa280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.055+0000 7f907e000640 1 -- 172.21.15.82:0/3643938249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556454532620 con 0x5564547efbe0 2024-04-26T20:25:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.056+0000 7f907e000640 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 0x5564547eb630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9070004a10 tx=0x7f9070009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb2062cfaa02440 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.060+0000 7f9069c00640 1 -- 172.21.15.82:0/3643938249 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907002d070 con 0x5564547efbe0 2024-04-26T20:25:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.060+0000 7f9069c00640 1 -- 172.21.15.82:0/3643938249 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907000f5c0 con 0x5564547efbe0 2024-04-26T20:25:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.060+0000 7f9069c00640 1 -- 172.21.15.82:0/3643938249 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070029390 con 0x5564547efbe0 2024-04-26T20:25:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.061+0000 7f9082dae740 1 -- 172.21.15.82:0/3643938249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 msgr2=0x5564547eb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.061+0000 7f9082dae740 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 0x5564547eb630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9070004a10 tx=0x7f9070009b10 comp rx=0 tx=0).stop 2024-04-26T20:25:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.064+0000 7f9082dae740 1 -- 172.21.15.82:0/3643938249 shutdown_connections 2024-04-26T20:25:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.064+0000 7f9082dae740 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547f9dd0 0x5564547fa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.065+0000 7f9082dae740 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x556454801310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.065+0000 7f9082dae740 1 --2- 172.21.15.82:0/3643938249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547efbe0 0x5564547eb630 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.065+0000 7f9082dae740 1 -- 172.21.15.82:0/3643938249 >> 172.21.15.82:0/3643938249 conn(0x5564547eb250 msgr2=0x5564547f4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.065+0000 7f9082dae740 1 -- 172.21.15.82:0/3643938249 shutdown_connections 2024-04-26T20:25:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.065+0000 7f9082dae740 1 -- 172.21.15.82:0/3643938249 wait complete. 2024-04-26T20:25:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.066+0000 7f9082dae740 1 -- start start 2024-04-26T20:25:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.066+0000 7f9082dae740 1 Processor -- start 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.068+0000 7f9082dae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547fe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.069+0000 7f9082dae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.069+0000 7f9082dae740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f9dd0 0x5564547ffdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.069+0000 7f9082dae740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90781c4490 con 0x5564547f9dd0 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.069+0000 7f9082dae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90781c3d00 con 0x5564547efbe0 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.069+0000 7f9082dae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f90781194c0 con 0x5564547f5740 2024-04-26T20:25:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.069+0000 7f9082dae740 10 client.0 _ll_register_callbacks cb 0x7f9064009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.070+0000 7f907e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547fe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.070+0000 7f907cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.070+0000 7f907e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547fe870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:58636/0 (socket says 172.21.15.82:58636) 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.070+0000 7f907e000640 1 -- 172.21.15.82:0/1346872437 learned_addr learned my addr 172.21.15.82:0/1346872437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.070+0000 7f907e000640 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f9dd0 0x5564547ffdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.071+0000 7f907e000640 1 -- 172.21.15.82:0/1346872437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 msgr2=0x5564547fedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.071+0000 7f907e000640 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547fedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.071+0000 7f907e000640 1 -- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 msgr2=0x5564547fe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.071+0000 7f907e000640 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547fe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.071+0000 7f907e000640 1 -- 172.21.15.82:0/1346872437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55645470ecb0 con 0x5564547f9dd0 2024-04-26T20:25:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.072+0000 7f907e000640 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f9dd0 0x5564547ffdc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9070009e10 tx=0x7f9070009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a247d82cac65f603 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.072+0000 7f905ea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.074+0000 7f905ea00640 1 -- 172.21.15.82:0/1346872437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070036030 con 0x5564547f9dd0 2024-04-26T20:25:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.074+0000 7f905ea00640 1 -- 172.21.15.82:0/1346872437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f9070004c50 con 0x5564547f9dd0 2024-04-26T20:25:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.074+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907000f5c0 con 0x5564547f9dd0 2024-04-26T20:25:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.079+0000 7f905ea00640 1 -- 172.21.15.82:0/1346872437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9070043050 con 0x5564547f9dd0 2024-04-26T20:25:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.079+0000 7f9082dae740 10 client.16266 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.079+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5564548014f0 con 0x5564547f9dd0 2024-04-26T20:25:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f905ea00640 1 -- 172.21.15.82:0/1346872437 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907000f5c0 con 0x5564547f9dd0 2024-04-26T20:25:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f905ea00640 1 -- 172.21.15.82:0/1346872437 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f9070046080 con 0x5564547f9dd0 2024-04-26T20:25:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f9082dae740 10 client.16266 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f9082dae740 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:39.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f9082dae740 20 client.16266 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:39.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f9082dae740 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55645486c5e0 0x55645486ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:39.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f9082dae740 4 client.16266 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:25:39.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.080+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556454761f90 con 0x55645486c5e0 2024-04-26T20:25:39.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.081+0000 7f907cc00640 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55645486c5e0 0x55645486ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.081+0000 7f905ea00640 10 client.16266 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:39.081+0000 7f907cc00640 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55645486c5e0 0x55645486ea00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a91ecf0126d813f4 server_cookie=26c4baa760621456 in_seq=0 out_seq=0 2024-04-26T20:25:40.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:39 smithi139 ceph-mon[32999]: pgmap v497: 129 pgs: 129 active+clean; 168 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 346 op/s 2024-04-26T20:25:40.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:39 smithi135 ceph-mon[32816]: pgmap v497: 129 pgs: 129 active+clean; 168 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 346 op/s 2024-04-26T20:25:40.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:39 smithi082 ceph-mon[28105]: pgmap v497: 129 pgs: 129 active+clean; 168 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 346 op/s 2024-04-26T20:25:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.504+0000 7f905ea00640 1 -- 172.21.15.82:0/1346872437 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556454761f90 con 0x55645486c5e0 2024-04-26T20:25:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.504+0000 7f905ea00640 10 client.16266 handle_command_reply: tid=0 2024-04-26T20:25:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.504+0000 7f9082dae740 1 client.16266 shutdown 2024-04-26T20:25:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.505+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f9dd0 msgr2=0x5564547ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.505+0000 7f9082dae740 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f9dd0 0x5564547ffdc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9070009e10 tx=0x7f9070009b80 comp rx=0 tx=0).stop 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 shutdown_connections 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55645486c5e0 0x55645486ea00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564547f9dd0 0x5564547ffdc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564547f5740 0x5564547fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 --2- 172.21.15.82:0/1346872437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564547efbe0 0x5564547fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 >> 172.21.15.82:0/1346872437 conn(0x5564547eb250 msgr2=0x5564547eb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f905ea00640 0 client.16266 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 shutdown_connections 2024-04-26T20:25:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 1 -- 172.21.15.82:0/1346872437 wait complete. 2024-04-26T20:25:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.506+0000 7f9082dae740 20 client.16266 trim_cache size 0 max 16384 2024-04-26T20:25:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:25:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:25:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:25:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90600a3e80 msgr2=0x7f90600a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90600a3e80 0x7f90600a6340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5564547f1040 tx=0x7f906c0046c0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 msgr2=0x7f90781a7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 0x7f90781a7b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f906c008000 tx=0x7f906c003c00 comp rx=0 tx=0).stop 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 shutdown_connections 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f90600a3e80 0x7f90600a6340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90781ad0a0 0x7f90781af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f907810ec50 0x7f90781a8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 --2- 172.21.15.82:0/149671484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907810c2a0 0x7f90781a7b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.507+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 >> 172.21.15.82:0/149671484 conn(0x7f907806f9a0 msgr2=0x7f907810c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.508+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 shutdown_connections 2024-04-26T20:25:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:40.508+0000 7f9080000640 1 -- 172.21.15.82:0/149671484 wait complete. 2024-04-26T20:25:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:40 smithi135 ceph-mon[32816]: pgmap v498: 129 pgs: 129 active+clean; 168 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 236 op/s 2024-04-26T20:25:41.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:40 smithi082 ceph-mon[28105]: pgmap v498: 129 pgs: 129 active+clean; 168 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 236 op/s 2024-04-26T20:25:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:40 smithi139 ceph-mon[32999]: pgmap v498: 129 pgs: 129 active+clean; 168 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 236 op/s 2024-04-26T20:25:42.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:42 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:42.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:42 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:42.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:42 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:43.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:43 smithi139 ceph-mon[32999]: pgmap v499: 129 pgs: 129 active+clean; 171 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 245 op/s 2024-04-26T20:25:43.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:43 smithi135 ceph-mon[32816]: pgmap v499: 129 pgs: 129 active+clean; 171 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 245 op/s 2024-04-26T20:25:43.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:43 smithi082 ceph-mon[28105]: pgmap v499: 129 pgs: 129 active+clean; 171 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 245 op/s 2024-04-26T20:25:44.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:25:44.869 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:25:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:44 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:44 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:45.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:44 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:25:45.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:44 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:45.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:44 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:45.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:44 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:25:45.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 -- 172.21.15.82:0/3924211269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c1011e0 msgr2=0x7f211c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 --2- 172.21.15.82:0/3924211269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c1011e0 0x7f211c103610 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2110009900 tx=0x7f211002a410 comp rx=0 tx=0).stop 2024-04-26T20:25:45.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 -- 172.21.15.82:0/3924211269 shutdown_connections 2024-04-26T20:25:45.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 --2- 172.21.15.82:0/3924211269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c106500 0x7f211c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 --2- 172.21.15.82:0/3924211269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c103b50 0x7f211c105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 --2- 172.21.15.82:0/3924211269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c1011e0 0x7f211c103610 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.130+0000 7f2124000640 1 -- 172.21.15.82:0/3924211269 >> 172.21.15.82:0/3924211269 conn(0x7f211c0fcde0 msgr2=0x7f211c0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.131+0000 7f2124000640 1 -- 172.21.15.82:0/3924211269 shutdown_connections 2024-04-26T20:25:45.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.131+0000 7f2124000640 1 -- 172.21.15.82:0/3924211269 wait complete. 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 Processor -- start 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 -- start start 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c1011e0 0x7f211c19f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c103b50 0x7f211c19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 0x7f211c1a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f211c114b10 con 0x7f211c106500 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f211c114990 con 0x7f211c1011e0 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.132+0000 7f2124000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f211c114c90 con 0x7f211c103b50 2024-04-26T20:25:45.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 0x7f211c1a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 0x7f211c1a6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41942/0 (socket says 172.21.15.82:41942) 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2121600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c1011e0 0x7f211c19f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 -- 172.21.15.82:0/444231353 learned_addr learned my addr 172.21.15.82:0/444231353 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2120c00640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c103b50 0x7f211c19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 -- 172.21.15.82:0/444231353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c103b50 msgr2=0x7f211c19f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c103b50 0x7f211c19f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 -- 172.21.15.82:0/444231353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c1011e0 msgr2=0x7f211c19f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c1011e0 0x7f211c19f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.133+0000 7f2122000640 1 -- 172.21.15.82:0/444231353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c1a6e00 con 0x7f211c106500 2024-04-26T20:25:45.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.134+0000 7f2122000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 0x7f211c1a6790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f211400eb10 tx=0x7f211400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.134+0000 7f211a000640 1 -- 172.21.15.82:0/444231353 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114004b20 con 0x7f211c106500 2024-04-26T20:25:45.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.134+0000 7f211a000640 1 -- 172.21.15.82:0/444231353 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2114004cc0 con 0x7f211c106500 2024-04-26T20:25:45.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.134+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c1a70f0 con 0x7f211c106500 2024-04-26T20:25:45.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.134+0000 7f211a000640 1 -- 172.21.15.82:0/444231353 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114004b20 con 0x7f211c106500 2024-04-26T20:25:45.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.135+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c1a75f0 con 0x7f211c106500 2024-04-26T20:25:45.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.140+0000 7f211a000640 1 -- 172.21.15.82:0/444231353 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2114005000 con 0x7f211c106500 2024-04-26T20:25:45.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.140+0000 7f2126e03740 1 Processor -- start 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 -- start start 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef41790 0x55df0ef41bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 0x55df0ef46c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef49780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55df0ee52030 con 0x55df0ef42180 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df0ee6d7f0 con 0x55df0ef472f0 2024-04-26T20:25:45.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.141+0000 7f2126e03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55df0ee287e0 con 0x55df0ef41790 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.142+0000 7f2121600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 0x55df0ef46c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.142+0000 7f2121600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 0x55df0ef46c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41946/0 (socket says 172.21.15.82:41946) 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.142+0000 7f2121600640 1 -- 172.21.15.82:0/2625909094 learned_addr learned my addr 172.21.15.82:0/2625909094 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.142+0000 7f211a000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21040a3e40 0x7f21040a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.142+0000 7f211a000640 1 -- 172.21.15.82:0/444231353 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f21140d0ac0 con 0x7f211c106500 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.142+0000 7f2121600640 1 -- 172.21.15.82:0/2625909094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef41790 msgr2=0x55df0ef41bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.143+0000 7f2121600640 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef41790 0x55df0ef41bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.143+0000 7f2121600640 1 -- 172.21.15.82:0/2625909094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 msgr2=0x55df0ef49780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:45.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.143+0000 7f2121600640 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef49780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.143+0000 7f2121600640 1 -- 172.21.15.82:0/2625909094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0ee34050 con 0x55df0ef42180 2024-04-26T20:25:45.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.143+0000 7f2122000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21040a3e40 0x7f21040a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.143+0000 7f2122000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21040a3e40 0x7f21040a6300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f21140ce140 tx=0x7f2114009200 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.144+0000 7f2121600640 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 0x55df0ef46c80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2110006010 tx=0x7f2110004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1b7454aa799ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.144+0000 7f210e600640 1 -- 172.21.15.82:0/2625909094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110035030 con 0x55df0ef42180 2024-04-26T20:25:45.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.144+0000 7f210e600640 1 -- 172.21.15.82:0/2625909094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2110040070 con 0x55df0ef42180 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.144+0000 7f210e600640 1 -- 172.21.15.82:0/2625909094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21100319a0 con 0x55df0ef42180 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 -- 172.21.15.82:0/2625909094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 msgr2=0x55df0ef46c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 0x55df0ef46c80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2110006010 tx=0x7f2110004170 comp rx=0 tx=0).stop 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 -- 172.21.15.82:0/2625909094 shutdown_connections 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef49780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef42180 0x55df0ef46c80 secure :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2110006010 tx=0x7f2110004170 comp rx=0 tx=0).stop 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 --2- 172.21.15.82:0/2625909094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef41790 0x55df0ef41bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.145+0000 7f2126e03740 1 -- 172.21.15.82:0/2625909094 >> 172.21.15.82:0/2625909094 conn(0x55df0ef3cdb0 msgr2=0x55df0ef3d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.146+0000 7f2126e03740 1 -- 172.21.15.82:0/2625909094 shutdown_connections 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.146+0000 7f2126e03740 1 -- 172.21.15.82:0/2625909094 wait complete. 2024-04-26T20:25:45.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.146+0000 7f2126e03740 1 -- start start 2024-04-26T20:25:45.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.146+0000 7f2126e03740 1 Processor -- start 2024-04-26T20:25:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef4b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef472f0 0x55df0ef4bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef50d60 0x55df0ef53150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55df0eeaa200 con 0x55df0ef50d60 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df0eea4ee0 con 0x55df0ef41790 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55df0eeb1e70 con 0x55df0ef472f0 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2126e03740 10 client.0 _ll_register_callbacks cb 0x55df0ee9b270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2120c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef4b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2120c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef4b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55666/0 (socket says 172.21.15.82:55666) 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.147+0000 7f2120c00640 1 -- 172.21.15.82:0/1487471656 learned_addr learned my addr 172.21.15.82:0/1487471656 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2120c00640 1 -- 172.21.15.82:0/1487471656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef472f0 msgr2=0x55df0ef4bd30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2120c00640 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef472f0 0x55df0ef4bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2120c00640 1 -- 172.21.15.82:0/1487471656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef50d60 msgr2=0x55df0ef53150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2120c00640 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef50d60 0x55df0ef53150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2120c00640 1 -- 172.21.15.82:0/1487471656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0ec817d0 con 0x55df0ef41790 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2120c00640 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef4b7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f210800bfa0 tx=0x7f2108012880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a7b2519eb96cd65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2102a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2102a00640 1 -- 172.21.15.82:0/1487471656 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108005220 con 0x55df0ef41790 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2110040070 con 0x55df0ef41790 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.148+0000 7f2102a00640 1 -- 172.21.15.82:0/1487471656 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f21080053c0 con 0x55df0ef41790 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2102a00640 1 -- 172.21.15.82:0/1487471656 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f21080055c0 con 0x55df0ef41790 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2126e03740 10 client.26384 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df0ebb73f0 con 0x55df0ef41790 2024-04-26T20:25:45.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2102a00640 1 -- 172.21.15.82:0/1487471656 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2108004c50 con 0x55df0ef41790 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2102a00640 1 -- 172.21.15.82:0/1487471656 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f2108019070 con 0x55df0ef41790 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2126e03740 10 client.26384 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.149+0000 7f2126e03740 10 client.26384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.150+0000 7f2126e03740 20 client.26384 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.150+0000 7f2126e03740 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0ef57750 0x55df0ef59bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.150+0000 7f2126e03740 4 client.26384 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.150+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2110040070 con 0x55df0ef57750 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.150+0000 7f2121600640 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0ef57750 0x55df0ef59bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.151+0000 7f2102a00640 10 client.26384 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:45.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.151+0000 7f2121600640 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0ef57750 0x55df0ef59bf0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00471f7c79ded7e server_cookie=958e45fe88f3dc04 in_seq=0 out_seq=0 2024-04-26T20:25:45.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.152+0000 7f2102a00640 1 -- 172.21.15.82:0/1487471656 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f2110040070 con 0x55df0ef57750 2024-04-26T20:25:45.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.152+0000 7f2102a00640 10 client.26384 handle_command_reply: tid=0 2024-04-26T20:25:45.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.152+0000 7f2126e03740 1 client.26384 shutdown 2024-04-26T20:25:45.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.152+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 msgr2=0x55df0ef4b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.152+0000 7f2126e03740 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef4b7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f210800bfa0 tx=0x7f2108012880 comp rx=0 tx=0).stop 2024-04-26T20:25:45.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 shutdown_connections 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0ef57750 0x55df0ef59bf0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef50d60 0x55df0ef53150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef472f0 0x55df0ef4bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 --2- 172.21.15.82:0/1487471656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef4b7f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 >> 172.21.15.82:0/1487471656 conn(0x55df0ef3cdb0 msgr2=0x55df0ef3c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2102a00640 0 client.26384 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 shutdown_connections 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 1 -- 172.21.15.82:0/1487471656 wait complete. 2024-04-26T20:25:45.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.153+0000 7f2126e03740 20 client.26384 trim_cache size 0 max 16384 2024-04-26T20:25:45.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.174+0000 7f2126e03740 1 Processor -- start 2024-04-26T20:25:45.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.174+0000 7f2126e03740 1 -- start start 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2126e03740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef41790 0x55df0ef4bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2126e03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef3d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2126e03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef3bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2126e03740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b3700 con 0x55df0ef41790 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2126e03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b2110 con 0x55df0ef472f0 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2126e03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b27e0 con 0x55df0ef50d60 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2120c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef41790 0x55df0ef4bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2121600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef3d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2120c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef41790 0x55df0ef4bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41952/0 (socket says 172.21.15.82:41952) 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2120c00640 1 -- 172.21.15.82:0/664399493 learned_addr learned my addr 172.21.15.82:0/664399493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.175+0000 7f2120c00640 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef3bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f2121600640 1 -- 172.21.15.82:0/664399493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 msgr2=0x55df0ef3bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f2121600640 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef3bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f2121600640 1 -- 172.21.15.82:0/664399493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef41790 msgr2=0x55df0ef4bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f2121600640 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef41790 0x55df0ef4bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f2121600640 1 -- 172.21.15.82:0/664399493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0eb770f0 con 0x55df0ef472f0 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f2121600640 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef3d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55df0ef42640 tx=0x7f2110000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8a40c8751d8c6d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.176+0000 7f210dc00640 1 -- 172.21.15.82:0/664399493 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110035030 con 0x55df0ef472f0 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.177+0000 7f210dc00640 1 -- 172.21.15.82:0/664399493 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2110040070 con 0x55df0ef472f0 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.177+0000 7f210dc00640 1 -- 172.21.15.82:0/664399493 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110003c70 con 0x55df0ef472f0 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 -- 172.21.15.82:0/664399493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 msgr2=0x55df0ef3d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef3d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55df0ef42640 tx=0x7f2110000bc0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 -- 172.21.15.82:0/664399493 shutdown_connections 2024-04-26T20:25:45.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef3bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef472f0 0x55df0ef3d190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 --2- 172.21.15.82:0/664399493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef41790 0x55df0ef4bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 -- 172.21.15.82:0/664399493 >> 172.21.15.82:0/664399493 conn(0x55df0ef3cdb0 msgr2=0x55df0ef3b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 -- 172.21.15.82:0/664399493 shutdown_connections 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 -- 172.21.15.82:0/664399493 wait complete. 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.178+0000 7f2126e03740 1 -- start start 2024-04-26T20:25:45.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 Processor -- start 2024-04-26T20:25:45.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef69000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef472f0 0x55df0ef69540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef6a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1afa20 con 0x55df0ef472f0 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b2f70 con 0x55df0ef41790 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b0090 con 0x55df0ef50d60 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.179+0000 7f2126e03740 10 client.0 _ll_register_callbacks cb 0x7f210800b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.180+0000 7f2121600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef472f0 0x55df0ef69540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.180+0000 7f2120c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef69000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.180+0000 7f2121600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef472f0 0x55df0ef69540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41966/0 (socket says 172.21.15.82:41966) 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.180+0000 7f2121600640 1 -- 172.21.15.82:0/898568378 learned_addr learned my addr 172.21.15.82:0/898568378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.180+0000 7f2120c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef69000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55684/0 (socket says 172.21.15.82:55684) 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.180+0000 7f2120c00640 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef6a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2120c00640 1 -- 172.21.15.82:0/898568378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 msgr2=0x55df0ef6a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2120c00640 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef6a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2120c00640 1 -- 172.21.15.82:0/898568378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef472f0 msgr2=0x55df0ef69540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2120c00640 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef472f0 0x55df0ef69540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2120c00640 1 -- 172.21.15.82:0/898568378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0ee6da30 con 0x55df0ef41790 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2120c00640 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef69000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f210800b6c0 tx=0x7f210800b650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b525906c95e17c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2102a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2102a00640 1 -- 172.21.15.82:0/898568378 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108004220 con 0x55df0ef41790 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.181+0000 7f2102a00640 1 -- 172.21.15.82:0/898568378 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f21080043c0 con 0x55df0ef41790 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.182+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2110040070 con 0x55df0ef41790 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.182+0000 7f2102a00640 1 -- 172.21.15.82:0/898568378 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f210802a7b0 con 0x55df0ef41790 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.182+0000 7f2126e03740 10 client.26390 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.182+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df0efbdea0 con 0x55df0ef41790 2024-04-26T20:25:45.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.182+0000 7f2102a00640 1 -- 172.21.15.82:0/898568378 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2110040070 con 0x55df0ef41790 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2102a00640 1 -- 172.21.15.82:0/898568378 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f2108019040 con 0x55df0ef41790 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2126e03740 10 client.26390 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2126e03740 10 client.26390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2126e03740 20 client.26390 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2126e03740 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0efbe7a0 0x55df0efc0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2126e03740 4 client.26390 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55df0eeb37e0 con 0x55df0efbe7a0 2024-04-26T20:25:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.184+0000 7f2121600640 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0efbe7a0 0x55df0efc0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.185+0000 7f2121600640 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0efbe7a0 0x55df0efc0bc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e099138cc14444a1 server_cookie=1911ff9074fb2ca3 in_seq=0 out_seq=0 2024-04-26T20:25:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.185+0000 7f2102a00640 10 client.26390 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.185+0000 7f2102a00640 1 -- 172.21.15.82:0/898568378 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55df0eeb37e0 con 0x55df0efbe7a0 2024-04-26T20:25:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.185+0000 7f2102a00640 10 client.26390 handle_command_reply: tid=0 2024-04-26T20:25:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.185+0000 7f2126e03740 1 client.26390 shutdown 2024-04-26T20:25:45.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:44 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:45.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:44 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:45.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:44 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:25:45.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 msgr2=0x55df0ef69000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef69000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f210800b6c0 tx=0x7f210800b650 comp rx=0 tx=0).stop 2024-04-26T20:25:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 shutdown_connections 2024-04-26T20:25:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55df0efbe7a0 0x55df0efc0bc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df0ef50d60 0x55df0ef6a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df0ef472f0 0x55df0ef69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 --2- 172.21.15.82:0/898568378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df0ef41790 0x55df0ef69000 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.186+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 >> 172.21.15.82:0/898568378 conn(0x55df0ef3cdb0 msgr2=0x55df0ef40410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.187+0000 7f2102a00640 0 client.26390 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.187+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 shutdown_connections 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.187+0000 7f2126e03740 1 -- 172.21.15.82:0/898568378 wait complete. 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.187+0000 7f2126e03740 20 client.26390 trim_cache size 0 max 16384 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:25:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.187+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21040a3e40 msgr2=0x7f21040a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21040a3e40 0x7f21040a6300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f21140ce140 tx=0x7f2114009200 comp rx=0 tx=0).stop 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 msgr2=0x7f211c1a6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 0x7f211c1a6790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f211400eb10 tx=0x7f211400c2d0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 shutdown_connections 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f21040a3e40 0x7f21040a6300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f211c106500 0x7f211c1a6790 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f211c103b50 0x7f211c19f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 --2- 172.21.15.82:0/444231353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f211c1011e0 0x7f211c19f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 >> 172.21.15.82:0/444231353 conn(0x7f211c0fcde0 msgr2=0x7f211c104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 shutdown_connections 2024-04-26T20:25:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.188+0000 7f2124000640 1 -- 172.21.15.82:0/444231353 wait complete. 2024-04-26T20:25:45.212 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:25:45.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:25:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 -- 172.21.15.82:0/364859417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b90105bc0 msgr2=0x7f5b90107fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 --2- 172.21.15.82:0/364859417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b90105bc0 0x7f5b90107fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009900 tx=0x7f5b7c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 -- 172.21.15.82:0/364859417 shutdown_connections 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 --2- 172.21.15.82:0/364859417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901084f0 0x7f5b9010a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 --2- 172.21.15.82:0/364859417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b90105bc0 0x7f5b90107fb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 --2- 172.21.15.82:0/364859417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90103290 0x7f5b90105680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 -- 172.21.15.82:0/364859417 >> 172.21.15.82:0/364859417 conn(0x7f5b900fcbc0 msgr2=0x7f5b900ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 -- 172.21.15.82:0/364859417 shutdown_connections 2024-04-26T20:25:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.421+0000 7f5b95c00640 1 -- 172.21.15.82:0/364859417 wait complete. 2024-04-26T20:25:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 Processor -- start 2024-04-26T20:25:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 -- start start 2024-04-26T20:25:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90103290 0x7f5b90102c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 0x7f5b90101240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b901084f0 0x7f5b90101780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9010e270 con 0x7f5b90105bc0 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9010e0f0 con 0x7f5b90103290 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.422+0000 7f5b95c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9010e3f0 con 0x7f5b901084f0 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 0x7f5b90101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90103290 0x7f5b90102c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 0x7f5b90101240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41970/0 (socket says 172.21.15.82:41970) 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8f400640 1 -- 172.21.15.82:0/2375412013 learned_addr learned my addr 172.21.15.82:0/2375412013 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b95200640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b901084f0 0x7f5b90101780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8fe00640 1 -- 172.21.15.82:0/2375412013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b901084f0 msgr2=0x7f5b90101780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8fe00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b901084f0 0x7f5b90101780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8fe00640 1 -- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 msgr2=0x7f5b90101240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8fe00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 0x7f5b90101240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8fe00640 1 -- 172.21.15.82:0/2375412013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b90102010 con 0x7f5b90103290 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b8f400640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 0x7f5b90101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.423+0000 7f5b95200640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b901084f0 0x7f5b90101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.424+0000 7f5b8fe00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90103290 0x7f5b90102c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000e9f0 tx=0x7f5b8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.424+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000ccc0 con 0x7f5b90103290 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.424+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800108e0 con 0x7f5b90103290 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.424+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80018880 con 0x7f5b90103290 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.424+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b901a2a90 con 0x7f5b90103290 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.424+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b901a2f90 con 0x7f5b90103290 2024-04-26T20:25:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.425+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b900fe6b0 con 0x7f5b90103290 2024-04-26T20:25:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.428+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5b8001f020 con 0x7f5b90103290 2024-04-26T20:25:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.430+0000 7f5b8cc00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5b740a3cc0 0x7f5b740a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.431+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f5b800d0ff0 con 0x7f5b90103290 2024-04-26T20:25:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.431+0000 7f5b8f400640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5b740a3cc0 0x7f5b740a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.431+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f5b8009d510 con 0x7f5b90103290 2024-04-26T20:25:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.432+0000 7f5b8f400640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5b740a3cc0 0x7f5b740a6180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c032fd0 tx=0x7f5b7c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.743+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b90063530 con 0x7f5b90103290 2024-04-26T20:25:45.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.745+0000 7f5b8cc00640 1 -- 172.21.15.82:0/2375412013 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7f5b8009ce10 con 0x7f5b90103290 2024-04-26T20:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:25:09.261942+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24584,24554,24454,24550,24529]},"id":1}]} 2024-04-26T20:25:45.747 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 34 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.747+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5b740a3cc0 msgr2=0x7f5b740a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.747+0000 7f5b95c00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5b740a3cc0 0x7f5b740a6180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c032fd0 tx=0x7f5b7c0314a0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.747+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90103290 msgr2=0x7f5b90102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.747+0000 7f5b95c00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90103290 0x7f5b90102c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000e9f0 tx=0x7f5b8000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 shutdown_connections 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f5b740a3cc0 0x7f5b740a6180 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b901084f0 0x7f5b90101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b90105bc0 0x7f5b90101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 --2- 172.21.15.82:0/2375412013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b90103290 0x7f5b90102c00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 >> 172.21.15.82:0/2375412013 conn(0x7f5b900fcbc0 msgr2=0x7f5b90103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 shutdown_connections 2024-04-26T20:25:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.748+0000 7f5b95c00640 1 -- 172.21.15.82:0/2375412013 wait complete. 2024-04-26T20:25:45.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 -- 172.21.15.82:0/2049234340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101110 msgr2=0x7f2380101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 --2- 172.21.15.82:0/2049234340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101110 0x7f2380101530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2370009900 tx=0x7f237002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 -- 172.21.15.82:0/2049234340 shutdown_connections 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 --2- 172.21.15.82:0/2049234340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 0x7f2380102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 --2- 172.21.15.82:0/2049234340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101a70 0x7f2380101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 --2- 172.21.15.82:0/2049234340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101110 0x7f2380101530 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 -- 172.21.15.82:0/2049234340 >> 172.21.15.82:0/2049234340 conn(0x7f23800fccd0 msgr2=0x7f23800ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:45.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.987+0000 7f2384e00640 1 -- 172.21.15.82:0/2049234340 shutdown_connections 2024-04-26T20:25:45.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.988+0000 7f2384e00640 1 -- 172.21.15.82:0/2049234340 wait complete. 2024-04-26T20:25:45.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.989+0000 7f2384e00640 1 Processor -- start 2024-04-26T20:25:45.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.989+0000 7f2384e00640 1 -- start start 2024-04-26T20:25:45.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f2384e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 0x7f238019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f2384e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a70 0x7f238019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f2384e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 0x7f23801a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f2384e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f23801105a0 con 0x7f2380102410 2024-04-26T20:25:45.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f2384e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2380110420 con 0x7f2380101a70 2024-04-26T20:25:45.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f2384e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2380110720 con 0x7f2380101110 2024-04-26T20:25:45.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 0x7f238019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 0x7f238019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40460/0 (socket says 172.21.15.82:40460) 2024-04-26T20:25:45.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 -- 172.21.15.82:0/3091493874 learned_addr learned my addr 172.21.15.82:0/3091493874 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237ea00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a70 0x7f238019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237fe00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 0x7f23801a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 -- 172.21.15.82:0/3091493874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a70 msgr2=0x7f238019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a70 0x7f238019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 -- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 msgr2=0x7f23801a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 0x7f23801a21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237f400640 1 -- 172.21.15.82:0/3091493874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23801a2880 con 0x7f2380101110 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.990+0000 7f237fe00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 0x7f23801a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.991+0000 7f237f400640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 0x7f238019ac70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2370005ab0 tx=0x7f2370003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.991+0000 7f2377e00640 1 -- 172.21.15.82:0/3091493874 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237003f070 con 0x7f2380101110 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.991+0000 7f2377e00640 1 -- 172.21.15.82:0/3091493874 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2370031c50 con 0x7f2380101110 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.991+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23801a2b10 con 0x7f2380101110 2024-04-26T20:25:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.991+0000 7f2377e00640 1 -- 172.21.15.82:0/3091493874 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370035030 con 0x7f2380101110 2024-04-26T20:25:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.991+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23801a2fb0 con 0x7f2380101110 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.994+0000 7f23891d1740 1 Processor -- start 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.994+0000 7f23891d1740 1 -- start start 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.994+0000 7f2377e00640 1 -- 172.21.15.82:0/3091493874 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2370042070 con 0x7f2380101110 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f23891d1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 0x55c6a2151c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f23891d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f23891d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a21573c0 0x55c6a2159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f23891d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c6a20acc70 con 0x55c6a2152250 2024-04-26T20:25:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f23891d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c6a2065980 con 0x55c6a21573c0 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f23891d1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c6a20a8c30 con 0x55c6a2151860 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 0x55c6a2151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 0x55c6a2151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40462/0 (socket says 172.21.15.82:40462) 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 -- 172.21.15.82:0/126865351 learned_addr learned my addr 172.21.15.82:0/126865351 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 -- 172.21.15.82:0/126865351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a21573c0 msgr2=0x55c6a2159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a21573c0 0x55c6a2159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 -- 172.21.15.82:0/126865351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 msgr2=0x55c6a2156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.995+0000 7f237fe00640 1 -- 172.21.15.82:0/126865351 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a203d7b0 con 0x55c6a2151860 2024-04-26T20:25:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.996+0000 7f237fe00640 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 0x55c6a2151c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2378009f60 tx=0x7f2378009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c676f99cc02298cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.996+0000 7f2377e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f23640a3c40 0x7f23640a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.997+0000 7f2377e00640 1 -- 172.21.15.82:0/3091493874 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f23700f1150 con 0x7f2380101110 2024-04-26T20:25:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.997+0000 7f237f400640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f23640a3c40 0x7f23640a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.997+0000 7f2374c00640 1 -- 172.21.15.82:0/126865351 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378011640 con 0x55c6a2151860 2024-04-26T20:25:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.997+0000 7f2374c00640 1 -- 172.21.15.82:0/126865351 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2378011c90 con 0x55c6a2151860 2024-04-26T20:25:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.997+0000 7f2374c00640 1 -- 172.21.15.82:0/126865351 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378010d50 con 0x55c6a2151860 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 -- 172.21.15.82:0/126865351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 msgr2=0x55c6a2151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 0x55c6a2151c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2378009f60 tx=0x7f2378009f90 comp rx=0 tx=0).stop 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 -- 172.21.15.82:0/126865351 shutdown_connections 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a21573c0 0x55c6a2159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 --2- 172.21.15.82:0/126865351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2151860 0x55c6a2151c80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 -- 172.21.15.82:0/126865351 >> 172.21.15.82:0/126865351 conn(0x55c6a214ced0 msgr2=0x55c6a214d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f237f400640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f23640a3c40 0x7f23640a6100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55c6a2152650 tx=0x7f237003b790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 -- 172.21.15.82:0/126865351 shutdown_connections 2024-04-26T20:25:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.998+0000 7f23891d1740 1 -- 172.21.15.82:0/126865351 wait complete. 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 -- start start 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 Processor -- start 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a215bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2162d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c6a20abf80 con 0x55c6a2152250 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c6a2059260 con 0x55c6a2151860 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:45.999+0000 7f23891d1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c6a20b12a0 con 0x55c6a21573c0 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f23891d1740 10 client.0 _ll_register_callbacks cb 0x55c6a20a3960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2162d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40466/0 (socket says 172.21.15.82:40466) 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 -- 172.21.15.82:0/1277477452 learned_addr learned my addr 172.21.15.82:0/1277477452 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 -- 172.21.15.82:0/1277477452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 msgr2=0x55c6a215b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 -- 172.21.15.82:0/1277477452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 msgr2=0x55c6a215bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a215bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 -- 172.21.15.82:0/1277477452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a203b1c0 con 0x55c6a21573c0 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f237fe00640 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2162d20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2378005fd0 tx=0x7f2378000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5157a9cf5f72308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.000+0000 7f2369600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f2369600640 1 -- 172.21.15.82:0/1277477452 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378024040 con 0x55c6a21573c0 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2378011c90 con 0x55c6a21573c0 2024-04-26T20:25:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f2369600640 1 -- 172.21.15.82:0/1277477452 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2378004a40 con 0x55c6a21573c0 2024-04-26T20:25:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f2369600640 1 -- 172.21.15.82:0/1277477452 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2378004c40 con 0x55c6a21573c0 2024-04-26T20:25:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f23891d1740 10 client.26428 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c6a1dbe3f0 con 0x55c6a21573c0 2024-04-26T20:25:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.001+0000 7f2369600640 1 -- 172.21.15.82:0/1277477452 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2378011c90 con 0x55c6a21573c0 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f2369600640 1 -- 172.21.15.82:0/1277477452 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f23780050b0 con 0x55c6a21573c0 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f23891d1740 10 client.26428 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f23891d1740 10 client.26428 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f23891d1740 20 client.26428 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f23891d1740 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a2167000 0x55c6a2169410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f23891d1740 4 client.26428 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6a20ba880 con 0x55c6a2167000 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.002+0000 7f237ea00640 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a2167000 0x55c6a2169410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.003+0000 7f2369600640 10 client.26428 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.003+0000 7f237ea00640 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a2167000 0x55c6a2169410 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=62e392080983fbfe server_cookie=c60d3bda0577ba0 in_seq=0 out_seq=0 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.003+0000 7f2369600640 1 -- 172.21.15.82:0/1277477452 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c6a20ba880 con 0x55c6a2167000 2024-04-26T20:25:46.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.003+0000 7f2369600640 10 client.26428 handle_command_reply: tid=0 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 client.26428 shutdown 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 msgr2=0x55c6a2162d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2162d20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2378005fd0 tx=0x7f2378000f40 comp rx=0 tx=0).stop 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 shutdown_connections 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a2167000 0x55c6a2169410 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2162d20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a215bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 --2- 172.21.15.82:0/1277477452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f2369600640 0 client.26428 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 >> 172.21.15.82:0/1277477452 conn(0x55c6a214ced0 msgr2=0x55c6a21437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 shutdown_connections 2024-04-26T20:25:46.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 1 -- 172.21.15.82:0/1277477452 wait complete. 2024-04-26T20:25:46.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.004+0000 7f23891d1740 20 client.26428 trim_cache size 0 max 16384 2024-04-26T20:25:46.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.026+0000 7f23891d1740 1 Processor -- start 2024-04-26T20:25:46.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.026+0000 7f23891d1740 1 -- start start 2024-04-26T20:25:46.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.026+0000 7f23891d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a21504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.026+0000 7f23891d1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 0x55c6a2162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f23891d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a21573c0 0x55c6a2152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f23891d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f236000fac0 con 0x55c6a21573c0 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f23891d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2360011780 con 0x55c6a2151860 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f23891d1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2360010190 con 0x55c6a2152250 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 0x55c6a2162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 0x55c6a2162ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40482/0 (socket says 172.21.15.82:40482) 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 -- 172.21.15.82:0/2537720428 learned_addr learned my addr 172.21.15.82:0/2537720428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237fe00640 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a21504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237fe00640 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a21573c0 0x55c6a2152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 -- 172.21.15.82:0/2537720428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 msgr2=0x55c6a21504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a21504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 -- 172.21.15.82:0/2537720428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a21573c0 msgr2=0x55c6a2152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a21573c0 0x55c6a2152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.027+0000 7f237ea00640 1 -- 172.21.15.82:0/2537720428 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a1e887d0 con 0x55c6a2152250 2024-04-26T20:25:46.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.028+0000 7f237ea00640 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 0x55c6a2162ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55c6a2169cc0 tx=0x7f236c0097b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=740d1cd3c18c9091 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.028+0000 7f236be00640 1 -- 172.21.15.82:0/2537720428 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c004250 con 0x55c6a2152250 2024-04-26T20:25:46.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.028+0000 7f236be00640 1 -- 172.21.15.82:0/2537720428 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f236c020070 con 0x55c6a2152250 2024-04-26T20:25:46.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.028+0000 7f236be00640 1 -- 172.21.15.82:0/2537720428 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c003b20 con 0x55c6a2152250 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 -- 172.21.15.82:0/2537720428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 msgr2=0x55c6a2162ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 0x55c6a2162ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55c6a2169cc0 tx=0x7f236c0097b0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 -- 172.21.15.82:0/2537720428 shutdown_connections 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a21573c0 0x55c6a2152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a2152250 0x55c6a2162ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 --2- 172.21.15.82:0/2537720428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a21504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 -- 172.21.15.82:0/2537720428 >> 172.21.15.82:0/2537720428 conn(0x55c6a214ced0 msgr2=0x55c6a214fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 -- 172.21.15.82:0/2537720428 shutdown_connections 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.029+0000 7f23891d1740 1 -- 172.21.15.82:0/2537720428 wait complete. 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.030+0000 7f23891d1740 1 -- start start 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.030+0000 7f23891d1740 1 Processor -- start 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2360010ff0 con 0x55c6a2152250 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2360010860 con 0x55c6a2151860 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f236000daa0 con 0x55c6a21573c0 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f23891d1740 10 client.0 _ll_register_callbacks cb 0x7f2378015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40492/0 (socket says 172.21.15.82:40492) 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237fe00640 1 -- 172.21.15.82:0/276267291 learned_addr learned my addr 172.21.15.82:0/276267291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237fe00640 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237fe00640 1 -- 172.21.15.82:0/276267291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 msgr2=0x55c6a215fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.031+0000 7f237fe00640 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f237fe00640 1 -- 172.21.15.82:0/276267291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 msgr2=0x55c6a2160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f237fe00640 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f237fe00640 1 -- 172.21.15.82:0/276267291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a20532a0 con 0x55c6a21573c0 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f237fe00640 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2161540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f237800a010 tx=0x7f2378000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc9b450e7970874 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f2369600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f2369600640 1 -- 172.21.15.82:0/276267291 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378010720 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f236c020070 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f2369600640 1 -- 172.21.15.82:0/276267291 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2378004de0 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f2369600640 1 -- 172.21.15.82:0/276267291 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f23780108c0 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f23891d1740 10 client.26434 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.032+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c6a2162c90 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f2369600640 1 -- 172.21.15.82:0/276267291 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f236c020070 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f2369600640 1 -- 172.21.15.82:0/276267291 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f23780117b0 con 0x55c6a21573c0 2024-04-26T20:25:46.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f23891d1740 10 client.26434 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f23891d1740 10 client.26434 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f23891d1740 20 client.26434 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f23891d1740 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a21cd9a0 0x55c6a21cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f23891d1740 4 client.26434 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6a20b46f0 con 0x55c6a21cd9a0 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.033+0000 7f237ea00640 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a21cd9a0 0x55c6a21cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.034+0000 7f237ea00640 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a21cd9a0 0x55c6a21cfdc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=113d45db5675d749 server_cookie=467e97c6a843c1c9 in_seq=0 out_seq=0 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.034+0000 7f2369600640 10 client.26434 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.034+0000 7f2369600640 1 -- 172.21.15.82:0/276267291 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c6a20b46f0 con 0x55c6a21cd9a0 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.034+0000 7f2369600640 10 client.26434 handle_command_reply: tid=0 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.034+0000 7f23891d1740 1 client.26434 shutdown 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 msgr2=0x55c6a2161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2161540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f237800a010 tx=0x7f2378000f40 comp rx=0 tx=0).stop 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 shutdown_connections 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55c6a21cd9a0 0x55c6a21cfdc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c6a21573c0 0x55c6a2161540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6a2152250 0x55c6a2160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 --2- 172.21.15.82:0/276267291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a2151860 0x55c6a215fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 >> 172.21.15.82:0/276267291 conn(0x55c6a214ced0 msgr2=0x55c6a2142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f2369600640 0 client.26434 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 shutdown_connections 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 1 -- 172.21.15.82:0/276267291 wait complete. 2024-04-26T20:25:46.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.035+0000 7f23891d1740 20 client.26434 trim_cache size 0 max 16384 2024-04-26T20:25:46.041 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:46.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f23640a3c40 msgr2=0x7f23640a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f23640a3c40 0x7f23640a6100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55c6a2152650 tx=0x7f237003b790 comp rx=0 tx=0).stop 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 msgr2=0x7f238019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 0x7f238019ac70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2370005ab0 tx=0x7f2370003b90 comp rx=0 tx=0).stop 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 shutdown_connections 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f23640a3c40 0x7f23640a6100 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2380102410 0x7f23801a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a70 0x7f238019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 --2- 172.21.15.82:0/3091493874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380101110 0x7f238019ac70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 >> 172.21.15.82:0/3091493874 conn(0x7f23800fccd0 msgr2=0x7f23800fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 shutdown_connections 2024-04-26T20:25:46.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.036+0000 7f2384e00640 1 -- 172.21.15.82:0/3091493874 wait complete. 2024-04-26T20:25:46.052 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:45 smithi082 ceph-mon[28105]: pgmap v500: 129 pgs: 129 active+clean; 167 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 206 op/s 2024-04-26T20:25:46.052 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:45 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2375412013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:46.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:25:46.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:45 smithi139 ceph-mon[32999]: pgmap v500: 129 pgs: 129 active+clean; 167 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 206 op/s 2024-04-26T20:25:46.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:45 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2375412013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:45 smithi135 ceph-mon[32816]: pgmap v500: 129 pgs: 129 active+clean; 167 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 206 op/s 2024-04-26T20:25:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:45 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2375412013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 -- 172.21.15.82:0/2795542308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8102930 msgr2=0x7f51d8102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 --2- 172.21.15.82:0/2795542308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8102930 0x7f51d8102db0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009860 tx=0x7f51c402a360 comp rx=0 tx=0).stop 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 -- 172.21.15.82:0/2795542308 shutdown_connections 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 --2- 172.21.15.82:0/2795542308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51d81032f0 0x7f51d8109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 --2- 172.21.15.82:0/2795542308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8102930 0x7f51d8102db0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 --2- 172.21.15.82:0/2795542308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d8101740 0x7f51d8101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 -- 172.21.15.82:0/2795542308 >> 172.21.15.82:0/2795542308 conn(0x7f51d80fccd0 msgr2=0x7f51d80ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.255+0000 7f51dd600640 1 -- 172.21.15.82:0/2795542308 shutdown_connections 2024-04-26T20:25:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.256+0000 7f51dd600640 1 -- 172.21.15.82:0/2795542308 wait complete. 2024-04-26T20:25:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.256+0000 7f51dd600640 1 Processor -- start 2024-04-26T20:25:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 -- start start 2024-04-26T20:25:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 0x7f51d8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51d8102930 0x7f51d8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d81032f0 0x7f51d81a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51d810e390 con 0x7f51d81032f0 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51d810e210 con 0x7f51d8102930 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dd600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f51d810e510 con 0x7f51d8101740 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51d7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 0x7f51d8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51d7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 0x7f51d8198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40512/0 (socket says 172.21.15.82:40512) 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51d7e00640 1 -- 172.21.15.82:0/374364637 learned_addr learned my addr 172.21.15.82:0/374364637 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.257+0000 7f51dcc00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d81032f0 0x7f51d81a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7400640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51d8102930 0x7f51d8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7e00640 1 -- 172.21.15.82:0/374364637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51d8102930 msgr2=0x7f51d8198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7e00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51d8102930 0x7f51d8198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7e00640 1 -- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d81032f0 msgr2=0x7f51d81a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7e00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d81032f0 0x7f51d81a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7e00640 1 -- 172.21.15.82:0/374364637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d81a0680 con 0x7f51d8101740 2024-04-26T20:25:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51dcc00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d81032f0 0x7f51d81a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d7e00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 0x7f51d8198a60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e9f0 tx=0x7f51c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d4c00640 1 -- 172.21.15.82:0/374364637 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c800ccc0 con 0x7f51d8101740 2024-04-26T20:25:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d4c00640 1 -- 172.21.15.82:0/374364637 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51c80035f0 con 0x7f51d8101740 2024-04-26T20:25:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d81a0970 con 0x7f51d8101740 2024-04-26T20:25:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.258+0000 7f51d4c00640 1 -- 172.21.15.82:0/374364637 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c800ce60 con 0x7f51d8101740 2024-04-26T20:25:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.259+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d81a0ee0 con 0x7f51d8101740 2024-04-26T20:25:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.263+0000 7f51e198f740 1 Processor -- start 2024-04-26T20:25:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.263+0000 7f51e198f740 1 -- start start 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.263+0000 7f51d4c00640 1 -- 172.21.15.82:0/374364637 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f51c8004000 con 0x7f51d8101740 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51e198f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c031880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51e198f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c036950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51e198f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 0x56359c039450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51e198f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56359bf90c70 con 0x56359c031e50 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51e198f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56359bf49980 con 0x56359c031460 2024-04-26T20:25:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51e198f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56359bf8cc30 con 0x56359c036fc0 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 0x56359c039450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 0x56359c039450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40518/0 (socket says 172.21.15.82:40518) 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.264+0000 7f51d7400640 1 -- 172.21.15.82:0/44723356 learned_addr learned my addr 172.21.15.82:0/44723356 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7e00640 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c036950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7400640 1 -- 172.21.15.82:0/44723356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 msgr2=0x56359c031880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7400640 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c031880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7400640 1 -- 172.21.15.82:0/44723356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 msgr2=0x56359c036950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7400640 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c036950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7400640 1 -- 172.21.15.82:0/44723356 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359bf217b0 con 0x56359c036fc0 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7e00640 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c036950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d4c00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51bc0a3cc0 0x7f51bc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d7400640 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 0x56359c039450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009830 tx=0x7f51c40094f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7f47aa7479516b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.265+0000 7f51d4c00640 1 -- 172.21.15.82:0/374364637 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f51c80d0b30 con 0x7f51d8101740 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.266+0000 7f51cd200640 1 -- 172.21.15.82:0/44723356 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4037040 con 0x56359c036fc0 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.266+0000 7f51cd200640 1 -- 172.21.15.82:0/44723356 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51c4038040 con 0x56359c036fc0 2024-04-26T20:25:46.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.266+0000 7f51cd200640 1 -- 172.21.15.82:0/44723356 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4005410 con 0x56359c036fc0 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 -- 172.21.15.82:0/44723356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 msgr2=0x56359c039450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 0x56359c039450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009830 tx=0x7f51c40094f0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 -- 172.21.15.82:0/44723356 shutdown_connections 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c036fc0 0x56359c039450 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c036950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 --2- 172.21.15.82:0/44723356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c031880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 -- 172.21.15.82:0/44723356 >> 172.21.15.82:0/44723356 conn(0x56359c0286c0 msgr2=0x56359c028ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 -- 172.21.15.82:0/44723356 shutdown_connections 2024-04-26T20:25:46.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51dcc00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51bc0a3cc0 0x7f51bc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.267+0000 7f51e198f740 1 -- 172.21.15.82:0/44723356 wait complete. 2024-04-26T20:25:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.268+0000 7f51e198f740 1 -- start start 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.268+0000 7f51dcc00640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51bc0a3cc0 0x7f51bc0a6180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x56359c0326b0 tx=0x7f51d00097f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.268+0000 7f51e198f740 1 Processor -- start 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c03b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 0x56359c03b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c036fc0 0x56359c042810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56359bf8ff80 con 0x56359c036fc0 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56359bf3d260 con 0x56359c031460 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56359bf952a0 con 0x56359c031e50 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51e198f740 10 client.0 _ll_register_callbacks cb 0x56359bf87960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 0x56359c03b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 0x56359c03b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40522/0 (socket says 172.21.15.82:40522) 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 -- 172.21.15.82:0/4288855528 learned_addr learned my addr 172.21.15.82:0/4288855528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7e00640 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c03b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 -- 172.21.15.82:0/4288855528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 msgr2=0x56359c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c03b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 -- 172.21.15.82:0/4288855528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c036fc0 msgr2=0x56359c042810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.269+0000 7f51d7400640 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c036fc0 0x56359c042810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.270+0000 7f51d7400640 1 -- 172.21.15.82:0/4288855528 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359bf1f1c0 con 0x56359c031e50 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.270+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51c4038040 con 0x56359c031e50 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.270+0000 7f51d7400640 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 0x56359c03b7d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51c402a950 tx=0x7f51c4030820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73197c00cfd41999 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.270+0000 7f51c1600640 10 client.26446 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.270+0000 7f51c1600640 1 -- 172.21.15.82:0/4288855528 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4058050 con 0x56359c031e50 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.270+0000 7f51c1600640 1 -- 172.21.15.82:0/4288855528 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f51c40053a0 con 0x56359c031e50 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51c1600640 1 -- 172.21.15.82:0/4288855528 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f51c404e070 con 0x56359c031e50 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 10 client.26446 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=34}) -- 0x56359bca23f0 con 0x56359c031e50 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51c1600640 1 -- 172.21.15.82:0/4288855528 <== mon.1 v2:172.21.15.139:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f51c40046c0 con 0x56359c031e50 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 10 client.26446 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 10 client.26446 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 20 client.26446 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c046800 0x56359c048bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 4 client.26446 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56359bf9e880 con 0x56359c046800 2024-04-26T20:25:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.271+0000 7f51d7e00640 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c046800 0x56359c048bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.272+0000 7f51d7e00640 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c046800 0x56359c048bf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a588089275b828d5 server_cookie=ed04a7dee54368b8 in_seq=0 out_seq=0 2024-04-26T20:25:46.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.272+0000 7f51c1600640 10 client.26446 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.272+0000 7f51c1600640 1 -- 172.21.15.82:0/4288855528 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56359bf9e880 con 0x56359c046800 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.272+0000 7f51c1600640 10 client.26446 handle_command_reply: tid=0 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 client.26446 shutdown 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 msgr2=0x56359c03b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 0x56359c03b7d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51c402a950 tx=0x7f51c4030820 comp rx=0 tx=0).stop 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 shutdown_connections 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c036fc0 0x56359c042810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031e50 0x56359c03b7d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c046800 0x56359c048bf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 --2- 172.21.15.82:0/4288855528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031460 0x56359c03b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 >> 172.21.15.82:0/4288855528 conn(0x56359c0286c0 msgr2=0x56359c0277b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51c1600640 0 client.26446 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 shutdown_connections 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.273+0000 7f51e198f740 1 -- 172.21.15.82:0/4288855528 wait complete. 2024-04-26T20:25:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.274+0000 7f51e198f740 20 client.26446 trim_cache size 0 max 16384 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 Processor -- start 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 -- start start 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c0286c0 0x56359c036640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c0427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031e50 0x56359c02b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81a8f80 con 0x56359c0286c0 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81aac40 con 0x56359c031e50 2024-04-26T20:25:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.291+0000 7f51e198f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81a9650 con 0x56359c031460 2024-04-26T20:25:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c0427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c0286c0 0x56359c036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c0427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40524/0 (socket says 172.21.15.82:40524) 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7400640 1 -- 172.21.15.82:0/3850764816 learned_addr learned my addr 172.21.15.82:0/3850764816 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51dcc00640 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031e50 0x56359c02b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7e00640 1 -- 172.21.15.82:0/3850764816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 msgr2=0x56359c0427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7e00640 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c0427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7e00640 1 -- 172.21.15.82:0/3850764816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031e50 msgr2=0x56359c02b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7e00640 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031e50 0x56359c02b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7e00640 1 -- 172.21.15.82:0/3850764816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359bd6c7d0 con 0x56359c0286c0 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.292+0000 7f51d7400640 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c0427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.293+0000 7f51d7e00640 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c0286c0 0x56359c036640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f51c80ce180 tx=0x7f51c80bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375c7dc255179dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.293+0000 7f51c3e00640 1 -- 172.21.15.82:0/3850764816 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c80042f0 con 0x56359c0286c0 2024-04-26T20:25:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.293+0000 7f51c3e00640 1 -- 172.21.15.82:0/3850764816 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51c809d050 con 0x56359c0286c0 2024-04-26T20:25:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.293+0000 7f51c3e00640 1 -- 172.21.15.82:0/3850764816 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8003aa0 con 0x56359c0286c0 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 -- 172.21.15.82:0/3850764816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c0286c0 msgr2=0x56359c036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c0286c0 0x56359c036640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f51c80ce180 tx=0x7f51c80bd040 comp rx=0 tx=0).stop 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 -- 172.21.15.82:0/3850764816 shutdown_connections 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c031e50 0x56359c02b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c0427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 --2- 172.21.15.82:0/3850764816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c0286c0 0x56359c036640 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 -- 172.21.15.82:0/3850764816 >> 172.21.15.82:0/3850764816 conn(0x56359c03a4a0 msgr2=0x56359c0277b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 -- 172.21.15.82:0/3850764816 shutdown_connections 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 -- 172.21.15.82:0/3850764816 wait complete. 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.294+0000 7f51e198f740 1 -- start start 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 Processor -- start 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 0x56359c0403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c040930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c041940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81aa4b0 con 0x56359c031e50 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81a9d20 con 0x56359c0286c0 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f51d81a6f60 con 0x56359c031460 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.295+0000 7f51e198f740 10 client.0 _ll_register_callbacks cb 0x7f51c40096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 0x56359c0403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 0x56359c0403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55832/0 (socket says 172.21.15.82:55832) 2024-04-26T20:25:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 -- 172.21.15.82:0/2484419557 learned_addr learned my addr 172.21.15.82:0/2484419557 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51dcc00640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c041940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 -- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 msgr2=0x56359c040930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 -- 172.21.15.82:0/2484419557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 msgr2=0x56359c041940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c041940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 -- 172.21.15.82:0/2484419557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359bf372a0 con 0x56359c0286c0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51dcc00640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c041940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51d7e00640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 0x56359c0403f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f51c8087010 tx=0x7f51c80ce0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe45cf0f39269ff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.296+0000 7f51c1600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51c1600640 1 -- 172.21.15.82:0/2484419557 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c80b8060 con 0x56359c0286c0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51c1600640 1 -- 172.21.15.82:0/2484419557 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f51c80037a0 con 0x56359c0286c0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51c809d050 con 0x56359c0286c0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51c1600640 1 -- 172.21.15.82:0/2484419557 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f51c80a0d00 con 0x56359c0286c0 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51e198f740 10 client.26426 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56359c0b13c0 con 0x56359c0286c0 2024-04-26T20:25:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51c1600640 1 -- 172.21.15.82:0/2484419557 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51c809d050 con 0x56359c0286c0 2024-04-26T20:25:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51c1600640 1 -- 172.21.15.82:0/2484419557 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f51c80a51c0 con 0x56359c0286c0 2024-04-26T20:25:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51e198f740 10 client.26426 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.297+0000 7f51e198f740 10 client.26426 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:25:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51e198f740 20 client.26426 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51e198f740 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c036fc0 0x56359c0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51e198f740 4 client.26426 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56359bf986f0 con 0x56359c036fc0 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51d7400640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c036fc0 0x56359c0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51d7400640 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c036fc0 0x56359c0b3b60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=42cc9ac7825a1f49 server_cookie=f12ef14dbd107414 in_seq=0 out_seq=0 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.298+0000 7f51c1600640 10 client.26426 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51c1600640 1 -- 172.21.15.82:0/2484419557 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56359bf986f0 con 0x56359c036fc0 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51c1600640 10 client.26426 handle_command_reply: tid=0 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 client.26426 shutdown 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 msgr2=0x56359c0403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 0x56359c0403f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f51c8087010 tx=0x7f51c80ce0c0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 shutdown_connections 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359c031e50 0x56359c041940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56359c031460 0x56359c040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56359c036fc0 0x56359c0b3b60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 --2- 172.21.15.82:0/2484419557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56359c0286c0 0x56359c0403f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51c1600640 0 client.26426 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 >> 172.21.15.82:0/2484419557 conn(0x56359c03a4a0 msgr2=0x56359c032830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 shutdown_connections 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 1 -- 172.21.15.82:0/2484419557 wait complete. 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.299+0000 7f51e198f740 20 client.26426 trim_cache size 0 max 16384 2024-04-26T20:25:46.304 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51bc0a3cc0 msgr2=0x7f51bc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51bc0a3cc0 0x7f51bc0a6180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x56359c0326b0 tx=0x7f51d00097f0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 msgr2=0x7f51d8198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 0x7f51d8198a60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e9f0 tx=0x7f51c800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 shutdown_connections 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f51bc0a3cc0 0x7f51bc0a6180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51d81032f0 0x7f51d81a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51d8102930 0x7f51d8198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 --2- 172.21.15.82:0/374364637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51d8101740 0x7f51d8198a60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.300+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 >> 172.21.15.82:0/374364637 conn(0x7f51d80fccd0 msgr2=0x7f51d8105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.301+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 shutdown_connections 2024-04-26T20:25:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.301+0000 7f51dd600640 1 -- 172.21.15.82:0/374364637 wait complete. 2024-04-26T20:25:46.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 -- 172.21.15.82:0/3187115761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8102970 msgr2=0x7fd7d8102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 --2- 172.21.15.82:0/3187115761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8102970 0x7fd7d8102d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009900 tx=0x7fd7c802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 -- 172.21.15.82:0/3187115761 shutdown_connections 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 --2- 172.21.15.82:0/3187115761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d8104520 0x7fd7d810adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 --2- 172.21.15.82:0/3187115761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7d8103b60 0x7fd7d8103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 --2- 172.21.15.82:0/3187115761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8102970 0x7fd7d8102d90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 -- 172.21.15.82:0/3187115761 >> 172.21.15.82:0/3187115761 conn(0x7fd7d80fdee0 msgr2=0x7fd7d8100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 -- 172.21.15.82:0/3187115761 shutdown_connections 2024-04-26T20:25:46.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.565+0000 7fd7de200640 1 -- 172.21.15.82:0/3187115761 wait complete. 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.566+0000 7fd7de200640 1 Processor -- start 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 -- start start 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7d8102970 0x7fd7d8198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 0x7fd7d81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d8104520 0x7fd7d81a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d810e4a0 con 0x7fd7d8103b60 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d810e320 con 0x7fd7d8102970 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7de200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d810e620 con 0x7fd7d8104520 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7d6a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 0x7fd7d81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7d6a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 0x7fd7d81991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42094/0 (socket says 172.21.15.82:42094) 2024-04-26T20:25:46.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7d6a00640 1 -- 172.21.15.82:0/2949758550 learned_addr learned my addr 172.21.15.82:0/2949758550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7d7400640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7d8102970 0x7fd7d8198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.567+0000 7fd7d7e00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d8104520 0x7fd7d81a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7d6a00640 1 -- 172.21.15.82:0/2949758550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d8104520 msgr2=0x7fd7d81a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d8104520 0x7fd7d81a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7d6a00640 1 -- 172.21.15.82:0/2949758550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7d8102970 msgr2=0x7fd7d8198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7d8102970 0x7fd7d8198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7d6a00640 1 -- 172.21.15.82:0/2949758550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d81a0840 con 0x7fd7d8103b60 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 0x7fd7d81991c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400e9f0 tx=0x7fd7c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7cfe00640 1 -- 172.21.15.82:0/2949758550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400cd80 con 0x7fd7d8103b60 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7cfe00640 1 -- 172.21.15.82:0/2949758550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7c40108e0 con 0x7fd7d8103b60 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d81a0b30 con 0x7fd7d8103b60 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.568+0000 7fd7cfe00640 1 -- 172.21.15.82:0/2949758550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4018980 con 0x7fd7d8103b60 2024-04-26T20:25:46.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.569+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d81a1080 con 0x7fd7d8103b60 2024-04-26T20:25:46.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.572+0000 7fd7cfe00640 1 -- 172.21.15.82:0/2949758550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd7c4010430 con 0x7fd7d8103b60 2024-04-26T20:25:46.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.573+0000 7fd7e1002740 1 Processor -- start 2024-04-26T20:25:46.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.573+0000 7fd7e1002740 1 -- start start 2024-04-26T20:25:46.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450da6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450daca0 0x55e6450df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450dfe10 0x55e6450e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7e1002740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e645039c70 con 0x55e6450daca0 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7e1002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e644ff2980 con 0x55e6450dfe10 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7e1002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e645035c30 con 0x55e6450da2b0 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450da6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450daca0 0x55e6450df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450da6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40562/0 (socket says 172.21.15.82:40562) 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7d7e00640 1 -- 172.21.15.82:0/3099917654 learned_addr learned my addr 172.21.15.82:0/3099917654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7cfe00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7bc0a3c40 0x7fd7bc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7d7e00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7bc0a3c40 0x7fd7bc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7cfe00640 1 -- 172.21.15.82:0/2949758550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd7c40d0cb0 con 0x7fd7d8103b60 2024-04-26T20:25:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.574+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450dfe10 0x55e6450e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 -- 172.21.15.82:0/3099917654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450dfe10 msgr2=0x55e6450e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450dfe10 0x55e6450e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 -- 172.21.15.82:0/3099917654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450daca0 msgr2=0x55e6450df7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450daca0 0x55e6450df7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 -- 172.21.15.82:0/3099917654 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e644fca7b0 con 0x55e6450da2b0 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7400640 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450daca0 0x55e6450df7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450da6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0005c40 tx=0x7fd7d000f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad700b2c7853db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7d7e00640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7bc0a3c40 0x7fd7bc0a6100 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0008000 tx=0x7fd7d0027000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.575+0000 7fd7c3e00640 1 -- 172.21.15.82:0/3099917654 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000fd30 con 0x55e6450da2b0 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7c3e00640 1 -- 172.21.15.82:0/3099917654 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7d0013120 con 0x55e6450da2b0 2024-04-26T20:25:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7c3e00640 1 -- 172.21.15.82:0/3099917654 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0010430 con 0x55e6450da2b0 2024-04-26T20:25:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 -- 172.21.15.82:0/3099917654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 msgr2=0x55e6450da6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450da6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0005c40 tx=0x7fd7d000f3c0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 -- 172.21.15.82:0/3099917654 shutdown_connections 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450dfe10 0x55e6450e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450daca0 0x55e6450df7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 --2- 172.21.15.82:0/3099917654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450da6d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.576+0000 7fd7e1002740 1 -- 172.21.15.82:0/3099917654 >> 172.21.15.82:0/3099917654 conn(0x55e6450d1510 msgr2=0x55e6450d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.577+0000 7fd7e1002740 1 -- 172.21.15.82:0/3099917654 shutdown_connections 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.577+0000 7fd7e1002740 1 -- 172.21.15.82:0/3099917654 wait complete. 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.577+0000 7fd7e1002740 1 -- start start 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.577+0000 7fd7e1002740 1 Processor -- start 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.577+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 0x55e6450dce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450daca0 0x55e6450dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7e1002740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e645038f80 con 0x55e6450dfe10 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7e1002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e644fe6260 con 0x55e6450da2b0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7e1002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e64503e2a0 con 0x55e6450daca0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7e1002740 10 client.0 _ll_register_callbacks cb 0x55e645030960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 0x55e6450dce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 0x55e6450dce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55878/0 (socket says 172.21.15.82:55878) 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 -- 172.21.15.82:0/2614627674 learned_addr learned my addr 172.21.15.82:0/2614627674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450daca0 0x55e6450dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 -- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450daca0 msgr2=0x55e6450dd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450daca0 0x55e6450dd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 -- 172.21.15.82:0/2614627674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 msgr2=0x55e6450de3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450de3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.578+0000 7fd7d7400640 1 -- 172.21.15.82:0/2614627674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e644fc81c0 con 0x55e6450da2b0 2024-04-26T20:25:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.579+0000 7fd7d7400640 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 0x55e6450dce70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd7d81039c0 tx=0x7fd7c8031db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e40a3f97298462b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.579+0000 7fd7c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.579+0000 7fd7c0c00640 1 -- 172.21.15.82:0/2614627674 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8035040 con 0x55e6450da2b0 2024-04-26T20:25:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.579+0000 7fd7c0c00640 1 -- 172.21.15.82:0/2614627674 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd7c8004040 con 0x55e6450da2b0 2024-04-26T20:25:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.579+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7d0013120 con 0x55e6450da2b0 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7c0c00640 1 -- 172.21.15.82:0/2614627674 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd7c8004240 con 0x55e6450da2b0 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 10 client.26438 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e644d4b3f0 con 0x55e6450da2b0 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7c0c00640 1 -- 172.21.15.82:0/2614627674 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7d0013120 con 0x55e6450da2b0 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7c0c00640 1 -- 172.21.15.82:0/2614627674 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fd7c803c560 con 0x55e6450da2b0 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 10 client.26438 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 10 client.26438 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 20 client.26438 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e6450eb880 0x55e6450edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 4 client.26438 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.580+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e645047880 con 0x55e6450eb880 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.581+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e6450eb880 0x55e6450edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.581+0000 7fd7c0c00640 10 client.26438 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.581+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e6450eb880 0x55e6450edcd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68681871f29b1a4b server_cookie=eb9ae126dbffce15 in_seq=0 out_seq=0 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7c0c00640 1 -- 172.21.15.82:0/2614627674 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e645047880 con 0x55e6450eb880 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7c0c00640 10 client.26438 handle_command_reply: tid=0 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 client.26438 shutdown 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 msgr2=0x55e6450dce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 0x55e6450dce70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd7d81039c0 tx=0x7fd7c8031db0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 shutdown_connections 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e6450eb880 0x55e6450edcd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450daca0 0x55e6450dd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 --2- 172.21.15.82:0/2614627674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450da2b0 0x55e6450dce70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 >> 172.21.15.82:0/2614627674 conn(0x55e6450d1510 msgr2=0x55e6450d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.582+0000 7fd7c0c00640 0 client.26438 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.583+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 shutdown_connections 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.583+0000 7fd7e1002740 1 -- 172.21.15.82:0/2614627674 wait complete. 2024-04-26T20:25:46.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.583+0000 7fd7e1002740 20 client.26438 trim_cache size 0 max 16384 2024-04-26T20:25:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.599+0000 7fd7e1002740 1 Processor -- start 2024-04-26T20:25:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.599+0000 7fd7e1002740 1 -- start start 2024-04-26T20:25:46.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.599+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.599+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.599+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.599+0000 7fd7e1002740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81a91d0 con 0x55e6450dfe10 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7e1002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81aae90 con 0x55e6450daca0 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7e1002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81a98a0 con 0x55e6450da2b0 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450d4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40586/0 (socket says 172.21.15.82:40586) 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 -- 172.21.15.82:0/1644981788 learned_addr learned my addr 172.21.15.82:0/1644981788 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 -- 172.21.15.82:0/1644981788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 msgr2=0x55e6450d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 -- 172.21.15.82:0/1644981788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 msgr2=0x55e6450d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d7400640 1 -- 172.21.15.82:0/1644981788 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e644e157d0 con 0x55e6450da2b0 2024-04-26T20:25:46.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.600+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:46.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.601+0000 7fd7d7400640 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450d4d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7c803c970 tx=0x7fd7c8032fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fc66b6bd8550c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.601+0000 7fd7c3400640 1 -- 172.21.15.82:0/1644981788 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8035070 con 0x55e6450da2b0 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.601+0000 7fd7c3400640 1 -- 172.21.15.82:0/1644981788 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7c80043e0 con 0x55e6450da2b0 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.601+0000 7fd7c3400640 1 -- 172.21.15.82:0/1644981788 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8046890 con 0x55e6450da2b0 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 -- 172.21.15.82:0/1644981788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 msgr2=0x55e6450d4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450d4d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7c803c970 tx=0x7fd7c8032fc0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 -- 172.21.15.82:0/1644981788 shutdown_connections 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450dfe10 0x55e6450d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 --2- 172.21.15.82:0/1644981788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450da2b0 0x55e6450d4d90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 -- 172.21.15.82:0/1644981788 >> 172.21.15.82:0/1644981788 conn(0x55e6450d1510 msgr2=0x55e6450cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 -- 172.21.15.82:0/1644981788 shutdown_connections 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 -- 172.21.15.82:0/1644981788 wait complete. 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 -- start start 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.602+0000 7fd7e1002740 1 Processor -- start 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 0x55e6450e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450dfe10 0x55e6450e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81aa700 con 0x55e6450da2b0 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81a9f70 con 0x55e6450daca0 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d81a71b0 con 0x55e6450dfe10 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7e1002740 10 client.0 _ll_register_callbacks cb 0x7fd7c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 0x55e6450e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450dfe10 0x55e6450e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450dfe10 0x55e6450e6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40594/0 (socket says 172.21.15.82:40594) 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 0x55e6450e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42136/0 (socket says 172.21.15.82:42136) 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7d7e00640 1 -- 172.21.15.82:0/844111210 learned_addr learned my addr 172.21.15.82:0/844111210 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.603+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d7400640 1 -- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450dfe10 msgr2=0x55e6450e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d7400640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450dfe10 0x55e6450e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d7400640 1 -- 172.21.15.82:0/844111210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 msgr2=0x55e6450e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d7400640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d7400640 1 -- 172.21.15.82:0/844111210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e644fe02a0 con 0x55e6450da2b0 2024-04-26T20:25:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7d7400640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 0x55e6450e5a30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009850 tx=0x7fd7c803df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655f4c049173f707 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7c0c00640 1 -- 172.21.15.82:0/844111210 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8035070 con 0x55e6450da2b0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7c80043e0 con 0x55e6450da2b0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.604+0000 7fd7c0c00640 1 -- 172.21.15.82:0/844111210 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd7c803c640 con 0x55e6450da2b0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7c0c00640 1 -- 172.21.15.82:0/844111210 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd7c8066050 con 0x55e6450da2b0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 10 client.16323 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e6450e8650 con 0x55e6450da2b0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7c0c00640 1 -- 172.21.15.82:0/844111210 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7c80043e0 con 0x55e6450da2b0 2024-04-26T20:25:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7c0c00640 1 -- 172.21.15.82:0/844111210 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fd7c80505b0 con 0x55e6450da2b0 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 10 client.16323 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 10 client.16323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 20 client.16323 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e645152220 0x55e645154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 4 client.16323 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.605+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6450416f0 con 0x55e645152220 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.606+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e645152220 0x55e645154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.606+0000 7fd7d6a00640 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e645152220 0x55e645154640 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1dbdacb22833a342 server_cookie=1e68832fc557dcb8 in_seq=0 out_seq=0 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.606+0000 7fd7c0c00640 10 client.16323 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7c0c00640 1 -- 172.21.15.82:0/844111210 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6450416f0 con 0x55e645152220 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7c0c00640 10 client.16323 handle_command_reply: tid=0 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 client.16323 shutdown 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 msgr2=0x55e6450e5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 0x55e6450e5a30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009850 tx=0x7fd7c803df50 comp rx=0 tx=0).stop 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 shutdown_connections 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55e645152220 0x55e645154640 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6450dfe10 0x55e6450e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7c0c00640 0 client.16323 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e6450daca0 0x55e6450e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 --2- 172.21.15.82:0/844111210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6450da2b0 0x55e6450e5a30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 >> 172.21.15.82:0/844111210 conn(0x55e6450d1510 msgr2=0x55e6450d4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 shutdown_connections 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 1 -- 172.21.15.82:0/844111210 wait complete. 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.607+0000 7fd7e1002740 20 client.16323 trim_cache size 0 max 16384 2024-04-26T20:25:46.612 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:46.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.608+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7bc0a3c40 msgr2=0x7fd7bc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.608+0000 7fd7de200640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7bc0a3c40 0x7fd7bc0a6100 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0008000 tx=0x7fd7d0027000 comp rx=0 tx=0).stop 2024-04-26T20:25:46.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.608+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 msgr2=0x7fd7d81991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.608+0000 7fd7de200640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 0x7fd7d81991c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400e9f0 tx=0x7fd7c400eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 shutdown_connections 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd7bc0a3c40 0x7fd7bc0a6100 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d8104520 0x7fd7d81a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d8103b60 0x7fd7d81991c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 --2- 172.21.15.82:0/2949758550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7d8102970 0x7fd7d8198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 >> 172.21.15.82:0/2949758550 conn(0x7fd7d80fdee0 msgr2=0x7fd7d8106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 shutdown_connections 2024-04-26T20:25:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.609+0000 7fd7de200640 1 -- 172.21.15.82:0/2949758550 wait complete. 2024-04-26T20:25:46.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:25:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 -- 172.21.15.82:0/1369750838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 msgr2=0x7fcedc104fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 --2- 172.21.15.82:0/1369750838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc104fd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009900 tx=0x7fcecc02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 -- 172.21.15.82:0/1369750838 shutdown_connections 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 --2- 172.21.15.82:0/1369750838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 0x7fcedc10cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 --2- 172.21.15.82:0/1369750838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 0x7fcedc106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 --2- 172.21.15.82:0/1369750838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc104fd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 -- 172.21.15.82:0/1369750838 >> 172.21.15.82:0/1369750838 conn(0x7fcedc100120 msgr2=0x7fcedc102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 -- 172.21.15.82:0/1369750838 shutdown_connections 2024-04-26T20:25:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.860+0000 7fcee1c00640 1 -- 172.21.15.82:0/1369750838 wait complete. 2024-04-26T20:25:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.861+0000 7fcee1c00640 1 Processor -- start 2024-04-26T20:25:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 -- start start 2024-04-26T20:25:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc19ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 0x7fcedc19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 0x7fcedc1a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1106d0 con 0x7fcedc106760 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc110550 con 0x7fcedc105da0 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcee1c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc110850 con 0x7fcedc104bb0 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcedaa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc19ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fceda000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 0x7fcedc19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcedaa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc19ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40616/0 (socket says 172.21.15.82:40616) 2024-04-26T20:25:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcedaa00640 1 -- 172.21.15.82:0/15227377 learned_addr learned my addr 172.21.15.82:0/15227377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.862+0000 7fcedb400640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 0x7fcedc1a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fceda000640 1 -- 172.21.15.82:0/15227377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 msgr2=0x7fcedc19ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fceda000640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc19ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fceda000640 1 -- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 msgr2=0x7fcedc1a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fceda000640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 0x7fcedc1a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fceda000640 1 -- 172.21.15.82:0/15227377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc1a2a50 con 0x7fcedc105da0 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fcedaa00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc19ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fcedb400640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 0x7fcedc1a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fceda000640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 0x7fcedc19b370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcec800e9f0 tx=0x7fcec800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fced3400640 1 -- 172.21.15.82:0/15227377 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800ccc0 con 0x7fcedc105da0 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fced3400640 1 -- 172.21.15.82:0/15227377 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec8005020 con 0x7fcedc105da0 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fced3400640 1 -- 172.21.15.82:0/15227377 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8004a00 con 0x7fcedc105da0 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.863+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc1a2d40 con 0x7fcedc105da0 2024-04-26T20:25:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.864+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcedc1a31e0 con 0x7fcedc105da0 2024-04-26T20:25:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.868+0000 7fcee4a26740 1 Processor -- start 2024-04-26T20:25:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.868+0000 7fcee4a26740 1 -- start start 2024-04-26T20:25:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.868+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc220b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.868+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220b890 0x55edc2210390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2212e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcee4a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55edc216ec70 con 0x55edc220aea0 2024-04-26T20:25:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcee4a26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55edc2127980 con 0x55edc220b890 2024-04-26T20:25:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcee4a26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55edc216ac30 con 0x55edc2210a00 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fced3400640 1 -- 172.21.15.82:0/15227377 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcec8004ba0 con 0x7fcedc105da0 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcedb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc220b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcedb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc220b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42154/0 (socket says 172.21.15.82:42154) 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fcedb400640 1 -- 172.21.15.82:0/3985035147 learned_addr learned my addr 172.21.15.82:0/3985035147 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.869+0000 7fceda000640 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2212e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fceda000640 1 -- 172.21.15.82:0/3985035147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220b890 msgr2=0x55edc2210390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fcedaa00640 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220b890 0x55edc2210390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fceda000640 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220b890 0x55edc2210390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fceda000640 1 -- 172.21.15.82:0/3985035147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 msgr2=0x55edc220b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fceda000640 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc220b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fceda000640 1 -- 172.21.15.82:0/3985035147 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edc20ff7b0 con 0x55edc2210a00 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fcedaa00640 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220b890 0x55edc2210390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fceda000640 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2212e90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcec80cdf70 tx=0x7fcec80d6c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488a06c7195f1b87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fcec7e00640 1 -- 172.21.15.82:0/3985035147 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80df070 con 0x55edc2210a00 2024-04-26T20:25:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fcec7e00640 1 -- 172.21.15.82:0/3985035147 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80d8c80 con 0x55edc2210a00 2024-04-26T20:25:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.870+0000 7fcec7e00640 1 -- 172.21.15.82:0/3985035147 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80da600 con 0x55edc2210a00 2024-04-26T20:25:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fced3400640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcec00a3c40 0x7fcec00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fced3400640 1 -- 172.21.15.82:0/15227377 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcec80d0920 con 0x7fcedc105da0 2024-04-26T20:25:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 -- 172.21.15.82:0/3985035147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 msgr2=0x55edc2212e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2212e90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcec80cdf70 tx=0x7fcec80d6c40 comp rx=0 tx=0).stop 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcedb400640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcec00a3c40 0x7fcec00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 -- 172.21.15.82:0/3985035147 shutdown_connections 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2212e90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220b890 0x55edc2210390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 --2- 172.21.15.82:0/3985035147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc220b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.871+0000 7fcee4a26740 1 -- 172.21.15.82:0/3985035147 >> 172.21.15.82:0/3985035147 conn(0x55edc2206510 msgr2=0x55edc2206910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.872+0000 7fcedb400640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcec00a3c40 0x7fcec00a6100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55edc220c0f0 tx=0x7fced4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.872+0000 7fcee4a26740 1 -- 172.21.15.82:0/3985035147 shutdown_connections 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.872+0000 7fcee4a26740 1 -- 172.21.15.82:0/3985035147 wait complete. 2024-04-26T20:25:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.873+0000 7fcee4a26740 1 -- start start 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.873+0000 7fcee4a26740 1 Processor -- start 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc221d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc221db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2224b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55edc216df80 con 0x55edc220b890 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55edc211b260 con 0x55edc220aea0 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55edc21732a0 con 0x55edc2210a00 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.874+0000 7fcee4a26740 10 client.0 _ll_register_callbacks cb 0x55edc2165960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc221d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc221d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55936/0 (socket says 172.21.15.82:55936) 2024-04-26T20:25:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedaa00640 1 -- 172.21.15.82:0/2137712118 learned_addr learned my addr 172.21.15.82:0/2137712118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedb400640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2224b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedaa00640 1 -- 172.21.15.82:0/2137712118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 msgr2=0x55edc2224b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedaa00640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2224b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fcedaa00640 1 -- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 msgr2=0x55edc221db90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.875+0000 7fceda000640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc221db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.876+0000 7fcedaa00640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc221db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.876+0000 7fcedaa00640 1 -- 172.21.15.82:0/2137712118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edc20fd1c0 con 0x55edc220aea0 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.876+0000 7fceda000640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc221db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.876+0000 7fcedaa00640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc221d650 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009230 tx=0x7fcecc0317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a4cd119e975fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.876+0000 7fcec4c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.876+0000 7fcec4c00640 1 -- 172.21.15.82:0/2137712118 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc035070 con 0x55edc220aea0 2024-04-26T20:25:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.877+0000 7fcec4c00640 1 -- 172.21.15.82:0/2137712118 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcecc004240 con 0x55edc220aea0 2024-04-26T20:25:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.877+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec80d8c80 con 0x55edc220aea0 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.877+0000 7fcec4c00640 1 -- 172.21.15.82:0/2137712118 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcecc04e050 con 0x55edc220aea0 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.877+0000 7fcee4a26740 10 client.26453 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.877+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55edc1e803f0 con 0x55edc220aea0 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.877+0000 7fcec4c00640 1 -- 172.21.15.82:0/2137712118 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80d8c80 con 0x55edc220aea0 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcec4c00640 1 -- 172.21.15.82:0/2137712118 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fcecc004a10 con 0x55edc220aea0 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcee4a26740 10 client.26453 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcee4a26740 10 client.26453 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcee4a26740 20 client.26453 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcee4a26740 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc22290c0 0x55edc222b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcee4a26740 4 client.26453 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.878+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edc217c880 con 0x55edc22290c0 2024-04-26T20:25:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.879+0000 7fceda000640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc22290c0 0x55edc222b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.879+0000 7fcec4c00640 10 client.26453 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.879+0000 7fceda000640 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc22290c0 0x55edc222b560 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a0d68bf047bb93d server_cookie=983da7520e73bb68 in_seq=0 out_seq=0 2024-04-26T20:25:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcec4c00640 1 -- 172.21.15.82:0/2137712118 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55edc217c880 con 0x55edc22290c0 2024-04-26T20:25:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcec4c00640 10 client.26453 handle_command_reply: tid=0 2024-04-26T20:25:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 client.26453 shutdown 2024-04-26T20:25:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 msgr2=0x55edc221d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc221d650 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009230 tx=0x7fcecc0317d0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 shutdown_connections 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc22290c0 0x55edc222b560 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2224b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc221db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.883+0000 7fcee4a26740 1 --2- 172.21.15.82:0/2137712118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc221d650 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.884+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 >> 172.21.15.82:0/2137712118 conn(0x55edc2206510 msgr2=0x55edc2205690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.884+0000 7fcec4c00640 0 client.26453 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.884+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 shutdown_connections 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.884+0000 7fcee4a26740 1 -- 172.21.15.82:0/2137712118 wait complete. 2024-04-26T20:25:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.884+0000 7fcee4a26740 20 client.26453 trim_cache size 0 max 16384 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 Processor -- start 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 -- start start 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc2209900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc2224b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2209e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1a9290 con 0x55edc220b890 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1aaf50 con 0x55edc220aea0 2024-04-26T20:25:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcee4a26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1a9960 con 0x55edc2210a00 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fceda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc2224b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fceda000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc2224b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42180/0 (socket says 172.21.15.82:42180) 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fceda000640 1 -- 172.21.15.82:0/1069164562 learned_addr learned my addr 172.21.15.82:0/1069164562 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.906+0000 7fcedb400640 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2209e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fcedaa00640 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc2209900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fceda000640 1 -- 172.21.15.82:0/1069164562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 msgr2=0x55edc2209e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fceda000640 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2209e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fceda000640 1 -- 172.21.15.82:0/1069164562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 msgr2=0x55edc2209900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fceda000640 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc2209900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fceda000640 1 -- 172.21.15.82:0/1069164562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edc1f4a7d0 con 0x55edc220b890 2024-04-26T20:25:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fceda000640 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc2224b20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcec809c6d0 tx=0x7fcec80d6550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb703af61c9ffc36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fcec7400640 1 -- 172.21.15.82:0/1069164562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec801c030 con 0x55edc220b890 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fcec7400640 1 -- 172.21.15.82:0/1069164562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80d6e90 con 0x55edc220b890 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.907+0000 7fcec7400640 1 -- 172.21.15.82:0/1069164562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80df070 con 0x55edc220b890 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 -- 172.21.15.82:0/1069164562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 msgr2=0x55edc2224b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc2224b20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcec809c6d0 tx=0x7fcec80d6550 comp rx=0 tx=0).stop 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 -- 172.21.15.82:0/1069164562 shutdown_connections 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc2210a00 0x55edc2209e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220b890 0x55edc2224b20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 --2- 172.21.15.82:0/1069164562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc220aea0 0x55edc2209900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 -- 172.21.15.82:0/1069164562 >> 172.21.15.82:0/1069164562 conn(0x55edc2206510 msgr2=0x55edc22091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.908+0000 7fcee4a26740 1 -- 172.21.15.82:0/1069164562 shutdown_connections 2024-04-26T20:25:46.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.909+0000 7fcee4a26740 1 -- 172.21.15.82:0/1069164562 wait complete. 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.909+0000 7fcee4a26740 1 -- start start 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.909+0000 7fcee4a26740 1 Processor -- start 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc2221ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 0x55edc2222420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc2210a00 0x55edc2223430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1aa7c0 con 0x55edc220aea0 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1aa030 con 0x55edc2210a00 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc1a7270 con 0x55edc220b890 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcee4a26740 10 client.0 _ll_register_callbacks cb 0x7fcec8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 0x55edc2222420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 0x55edc2222420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40662/0 (socket says 172.21.15.82:40662) 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 -- 172.21.15.82:0/517171589 learned_addr learned my addr 172.21.15.82:0/517171589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fcedaa00640 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc2221ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 -- 172.21.15.82:0/517171589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc2210a00 msgr2=0x55edc2223430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc2210a00 0x55edc2223430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 -- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 msgr2=0x55edc2221ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:46.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc2221ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.910+0000 7fceda000640 1 -- 172.21.15.82:0/517171589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edc21152a0 con 0x55edc220b890 2024-04-26T20:25:46.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fceda000640 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 0x55edc2222420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcec80d6ad0 tx=0x7fcec8005460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d0fb38a0f94c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:46.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcec4c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:46.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcec4c00640 1 -- 172.21.15.82:0/517171589 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec801c050 con 0x55edc220b890 2024-04-26T20:25:46.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec80d6e90 con 0x55edc220b890 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcec4c00640 1 -- 172.21.15.82:0/517171589 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcec809a7e0 con 0x55edc220b890 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcec4c00640 1 -- 172.21.15.82:0/517171589 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcec80df070 con 0x55edc220b890 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcee4a26740 10 client.26485 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55edc2224b50 con 0x55edc220b890 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcec4c00640 1 -- 172.21.15.82:0/517171589 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80d6e90 con 0x55edc220b890 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.911+0000 7fcec4c00640 1 -- 172.21.15.82:0/517171589 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fcec80ce1c0 con 0x55edc220b890 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcee4a26740 10 client.26485 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcee4a26740 10 client.26485 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcee4a26740 20 client.26485 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcee4a26740 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc228f760 0x55edc2291b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcee4a26740 4 client.26485 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55edc21766f0 con 0x55edc228f760 2024-04-26T20:25:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.912+0000 7fcedaa00640 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc228f760 0x55edc2291b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.913+0000 7fcedaa00640 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc228f760 0x55edc2291b80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74e8ae82dc913b08 server_cookie=59d77cb1bd1a8435 in_seq=0 out_seq=0 2024-04-26T20:25:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.913+0000 7fcec4c00640 10 client.26485 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcec4c00640 1 -- 172.21.15.82:0/517171589 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55edc21766f0 con 0x55edc228f760 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcec4c00640 10 client.26485 handle_command_reply: tid=0 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 client.26485 shutdown 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 msgr2=0x55edc2222420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 0x55edc2222420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcec80d6ad0 tx=0x7fcec8005460 comp rx=0 tx=0).stop 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 shutdown_connections 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55edc228f760 0x55edc2291b80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edc2210a00 0x55edc2223430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edc220b890 0x55edc2222420 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcec80d6ad0 tx=0x7fcec8005460 comp rx=0 tx=0).stop 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 --2- 172.21.15.82:0/517171589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edc220aea0 0x55edc2221ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 >> 172.21.15.82:0/517171589 conn(0x55edc2206510 msgr2=0x55edc2209a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.915+0000 7fcec4c00640 0 client.26485 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.916+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 shutdown_connections 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.916+0000 7fcee4a26740 1 -- 172.21.15.82:0/517171589 wait complete. 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.916+0000 7fcee4a26740 20 client.26485 trim_cache size 0 max 16384 2024-04-26T20:25:46.919 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcec00a3c40 msgr2=0x7fcec00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcec00a3c40 0x7fcec00a6100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55edc220c0f0 tx=0x7fced4009500 comp rx=0 tx=0).stop 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 msgr2=0x7fcedc19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 0x7fcedc19b370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcec800e9f0 tx=0x7fcec800eeb0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 shutdown_connections 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fcec00a3c40 0x7fcec00a6100 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcedc106760 0x7fcedc1a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcedc105da0 0x7fcedc19b370 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 --2- 172.21.15.82:0/15227377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcedc104bb0 0x7fcedc19ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.917+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 >> 172.21.15.82:0/15227377 conn(0x7fcedc100120 msgr2=0x7fcedc109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.918+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 shutdown_connections 2024-04-26T20:25:46.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:46.918+0000 7fcee1c00640 1 -- 172.21.15.82:0/15227377 wait complete. 2024-04-26T20:25:46.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:25:47.004 INFO:tasks.workunit.client.0.smithi082.stdout: 66 475585 804 321465 711 88576 520 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 -- 172.21.15.82:0/2631199864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80105c50 msgr2=0x7f1d80108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 --2- 172.21.15.82:0/2631199864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80105c50 0x7f1d80108040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009900 tx=0x7f1d6c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 -- 172.21.15.82:0/2631199864 shutdown_connections 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 --2- 172.21.15.82:0/2631199864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d80108580 0x7f1d8010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 --2- 172.21.15.82:0/2631199864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80105c50 0x7f1d80108040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 --2- 172.21.15.82:0/2631199864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80103320 0x7f1d80105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 -- 172.21.15.82:0/2631199864 >> 172.21.15.82:0/2631199864 conn(0x7f1d800fccd0 msgr2=0x7f1d800ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 -- 172.21.15.82:0/2631199864 shutdown_connections 2024-04-26T20:25:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.130+0000 7f1d86200640 1 -- 172.21.15.82:0/2631199864 wait complete. 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.131+0000 7f1d86200640 1 Processor -- start 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 -- start start 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d80103320 0x7f1d80198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80105c50 0x7f1d80198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 0x7f1d801a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8010e340 con 0x7f1d80105c50 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8010e1c0 con 0x7f1d80103320 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d86200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8010e4c0 con 0x7f1d80108580 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80105c50 0x7f1d80198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.132+0000 7f1d85800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 0x7f1d801a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 0x7f1d801a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40670/0 (socket says 172.21.15.82:40670) 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 -- 172.21.15.82:0/1043756439 learned_addr learned my addr 172.21.15.82:0/1043756439 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80105c50 0x7f1d80198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42194/0 (socket says 172.21.15.82:42194) 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d84e00640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d80103320 0x7f1d80198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 -- 172.21.15.82:0/1043756439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d80103320 msgr2=0x7f1d80198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d80103320 0x7f1d80198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 -- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80105c50 msgr2=0x7f1d80198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80105c50 0x7f1d80198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 -- 172.21.15.82:0/1043756439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d801a0690 con 0x7f1d80108580 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d85800640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 0x7f1d801a0020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800eaa0 tx=0x7f1d7800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d7d600640 1 -- 172.21.15.82:0/1043756439 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800cdb0 con 0x7f1d80108580 2024-04-26T20:25:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d80101170 con 0x7f1d80108580 2024-04-26T20:25:47.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d7d600640 1 -- 172.21.15.82:0/1043756439 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d78005020 con 0x7f1d80108580 2024-04-26T20:25:47.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.133+0000 7f1d7d600640 1 -- 172.21.15.82:0/1043756439 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d780116d0 con 0x7f1d80108580 2024-04-26T20:25:47.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.134+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d80101640 con 0x7f1d80108580 2024-04-26T20:25:47.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.137+0000 7f1d8a665740 1 Processor -- start 2024-04-26T20:25:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.137+0000 7f1d7d600640 1 -- 172.21.15.82:0/1043756439 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1d780051d0 con 0x7f1d80108580 2024-04-26T20:25:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.137+0000 7f1d8a665740 1 -- start start 2024-04-26T20:25:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.137+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc92e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.137+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc92ea40 0x55efdc933540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.137+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc933bb0 0x55efdc936040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d8a665740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55efdc891c70 con 0x55efdc92ea40 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d8a665740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efdc84a980 con 0x55efdc933bb0 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d8a665740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55efdc88dc30 con 0x55efdc92e050 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc92e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc92ea40 0x55efdc933540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc92e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40684/0 (socket says 172.21.15.82:40684) 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 -- 172.21.15.82:0/821723880 learned_addr learned my addr 172.21.15.82:0/821723880 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc933bb0 0x55efdc936040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 -- 172.21.15.82:0/821723880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc933bb0 msgr2=0x55efdc936040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc933bb0 0x55efdc936040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 -- 172.21.15.82:0/821723880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc92ea40 msgr2=0x55efdc933540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc92ea40 0x55efdc933540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d7fe00640 1 -- 172.21.15.82:0/821723880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efdc8227b0 con 0x55efdc92e050 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.138+0000 7f1d84e00640 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc92ea40 0x55efdc933540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc92e470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006a5c0 tx=0x7f1d6c0046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ef2af1bc1e5028 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d72000640 1 -- 172.21.15.82:0/821723880 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c035040 con 0x55efdc92e050 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d72000640 1 -- 172.21.15.82:0/821723880 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d6c004040 con 0x55efdc92e050 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d72000640 1 -- 172.21.15.82:0/821723880 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c003a80 con 0x55efdc92e050 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d7d600640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d680a3c40 0x7f1d680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d7d600640 1 -- 172.21.15.82:0/1043756439 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1d780d0aa0 con 0x7f1d80108580 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.139+0000 7f1d84e00640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d680a3c40 0x7f1d680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 -- 172.21.15.82:0/821723880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 msgr2=0x55efdc92e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc92e470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006a5c0 tx=0x7f1d6c0046e0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 -- 172.21.15.82:0/821723880 shutdown_connections 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc933bb0 0x55efdc936040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc92ea40 0x55efdc933540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 --2- 172.21.15.82:0/821723880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc92e470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 -- 172.21.15.82:0/821723880 >> 172.21.15.82:0/821723880 conn(0x55efdc9296c0 msgr2=0x55efdc929ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 -- 172.21.15.82:0/821723880 shutdown_connections 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d8a665740 1 -- 172.21.15.82:0/821723880 wait complete. 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.140+0000 7f1d84e00640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d680a3c40 0x7f1d680a6100 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55efdc92ee40 tx=0x7f1d74014f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.141+0000 7f1d8a665740 1 -- start start 2024-04-26T20:25:47.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.141+0000 7f1d8a665740 1 Processor -- start 2024-04-26T20:25:47.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc948ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc949410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc950450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55efdc890f80 con 0x55efdc933bb0 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efdc83e260 con 0x55efdc92ea40 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55efdc8962a0 con 0x55efdc92e050 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d8a665740 10 client.0 _ll_register_callbacks cb 0x55efdc888960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc948ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc948ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40700/0 (socket says 172.21.15.82:40700) 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 -- 172.21.15.82:0/2892977230 learned_addr learned my addr 172.21.15.82:0/2892977230 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:47.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc949410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d85800640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc950450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 -- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 msgr2=0x55efdc949410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc949410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 -- 172.21.15.82:0/2892977230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 msgr2=0x55efdc950450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc950450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.142+0000 7f1d84e00640 1 -- 172.21.15.82:0/2892977230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efdc8201c0 con 0x55efdc92e050 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d84e00640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc948ed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009fd0 tx=0x7f1d74016040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0476e58c221dd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d66a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d66a00640 1 -- 172.21.15.82:0/2892977230 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74003b40 con 0x55efdc92e050 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d6c004040 con 0x55efdc92e050 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d66a00640 1 -- 172.21.15.82:0/2892977230 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1d74003ce0 con 0x55efdc92e050 2024-04-26T20:25:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d66a00640 1 -- 172.21.15.82:0/2892977230 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1d74039050 con 0x55efdc92e050 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d8a665740 10 client.26497 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.143+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55efdc5a33f0 con 0x55efdc92e050 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d66a00640 1 -- 172.21.15.82:0/2892977230 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d6c004040 con 0x55efdc92e050 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d66a00640 1 -- 172.21.15.82:0/2892977230 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f1d7401f420 con 0x55efdc92e050 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d8a665740 10 client.26497 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d8a665740 10 client.26497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d8a665740 20 client.26497 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d8a665740 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc954aa0 0x55efdc956f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d8a665740 4 client.26497 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.144+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efdc89f880 con 0x55efdc954aa0 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.145+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc954aa0 0x55efdc956f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.145+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc954aa0 0x55efdc956f60 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f1e0728bc7c868 server_cookie=bb8f872629a89236 in_seq=0 out_seq=0 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.145+0000 7f1d66a00640 10 client.26497 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d66a00640 1 -- 172.21.15.82:0/2892977230 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55efdc89f880 con 0x55efdc954aa0 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d66a00640 10 client.26497 handle_command_reply: tid=0 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 client.26497 shutdown 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 msgr2=0x55efdc948ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc948ed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009fd0 tx=0x7f1d74016040 comp rx=0 tx=0).stop 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 shutdown_connections 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc954aa0 0x55efdc956f60 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc950450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc949410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d66a00640 0 client.26497 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 --2- 172.21.15.82:0/2892977230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc948ed0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.146+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 >> 172.21.15.82:0/2892977230 conn(0x55efdc9296c0 msgr2=0x55efdc9287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:47.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.147+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 shutdown_connections 2024-04-26T20:25:47.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.147+0000 7f1d8a665740 1 -- 172.21.15.82:0/2892977230 wait complete. 2024-04-26T20:25:47.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.147+0000 7f1d8a665740 20 client.26497 trim_cache size 0 max 16384 2024-04-26T20:25:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.166+0000 7f1d8a665740 1 Processor -- start 2024-04-26T20:25:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 -- start start 2024-04-26T20:25:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc949150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc9503e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc92f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d801a0860 con 0x55efdc933bb0 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d801a2480 con 0x55efdc92ea40 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d8a665740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1d801a0e90 con 0x55efdc92e050 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc949150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc949150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40708/0 (socket says 172.21.15.82:40708) 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d84e00640 1 -- 172.21.15.82:0/990573611 learned_addr learned my addr 172.21.15.82:0/990573611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d85800640 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc92f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.167+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc9503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d84e00640 1 -- 172.21.15.82:0/990573611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 msgr2=0x55efdc9503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d84e00640 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc9503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d84e00640 1 -- 172.21.15.82:0/990573611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 msgr2=0x55efdc92f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d84e00640 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc92f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d84e00640 1 -- 172.21.15.82:0/990573611 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efdc66d7d0 con 0x55efdc92e050 2024-04-26T20:25:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d85800640 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc92f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d84e00640 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc949150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c010 tx=0x7f1d74004620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecfa6c20a5bba81c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d71600640 1 -- 172.21.15.82:0/990573611 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7401fd00 con 0x55efdc92e050 2024-04-26T20:25:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d71600640 1 -- 172.21.15.82:0/990573611 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d74044070 con 0x55efdc92e050 2024-04-26T20:25:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.168+0000 7f1d71600640 1 -- 172.21.15.82:0/990573611 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d740356b0 con 0x55efdc92e050 2024-04-26T20:25:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 -- 172.21.15.82:0/990573611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 msgr2=0x55efdc949150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc949150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c010 tx=0x7f1d74004620 comp rx=0 tx=0).stop 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 -- 172.21.15.82:0/990573611 shutdown_connections 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc92f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc9503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 --2- 172.21.15.82:0/990573611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc949150 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 -- 172.21.15.82:0/990573611 >> 172.21.15.82:0/990573611 conn(0x55efdc9296c0 msgr2=0x55efdc9287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.169+0000 7f1d8a665740 1 -- 172.21.15.82:0/990573611 shutdown_connections 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.170+0000 7f1d8a665740 1 -- 172.21.15.82:0/990573611 wait complete. 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.170+0000 7f1d8a665740 1 -- start start 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.170+0000 7f1d8a665740 1 Processor -- start 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc94de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc94e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc94f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d801a1cf0 con 0x55efdc933bb0 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d801a1560 con 0x55efdc92ea40 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1d80072a90 con 0x55efdc92e050 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d8a665740 10 client.0 _ll_register_callbacks cb 0x7f1d74009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc94de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc94de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40724/0 (socket says 172.21.15.82:40724) 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 -- 172.21.15.82:0/3692653752 learned_addr learned my addr 172.21.15.82:0/3692653752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc94e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 -- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 msgr2=0x55efdc94e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc94e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 -- 172.21.15.82:0/3692653752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 msgr2=0x55efdc94f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc94f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.171+0000 7f1d84e00640 1 -- 172.21.15.82:0/3692653752 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efdc8382a0 con 0x55efdc92e050 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.172+0000 7f1d84e00640 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc94de60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d74005bf0 tx=0x7f1d74004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d122eedd5457cb8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.172+0000 7f1d66a00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.172+0000 7f1d66a00640 1 -- 172.21.15.82:0/3692653752 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74003b40 con 0x55efdc92e050 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.172+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d74044070 con 0x55efdc92e050 2024-04-26T20:25:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.172+0000 7f1d66a00640 1 -- 172.21.15.82:0/3692653752 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f1d74003ce0 con 0x55efdc92e050 2024-04-26T20:25:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.172+0000 7f1d66a00640 1 -- 172.21.15.82:0/3692653752 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1d74005040 con 0x55efdc92e050 2024-04-26T20:25:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 10 client.26503 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55efdc9bb220 con 0x55efdc92e050 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d66a00640 1 -- 172.21.15.82:0/3692653752 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d74044070 con 0x55efdc92e050 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d66a00640 1 -- 172.21.15.82:0/3692653752 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f1d74021450 con 0x55efdc92e050 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 10 client.26503 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 10 client.26503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 20 client.26503 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc9bbc80 0x55efdc9be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 4 client.26503 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.173+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efdc8996f0 con 0x55efdc9bbc80 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.174+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc9bbc80 0x55efdc9be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.175+0000 7f1d7fe00640 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc9bbc80 0x55efdc9be0a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259efc4cbb10bd80 server_cookie=48946adeed985282 in_seq=0 out_seq=0 2024-04-26T20:25:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.175+0000 7f1d66a00640 10 client.26503 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d66a00640 1 -- 172.21.15.82:0/3692653752 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55efdc8996f0 con 0x55efdc9bbc80 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d66a00640 10 client.26503 handle_command_reply: tid=0 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 client.26503 shutdown 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 msgr2=0x55efdc94de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc94de60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d74005bf0 tx=0x7f1d74004480 comp rx=0 tx=0).stop 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 shutdown_connections 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55efdc9bbc80 0x55efdc9be0a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efdc933bb0 0x55efdc94f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efdc92ea40 0x55efdc94e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 --2- 172.21.15.82:0/3692653752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efdc92e050 0x55efdc94de60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 >> 172.21.15.82:0/3692653752 conn(0x55efdc9296c0 msgr2=0x55efdc9287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d66a00640 0 client.26503 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 shutdown_connections 2024-04-26T20:25:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.179+0000 7f1d8a665740 1 -- 172.21.15.82:0/3692653752 wait complete. 2024-04-26T20:25:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d8a665740 20 client.26503 trim_cache size 0 max 16384 2024-04-26T20:25:47.182 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d680a3c40 msgr2=0x7f1d680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d680a3c40 0x7f1d680a6100 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55efdc92ee40 tx=0x7f1d74014f90 comp rx=0 tx=0).stop 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 msgr2=0x7f1d801a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 0x7f1d801a0020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800eaa0 tx=0x7f1d7800ef60 comp rx=0 tx=0).stop 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 shutdown_connections 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d680a3c40 0x7f1d680a6100 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d80108580 0x7f1d801a0020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d80105c50 0x7f1d80198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 --2- 172.21.15.82:0/1043756439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d80103320 0x7f1d80198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:47.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.180+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 >> 172.21.15.82:0/1043756439 conn(0x7f1d800fccd0 msgr2=0x7f1d80103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:47.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.181+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 shutdown_connections 2024-04-26T20:25:47.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:47.181+0000 7f1d86200640 1 -- 172.21.15.82:0/1043756439 wait complete. 2024-04-26T20:25:48.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:47 smithi139 ceph-mon[32999]: pgmap v501: 129 pgs: 129 active+clean; 171 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 189 op/s 2024-04-26T20:25:48.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:47 smithi135 ceph-mon[32816]: pgmap v501: 129 pgs: 129 active+clean; 171 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 189 op/s 2024-04-26T20:25:48.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:47 smithi082 ceph-mon[28105]: pgmap v501: 129 pgs: 129 active+clean; 171 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 189 op/s 2024-04-26T20:25:48.201 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:25:48.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:25:48.201 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:25:50.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:49 smithi139 ceph-mon[32999]: pgmap v502: 129 pgs: 129 active+clean; 174 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 187 op/s 2024-04-26T20:25:50.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:49 smithi135 ceph-mon[32816]: pgmap v502: 129 pgs: 129 active+clean; 174 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 187 op/s 2024-04-26T20:25:50.214 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:49 smithi082 ceph-mon[28105]: pgmap v502: 129 pgs: 129 active+clean; 174 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 187 op/s 2024-04-26T20:25:50.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.522+0000 7f4bffc00640 1 -- 172.21.15.82:0/3417307520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 msgr2=0x7f4bf810bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.522+0000 7f4bffc00640 1 --2- 172.21.15.82:0/3417307520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf810bd60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009950 tx=0x7f4be802a480 comp rx=0 tx=0).stop 2024-04-26T20:25:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.524+0000 7f4bffc00640 1 -- 172.21.15.82:0/3417307520 shutdown_connections 2024-04-26T20:25:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.525+0000 7f4bffc00640 1 --2- 172.21.15.82:0/3417307520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf810ec70 0x7f4bf810f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.525+0000 7f4bffc00640 1 --2- 172.21.15.82:0/3417307520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810c2a0 0x7f4bf810e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.525+0000 7f4bffc00640 1 --2- 172.21.15.82:0/3417307520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf810bd60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.525+0000 7f4bffc00640 1 -- 172.21.15.82:0/3417307520 >> 172.21.15.82:0/3417307520 conn(0x7f4bf806f7c0 msgr2=0x7f4bf8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.525+0000 7f4bffc00640 1 -- 172.21.15.82:0/3417307520 shutdown_connections 2024-04-26T20:25:50.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.526+0000 7f4bffc00640 1 -- 172.21.15.82:0/3417307520 wait complete. 2024-04-26T20:25:50.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.530+0000 7f4bffc00640 1 Processor -- start 2024-04-26T20:25:50.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.530+0000 7f4bffc00640 1 -- start start 2024-04-26T20:25:50.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.532+0000 7f4bffc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf81a7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.532+0000 7f4bfd200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf81a7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.532+0000 7f4bfd200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf81a7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42230/0 (socket says 172.21.15.82:42230) 2024-04-26T20:25:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.532+0000 7f4bfd200640 1 -- 172.21.15.82:0/2338310242 learned_addr learned my addr 172.21.15.82:0/2338310242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.538+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf810c2a0 0x7f4bf81a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.538+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810ec70 0x7f4bf81af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.538+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf811d390 con 0x7f4bf8109930 2024-04-26T20:25:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.538+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf811d210 con 0x7f4bf810c2a0 2024-04-26T20:25:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.538+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf811d510 con 0x7f4bf810ec70 2024-04-26T20:25:50.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.539+0000 7f4bfdc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810ec70 0x7f4bf81af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.539+0000 7f4bfdc00640 1 -- 172.21.15.82:0/2338310242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf810c2a0 msgr2=0x7f4bf81a7fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:25:50.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.539+0000 7f4bfdc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf810c2a0 0x7f4bf81a7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.540+0000 7f4bfdc00640 1 -- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 msgr2=0x7f4bf81a7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.540+0000 7f4bfdc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf81a7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.540+0000 7f4bfdc00640 1 -- 172.21.15.82:0/2338310242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf81af6b0 con 0x7f4bf810ec70 2024-04-26T20:25:50.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.540+0000 7f4bfd200640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf81a7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:50.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.540+0000 7f4bfdc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810ec70 0x7f4bf81af040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000bdd0 tx=0x7f4bf0009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:50.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.541+0000 7f4bf5600640 1 -- 172.21.15.82:0/2338310242 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0019070 con 0x7f4bf810ec70 2024-04-26T20:25:50.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.541+0000 7f4bf5600640 1 -- 172.21.15.82:0/2338310242 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bf000cdf0 con 0x7f4bf810ec70 2024-04-26T20:25:50.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.541+0000 7f4bf5600640 1 -- 172.21.15.82:0/2338310242 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0012920 con 0x7f4bf810ec70 2024-04-26T20:25:50.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.541+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf81af9a0 con 0x7f4bf810ec70 2024-04-26T20:25:50.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.541+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81aff20 con 0x7f4bf810ec70 2024-04-26T20:25:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.547+0000 7f4c02a08740 1 Processor -- start 2024-04-26T20:25:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.548+0000 7f4bf5600640 1 -- 172.21.15.82:0/2338310242 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4bf001c070 con 0x7f4bf810ec70 2024-04-26T20:25:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.549+0000 7f4c02a08740 1 -- start start 2024-04-26T20:25:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.552+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75186c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.552+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d7518bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.552+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d7518c3c0 0x555d7518e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.552+0000 7f4c02a08740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d750eb980 con 0x555d75186860 2024-04-26T20:25:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.552+0000 7f4c02a08740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555d75088220 con 0x555d7518c3c0 2024-04-26T20:25:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.552+0000 7f4c02a08740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555d750e7940 con 0x555d75187250 2024-04-26T20:25:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.553+0000 7f4bfd200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d7518bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.553+0000 7f4bfd200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d7518bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40754/0 (socket says 172.21.15.82:40754) 2024-04-26T20:25:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.553+0000 7f4bfd200640 1 -- 172.21.15.82:0/1369866664 learned_addr learned my addr 172.21.15.82:0/1369866664 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.553+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75186c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bf5600640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4bdc0a3e10 0x7f4bdc0a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1369866664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 msgr2=0x555d7518bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d7518bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1369866664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d7518c3c0 msgr2=0x555d7518e850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:50.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d7518c3c0 0x555d7518e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1369866664 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d74ec57e0 con 0x555d75186860 2024-04-26T20:25:50.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.554+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d7518bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.555+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75186c80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8074230 tx=0x7f4be400e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a35c33fb6797cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.555+0000 7f4bee000640 1 -- 172.21.15.82:0/1369866664 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be400eca0 con 0x555d75186860 2024-04-26T20:25:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.556+0000 7f4bee000640 1 -- 172.21.15.82:0/1369866664 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be400ee40 con 0x555d75186860 2024-04-26T20:25:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.556+0000 7f4bee000640 1 -- 172.21.15.82:0/1369866664 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be400eca0 con 0x555d75186860 2024-04-26T20:25:50.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.556+0000 7f4bfdc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4bdc0a3e10 0x7f4bdc0a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.557+0000 7f4bf5600640 1 -- 172.21.15.82:0/2338310242 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4bf00cfec0 con 0x7f4bf810ec70 2024-04-26T20:25:50.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.560+0000 7f4c02a08740 1 -- 172.21.15.82:0/1369866664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 msgr2=0x555d75186c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.560+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75186c80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8074230 tx=0x7f4be400e350 comp rx=0 tx=0).stop 2024-04-26T20:25:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.561+0000 7f4bfdc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4bdc0a3e10 0x7f4bdc0a62d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00a44d0 tx=0x7f4bf0066370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.561+0000 7f4c02a08740 1 -- 172.21.15.82:0/1369866664 shutdown_connections 2024-04-26T20:25:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.561+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d7518c3c0 0x555d7518e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.561+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d7518bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.561+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1369866664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75186c80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.561+0000 7f4c02a08740 1 -- 172.21.15.82:0/1369866664 >> 172.21.15.82:0/1369866664 conn(0x555d75181ed0 msgr2=0x555d751822d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:50.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.562+0000 7f4c02a08740 1 -- 172.21.15.82:0/1369866664 shutdown_connections 2024-04-26T20:25:50.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.562+0000 7f4c02a08740 1 -- 172.21.15.82:0/1369866664 wait complete. 2024-04-26T20:25:50.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.563+0000 7f4c02a08740 1 -- start start 2024-04-26T20:25:50.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.564+0000 7f4c02a08740 1 Processor -- start 2024-04-26T20:25:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.565+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75190d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.566+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d75191280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.567+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 0x555d751982c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.567+0000 7f4c02a08740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d7518f370 con 0x555d7518c3c0 2024-04-26T20:25:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.567+0000 7f4c02a08740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555d75073170 con 0x555d75187250 2024-04-26T20:25:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.567+0000 7f4c02a08740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555d7518f4f0 con 0x555d75186860 2024-04-26T20:25:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.567+0000 7f4c02a08740 10 client.0 _ll_register_callbacks cb 0x555d750e2770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.570+0000 7f4bfd200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d75191280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.571+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75190d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.571+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 0x555d751982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 0x555d751982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42234/0 (socket says 172.21.15.82:42234) 2024-04-26T20:25:50.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1560615176 learned_addr learned my addr 172.21.15.82:0/1560615176 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1560615176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 msgr2=0x555d75190d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75190d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 msgr2=0x555d75191280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d75191280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.572+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1560615176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d74f25f70 con 0x555d7518c3c0 2024-04-26T20:25:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.573+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 0x555d751982c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004b00 tx=0x7f4be4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977479ae61f1ded7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.578+0000 7f4be2a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.579+0000 7f4be2a00640 1 -- 172.21.15.82:0/1560615176 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be402a060 con 0x555d7518c3c0 2024-04-26T20:25:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.579+0000 7f4be2a00640 1 -- 172.21.15.82:0/1560615176 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4be40055b0 con 0x555d7518c3c0 2024-04-26T20:25:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.584+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4be400ee40 con 0x555d7518c3c0 2024-04-26T20:25:50.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.586+0000 7f4be2a00640 1 -- 172.21.15.82:0/1560615176 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4be4010430 con 0x555d7518c3c0 2024-04-26T20:25:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.587+0000 7f4c02a08740 10 client.16365 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.587+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555d74dbd170 con 0x555d7518c3c0 2024-04-26T20:25:50.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.587+0000 7f4be2a00640 1 -- 172.21.15.82:0/1560615176 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be400ee40 con 0x555d7518c3c0 2024-04-26T20:25:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.592+0000 7f4be2a00640 1 -- 172.21.15.82:0/1560615176 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f4be40187d0 con 0x555d7518c3c0 2024-04-26T20:25:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.595+0000 7f4c02a08740 10 client.16365 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.595+0000 7f4c02a08740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.595+0000 7f4c02a08740 20 client.16365 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.595+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d7519c4a0 0x555d7519e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.595+0000 7f4c02a08740 4 client.16365 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:50.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.595+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d750f9590 con 0x555d7519c4a0 2024-04-26T20:25:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.596+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d7519c4a0 0x555d7519e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.601+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d7519c4a0 0x555d7519e890 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce4e8a99d3a442a0 server_cookie=bb4c3b0fa6450ff0 in_seq=0 out_seq=0 2024-04-26T20:25:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.602+0000 7f4be2a00640 10 client.16365 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.602+0000 7f4be2a00640 1 -- 172.21.15.82:0/1560615176 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555d750f9590 con 0x555d7519c4a0 2024-04-26T20:25:50.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.602+0000 7f4be2a00640 10 client.16365 handle_command_reply: tid=0 2024-04-26T20:25:50.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.602+0000 7f4c02a08740 1 client.16365 shutdown 2024-04-26T20:25:50.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 msgr2=0x555d751982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 0x555d751982c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004b00 tx=0x7f4be4005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 shutdown_connections 2024-04-26T20:25:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d7519c4a0 0x555d7519e890 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d7518c3c0 0x555d751982c0 secure :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004b00 tx=0x7f4be4005f90 comp rx=0 tx=0).stop 2024-04-26T20:25:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d75191280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1560615176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75190d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.606+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 >> 172.21.15.82:0/1560615176 conn(0x555d75181ed0 msgr2=0x555d75180ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.612+0000 7f4be2a00640 0 client.16365 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.613+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 shutdown_connections 2024-04-26T20:25:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.613+0000 7f4c02a08740 1 -- 172.21.15.82:0/1560615176 wait complete. 2024-04-26T20:25:50.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.613+0000 7f4c02a08740 20 client.16365 trim_cache size 0 max 16384 2024-04-26T20:25:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.813+0000 7f4c02a08740 1 Processor -- start 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 -- start start 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75184f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d751981e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75188dc0 0x555d75185470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81ba2e0 con 0x555d75188dc0 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81bbfa0 con 0x555d75187250 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.821+0000 7f4c02a08740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81ba9b0 con 0x555d75186860 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.824+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75184f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.824+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75184f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44502/0 (socket says 172.21.15.82:44502) 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.824+0000 7f4bf7e00640 1 -- 172.21.15.82:0/1277111183 learned_addr learned my addr 172.21.15.82:0/1277111183 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75188dc0 0x555d75185470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d751981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bfd200640 1 -- 172.21.15.82:0/1277111183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 msgr2=0x555d75184f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75184f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bfd200640 1 -- 172.21.15.82:0/1277111183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75188dc0 msgr2=0x555d75185470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75188dc0 0x555d75185470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.825+0000 7f4bfd200640 1 -- 172.21.15.82:0/1277111183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d75191d90 con 0x555d75187250 2024-04-26T20:25:50.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.833+0000 7f4bfd200640 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d751981e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4be802aa70 tx=0x7f4be80314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a04decd4b6b9e48c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.837+0000 7f4bed600640 1 -- 172.21.15.82:0/1277111183 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be804b070 con 0x555d75187250 2024-04-26T20:25:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.837+0000 7f4bed600640 1 -- 172.21.15.82:0/1277111183 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be8045710 con 0x555d75187250 2024-04-26T20:25:50.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.837+0000 7f4bed600640 1 -- 172.21.15.82:0/1277111183 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8035030 con 0x555d75187250 2024-04-26T20:25:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.839+0000 7f4c02a08740 1 -- 172.21.15.82:0/1277111183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 msgr2=0x555d751981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.839+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d751981e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4be802aa70 tx=0x7f4be80314a0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.850+0000 7f4c02a08740 1 -- 172.21.15.82:0/1277111183 shutdown_connections 2024-04-26T20:25:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.850+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75188dc0 0x555d75185470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.850+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75187250 0x555d751981e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.850+0000 7f4c02a08740 1 --2- 172.21.15.82:0/1277111183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75186860 0x555d75184f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.850+0000 7f4c02a08740 1 -- 172.21.15.82:0/1277111183 >> 172.21.15.82:0/1277111183 conn(0x555d75181ed0 msgr2=0x555d751886b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.887+0000 7f4c02a08740 1 -- 172.21.15.82:0/1277111183 shutdown_connections 2024-04-26T20:25:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.887+0000 7f4c02a08740 1 -- 172.21.15.82:0/1277111183 wait complete. 2024-04-26T20:25:50.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.888+0000 7f4c02a08740 1 -- start start 2024-04-26T20:25:50.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.889+0000 7f4c02a08740 1 Processor -- start 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75196140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d75196680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75188dc0 0x555d75197690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81bb810 con 0x555d75186860 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81bb080 con 0x555d75188dc0 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81b82c0 con 0x555d75187250 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.898+0000 7f4c02a08740 10 client.0 _ll_register_callbacks cb 0x7f4be40099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.899+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.899+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42220/0 (socket says 172.21.15.82:42220) 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.899+0000 7f4bf7e00640 1 -- 172.21.15.82:0/3383393154 learned_addr learned my addr 172.21.15.82:0/3383393154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:50.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.899+0000 7f4bfd200640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d75196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.899+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75188dc0 0x555d75197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.900+0000 7f4bf7e00640 1 -- 172.21.15.82:0/3383393154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 msgr2=0x555d75196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.900+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d75196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.900+0000 7f4bf7e00640 1 -- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75188dc0 msgr2=0x555d75197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.900+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75188dc0 0x555d75197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.900+0000 7f4bf7e00640 1 -- 172.21.15.82:0/3383393154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d75197c80 con 0x555d75186860 2024-04-26T20:25:50.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.900+0000 7f4bfd200640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d75196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:50.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.901+0000 7f4bf7e00640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75196140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004fa0 tx=0x7f4be4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b152f0feb36911f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:50.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.911+0000 7f4be2a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:50.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.911+0000 7f4be2a00640 1 -- 172.21.15.82:0/3383393154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be402a070 con 0x555d75186860 2024-04-26T20:25:50.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.911+0000 7f4be2a00640 1 -- 172.21.15.82:0/3383393154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4be4005430 con 0x555d75186860 2024-04-26T20:25:50.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.923+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4be8045710 con 0x555d75186860 2024-04-26T20:25:50.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.930+0000 7f4be2a00640 1 -- 172.21.15.82:0/3383393154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4be4005630 con 0x555d75186860 2024-04-26T20:25:50.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.937+0000 7f4c02a08740 10 client.16368 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:50.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.937+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555d752032a0 con 0x555d75186860 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.937+0000 7f4be2a00640 1 -- 172.21.15.82:0/3383393154 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4be8045710 con 0x555d75186860 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.937+0000 7f4be2a00640 1 -- 172.21.15.82:0/3383393154 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f4be40106e0 con 0x555d75186860 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4c02a08740 10 client.16368 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4c02a08740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4c02a08740 20 client.16368 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4c02a08740 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d75203d30 0x555d75206150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4c02a08740 4 client.16368 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:25:50.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555d750f3400 con 0x555d75203d30 2024-04-26T20:25:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.938+0000 7f4bfd200640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d75203d30 0x555d75206150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.939+0000 7f4bfd200640 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d75203d30 0x555d75206150 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36be079890d1f708 server_cookie=4421742a501e5e9f in_seq=0 out_seq=0 2024-04-26T20:25:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.939+0000 7f4be2a00640 10 client.16368 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.940+0000 7f4be2a00640 1 -- 172.21.15.82:0/3383393154 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555d750f3400 con 0x555d75203d30 2024-04-26T20:25:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.940+0000 7f4be2a00640 10 client.16368 handle_command_reply: tid=0 2024-04-26T20:25:50.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.940+0000 7f4c02a08740 1 client.16368 shutdown 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 msgr2=0x555d75196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75196140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004fa0 tx=0x7f4be4004db0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 shutdown_connections 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555d75203d30 0x555d75206150 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555d75188dc0 0x555d75197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555d75187250 0x555d75196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 --2- 172.21.15.82:0/3383393154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d75186860 0x555d75196140 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.945+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 >> 172.21.15.82:0/3383393154 conn(0x555d75181ed0 msgr2=0x555d75184f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:50.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.947+0000 7f4be2a00640 0 client.16368 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:50.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.957+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 shutdown_connections 2024-04-26T20:25:50.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.983+0000 7f4c02a08740 1 -- 172.21.15.82:0/3383393154 wait complete. 2024-04-26T20:25:50.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.983+0000 7f4c02a08740 20 client.16368 trim_cache size 0 max 16384 2024-04-26T20:25:50.995 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:25:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:25:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "9f83af18-a549-4553-b420-585f9ca371a0", 2024-04-26T20:25:50.995 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:25:50.995 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.996+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4bdc0a3e10 msgr2=0x7f4bdc0a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.996+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4bdc0a3e10 0x7f4bdc0a62d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00a44d0 tx=0x7f4bf0066370 comp rx=0 tx=0).stop 2024-04-26T20:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.996+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810ec70 msgr2=0x7f4bf81af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.996+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810ec70 0x7f4bf81af040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000bdd0 tx=0x7f4bf0009ed0 comp rx=0 tx=0).stop 2024-04-26T20:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.997+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 shutdown_connections 2024-04-26T20:25:51.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.997+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4bdc0a3e10 0x7f4bdc0a62d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.997+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4bf810ec70 0x7f4bf81af040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.997+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf810c2a0 0x7f4bf81a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.997+0000 7f4bffc00640 1 --2- 172.21.15.82:0/2338310242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bf8109930 0x7f4bf81a7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:50.997+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 >> 172.21.15.82:0/2338310242 conn(0x7f4bf806f7c0 msgr2=0x7f4bf810c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.006+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 shutdown_connections 2024-04-26T20:25:51.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.006+0000 7f4bffc00640 1 -- 172.21.15.82:0/2338310242 wait complete. 2024-04-26T20:25:51.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:25:51.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:25:51.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.613+0000 7f447b200640 1 -- 172.21.15.82:0/3569026674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c10a9b0 msgr2=0x7f447c10f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.613+0000 7f447b200640 1 --2- 172.21.15.82:0/3569026674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c10a9b0 0x7f447c10f270 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f44680098b0 tx=0x7f446802a3b0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.613+0000 7f447b200640 1 -- 172.21.15.82:0/3569026674 shutdown_connections 2024-04-26T20:25:51.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.614+0000 7f447b200640 1 --2- 172.21.15.82:0/3569026674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c10a9b0 0x7f447c10f270 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.614+0000 7f447b200640 1 --2- 172.21.15.82:0/3569026674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a010 0x7f447c10a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.614+0000 7f447b200640 1 --2- 172.21.15.82:0/3569026674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f447c073d70 0x7f447c074190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.614+0000 7f447b200640 1 -- 172.21.15.82:0/3569026674 >> 172.21.15.82:0/3569026674 conn(0x7f447c06f840 msgr2=0x7f447c071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.614+0000 7f447b200640 1 -- 172.21.15.82:0/3569026674 shutdown_connections 2024-04-26T20:25:51.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.616+0000 7f447b200640 1 -- 172.21.15.82:0/3569026674 wait complete. 2024-04-26T20:25:51.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.618+0000 7f447b200640 1 Processor -- start 2024-04-26T20:25:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.619+0000 7f447b200640 1 -- start start 2024-04-26T20:25:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.620+0000 7f447b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c073d70 0x7f447c1a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f447c10a010 0x7f447c1a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 0x7f447c1aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f447c11d1d0 con 0x7f447c073d70 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f447c11d050 con 0x7f447c10a9b0 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f447c11d350 con 0x7f447c10a010 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 0x7f447c1aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 0x7f447c1aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59676/0 (socket says 172.21.15.82:59676) 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.621+0000 7f447a800640 1 -- 172.21.15.82:0/1425117088 learned_addr learned my addr 172.21.15.82:0/1425117088 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.622+0000 7f4479400640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f447c10a010 0x7f447c1a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.622+0000 7f447a800640 1 -- 172.21.15.82:0/1425117088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f447c10a010 msgr2=0x7f447c1a7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.622+0000 7f447a800640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f447c10a010 0x7f447c1a7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.622+0000 7f447a800640 1 -- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c073d70 msgr2=0x7f447c1a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.622+0000 7f447a800640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c073d70 0x7f447c1a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.622+0000 7f447a800640 1 -- 172.21.15.82:0/1425117088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c1af4f0 con 0x7f447c10a9b0 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.623+0000 7f447a800640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 0x7f447c1aee80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f44680097d0 tx=0x7f4468032cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.623+0000 7f4472a00640 1 -- 172.21.15.82:0/1425117088 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468037070 con 0x7f447c10a9b0 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.623+0000 7f4472a00640 1 -- 172.21.15.82:0/1425117088 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4468038040 con 0x7f447c10a9b0 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.623+0000 7f4472a00640 1 -- 172.21.15.82:0/1425117088 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468004920 con 0x7f447c10a9b0 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.623+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c1af780 con 0x7f447c10a9b0 2024-04-26T20:25:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.624+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1afc20 con 0x7f447c10a9b0 2024-04-26T20:25:51.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.634+0000 7f4472a00640 1 -- 172.21.15.82:0/1425117088 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4468004030 con 0x7f447c10a9b0 2024-04-26T20:25:51.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.650+0000 7f4483c2c740 1 Processor -- start 2024-04-26T20:25:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.655+0000 7f4483c2c740 1 -- start start 2024-04-26T20:25:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.656+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e001d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.656+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.656+0000 7f4472a00640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f44600a3d80 0x7f44600a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.656+0000 7f4472a00640 1 -- 172.21.15.82:0/1425117088 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f44680f0b20 con 0x7f447c10a9b0 2024-04-26T20:25:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.657+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e0074c0 0x55d31e009950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.657+0000 7f4479e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.658+0000 7f4479e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59682/0 (socket says 172.21.15.82:59682) 2024-04-26T20:25:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.658+0000 7f4479e00640 1 -- 172.21.15.82:0/3447567647 learned_addr learned my addr 172.21.15.82:0/3447567647 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.658+0000 7f447a800640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e0074c0 0x55d31e009950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.658+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d31df12030 con 0x55d31e001960 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.659+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d31df2d7f0 con 0x55d31e002350 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.659+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d31dee87e0 con 0x55d31e0074c0 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.659+0000 7f4479400640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e001d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.662+0000 7f4479400640 1 -- 172.21.15.82:0/3447567647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e0074c0 msgr2=0x55d31e009950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.662+0000 7f4479400640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e0074c0 0x55d31e009950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.662+0000 7f4479400640 1 -- 172.21.15.82:0/3447567647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 msgr2=0x55d31e006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.662+0000 7f4479400640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.662+0000 7f4479400640 1 -- 172.21.15.82:0/3447567647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31def4050 con 0x55d31e001960 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.663+0000 7f4479400640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e001d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f447c1a8de0 tx=0x7f44740119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c260a34ba388142 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.664+0000 7f4479e00640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.664+0000 7f447a800640 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e0074c0 0x55d31e009950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.665+0000 7f4479400640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f44600a3d80 0x7f44600a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.665+0000 7f4467400640 1 -- 172.21.15.82:0/3447567647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447401f070 con 0x55d31e001960 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.665+0000 7f4467400640 1 -- 172.21.15.82:0/3447567647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447400c9c0 con 0x55d31e001960 2024-04-26T20:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.665+0000 7f4467400640 1 -- 172.21.15.82:0/3447567647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447401aa00 con 0x55d31e001960 2024-04-26T20:25:51.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.666+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 msgr2=0x55d31e001d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.666+0000 7f4483c2c740 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e001d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f447c1a8de0 tx=0x7f44740119b0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.668+0000 7f4479400640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f44600a3d80 0x7f44600a6240 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4474000f80 tx=0x7f447401aba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:51.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.668+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 shutdown_connections 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.668+0000 7f4483c2c740 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e0074c0 0x55d31e009950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.668+0000 7f4483c2c740 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.668+0000 7f4483c2c740 1 --2- 172.21.15.82:0/3447567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e001d80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.668+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 >> 172.21.15.82:0/3447567647 conn(0x55d31dffcfd0 msgr2=0x55d31dffd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.669+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 shutdown_connections 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.669+0000 7f4483c2c740 1 -- 172.21.15.82:0/3447567647 wait complete. 2024-04-26T20:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.669+0000 7f4483c2c740 1 -- start start 2024-04-26T20:25:51.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.670+0000 7f4483c2c740 1 Processor -- start 2024-04-26T20:25:51.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.671+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e00b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.672+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e00b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.672+0000 7f4479e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e00b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.673+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 0x55d31e012a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.673+0000 7f4479400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e00b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.673+0000 7f4483c2c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d31df6a200 con 0x55d31e001960 2024-04-26T20:25:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.673+0000 7f4483c2c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d31df64ee0 con 0x55d31e0074c0 2024-04-26T20:25:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.673+0000 7f4483c2c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d31df71e70 con 0x55d31e002350 2024-04-26T20:25:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.673+0000 7f447a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 0x55d31e012a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 0x55d31e012a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59684/0 (socket says 172.21.15.82:59684) 2024-04-26T20:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 -- 172.21.15.82:0/1764425643 learned_addr learned my addr 172.21.15.82:0/1764425643 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 -- 172.21.15.82:0/1764425643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 msgr2=0x55d31e00b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e00b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 -- 172.21.15.82:0/1764425643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 msgr2=0x55d31e00b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e00b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f447a800640 1 -- 172.21.15.82:0/1764425643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31dd417d0 con 0x55d31e0074c0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.674+0000 7f4483c2c740 10 client.0 _ll_register_callbacks cb 0x55d31df5b270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.675+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f447400c9c0 con 0x55d31e0074c0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.675+0000 7f447a800640 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 0x55d31e012a30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44680c5130 tx=0x7f44680bc350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c3225cf3014efb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.676+0000 7f445be00640 10 client.26489 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.676+0000 7f445be00640 1 -- 172.21.15.82:0/1764425643 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44680bce50 con 0x55d31e0074c0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.676+0000 7f445be00640 1 -- 172.21.15.82:0/1764425643 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f44680c51d0 con 0x55d31e0074c0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.676+0000 7f445be00640 1 -- 172.21.15.82:0/1764425643 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f44680c53f0 con 0x55d31e0074c0 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.676+0000 7f4483c2c740 10 client.26489 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.676+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55d31dc773f0 con 0x55d31e0074c0 2024-04-26T20:25:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f445be00640 1 -- 172.21.15.82:0/1764425643 <== mon.2 v2:172.21.15.135:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f44680dbbb0 con 0x55d31e0074c0 2024-04-26T20:25:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f4483c2c740 10 client.26489 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f4483c2c740 10 client.26489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f4483c2c740 20 client.26489 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f4483c2c740 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e016d90 0x55d31e019250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f4483c2c740 4 client.26489 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.677+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d31df737e0 con 0x55d31e016d90 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.678+0000 7f4479e00640 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e016d90 0x55d31e019250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.680+0000 7f4479e00640 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e016d90 0x55d31e019250 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b2dd5e6b00b40 server_cookie=b957e43c8d35ba4b in_seq=0 out_seq=0 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.680+0000 7f445be00640 10 client.26489 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.681+0000 7f445be00640 1 -- 172.21.15.82:0/1764425643 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d31df737e0 con 0x55d31e016d90 2024-04-26T20:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.681+0000 7f445be00640 10 client.26489 handle_command_reply: tid=0 2024-04-26T20:25:51.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.683+0000 7f4483c2c740 1 client.26489 shutdown 2024-04-26T20:25:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.683+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 msgr2=0x55d31e012a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.683+0000 7f4483c2c740 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 0x55d31e012a30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44680c5130 tx=0x7f44680bc350 comp rx=0 tx=0).stop 2024-04-26T20:25:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 shutdown_connections 2024-04-26T20:25:51.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e016d90 0x55d31e019250 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e0074c0 0x55d31e012a30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e00b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 --2- 172.21.15.82:0/1764425643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31e001960 0x55d31e00b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 >> 172.21.15.82:0/1764425643 conn(0x55d31dffcfd0 msgr2=0x55d31dffc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f445be00640 0 client.26489 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 shutdown_connections 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.684+0000 7f4483c2c740 1 -- 172.21.15.82:0/1764425643 wait complete. 2024-04-26T20:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.685+0000 7f4483c2c740 20 client.26489 trim_cache size 0 max 16384 2024-04-26T20:25:51.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.787+0000 7f4483c2c740 1 Processor -- start 2024-04-26T20:25:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.787+0000 7f4483c2c740 1 -- start start 2024-04-26T20:25:51.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.788+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.788+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e001960 0x55d31e0129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e003680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4483c2c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1bbe80 con 0x55d31dffcfd0 2024-04-26T20:25:51.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4483c2c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1ba890 con 0x55d31e002350 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4483c2c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1baf60 con 0x55d31e001960 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4479e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4479e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42266/0 (socket says 172.21.15.82:42266) 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4479e00640 1 -- 172.21.15.82:0/288007285 learned_addr learned my addr 172.21.15.82:0/288007285 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4479400640 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e001960 0x55d31e0129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f447a800640 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e003680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4479e00640 1 -- 172.21.15.82:0/288007285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e001960 msgr2=0x55d31e0129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.789+0000 7f4479e00640 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e001960 0x55d31e0129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.790+0000 7f4479e00640 1 -- 172.21.15.82:0/288007285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 msgr2=0x55d31e003680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.790+0000 7f4479e00640 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e003680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.790+0000 7f4479e00640 1 -- 172.21.15.82:0/288007285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31dc370f0 con 0x55d31dffcfd0 2024-04-26T20:25:51.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.790+0000 7f4479e00640 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0006b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x55d31e002750 tx=0x7f446c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74725202a904bbe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:51.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.790+0000 7f447a800640 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e003680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:51.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.791+0000 7f4466a00640 1 -- 172.21.15.82:0/288007285 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c014cc0 con 0x55d31dffcfd0 2024-04-26T20:25:51.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.791+0000 7f4466a00640 1 -- 172.21.15.82:0/288007285 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f446c01b030 con 0x55d31dffcfd0 2024-04-26T20:25:51.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.791+0000 7f4466a00640 1 -- 172.21.15.82:0/288007285 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c012810 con 0x55d31dffcfd0 2024-04-26T20:25:51.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.792+0000 7f4483c2c740 1 -- 172.21.15.82:0/288007285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 msgr2=0x55d31e0006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.792+0000 7f4483c2c740 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0006b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x55d31e002750 tx=0x7f446c00bf20 comp rx=0 tx=0).stop 2024-04-26T20:25:51.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.792+0000 7f4483c2c740 1 -- 172.21.15.82:0/288007285 shutdown_connections 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.793+0000 7f4483c2c740 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e002350 0x55d31e003680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.793+0000 7f4483c2c740 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e001960 0x55d31e0129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.793+0000 7f4483c2c740 1 --2- 172.21.15.82:0/288007285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0006b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.793+0000 7f4483c2c740 1 -- 172.21.15.82:0/288007285 >> 172.21.15.82:0/288007285 conn(0x55d31e006ec0 msgr2=0x55d31e00aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.793+0000 7f4483c2c740 1 -- 172.21.15.82:0/288007285 shutdown_connections 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.794+0000 7f4483c2c740 1 -- 172.21.15.82:0/288007285 wait complete. 2024-04-26T20:25:51.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.794+0000 7f4483c2c740 1 -- start start 2024-04-26T20:25:51.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.794+0000 7f4483c2c740 1 Processor -- start 2024-04-26T20:25:51.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.795+0000 7f4483c2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.796+0000 7f4479e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.796+0000 7f4479e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42282/0 (socket says 172.21.15.82:42282) 2024-04-26T20:25:51.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.796+0000 7f4479e00640 1 -- 172.21.15.82:0/2979474358 learned_addr learned my addr 172.21.15.82:0/2979474358 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:51.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.797+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e001960 0x55d31e010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.797+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e011940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.797+0000 7f4479400640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e001960 0x55d31e010930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.797+0000 7f447a800640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e011940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.797+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1b81a0 con 0x55d31dffcfd0 2024-04-26T20:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.798+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1bb6f0 con 0x55d31e001960 2024-04-26T20:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.798+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1b8810 con 0x55d31e002350 2024-04-26T20:25:51.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.798+0000 7f4483c2c740 10 client.0 _ll_register_callbacks cb 0x7f44680056e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:51.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.801+0000 7f4479e00640 1 -- 172.21.15.82:0/2979474358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 msgr2=0x55d31e011940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.801+0000 7f4479e00640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e011940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.801+0000 7f4479e00640 1 -- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e001960 msgr2=0x55d31e010930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:51.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.801+0000 7f4479e00640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e001960 0x55d31e010930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.801+0000 7f4479e00640 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31df2da30 con 0x55d31dffcfd0 2024-04-26T20:25:51.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.802+0000 7f4479e00640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0103f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f446c008010 tx=0x7f446c014cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d5baa8764ff033 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:51.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.802+0000 7f447a800640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e011940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:25:51.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.802+0000 7f4479400640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e001960 0x55d31e010930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:51.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.805+0000 7f445be00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:51.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.805+0000 7f445be00640 1 -- 172.21.15.82:0/2979474358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c02d060 con 0x55d31dffcfd0 2024-04-26T20:25:51.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.805+0000 7f445be00640 1 -- 172.21.15.82:0/2979474358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f446c017360 con 0x55d31dffcfd0 2024-04-26T20:25:51.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.805+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f446c01b030 con 0x55d31dffcfd0 2024-04-26T20:25:51.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.806+0000 7f445be00640 1 -- 172.21.15.82:0/2979474358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f446c017560 con 0x55d31dffcfd0 2024-04-26T20:25:51.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.806+0000 7f4483c2c740 10 client.16380 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:51.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.806+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d31e07d490 con 0x55d31dffcfd0 2024-04-26T20:25:51.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.806+0000 7f445be00640 1 -- 172.21.15.82:0/2979474358 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f446c01b030 con 0x55d31dffcfd0 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.807+0000 7f445be00640 1 -- 172.21.15.82:0/2979474358 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f446c012590 con 0x55d31dffcfd0 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4483c2c740 10 client.16380 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4483c2c740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4483c2c740 20 client.16380 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e0074c0 0x55d31e07fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4483c2c740 4 client.16380 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:25:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d31df6d650 con 0x55d31e0074c0 2024-04-26T20:25:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.808+0000 7f4479400640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e0074c0 0x55d31e07fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:51.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.810+0000 7f4479400640 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e0074c0 0x55d31e07fd90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919a6ddc9cddf822 server_cookie=4f0331cbf969209d in_seq=0 out_seq=0 2024-04-26T20:25:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.813+0000 7f445be00640 10 client.16380 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.813+0000 7f445be00640 1 -- 172.21.15.82:0/2979474358 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d31df6d650 con 0x55d31e0074c0 2024-04-26T20:25:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.813+0000 7f445be00640 10 client.16380 handle_command_reply: tid=0 2024-04-26T20:25:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.813+0000 7f4483c2c740 1 client.16380 shutdown 2024-04-26T20:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 msgr2=0x55d31e0103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0103f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f446c008010 tx=0x7f446c014cf0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 shutdown_connections 2024-04-26T20:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55d31e0074c0 0x55d31e07fd90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d31e002350 0x55d31e011940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d31e001960 0x55d31e010930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 --2- 172.21.15.82:0/2979474358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d31dffcfd0 0x55d31e0103f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.817+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 >> 172.21.15.82:0/2979474358 conn(0x55d31e006ec0 msgr2=0x55d31e00aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.820+0000 7f445be00640 0 client.16380 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.820+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 shutdown_connections 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.820+0000 7f4483c2c740 1 -- 172.21.15.82:0/2979474358 wait complete. 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.820+0000 7f4483c2c740 20 client.16380 trim_cache size 0 max 16384 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:25:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "9f83af18-a549-4553-b420-585f9ca371a0": { 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "9f83af18-a549-4553-b420-585f9ca371a0", 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:25:51.823 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.822+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f44600a3d80 msgr2=0x7f44600a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.822+0000 7f447b200640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f44600a3d80 0x7f44600a6240 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4474000f80 tx=0x7f447401aba0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.822+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 msgr2=0x7f447c1aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.822+0000 7f447b200640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 0x7f447c1aee80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f44680097d0 tx=0x7f4468032cd0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.822+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 shutdown_connections 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f44600a3d80 0x7f44600a6240 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447c10a9b0 0x7f447c1aee80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f447c10a010 0x7f447c1a7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 --2- 172.21.15.82:0/1425117088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447c073d70 0x7f447c1a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 >> 172.21.15.82:0/1425117088 conn(0x7f447c06f840 msgr2=0x7f447c0714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:51.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 shutdown_connections 2024-04-26T20:25:51.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:25:51.823+0000 7f447b200640 1 -- 172.21.15.82:0/1425117088 wait complete. 2024-04-26T20:25:51.851 INFO:tasks.cephfs.filesystem:scrub status for tag:9f83af18-a549-4553-b420-585f9ca371a0 - {'path': '/', 'tag': '9f83af18-a549-4553-b420-585f9ca371a0', 'options': 'recursive,force'} 2024-04-26T20:25:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:51 smithi139 ceph-mon[32999]: pgmap v503: 129 pgs: 129 active+clean; 175 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-04-26T20:25:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:51 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:25:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:51 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:51 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:51 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:51 smithi135 ceph-mon[32816]: pgmap v503: 129 pgs: 129 active+clean; 175 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-04-26T20:25:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:51 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:25:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:51 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:51 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:51 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:51 smithi082 ceph-mon[28105]: pgmap v503: 129 pgs: 129 active+clean; 175 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-04-26T20:25:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:51 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:25:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:51 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:51 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:51 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:52 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:53.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:52 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:53.216 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:52 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: pgmap v504: 129 pgs: 129 active+clean; 187 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 203 op/s 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.074 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:53 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: pgmap v504: 129 pgs: 129 active+clean; 187 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 203 op/s 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:53 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: pgmap v504: 129 pgs: 129 active+clean; 187 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 203 op/s 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:25:54.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:54.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:53 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:25:55.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:54 smithi139 ceph-mon[32999]: pgmap v505: 129 pgs: 129 active+clean; 190 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 172 op/s 2024-04-26T20:25:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.094+0000 7fd479600640 1 -- 172.21.15.82:0/2675666519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd47410a900 msgr2=0x7fd47410f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.094+0000 7fd479600640 1 --2- 172.21.15.82:0/2675666519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd47410a900 0x7fd47410f270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd464009900 tx=0x7fd46402a420 comp rx=0 tx=0).stop 2024-04-26T20:25:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.099+0000 7fd479600640 1 -- 172.21.15.82:0/2675666519 shutdown_connections 2024-04-26T20:25:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.099+0000 7fd479600640 1 --2- 172.21.15.82:0/2675666519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd47410a900 0x7fd47410f270 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.099+0000 7fd479600640 1 --2- 172.21.15.82:0/2675666519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd474109f40 0x7fd47410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.099+0000 7fd479600640 1 --2- 172.21.15.82:0/2675666519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd474073c60 0x7fd474074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.099+0000 7fd479600640 1 -- 172.21.15.82:0/2675666519 >> 172.21.15.82:0/2675666519 conn(0x7fd47406f7d0 msgr2=0x7fd474071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.099+0000 7fd479600640 1 -- 172.21.15.82:0/2675666519 shutdown_connections 2024-04-26T20:25:55.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.100+0000 7fd479600640 1 -- 172.21.15.82:0/2675666519 wait complete. 2024-04-26T20:25:55.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.102+0000 7fd479600640 1 Processor -- start 2024-04-26T20:25:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.104+0000 7fd479600640 1 -- start start 2024-04-26T20:25:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.105+0000 7fd479600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd474073c60 0x7fd4741a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.108+0000 7fd479600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 0x7fd4741a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.109+0000 7fd479600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd47410a900 0x7fd4741aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.109+0000 7fd479600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd47411d110 con 0x7fd47410a900 2024-04-26T20:25:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.109+0000 7fd479600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd47411cf90 con 0x7fd474109f40 2024-04-26T20:25:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.109+0000 7fd479600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd47411d290 con 0x7fd474073c60 2024-04-26T20:25:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.109+0000 7fd473400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 0x7fd4741a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd474073c60 0x7fd4741a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 0x7fd4741a7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59726/0 (socket says 172.21.15.82:59726) 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 -- 172.21.15.82:0/3477645282 learned_addr learned my addr 172.21.15.82:0/3477645282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd478c00640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd47410a900 0x7fd4741aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 -- 172.21.15.82:0/3477645282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd474073c60 msgr2=0x7fd4741a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd474073c60 0x7fd4741a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 -- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd47410a900 msgr2=0x7fd4741aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd47410a900 0x7fd4741aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd473400640 1 -- 172.21.15.82:0/3477645282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4741af1a0 con 0x7fd474109f40 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.110+0000 7fd478c00640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd47410a900 0x7fd4741aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:25:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.111+0000 7fd473400640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 0x7fd4741a7ac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00ea80 tx=0x7fd46c00ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.111+0000 7fd470c00640 1 -- 172.21.15.82:0/3477645282 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00ce40 con 0x7fd474109f40 2024-04-26T20:25:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.111+0000 7fd470c00640 1 -- 172.21.15.82:0/3477645282 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46c011920 con 0x7fd474109f40 2024-04-26T20:25:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.111+0000 7fd470c00640 1 -- 172.21.15.82:0/3477645282 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c01aaa0 con 0x7fd474109f40 2024-04-26T20:25:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.113+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4741af490 con 0x7fd474109f40 2024-04-26T20:25:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:54 smithi135 ceph-mon[32816]: pgmap v505: 129 pgs: 129 active+clean; 190 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 172 op/s 2024-04-26T20:25:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.119+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4741af900 con 0x7fd474109f40 2024-04-26T20:25:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.130+0000 7fd47d9c3740 1 Processor -- start 2024-04-26T20:25:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.132+0000 7fd47d9c3740 1 -- start start 2024-04-26T20:25:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.132+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 0x5600fd061200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.132+0000 7fd470c00640 1 -- 172.21.15.82:0/3477645282 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd46c01ac40 con 0x7fd474109f40 2024-04-26T20:25:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd0617d0 0x5600fd0662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd066940 0x5600fd068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd478c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 0x5600fd061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd478c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 0x5600fd061200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59728/0 (socket says 172.21.15.82:59728) 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd478c00640 1 -- 172.21.15.82:0/3991508399 learned_addr learned my addr 172.21.15.82:0/3991508399 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5600fcfc5380 con 0x5600fd066940 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5600fcf61c30 con 0x5600fd060de0 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.135+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5600fcfc1340 con 0x5600fd0617d0 2024-04-26T20:25:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.136+0000 7fd473e00640 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd0617d0 0x5600fd0662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.137+0000 7fd478c00640 1 -- 172.21.15.82:0/3991508399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd0617d0 msgr2=0x5600fd0662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.137+0000 7fd478c00640 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd0617d0 0x5600fd0662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.137+0000 7fd478c00640 1 -- 172.21.15.82:0/3991508399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd066940 msgr2=0x5600fd068dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:25:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.137+0000 7fd478c00640 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd066940 0x5600fd068dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.137+0000 7fd478c00640 1 -- 172.21.15.82:0/3991508399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600fcf83940 con 0x5600fd060de0 2024-04-26T20:25:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.138+0000 7fd478c00640 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 0x5600fd061200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd464009900 tx=0x7fd464004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236bf0bdf965788e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.138+0000 7fd469200640 1 -- 172.21.15.82:0/3991508399 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46403f070 con 0x5600fd060de0 2024-04-26T20:25:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.138+0000 7fd469200640 1 -- 172.21.15.82:0/3991508399 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd464003ca0 con 0x5600fd060de0 2024-04-26T20:25:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.138+0000 7fd469200640 1 -- 172.21.15.82:0/3991508399 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464035070 con 0x5600fd060de0 2024-04-26T20:25:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.139+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 msgr2=0x5600fd061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.139+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 0x5600fd061200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd464009900 tx=0x7fd464004180 comp rx=0 tx=0).stop 2024-04-26T20:25:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.142+0000 7fd470c00640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4580a3dc0 0x7fd4580a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.142+0000 7fd470c00640 1 -- 172.21.15.82:0/3477645282 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd46c0d4060 con 0x7fd474109f40 2024-04-26T20:25:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.146+0000 7fd473e00640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4580a3dc0 0x7fd4580a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.147+0000 7fd473e00640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4580a3dc0 0x7fd4580a6280 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x5600fd061bd0 tx=0x7fd46000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.148+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 shutdown_connections 2024-04-26T20:25:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.148+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd066940 0x5600fd068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.148+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd0617d0 0x5600fd0662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.148+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3991508399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd060de0 0x5600fd061200 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.148+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 >> 172.21.15.82:0/3991508399 conn(0x5600fd05c450 msgr2=0x5600fd05c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.149+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 shutdown_connections 2024-04-26T20:25:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.149+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3991508399 wait complete. 2024-04-26T20:25:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.149+0000 7fd47d9c3740 1 -- start start 2024-04-26T20:25:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.152+0000 7fd47d9c3740 1 Processor -- start 2024-04-26T20:25:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.153+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd06b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.156+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd473400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd473e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd473e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44588/0 (socket says 172.21.15.82:44588) 2024-04-26T20:25:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd473400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd06b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42314/0 (socket says 172.21.15.82:42314) 2024-04-26T20:25:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd473e00640 1 -- 172.21.15.82:0/3444048968 learned_addr learned my addr 172.21.15.82:0/3444048968 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd0725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5600fd069890 con 0x5600fd0617d0 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5600fcf4cc60 con 0x5600fd066940 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5600fd069a10 con 0x5600fd060de0 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.157+0000 7fd47d9c3740 10 client.0 _ll_register_callbacks cb 0x5600fcf78e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.158+0000 7fd478c00640 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd0725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.159+0000 7fd478c00640 1 -- 172.21.15.82:0/3444048968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 msgr2=0x5600fd06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.159+0000 7fd478c00640 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.159+0000 7fd478c00640 1 -- 172.21.15.82:0/3444048968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 msgr2=0x5600fd06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.159+0000 7fd478c00640 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd06b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.159+0000 7fd478c00640 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600fcf5b510 con 0x5600fd066940 2024-04-26T20:25:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.160+0000 7fd478c00640 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd0725b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd464009850 tx=0x7fd464031d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27923d7b45bc6271 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.160+0000 7fd45d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:25:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.165+0000 7fd45d600640 1 -- 172.21.15.82:0/3444048968 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464035040 con 0x5600fd066940 2024-04-26T20:25:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.165+0000 7fd45d600640 1 -- 172.21.15.82:0/3444048968 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd464003a00 con 0x5600fd066940 2024-04-26T20:25:55.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.170+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd464003ca0 con 0x5600fd066940 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.170+0000 7fd45d600640 1 -- 172.21.15.82:0/3444048968 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd46403f040 con 0x5600fd066940 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.170+0000 7fd47d9c3740 10 client.26504 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.170+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5600fccd7210 con 0x5600fd066940 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.170+0000 7fd45d600640 1 -- 172.21.15.82:0/3444048968 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd464003ca0 con 0x5600fd066940 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd45d600640 1 -- 172.21.15.82:0/3444048968 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fd464056480 con 0x5600fd066940 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd47d9c3740 10 client.26504 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd47d9c3740 10 client.26504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd47d9c3740 20 client.26504 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd076b00 0x5600fd078f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd47d9c3740 4 client.26504 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:25:55.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600fcfd2f90 con 0x5600fd076b00 2024-04-26T20:25:55.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.172+0000 7fd473e00640 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd076b00 0x5600fd078f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.179+0000 7fd473e00640 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd076b00 0x5600fd078f20 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1fa209d11011bd8 server_cookie=f5216634f2f877e6 in_seq=0 out_seq=0 2024-04-26T20:25:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.180+0000 7fd45d600640 10 client.26504 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:55.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.180+0000 7fd45d600640 1 -- 172.21.15.82:0/3444048968 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5600fcfd2f90 con 0x5600fd076b00 2024-04-26T20:25:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.180+0000 7fd45d600640 10 client.26504 handle_command_reply: tid=0 2024-04-26T20:25:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.180+0000 7fd47d9c3740 1 client.26504 shutdown 2024-04-26T20:25:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 msgr2=0x5600fd0725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd0725b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd464009850 tx=0x7fd464031d60 comp rx=0 tx=0).stop 2024-04-26T20:25:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 shutdown_connections 2024-04-26T20:25:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd076b00 0x5600fd078f20 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd0725b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd06b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/3444048968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 >> 172.21.15.82:0/3444048968 conn(0x5600fd05c450 msgr2=0x5600fd05b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.182+0000 7fd45d600640 0 client.26504 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.183+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 shutdown_connections 2024-04-26T20:25:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.183+0000 7fd47d9c3740 1 -- 172.21.15.82:0/3444048968 wait complete. 2024-04-26T20:25:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.183+0000 7fd47d9c3740 20 client.26504 trim_cache size 0 max 16384 2024-04-26T20:25:55.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:54 smithi082 ceph-mon[28105]: pgmap v505: 129 pgs: 129 active+clean; 190 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 172 op/s 2024-04-26T20:25:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.424+0000 7fd47d9c3740 1 Processor -- start 2024-04-26T20:25:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 -- start start 2024-04-26T20:25:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd062fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741b9f90 con 0x5600fd0617d0 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741bbc50 con 0x5600fd066940 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.440+0000 7fd47d9c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741ba660 con 0x5600fd060de0 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.444+0000 7fd478c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.444+0000 7fd478c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59736/0 (socket says 172.21.15.82:59736) 2024-04-26T20:25:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.444+0000 7fd473400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd062fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.445+0000 7fd473400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd062fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42330/0 (socket says 172.21.15.82:42330) 2024-04-26T20:25:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.445+0000 7fd473e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.445+0000 7fd473e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44590/0 (socket says 172.21.15.82:44590) 2024-04-26T20:25:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.445+0000 7fd478c00640 1 -- 172.21.15.82:0/2422485947 learned_addr learned my addr 172.21.15.82:0/2422485947 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.450+0000 7fd478c00640 1 -- 172.21.15.82:0/2422485947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 msgr2=0x5600fd062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.450+0000 7fd478c00640 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.450+0000 7fd478c00640 1 -- 172.21.15.82:0/2422485947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 msgr2=0x5600fd062fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.450+0000 7fd478c00640 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd062fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.450+0000 7fd478c00640 1 -- 172.21.15.82:0/2422485947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600fcda3620 con 0x5600fd066940 2024-04-26T20:25:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.461+0000 7fd478c00640 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd072570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd464001eb0 tx=0x7fd4640097c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2dbcc94cd7838e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.461+0000 7fd45fe00640 1 -- 172.21.15.82:0/2422485947 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464035040 con 0x5600fd066940 2024-04-26T20:25:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.461+0000 7fd45fe00640 1 -- 172.21.15.82:0/2422485947 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd464056480 con 0x5600fd066940 2024-04-26T20:25:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.461+0000 7fd45fe00640 1 -- 172.21.15.82:0/2422485947 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464044460 con 0x5600fd066940 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.462+0000 7fd47d9c3740 1 -- 172.21.15.82:0/2422485947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 msgr2=0x5600fd072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.462+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd072570 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd464001eb0 tx=0x7fd4640097c0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.463+0000 7fd47d9c3740 1 -- 172.21.15.82:0/2422485947 shutdown_connections 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.463+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd066940 0x5600fd072570 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.463+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0617d0 0x5600fd062fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.463+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.463+0000 7fd47d9c3740 1 -- 172.21.15.82:0/2422485947 >> 172.21.15.82:0/2422485947 conn(0x5600fd05c450 msgr2=0x5600fd05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.466+0000 7fd473e00640 1 --2- 172.21.15.82:0/2422485947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd060de0 0x5600fd062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:25:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.483+0000 7fd47d9c3740 1 -- 172.21.15.82:0/2422485947 shutdown_connections 2024-04-26T20:25:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.492+0000 7fd47d9c3740 1 -- 172.21.15.82:0/2422485947 wait complete. 2024-04-26T20:25:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.493+0000 7fd47d9c3740 1 -- start start 2024-04-26T20:25:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.493+0000 7fd47d9c3740 1 Processor -- start 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd0617d0 0x5600fd06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd066940 0x5600fd06f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0726b0 0x5600fd0db050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741bb4c0 con 0x5600fd0726b0 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741bad30 con 0x5600fd0617d0 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd4741b7f70 con 0x5600fd066940 2024-04-26T20:25:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.494+0000 7fd47d9c3740 10 client.0 _ll_register_callbacks cb 0x7fd46000b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.495+0000 7fd473400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd066940 0x5600fd06f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.495+0000 7fd473e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd0617d0 0x5600fd06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.495+0000 7fd473400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd066940 0x5600fd06f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44602/0 (socket says 172.21.15.82:44602) 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.495+0000 7fd473400640 1 -- 172.21.15.82:0/395602236 learned_addr learned my addr 172.21.15.82:0/395602236 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.495+0000 7fd478c00640 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0726b0 0x5600fd0db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.496+0000 7fd478c00640 1 -- 172.21.15.82:0/395602236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd066940 msgr2=0x5600fd06f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.496+0000 7fd478c00640 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd066940 0x5600fd06f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.496+0000 7fd478c00640 1 -- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd0617d0 msgr2=0x5600fd06f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:25:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.496+0000 7fd478c00640 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd0617d0 0x5600fd06f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.496+0000 7fd478c00640 1 -- 172.21.15.82:0/395602236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600fcf7fcb0 con 0x5600fd0726b0 2024-04-26T20:25:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.497+0000 7fd478c00640 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0726b0 0x5600fd0db050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5600fd05d460 tx=0x7fd4640092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe954a2afc1f48b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:25:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.498+0000 7fd45d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:25:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.508+0000 7fd45d600640 1 -- 172.21.15.82:0/395602236 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464035040 con 0x5600fd0726b0 2024-04-26T20:25:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.508+0000 7fd45d600640 1 -- 172.21.15.82:0/395602236 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd464044660 con 0x5600fd0726b0 2024-04-26T20:25:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.513+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd464056480 con 0x5600fd0726b0 2024-04-26T20:25:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.516+0000 7fd45d600640 1 -- 172.21.15.82:0/395602236 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd464056630 con 0x5600fd0726b0 2024-04-26T20:25:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.516+0000 7fd47d9c3740 10 client.16395 fetch_fsmap learned FSMap version 34 2024-04-26T20:25:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.516+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5600fd0dc750 con 0x5600fd0726b0 2024-04-26T20:25:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.518+0000 7fd45d600640 1 -- 172.21.15.82:0/395602236 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd464056480 con 0x5600fd0726b0 2024-04-26T20:25:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.518+0000 7fd45d600640 1 -- 172.21.15.82:0/395602236 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fd4640698e0 con 0x5600fd0726b0 2024-04-26T20:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.528+0000 7fd47d9c3740 10 client.16395 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.528+0000 7fd47d9c3740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.528+0000 7fd47d9c3740 20 client.16395 populate_metadata read hostname 'smithi082' 2024-04-26T20:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.528+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd0dd040 0x5600fd0df460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.528+0000 7fd47d9c3740 4 client.16395 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:25:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.528+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600fcfcce00 con 0x5600fd0dd040 2024-04-26T20:25:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.536+0000 7fd473e00640 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd0dd040 0x5600fd0df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:25:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.545+0000 7fd473e00640 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd0dd040 0x5600fd0df460 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1eb3947ac50d872 server_cookie=77094304a5fab0cb in_seq=0 out_seq=0 2024-04-26T20:25:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:55.549+0000 7fd45d600640 10 client.16395 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:57.004 INFO:tasks.workunit.client.0.smithi082.stdout: 73 446983 319 295585 468 86076 291 2024-04-26T20:25:58.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:57 smithi139 ceph-mon[32999]: pgmap v506: 129 pgs: 129 active+clean; 210 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 264 op/s 2024-04-26T20:25:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:57 smithi135 ceph-mon[32816]: pgmap v506: 129 pgs: 129 active+clean; 210 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 264 op/s 2024-04-26T20:25:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:57 smithi082 ceph-mon[28105]: pgmap v506: 129 pgs: 129 active+clean; 210 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 264 op/s 2024-04-26T20:25:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.326+0000 7fd45d600640 1 -- 172.21.15.82:0/395602236 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600fcfcce00 con 0x5600fd0dd040 2024-04-26T20:25:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.326+0000 7fd45d600640 10 client.16395 handle_command_reply: tid=0 2024-04-26T20:25:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.326+0000 7fd47d9c3740 1 client.16395 shutdown 2024-04-26T20:25:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0726b0 msgr2=0x5600fd0db050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0726b0 0x5600fd0db050 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5600fd05d460 tx=0x7fd4640092d0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 shutdown_connections 2024-04-26T20:25:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5600fd0dd040 0x5600fd0df460 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600fd0726b0 0x5600fd0db050 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600fd066940 0x5600fd06f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 --2- 172.21.15.82:0/395602236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600fd0617d0 0x5600fd06f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd45d600640 0 client.16395 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 >> 172.21.15.82:0/395602236 conn(0x5600fd05c450 msgr2=0x5600fd062a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.327+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 shutdown_connections 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.328+0000 7fd47d9c3740 1 -- 172.21.15.82:0/395602236 wait complete. 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.328+0000 7fd47d9c3740 20 client.16395 trim_cache size 0 max 16384 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:25:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:25:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4580a3dc0 msgr2=0x7fd4580a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4580a3dc0 0x7fd4580a6280 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x5600fd061bd0 tx=0x7fd46000b390 comp rx=0 tx=0).stop 2024-04-26T20:25:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 msgr2=0x7fd4741a7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:25:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 0x7fd4741a7ac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00ea80 tx=0x7fd46c00ef40 comp rx=0 tx=0).stop 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 shutdown_connections 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd4580a3dc0 0x7fd4580a6280 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd47410a900 0x7fd4741aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd474109f40 0x7fd4741a7ac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 --2- 172.21.15.82:0/3477645282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd474073c60 0x7fd4741a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.329+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 >> 172.21.15.82:0/3477645282 conn(0x7fd47406f7d0 msgr2=0x7fd47410b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.330+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 shutdown_connections 2024-04-26T20:25:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:25:59.330+0000 7fd479600640 1 -- 172.21.15.82:0/3477645282 wait complete. 2024-04-26T20:26:00.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:25:59 smithi139 ceph-mon[32999]: pgmap v507: 129 pgs: 129 active+clean; 239 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.1 MiB/s wr, 427 op/s 2024-04-26T20:26:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:25:59 smithi135 ceph-mon[32816]: pgmap v507: 129 pgs: 129 active+clean; 239 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.1 MiB/s wr, 427 op/s 2024-04-26T20:26:00.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:25:59 smithi082 ceph-mon[28105]: pgmap v507: 129 pgs: 129 active+clean; 239 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.1 MiB/s wr, 427 op/s 2024-04-26T20:26:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:00 smithi139 ceph-mon[32999]: pgmap v508: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 7.4 MiB/s wr, 509 op/s 2024-04-26T20:26:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:00 smithi135 ceph-mon[32816]: pgmap v508: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 7.4 MiB/s wr, 509 op/s 2024-04-26T20:26:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:00 smithi082 ceph-mon[28105]: pgmap v508: 129 pgs: 129 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 7.4 MiB/s wr, 509 op/s 2024-04-26T20:26:02.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:02.723 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.723 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:02 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.823 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.824 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.825 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.826 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.829 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.830 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.831 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.832 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.833 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.834 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.834 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.834 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.834 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.834 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.835 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.836 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.837 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.838 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.839 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.840 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.841 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.842 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.843 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.844 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.845 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.846 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.847 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.848 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.849 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.850 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.851 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.852 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:02 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.871 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.872 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.875 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.891 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.892 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:02.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:02 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:03.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:03 smithi082 ceph-mon[28105]: pgmap v509: 129 pgs: 129 active+clean; 274 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.8 MiB/s wr, 584 op/s 2024-04-26T20:26:03.820 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:03 smithi139 ceph-mon[32999]: pgmap v509: 129 pgs: 129 active+clean; 274 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.8 MiB/s wr, 584 op/s 2024-04-26T20:26:03.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:03 smithi135 ceph-mon[32816]: pgmap v509: 129 pgs: 129 active+clean; 274 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.8 MiB/s wr, 584 op/s 2024-04-26T20:26:06.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:05 smithi139 ceph-mon[32999]: pgmap v510: 129 pgs: 129 active+clean; 275 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.9 MiB/s wr, 545 op/s 2024-04-26T20:26:06.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:05 smithi135 ceph-mon[32816]: pgmap v510: 129 pgs: 129 active+clean; 275 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.9 MiB/s wr, 545 op/s 2024-04-26T20:26:06.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:05 smithi082 ceph-mon[28105]: pgmap v510: 129 pgs: 129 active+clean; 275 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.9 MiB/s wr, 545 op/s 2024-04-26T20:26:07.005 INFO:tasks.workunit.client.0.smithi082.stdout: 75 325352 205 219374 140 62246 201 2024-04-26T20:26:07.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:06 smithi135 ceph-mon[32816]: pgmap v511: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.6 MiB/s wr, 513 op/s 2024-04-26T20:26:07.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:06 smithi082 ceph-mon[28105]: pgmap v511: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.6 MiB/s wr, 513 op/s 2024-04-26T20:26:07.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:06 smithi139 ceph-mon[32999]: pgmap v511: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.6 MiB/s wr, 513 op/s 2024-04-26T20:26:10.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:09 smithi139 ceph-mon[32999]: pgmap v512: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-04-26T20:26:10.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:09 smithi135 ceph-mon[32816]: pgmap v512: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-04-26T20:26:10.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:09 smithi082 ceph-mon[28105]: pgmap v512: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.0 MiB/s wr, 406 op/s 2024-04-26T20:26:11.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:10 smithi135 ceph-mon[32816]: pgmap v513: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 3.4 MiB/s wr, 238 op/s 2024-04-26T20:26:11.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:10 smithi082 ceph-mon[28105]: pgmap v513: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 3.4 MiB/s wr, 238 op/s 2024-04-26T20:26:11.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:10 smithi139 ceph-mon[32999]: pgmap v513: 129 pgs: 129 active+clean; 276 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 3.4 MiB/s wr, 238 op/s 2024-04-26T20:26:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 -- 172.21.15.82:0/2700841718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 msgr2=0x7f532410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 --2- 172.21.15.82:0/2700841718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 0x7f532410cb30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f531c009be0 tx=0x7f531c02a750 comp rx=0 tx=0).stop 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 -- 172.21.15.82:0/2700841718 shutdown_connections 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 --2- 172.21.15.82:0/2700841718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 0x7f532410cb30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 --2- 172.21.15.82:0/2700841718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5324075310 0x7f5324075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 --2- 172.21.15.82:0/2700841718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53240768f0 0x7f5324074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 -- 172.21.15.82:0/2700841718 >> 172.21.15.82:0/2700841718 conn(0x7f53240fdd60 msgr2=0x7f53241001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 -- 172.21.15.82:0/2700841718 shutdown_connections 2024-04-26T20:26:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.483+0000 7f532a400640 1 -- 172.21.15.82:0/2700841718 wait complete. 2024-04-26T20:26:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 Processor -- start 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 -- start start 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 0x7f532419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53240768f0 0x7f532419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 0x7f53241a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5324110530 con 0x7f53240768f0 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53241103b0 con 0x7f532410a6a0 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.484+0000 7f532a400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53241106b0 con 0x7f5324075310 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 0x7f532419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 0x7f532419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40906/0 (socket says 172.21.15.82:40906) 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 -- 172.21.15.82:0/2562156825 learned_addr learned my addr 172.21.15.82:0/2562156825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329a00640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 0x7f53241a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5323e00640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53240768f0 0x7f532419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 -- 172.21.15.82:0/2562156825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 msgr2=0x7f53241a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 0x7f53241a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 -- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53240768f0 msgr2=0x7f532419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53240768f0 0x7f532419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 -- 172.21.15.82:0/2562156825 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53241a2810 con 0x7f5324075310 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5323e00640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53240768f0 0x7f532419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.485+0000 7f5329000640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 0x7f532419abf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f530c00e9f0 tx=0x7f530c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.486+0000 7f5321600640 1 -- 172.21.15.82:0/2562156825 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c00ccc0 con 0x7f5324075310 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.486+0000 7f5321600640 1 -- 172.21.15.82:0/2562156825 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f530c0054d0 con 0x7f5324075310 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.486+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53241a2b00 con 0x7f5324075310 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.486+0000 7f5321600640 1 -- 172.21.15.82:0/2562156825 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c010430 con 0x7f5324075310 2024-04-26T20:26:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.486+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53241a3050 con 0x7f5324075310 2024-04-26T20:26:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.489+0000 7f5321600640 1 -- 172.21.15.82:0/2562156825 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f530c0046c0 con 0x7f5324075310 2024-04-26T20:26:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 Processor -- start 2024-04-26T20:26:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 -- start start 2024-04-26T20:26:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 0x562967f97200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f977d0 0x562967f9c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f9c940 0x562967f9edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562967efb380 con 0x562967f9c940 2024-04-26T20:26:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562967e97c30 con 0x562967f977d0 2024-04-26T20:26:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.491+0000 7f532e9ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562967ef7340 con 0x562967f96de0 2024-04-26T20:26:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 0x562967f97200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 0x562967f97200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40916/0 (socket says 172.21.15.82:40916) 2024-04-26T20:26:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 -- 172.21.15.82:0/347128184 learned_addr learned my addr 172.21.15.82:0/347128184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329000640 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f977d0 0x562967f9c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5321600640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53080a3cb0 0x7f53080a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5323e00640 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f9c940 0x562967f9edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5321600640 1 -- 172.21.15.82:0/2562156825 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f530c0d0ba0 con 0x7f5324075310 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 -- 172.21.15.82:0/347128184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f977d0 msgr2=0x562967f9c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f977d0 0x562967f9c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 -- 172.21.15.82:0/347128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f9c940 msgr2=0x562967f9edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f9c940 0x562967f9edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5329a00640 1 -- 172.21.15.82:0/347128184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562967eb9940 con 0x562967f96de0 2024-04-26T20:26:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.492+0000 7f5323e00640 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f9c940 0x562967f9edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.493+0000 7f5329a00640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53080a3cb0 0x7f53080a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.493+0000 7f5329a00640 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 0x562967f97200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f531c009be0 tx=0x7f531c030420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73e14dc3ca2acfc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.493+0000 7f531a000640 1 -- 172.21.15.82:0/347128184 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c036040 con 0x562967f96de0 2024-04-26T20:26:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.494+0000 7f531a000640 1 -- 172.21.15.82:0/347128184 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f531c003d30 con 0x562967f96de0 2024-04-26T20:26:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.494+0000 7f531a000640 1 -- 172.21.15.82:0/347128184 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c03f870 con 0x562967f96de0 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.494+0000 7f532e9ba740 1 -- 172.21.15.82:0/347128184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 msgr2=0x562967f97200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.494+0000 7f532e9ba740 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 0x562967f97200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f531c009be0 tx=0x7f531c030420 comp rx=0 tx=0).stop 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.494+0000 7f5329a00640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53080a3cb0 0x7f53080a6170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f531c04b000 tx=0x7f531c048000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 -- 172.21.15.82:0/347128184 shutdown_connections 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f9c940 0x562967f9edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f977d0 0x562967f9c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 --2- 172.21.15.82:0/347128184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f96de0 0x562967f97200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 -- 172.21.15.82:0/347128184 >> 172.21.15.82:0/347128184 conn(0x562967f92450 msgr2=0x562967f92850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 -- 172.21.15.82:0/347128184 shutdown_connections 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 -- 172.21.15.82:0/347128184 wait complete. 2024-04-26T20:26:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.495+0000 7f532e9ba740 1 -- start start 2024-04-26T20:26:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 Processor -- start 2024-04-26T20:26:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562967f9f8f0 con 0x562967f96de0 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562967e82c60 con 0x562967f9c940 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.496+0000 7f532e9ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562967f9fa70 con 0x562967f977d0 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f532e9ba740 10 client.0 _ll_register_callbacks cb 0x562967eaee50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33248/0 (socket says 172.21.15.82:33248) 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329000640 1 -- 172.21.15.82:0/1628315646 learned_addr learned my addr 172.21.15.82:0/1628315646 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329a00640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5323e00640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329a00640 1 -- 172.21.15.82:0/1628315646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 msgr2=0x562967fa1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329a00640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329a00640 1 -- 172.21.15.82:0/1628315646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 msgr2=0x562967fa0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329a00640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5329a00640 1 -- 172.21.15.82:0/1628315646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562967e91510 con 0x562967f9c940 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.497+0000 7f5323e00640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f5329a00640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa8540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f531c034040 tx=0x7f531c0098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c8a301c1aa1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f5312a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f5312a00640 1 -- 172.21.15.82:0/1628315646 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c036030 con 0x562967f9c940 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f531c003d30 con 0x562967f9c940 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f5312a00640 1 -- 172.21.15.82:0/1628315646 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f531c03fad0 con 0x562967f9c940 2024-04-26T20:26:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f5312a00640 1 -- 172.21.15.82:0/1628315646 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f531c065050 con 0x562967f9c940 2024-04-26T20:26:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f532e9ba740 10 client.26519 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.498+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562967c0d210 con 0x562967f9c940 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f5312a00640 1 -- 172.21.15.82:0/1628315646 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f531c003d30 con 0x562967f9c940 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f5312a00640 1 -- 172.21.15.82:0/1628315646 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f531c05c470 con 0x562967f9c940 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f532e9ba740 10 client.26519 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f532e9ba740 10 client.26519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f532e9ba740 20 client.26519 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f532e9ba740 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562967fb4eb0 0x562967fb72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f532e9ba740 4 client.26519 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.499+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562967f08f90 con 0x562967fb4eb0 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.500+0000 7f5329000640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562967fb4eb0 0x562967fb72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.500+0000 7f5329000640 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562967fb4eb0 0x562967fb72a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6dc9a2f5eadfb0e server_cookie=23790e1e3338165b in_seq=0 out_seq=0 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.500+0000 7f5312a00640 10 client.26519 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f5312a00640 1 -- 172.21.15.82:0/1628315646 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562967f08f90 con 0x562967fb4eb0 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f5312a00640 10 client.26519 handle_command_reply: tid=0 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 client.26519 shutdown 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 msgr2=0x562967fa8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa8540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f531c034040 tx=0x7f531c0098e0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 shutdown_connections 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562967fb4eb0 0x562967fb72a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa8540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f5312a00640 0 client.26519 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 --2- 172.21.15.82:0/1628315646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.501+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 >> 172.21.15.82:0/1628315646 conn(0x562967f92450 msgr2=0x562967f91650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.502+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 shutdown_connections 2024-04-26T20:26:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.502+0000 7f532e9ba740 1 -- 172.21.15.82:0/1628315646 wait complete. 2024-04-26T20:26:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.502+0000 7f532e9ba740 20 client.26519 trim_cache size 0 max 16384 2024-04-26T20:26:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 Processor -- start 2024-04-26T20:26:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 -- start start 2024-04-26T20:26:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967f9bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967f95b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53241a8f60 con 0x562967f96de0 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53241aac20 con 0x562967f9c940 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.520+0000 7f532e9ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53241a9630 con 0x562967f977d0 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967f9bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5323e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967f95b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967f9bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33250/0 (socket says 172.21.15.82:33250) 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5323e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:40946/0 (socket says 172.21.15.82:40946) 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329000640 1 -- 172.21.15.82:0/3286929392 learned_addr learned my addr 172.21.15.82:0/3286929392 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329a00640 1 -- 172.21.15.82:0/3286929392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 msgr2=0x562967fa8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329a00640 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329a00640 1 -- 172.21.15.82:0/3286929392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 msgr2=0x562967f9bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329a00640 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967f9bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.521+0000 7f5329a00640 1 -- 172.21.15.82:0/3286929392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562967fb7610 con 0x562967f9c940 2024-04-26T20:26:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.522+0000 7f5329a00640 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967f95b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f531c02a790 tx=0x7f531c005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ffb455733332c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.522+0000 7f5319600640 1 -- 172.21.15.82:0/3286929392 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c036070 con 0x562967f9c940 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.522+0000 7f5319600640 1 -- 172.21.15.82:0/3286929392 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f531c057070 con 0x562967f9c940 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.522+0000 7f5319600640 1 -- 172.21.15.82:0/3286929392 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c03fd10 con 0x562967f9c940 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 -- 172.21.15.82:0/3286929392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 msgr2=0x562967f95b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967f95b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f531c02a790 tx=0x7f531c005ec0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 -- 172.21.15.82:0/3286929392 shutdown_connections 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967f95b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 --2- 172.21.15.82:0/3286929392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967f9bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 -- 172.21.15.82:0/3286929392 >> 172.21.15.82:0/3286929392 conn(0x562967f92450 msgr2=0x562967f95400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 -- 172.21.15.82:0/3286929392 shutdown_connections 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 -- 172.21.15.82:0/3286929392 wait complete. 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.523+0000 7f532e9ba740 1 -- start start 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 Processor -- start 2024-04-26T20:26:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53241aa490 con 0x562967f96de0 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53241a9d00 con 0x562967f9c940 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53241a6f40 con 0x562967f977d0 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f532e9ba740 10 client.0 _ll_register_callbacks cb 0x7f531c009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f5329000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f5329000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33258/0 (socket says 172.21.15.82:33258) 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.524+0000 7f5329000640 1 -- 172.21.15.82:0/2067653368 learned_addr learned my addr 172.21.15.82:0/2067653368 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5323e00640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329a00640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329000640 1 -- 172.21.15.82:0/2067653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 msgr2=0x562967fa6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329000640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329000640 1 -- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 msgr2=0x562967fa75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329000640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329000640 1 -- 172.21.15.82:0/2067653368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562967cd9620 con 0x562967f96de0 2024-04-26T20:26:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329a00640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5329000640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa60d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f530c00e9c0 tx=0x7f530c0bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf45fcdebaa458ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.525+0000 7f5312a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f5312a00640 1 -- 172.21.15.82:0/2067653368 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c0a55d0 con 0x562967f96de0 2024-04-26T20:26:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f5312a00640 1 -- 172.21.15.82:0/2067653368 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f530c0ce3e0 con 0x562967f96de0 2024-04-26T20:26:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f531c057070 con 0x562967f96de0 2024-04-26T20:26:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f5312a00640 1 -- 172.21.15.82:0/2067653368 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f530c0a5140 con 0x562967f96de0 2024-04-26T20:26:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 10 client.16410 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562967eb5cb0 con 0x562967f96de0 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f5312a00640 1 -- 172.21.15.82:0/2067653368 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f531c057070 con 0x562967f96de0 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f5312a00640 1 -- 172.21.15.82:0/2067653368 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f530c0870b0 con 0x562967f96de0 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 10 client.16410 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 20 client.16410 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56296801c050 0x56296801e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 4 client.16410 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.526+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562967f02e00 con 0x56296801c050 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.527+0000 7f5323e00640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56296801c050 0x56296801e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.527+0000 7f5323e00640 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56296801c050 0x56296801e470 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f856372be74b55b server_cookie=7a107dd3b929a0bc in_seq=0 out_seq=0 2024-04-26T20:26:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:12.527+0000 7f5312a00640 10 client.16410 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:12 smithi135 ceph-mon[32816]: pgmap v514: 129 pgs: 129 active+clean; 289 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 2.9 MiB/s wr, 213 op/s 2024-04-26T20:26:13.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:12 smithi082 ceph-mon[28105]: pgmap v514: 129 pgs: 129 active+clean; 289 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 2.9 MiB/s wr, 213 op/s 2024-04-26T20:26:13.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:12 smithi139 ceph-mon[32999]: pgmap v514: 129 pgs: 129 active+clean; 289 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 2.9 MiB/s wr, 213 op/s 2024-04-26T20:26:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.427+0000 7f5312a00640 1 -- 172.21.15.82:0/2067653368 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562967f02e00 con 0x56296801c050 2024-04-26T20:26:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.428+0000 7f5312a00640 10 client.16410 handle_command_reply: tid=0 2024-04-26T20:26:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.439+0000 7f532e9ba740 1 client.16410 shutdown 2024-04-26T20:26:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.442+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 msgr2=0x562967fa60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.442+0000 7f532e9ba740 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa60d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f530c00e9c0 tx=0x7f530c0bd040 comp rx=0 tx=0).stop 2024-04-26T20:26:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.461+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 shutdown_connections 2024-04-26T20:26:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.461+0000 7f532e9ba740 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56296801c050 0x56296801e470 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.461+0000 7f532e9ba740 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562967f9c940 0x562967fa75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.461+0000 7f532e9ba740 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562967f977d0 0x562967fa6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.461+0000 7f532e9ba740 1 --2- 172.21.15.82:0/2067653368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562967f96de0 0x562967fa60d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.461+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 >> 172.21.15.82:0/2067653368 conn(0x562967f92450 msgr2=0x562967f95400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.462+0000 7f5312a00640 0 client.16410 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.474+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 shutdown_connections 2024-04-26T20:26:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.475+0000 7f532e9ba740 1 -- 172.21.15.82:0/2067653368 wait complete. 2024-04-26T20:26:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.485+0000 7f532e9ba740 20 client.16410 trim_cache size 0 max 16384 2024-04-26T20:26:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:26:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:26:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:26:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:26:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.514+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53080a3cb0 msgr2=0x7f53080a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.514+0000 7f532a400640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53080a3cb0 0x7f53080a6170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f531c04b000 tx=0x7f531c048000 comp rx=0 tx=0).stop 2024-04-26T20:26:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.515+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 msgr2=0x7f532419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.515+0000 7f532a400640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 0x7f532419abf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f530c00e9f0 tx=0x7f530c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.518+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 shutdown_connections 2024-04-26T20:26:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.518+0000 7f532a400640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f53080a3cb0 0x7f53080a6170 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.518+0000 7f532a400640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532410a6a0 0x7f53241a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.518+0000 7f532a400640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53240768f0 0x7f532419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.518+0000 7f532a400640 1 --2- 172.21.15.82:0/2562156825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5324075310 0x7f532419abf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.518+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 >> 172.21.15.82:0/2562156825 conn(0x7f53240fdd60 msgr2=0x7f5324106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.531+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 shutdown_connections 2024-04-26T20:26:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:13.531+0000 7f532a400640 1 -- 172.21.15.82:0/2562156825 wait complete. 2024-04-26T20:26:16.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:15 smithi139 ceph-mon[32999]: pgmap v515: 129 pgs: 129 active+clean; 301 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 2.5 MiB/s wr, 207 op/s 2024-04-26T20:26:16.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:15 smithi135 ceph-mon[32816]: pgmap v515: 129 pgs: 129 active+clean; 301 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 2.5 MiB/s wr, 207 op/s 2024-04-26T20:26:16.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:15 smithi082 ceph-mon[28105]: pgmap v515: 129 pgs: 129 active+clean; 301 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 2.5 MiB/s wr, 207 op/s 2024-04-26T20:26:17.033 INFO:tasks.workunit.client.0.smithi082.stdout: 86 401292 575 268029 618 80336 265 2024-04-26T20:26:17.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:16 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:26:17.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:16 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:26:17.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:16 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:26:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:16 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:26:17.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:16 smithi139 ceph-mon[32999]: pgmap v516: 129 pgs: 129 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.8 MiB/s wr, 251 op/s 2024-04-26T20:26:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:16 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:26:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:16 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:26:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:16 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:26:17.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:16 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:26:17.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:16 smithi135 ceph-mon[32816]: pgmap v516: 129 pgs: 129 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.8 MiB/s wr, 251 op/s 2024-04-26T20:26:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:16 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:26:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:16 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:26:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:16 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:26:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:16 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:26:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:16 smithi082 ceph-mon[28105]: pgmap v516: 129 pgs: 129 active+clean; 306 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.8 MiB/s wr, 251 op/s 2024-04-26T20:26:18.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:17 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:26:18.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:17 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:26:18.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:17 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:26:19.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:18 smithi135 ceph-mon[32816]: pgmap v517: 129 pgs: 129 active+clean; 313 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 3.5 MiB/s wr, 321 op/s 2024-04-26T20:26:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:18 smithi082 ceph-mon[28105]: pgmap v517: 129 pgs: 129 active+clean; 313 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 3.5 MiB/s wr, 321 op/s 2024-04-26T20:26:19.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:18 smithi139 ceph-mon[32999]: pgmap v517: 129 pgs: 129 active+clean; 313 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 3.5 MiB/s wr, 321 op/s 2024-04-26T20:26:21.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:26:21.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:26:22.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:21 smithi139 ceph-mon[32999]: pgmap v518: 129 pgs: 129 active+clean; 318 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 3.8 MiB/s wr, 331 op/s 2024-04-26T20:26:22.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:21 smithi135 ceph-mon[32816]: pgmap v518: 129 pgs: 129 active+clean; 318 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 3.8 MiB/s wr, 331 op/s 2024-04-26T20:26:22.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:21 smithi082 ceph-mon[28105]: pgmap v518: 129 pgs: 129 active+clean; 318 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 3.8 MiB/s wr, 331 op/s 2024-04-26T20:26:23.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.170+0000 7f3481400640 1 -- 172.21.15.82:0/1382875200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 msgr2=0x7f347c1112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.170+0000 7f3481400640 1 --2- 172.21.15.82:0/1382875200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 0x7f347c1112a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3474009ca0 tx=0x7f347402a8b0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.199+0000 7f3481400640 1 -- 172.21.15.82:0/1382875200 shutdown_connections 2024-04-26T20:26:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.199+0000 7f3481400640 1 --2- 172.21.15.82:0/1382875200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 0x7f347c1112a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.199+0000 7f3481400640 1 --2- 172.21.15.82:0/1382875200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c109fc0 0x7f347c10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.199+0000 7f3481400640 1 --2- 172.21.15.82:0/1382875200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c108e70 0x7f347c109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.199+0000 7f3481400640 1 -- 172.21.15.82:0/1382875200 >> 172.21.15.82:0/1382875200 conn(0x7f347c077e00 msgr2=0x7f347c07a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.204+0000 7f3481400640 1 -- 172.21.15.82:0/1382875200 shutdown_connections 2024-04-26T20:26:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.209+0000 7f3481400640 1 -- 172.21.15.82:0/1382875200 wait complete. 2024-04-26T20:26:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.211+0000 7f3481400640 1 Processor -- start 2024-04-26T20:26:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.212+0000 7f3481400640 1 -- start start 2024-04-26T20:26:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.213+0000 7f3481400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c108e70 0x7f347c07fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.213+0000 7f3481400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 0x7f347c080410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f3481400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 0x7f347c19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f347b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 0x7f347c080410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f347b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 0x7f347c080410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60618/0 (socket says 172.21.15.82:60618) 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f347b400640 1 -- 172.21.15.82:0/3287925617 learned_addr learned my addr 172.21.15.82:0/3287925617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f347c114a40 con 0x7f347c108e70 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1148c0 con 0x7f347c109fc0 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.215+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f347c114bc0 con 0x7f347c10a980 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347be00640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c108e70 0x7f347c07fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f3480a00640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 0x7f347c19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347b400640 1 -- 172.21.15.82:0/3287925617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 msgr2=0x7f347c19e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347b400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 0x7f347c19e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347b400640 1 -- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c108e70 msgr2=0x7f347c07fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347b400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c108e70 0x7f347c07fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347b400640 1 -- 172.21.15.82:0/3287925617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c083600 con 0x7f347c109fc0 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.216+0000 7f347be00640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c108e70 0x7f347c07fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.217+0000 7f347b400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 0x7f347c080410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f346c00b450 tx=0x7f346c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.217+0000 7f3478c00640 1 -- 172.21.15.82:0/3287925617 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c015020 con 0x7f347c109fc0 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.217+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c19e680 con 0x7f347c109fc0 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.217+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c19eca0 con 0x7f347c109fc0 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.219+0000 7f3478c00640 1 -- 172.21.15.82:0/3287925617 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f346c011d40 con 0x7f347c109fc0 2024-04-26T20:26:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.219+0000 7f3478c00640 1 -- 172.21.15.82:0/3287925617 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c015020 con 0x7f347c109fc0 2024-04-26T20:26:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.244+0000 7f34857a5740 1 Processor -- start 2024-04-26T20:26:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.250+0000 7f3478c00640 1 -- 172.21.15.82:0/3287925617 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f346c018020 con 0x7f347c109fc0 2024-04-26T20:26:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.254+0000 7f3478c00640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f34600e7f10 0x7f34600ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.255+0000 7f3480a00640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f34600e7f10 0x7f34600ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.256+0000 7f3480a00640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f34600e7f10 0x7f34600ea3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f347402aea0 tx=0x7f3474009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.257+0000 7f34857a5740 1 -- start start 2024-04-26T20:26:23.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.257+0000 7f34857a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec50960 0x56037ec50d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.257+0000 7f34857a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec51350 0x56037ec55e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.257+0000 7f347be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec50960 0x56037ec50d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f347be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec50960 0x56037ec50d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49938/0 (socket says 172.21.15.82:49938) 2024-04-26T20:26:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f347be00640 1 -- 172.21.15.82:0/1864424918 learned_addr learned my addr 172.21.15.82:0/1864424918 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f34857a5740 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec564c0 0x56037ec58950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56037eb61030 con 0x56037ec564c0 2024-04-26T20:26:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56037eb7c7f0 con 0x56037ec51350 2024-04-26T20:26:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f347b400640 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec51350 0x56037ec55e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.258+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56037eb377e0 con 0x56037ec50960 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.259+0000 7f347b400640 1 -- 172.21.15.82:0/1864424918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec50960 msgr2=0x56037ec50d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.259+0000 7f347b400640 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec50960 0x56037ec50d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.259+0000 7f347b400640 1 -- 172.21.15.82:0/1864424918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec564c0 msgr2=0x56037ec58950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.259+0000 7f347b400640 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec564c0 0x56037ec58950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.259+0000 7f347b400640 1 -- 172.21.15.82:0/1864424918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037eb43050 con 0x56037ec51350 2024-04-26T20:26:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.259+0000 7f347b400640 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec51350 0x56037ec55e50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f346c0ce5c0 tx=0x7f346c09ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a537d70b55426db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.264+0000 7f3471200640 1 -- 172.21.15.82:0/1864424918 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0b5070 con 0x56037ec51350 2024-04-26T20:26:23.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.264+0000 7f3471200640 1 -- 172.21.15.82:0/1864424918 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f346c0b6260 con 0x56037ec51350 2024-04-26T20:26:23.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.264+0000 7f3471200640 1 -- 172.21.15.82:0/1864424918 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c09c1e0 con 0x56037ec51350 2024-04-26T20:26:23.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.272+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec51350 msgr2=0x56037ec55e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.272+0000 7f34857a5740 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec51350 0x56037ec55e50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f346c0ce5c0 tx=0x7f346c09ce50 comp rx=0 tx=0).stop 2024-04-26T20:26:23.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.274+0000 7f3478c00640 1 -- 172.21.15.82:0/3287925617 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f346c0118f0 con 0x7f347c109fc0 2024-04-26T20:26:23.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.282+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 shutdown_connections 2024-04-26T20:26:23.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.282+0000 7f34857a5740 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec564c0 0x56037ec58950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.282+0000 7f34857a5740 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec51350 0x56037ec55e50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.282+0000 7f34857a5740 1 --2- 172.21.15.82:0/1864424918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec50960 0x56037ec50d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.282+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 >> 172.21.15.82:0/1864424918 conn(0x56037ec4bfd0 msgr2=0x56037ec4c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.289+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 shutdown_connections 2024-04-26T20:26:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.289+0000 7f34857a5740 1 -- 172.21.15.82:0/1864424918 wait complete. 2024-04-26T20:26:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.289+0000 7f34857a5740 1 -- start start 2024-04-26T20:26:23.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.291+0000 7f34857a5740 1 Processor -- start 2024-04-26T20:26:23.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.293+0000 7f34857a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.315+0000 7f347be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.315+0000 7f347be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60642/0 (socket says 172.21.15.82:60642) 2024-04-26T20:26:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.317+0000 7f347be00640 1 -- 172.21.15.82:0/1564799840 learned_addr learned my addr 172.21.15.82:0/1564799840 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.321+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.322+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.322+0000 7f347b400640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.322+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56037ebb9200 con 0x56037ec51350 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.322+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56037ebb3ee0 con 0x56037ec50960 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.322+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56037ebc0e70 con 0x56037ec564c0 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.322+0000 7f3480a00640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.323+0000 7f34857a5740 10 client.0 _ll_register_callbacks cb 0x56037ebaa270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.323+0000 7f3480a00640 1 -- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 msgr2=0x56037ec5a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.323+0000 7f3480a00640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.323+0000 7f3480a00640 1 -- 172.21.15.82:0/1564799840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 msgr2=0x56037ec5ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.324+0000 7f3480a00640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.326+0000 7f3480a00640 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037e9907d0 con 0x56037ec564c0 2024-04-26T20:26:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.329+0000 7f3480a00640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec61bd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3474009bf0 tx=0x7f3474005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89d3820b12d950a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.330+0000 7f3465600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:26:23.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.331+0000 7f3465600640 1 -- 172.21.15.82:0/1564799840 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474004450 con 0x56037ec564c0 2024-04-26T20:26:23.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.331+0000 7f3465600640 1 -- 172.21.15.82:0/1564799840 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f34740045f0 con 0x56037ec564c0 2024-04-26T20:26:23.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.332+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f346c0b6260 con 0x56037ec564c0 2024-04-26T20:26:23.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.332+0000 7f347b400640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:23.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.332+0000 7f3465600640 1 -- 172.21.15.82:0/1564799840 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3474003e20 con 0x56037ec564c0 2024-04-26T20:26:23.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.335+0000 7f34857a5740 10 client.26569 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:23.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.335+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=34}) -- 0x56037e8c63f0 con 0x56037ec564c0 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f3465600640 1 -- 172.21.15.82:0/1564799840 <== mon.1 v2:172.21.15.139:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f347405b420 con 0x56037ec564c0 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f34857a5740 10 client.26569 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f34857a5740 10 client.26569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f34857a5740 20 client.26569 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037ec664b0 0x56037ec688f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f34857a5740 4 client.26569 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.336+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56037ebc27e0 con 0x56037ec664b0 2024-04-26T20:26:23.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.337+0000 7f347be00640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037ec664b0 0x56037ec688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.343+0000 7f3465600640 10 client.26569 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.343+0000 7f347be00640 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037ec664b0 0x56037ec688f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf79eff7bf0e1749 server_cookie=4d17cf9a781f67d6 in_seq=0 out_seq=0 2024-04-26T20:26:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.344+0000 7f3465600640 1 -- 172.21.15.82:0/1564799840 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56037ebc27e0 con 0x56037ec664b0 2024-04-26T20:26:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.344+0000 7f3465600640 10 client.26569 handle_command_reply: tid=0 2024-04-26T20:26:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.344+0000 7f34857a5740 1 client.26569 shutdown 2024-04-26T20:26:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.351+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 msgr2=0x56037ec61bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.351+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec61bd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3474009bf0 tx=0x7f3474005fd0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.351+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 shutdown_connections 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037ec664b0 0x56037ec688f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec61bd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 --2- 172.21.15.82:0/1564799840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 >> 172.21.15.82:0/1564799840 conn(0x56037ec4bfd0 msgr2=0x56037ec4b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f3465600640 0 client.26569 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 shutdown_connections 2024-04-26T20:26:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 1 -- 172.21.15.82:0/1564799840 wait complete. 2024-04-26T20:26:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.352+0000 7f34857a5740 20 client.26569 trim_cache size 0 max 16384 2024-04-26T20:26:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.434+0000 7f34857a5740 1 Processor -- start 2024-04-26T20:26:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.435+0000 7f34857a5740 1 -- start start 2024-04-26T20:26:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.435+0000 7f34857a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec4f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.436+0000 7f34857a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec61b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.436+0000 7f347be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec4f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.437+0000 7f347b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec61b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.437+0000 7f347b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec61b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59928/0 (socket says 172.21.15.82:59928) 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.437+0000 7f347b400640 1 -- 172.21.15.82:0/2162774768 learned_addr learned my addr 172.21.15.82:0/2162774768 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.438+0000 7f34857a5740 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec4a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.438+0000 7f3480a00640 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec4a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.439+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0117d0 con 0x56037ec51350 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.439+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0101e0 con 0x56037ec50960 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.439+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0108b0 con 0x56037ec564c0 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.440+0000 7f347b400640 1 -- 172.21.15.82:0/2162774768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 msgr2=0x56037ec4a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.440+0000 7f347b400640 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec4a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.440+0000 7f347b400640 1 -- 172.21.15.82:0/2162774768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 msgr2=0x56037ec4f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.440+0000 7f347b400640 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec4f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.440+0000 7f347b400640 1 -- 172.21.15.82:0/2162774768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037ec47850 con 0x56037ec51350 2024-04-26T20:26:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.441+0000 7f347b400640 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec61b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f346c0b6480 tx=0x7f346c09ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3102c0d8137afc02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.442+0000 7f3467e00640 1 -- 172.21.15.82:0/2162774768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0ba070 con 0x56037ec51350 2024-04-26T20:26:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.442+0000 7f3467e00640 1 -- 172.21.15.82:0/2162774768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f346c010d10 con 0x56037ec51350 2024-04-26T20:26:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.442+0000 7f3467e00640 1 -- 172.21.15.82:0/2162774768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0b5040 con 0x56037ec51350 2024-04-26T20:26:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.443+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 msgr2=0x56037ec61b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.443+0000 7f34857a5740 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec61b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f346c0b6480 tx=0x7f346c09ca00 comp rx=0 tx=0).stop 2024-04-26T20:26:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.446+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 shutdown_connections 2024-04-26T20:26:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.446+0000 7f34857a5740 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec4a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.448+0000 7f34857a5740 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec61b90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.448+0000 7f34857a5740 1 --2- 172.21.15.82:0/2162774768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec4f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.448+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 >> 172.21.15.82:0/2162774768 conn(0x56037ec4bfd0 msgr2=0x56037ec4ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.450+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 shutdown_connections 2024-04-26T20:26:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.450+0000 7f34857a5740 1 -- 172.21.15.82:0/2162774768 wait complete. 2024-04-26T20:26:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.450+0000 7f34857a5740 1 -- start start 2024-04-26T20:26:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.452+0000 7f34857a5740 1 Processor -- start 2024-04-26T20:26:23.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.454+0000 7f34857a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.455+0000 7f34857a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.455+0000 7f34857a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec60aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.455+0000 7f34857a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f345c00daf0 con 0x56037ec51350 2024-04-26T20:26:23.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.455+0000 7f34857a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f345c011040 con 0x56037ec50960 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.455+0000 7f34857a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f345c00e160 con 0x56037ec564c0 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.455+0000 7f34857a5740 10 client.0 _ll_register_callbacks cb 0x7f3474009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.456+0000 7f347b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.456+0000 7f347b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59944/0 (socket says 172.21.15.82:59944) 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.457+0000 7f347b400640 1 -- 172.21.15.82:0/162883220 learned_addr learned my addr 172.21.15.82:0/162883220 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.458+0000 7f347b400640 1 -- 172.21.15.82:0/162883220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 msgr2=0x56037ec60aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.458+0000 7f347b400640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec60aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.458+0000 7f347b400640 1 -- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 msgr2=0x56037ec5f5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.459+0000 7f347be00640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.459+0000 7f347b400640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.459+0000 7f347b400640 1 -- 172.21.15.82:0/162883220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037e8860f0 con 0x56037ec51350 2024-04-26T20:26:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.459+0000 7f347be00640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.460+0000 7f347b400640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5fae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f346c09b040 tx=0x7f346c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e30ad9cc2e9f76a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.460+0000 7f3465600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.461+0000 7f3465600640 1 -- 172.21.15.82:0/162883220 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0b5070 con 0x56037ec51350 2024-04-26T20:26:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.461+0000 7f3465600640 1 -- 172.21.15.82:0/162883220 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f346c098ae0 con 0x56037ec51350 2024-04-26T20:26:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.462+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f346c010d10 con 0x56037ec51350 2024-04-26T20:26:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.463+0000 7f3465600640 1 -- 172.21.15.82:0/162883220 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f346c0ba050 con 0x56037ec51350 2024-04-26T20:26:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.463+0000 7f34857a5740 10 client.16422 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.463+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56037eb7ca30 con 0x56037ec51350 2024-04-26T20:26:23.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.464+0000 7f3465600640 1 -- 172.21.15.82:0/162883220 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f346c010d10 con 0x56037ec51350 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f3465600640 1 -- 172.21.15.82:0/162883220 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f346c09bc50 con 0x56037ec51350 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f34857a5740 10 client.16422 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f34857a5740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f34857a5740 20 client.16422 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f34857a5740 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037eccd2c0 0x56037eccf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f34857a5740 4 client.16422 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56037ebbc650 con 0x56037eccd2c0 2024-04-26T20:26:23.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.465+0000 7f347be00640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037eccd2c0 0x56037eccf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:23.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.474+0000 7f3465600640 10 client.16422 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.474+0000 7f347be00640 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037eccd2c0 0x56037eccf6e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=596bf37d16cebb74 server_cookie=6bcc1d809c1aff76 in_seq=0 out_seq=0 2024-04-26T20:26:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.474+0000 7f3465600640 1 -- 172.21.15.82:0/162883220 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56037ebbc650 con 0x56037eccd2c0 2024-04-26T20:26:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.474+0000 7f3465600640 10 client.16422 handle_command_reply: tid=0 2024-04-26T20:26:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.474+0000 7f34857a5740 1 client.16422 shutdown 2024-04-26T20:26:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 msgr2=0x56037ec5fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5fae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f346c09b040 tx=0x7f346c000bc0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 shutdown_connections 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56037eccd2c0 0x56037eccf6e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56037ec564c0 0x56037ec60aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56037ec51350 0x56037ec5fae0 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f346c09b040 tx=0x7f346c000bc0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f3465600640 0 client.16422 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 --2- 172.21.15.82:0/162883220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56037ec50960 0x56037ec5f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.475+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 >> 172.21.15.82:0/162883220 conn(0x56037ec4bfd0 msgr2=0x56037ec51da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.476+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 shutdown_connections 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.476+0000 7f34857a5740 1 -- 172.21.15.82:0/162883220 wait complete. 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.476+0000 7f34857a5740 20 client.16422 trim_cache size 0 max 16384 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:26:23.477 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:26:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f34600e7f10 msgr2=0x7f34600ea3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f34600e7f10 0x7f34600ea3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f347402aea0 tx=0x7f3474009800 comp rx=0 tx=0).stop 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 msgr2=0x7f347c080410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 0x7f347c080410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f346c00b450 tx=0x7f346c00b910 comp rx=0 tx=0).stop 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 shutdown_connections 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f34600e7f10 0x7f34600ea3d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f347c10a980 0x7f347c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f347c109fc0 0x7f347c080410 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.479+0000 7f3481400640 1 --2- 172.21.15.82:0/3287925617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f347c108e70 0x7f347c07fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.480+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 >> 172.21.15.82:0/3287925617 conn(0x7f347c077e00 msgr2=0x7f347c10d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:23.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.480+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 shutdown_connections 2024-04-26T20:26:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:23.480+0000 7f3481400640 1 -- 172.21.15.82:0/3287925617 wait complete. 2024-04-26T20:26:23.547 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:26:23.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:26:24.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:23 smithi139 ceph-mon[32999]: pgmap v519: 129 pgs: 129 active+clean; 328 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.7 MiB/s wr, 361 op/s 2024-04-26T20:26:24.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:23 smithi135 ceph-mon[32816]: pgmap v519: 129 pgs: 129 active+clean; 328 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.7 MiB/s wr, 361 op/s 2024-04-26T20:26:24.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:23 smithi082 ceph-mon[28105]: pgmap v519: 129 pgs: 129 active+clean; 328 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.7 MiB/s wr, 361 op/s 2024-04-26T20:26:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.337+0000 7fdb2be00640 1 -- 172.21.15.82:0/2548490831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c10bf10 msgr2=0x7fdb2c10e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.337+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2548490831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c10e3a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009900 tx=0x7fdb1802a420 comp rx=0 tx=0).stop 2024-04-26T20:26:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.340+0000 7fdb2be00640 1 -- 172.21.15.82:0/2548490831 shutdown_connections 2024-04-26T20:26:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.340+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2548490831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10ea10 0x7fdb2c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.340+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2548490831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c10e3a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.340+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2548490831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c074760 0x7fdb2c10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.340+0000 7fdb2be00640 1 -- 172.21.15.82:0/2548490831 >> 172.21.15.82:0/2548490831 conn(0x7fdb2c06f690 msgr2=0x7fdb2c071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.351+0000 7fdb2be00640 1 -- 172.21.15.82:0/2548490831 shutdown_connections 2024-04-26T20:26:24.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.351+0000 7fdb2be00640 1 -- 172.21.15.82:0/2548490831 wait complete. 2024-04-26T20:26:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.352+0000 7fdb2be00640 1 Processor -- start 2024-04-26T20:26:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.353+0000 7fdb2be00640 1 -- start start 2024-04-26T20:26:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.353+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c074760 0x7fdb2c1a7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.353+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c1a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.354+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c10ea10 0x7fdb2c1aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.354+0000 7fdb2be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c11d180 con 0x7fdb2c10ea10 2024-04-26T20:26:24.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.354+0000 7fdb2be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c11d000 con 0x7fdb2c10bf10 2024-04-26T20:26:24.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.354+0000 7fdb2b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c10ea10 0x7fdb2c1aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:24.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.355+0000 7fdb2b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c10ea10 0x7fdb2c1aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59948/0 (socket says 172.21.15.82:59948) 2024-04-26T20:26:24.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.355+0000 7fdb2b400640 1 -- 172.21.15.82:0/2533183991 learned_addr learned my addr 172.21.15.82:0/2533183991 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.355+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c11d300 con 0x7fdb2c074760 2024-04-26T20:26:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.355+0000 7fdb2a000640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c1a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.356+0000 7fdb2a000640 1 -- 172.21.15.82:0/2533183991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c074760 msgr2=0x7fdb2c1a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.356+0000 7fdb2a000640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c074760 0x7fdb2c1a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.356+0000 7fdb2a000640 1 -- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c10ea10 msgr2=0x7fdb2c1aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.356+0000 7fdb2a000640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c10ea10 0x7fdb2c1aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.356+0000 7fdb2a000640 1 -- 172.21.15.82:0/2533183991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c1af450 con 0x7fdb2c10bf10 2024-04-26T20:26:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.358+0000 7fdb2a000640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c1a7e60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009850 tx=0x7fdb18003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.361+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1803f070 con 0x7fdb2c10bf10 2024-04-26T20:26:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.361+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb18031c50 con 0x7fdb2c10bf10 2024-04-26T20:26:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.361+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb18035030 con 0x7fdb2c10bf10 2024-04-26T20:26:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.367+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c1af6e0 con 0x7fdb2c10bf10 2024-04-26T20:26:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.367+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c1afc00 con 0x7fdb2c10bf10 2024-04-26T20:26:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.374+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c072190 con 0x7fdb2c10bf10 2024-04-26T20:26:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.384+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdb18042070 con 0x7fdb2c10bf10 2024-04-26T20:26:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.386+0000 7fdb23400640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdb100a3e40 0x7fdb100a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.386+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fdb180f11a0 con 0x7fdb2c10bf10 2024-04-26T20:26:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.387+0000 7fdb2aa00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdb100a3e40 0x7fdb100a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.388+0000 7fdb2aa00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdb100a3e40 0x7fdb100a6300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400abe0 tx=0x7fdb24009230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:24.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:24.395+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fdb180bd660 con 0x7fdb2c10bf10 2024-04-26T20:26:25.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.052+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb2c063530 con 0x7fdb2c10bf10 2024-04-26T20:26:25.054 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:26:25.055 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:25:09.261942+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24584,24554,24454,24550,24529]},"id":1}]} 2024-04-26T20:26:25.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.053+0000 7fdb23400640 1 -- 172.21.15.82:0/2533183991 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7fdb180bcf60 con 0x7fdb2c10bf10 2024-04-26T20:26:25.055 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 34 2024-04-26T20:26:25.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdb100a3e40 msgr2=0x7fdb100a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:25.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdb100a3e40 0x7fdb100a6300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400abe0 tx=0x7fdb24009230 comp rx=0 tx=0).stop 2024-04-26T20:26:25.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10bf10 msgr2=0x7fdb2c1a7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:25.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c1a7e60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009850 tx=0x7fdb18003c00 comp rx=0 tx=0).stop 2024-04-26T20:26:25.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 shutdown_connections 2024-04-26T20:26:25.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdb100a3e40 0x7fdb100a6300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2c10ea10 0x7fdb2c1aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb2c10bf10 0x7fdb2c1a7e60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 --2- 172.21.15.82:0/2533183991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb2c074760 0x7fdb2c1a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.056+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 >> 172.21.15.82:0/2533183991 conn(0x7fdb2c06f690 msgr2=0x7fdb2c109930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.057+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 shutdown_connections 2024-04-26T20:26:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:25.057+0000 7fdb2be00640 1 -- 172.21.15.82:0/2533183991 wait complete. 2024-04-26T20:26:25.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:24 smithi139 ceph-mon[32999]: pgmap v520: 129 pgs: 129 active+clean; 329 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 304 op/s 2024-04-26T20:26:25.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:24 smithi082 ceph-mon[28105]: pgmap v520: 129 pgs: 129 active+clean; 329 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 304 op/s 2024-04-26T20:26:25.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:26:25.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:24 smithi135 ceph-mon[32816]: pgmap v520: 129 pgs: 129 active+clean; 329 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 304 op/s 2024-04-26T20:26:26.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:25 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2533183991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:26.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:25 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2533183991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:26.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:25 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2533183991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:26:26.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.850+0000 7f8b16000640 1 -- 172.21.15.82:0/2589561873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 msgr2=0x7f8b1010e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:26.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.850+0000 7f8b16000640 1 --2- 172.21.15.82:0/2589561873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b1010e730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009900 tx=0x7f8afc02a420 comp rx=0 tx=0).stop 2024-04-26T20:26:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.870+0000 7f8b16000640 1 -- 172.21.15.82:0/2589561873 shutdown_connections 2024-04-26T20:26:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.870+0000 7f8b16000640 1 --2- 172.21.15.82:0/2589561873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 0x7f8b1010f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.870+0000 7f8b16000640 1 --2- 172.21.15.82:0/2589561873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b1010e730 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.870+0000 7f8b16000640 1 --2- 172.21.15.82:0/2589561873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b1010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.870+0000 7f8b16000640 1 -- 172.21.15.82:0/2589561873 >> 172.21.15.82:0/2589561873 conn(0x7f8b1006f7c0 msgr2=0x7f8b10071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.871+0000 7f8b16000640 1 -- 172.21.15.82:0/2589561873 shutdown_connections 2024-04-26T20:26:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.871+0000 7f8b16000640 1 -- 172.21.15.82:0/2589561873 wait complete. 2024-04-26T20:26:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.872+0000 7f8b16000640 1 Processor -- start 2024-04-26T20:26:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.873+0000 7f8b16000640 1 -- start start 2024-04-26T20:26:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.873+0000 7f8b16000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b101a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.874+0000 7f8b16000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b101a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.874+0000 7f8b16000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 0x7f8b101aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.874+0000 7f8b0f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b101a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.874+0000 7f8b0f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b101a7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60706/0 (socket says 172.21.15.82:60706) 2024-04-26T20:26:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.874+0000 7f8b0ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b101a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.874+0000 7f8b0ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b101a7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49998/0 (socket says 172.21.15.82:49998) 2024-04-26T20:26:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.875+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 0x7f8b101aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.875+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 0x7f8b101aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59956/0 (socket says 172.21.15.82:59956) 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.875+0000 7f8b0f400640 1 -- 172.21.15.82:0/4039262285 learned_addr learned my addr 172.21.15.82:0/4039262285 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.875+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1011d310 con 0x7f8b1010ec70 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.875+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1011d190 con 0x7f8b10109930 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.875+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1011d490 con 0x7f8b1010c2a0 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.876+0000 7f8b0ea00640 1 -- 172.21.15.82:0/4039262285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 msgr2=0x7f8b101a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.876+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b101a7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.876+0000 7f8b0ea00640 1 -- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 msgr2=0x7f8b101aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.876+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 0x7f8b101aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.876+0000 7f8b0ea00640 1 -- 172.21.15.82:0/4039262285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b101af450 con 0x7f8b1010c2a0 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.876+0000 7f8b0f400640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b101a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.877+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b101a7dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8afc005740 tx=0x7f8afc003e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:26.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.878+0000 7f8b07e00640 1 -- 172.21.15.82:0/4039262285 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc03f070 con 0x7f8b1010c2a0 2024-04-26T20:26:26.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.878+0000 7f8b07e00640 1 -- 172.21.15.82:0/4039262285 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8afc031d60 con 0x7f8b1010c2a0 2024-04-26T20:26:26.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.878+0000 7f8b07e00640 1 -- 172.21.15.82:0/4039262285 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc035030 con 0x7f8b1010c2a0 2024-04-26T20:26:26.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.879+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b101af6e0 con 0x7f8b1010c2a0 2024-04-26T20:26:26.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.879+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b101afb50 con 0x7f8b1010c2a0 2024-04-26T20:26:26.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.893+0000 7f8b18fb5740 1 Processor -- start 2024-04-26T20:26:26.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.896+0000 7f8b07e00640 1 -- 172.21.15.82:0/4039262285 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8afc042070 con 0x7f8b1010c2a0 2024-04-26T20:26:26.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b07e00640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8af40a3e40 0x7f8af40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 -- start start 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b07e00640 1 -- 172.21.15.82:0/4039262285 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8afc0f1250 con 0x7f8b1010c2a0 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5d890 0x55cb50c62390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c64e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cb50bc0c70 con 0x55cb50c5cea0 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cb50b79980 con 0x55cb50c5d890 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.905+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb50bbcc30 con 0x55cb50c62a00 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.906+0000 7f8b0f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.907+0000 7f8b0f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59968/0 (socket says 172.21.15.82:59968) 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.907+0000 7f8b0f400640 1 -- 172.21.15.82:0/1046563900 learned_addr learned my addr 172.21.15.82:0/1046563900 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.907+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8af40a3e40 0x7f8af40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.908+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8af40a3e40 0x7f8af40a6300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8b1006c650 tx=0x7f8b08009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:26.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.908+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c64e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.909+0000 7f8b0f400640 1 -- 172.21.15.82:0/1046563900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 msgr2=0x55cb50c64e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.909+0000 7f8b0f400640 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c64e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.909+0000 7f8b0f400640 1 -- 172.21.15.82:0/1046563900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5d890 msgr2=0x55cb50c62390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.909+0000 7f8b0f400640 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5d890 0x55cb50c62390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.909+0000 7f8b0f400640 1 -- 172.21.15.82:0/1046563900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb50b517b0 con 0x55cb50c5cea0 2024-04-26T20:26:26.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.909+0000 7f8b0f400640 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5d2c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009e00 tx=0x7f8b000117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a18fd4ed4fb60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:26.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.914+0000 7f8afbe00640 1 -- 172.21.15.82:0/1046563900 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b00034660 con 0x55cb50c5cea0 2024-04-26T20:26:26.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.915+0000 7f8afbe00640 1 -- 172.21.15.82:0/1046563900 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b00034cb0 con 0x55cb50c5cea0 2024-04-26T20:26:26.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.915+0000 7f8afbe00640 1 -- 172.21.15.82:0/1046563900 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000fce0 con 0x55cb50c5cea0 2024-04-26T20:26:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.933+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1046563900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 msgr2=0x55cb50c5d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.933+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5d2c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009e00 tx=0x7f8b000117b0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.948+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1046563900 shutdown_connections 2024-04-26T20:26:26.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.948+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c64e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.948+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5d890 0x55cb50c62390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.948+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1046563900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5d2c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.948+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1046563900 >> 172.21.15.82:0/1046563900 conn(0x55cb50c58510 msgr2=0x55cb50c58910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:26.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.949+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1046563900 shutdown_connections 2024-04-26T20:26:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.949+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1046563900 wait complete. 2024-04-26T20:26:26.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.950+0000 7f8b18fb5740 1 -- start start 2024-04-26T20:26:26.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.953+0000 7f8b18fb5740 1 Processor -- start 2024-04-26T20:26:26.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5cea0 0x55cb50c66e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c67340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c6e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cb50bbff80 con 0x55cb50c5d890 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cb50b6d260 con 0x55cb50c62a00 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb50bc52a0 con 0x55cb50c5cea0 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.958+0000 7f8b18fb5740 10 client.0 _ll_register_callbacks cb 0x55cb50bb7960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.959+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c6e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.959+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c6e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60714/0 (socket says 172.21.15.82:60714) 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.959+0000 7f8b0fe00640 1 -- 172.21.15.82:0/1123371688 learned_addr learned my addr 172.21.15.82:0/1123371688 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.959+0000 7f8b0f400640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5cea0 0x55cb50c66e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.960+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c67340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.960+0000 7f8b0fe00640 1 -- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5cea0 msgr2=0x55cb50c66e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:26.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.960+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5cea0 0x55cb50c66e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.960+0000 7f8b0fe00640 1 -- 172.21.15.82:0/1123371688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 msgr2=0x55cb50c67340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:26.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.960+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c67340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.960+0000 7f8b0fe00640 1 -- 172.21.15.82:0/1123371688 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb50b4f1c0 con 0x55cb50c62a00 2024-04-26T20:26:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.964+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c6e380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8b08012fd0 tx=0x7f8b08004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea00420bc5e759b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.964+0000 7f8af8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:26:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.965+0000 7f8af8c00640 1 -- 172.21.15.82:0/1123371688 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08029060 con 0x55cb50c62a00 2024-04-26T20:26:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.965+0000 7f8af8c00640 1 -- 172.21.15.82:0/1123371688 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8b0800fb10 con 0x55cb50c62a00 2024-04-26T20:26:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.966+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b00034cb0 con 0x55cb50c62a00 2024-04-26T20:26:26.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.967+0000 7f8af8c00640 1 -- 172.21.15.82:0/1123371688 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8b0800fd10 con 0x55cb50c62a00 2024-04-26T20:26:26.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.967+0000 7f8b18fb5740 10 client.26552 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:26.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.967+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cb508d23f0 con 0x55cb50c62a00 2024-04-26T20:26:26.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.976+0000 7f8af8c00640 1 -- 172.21.15.82:0/1123371688 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b00034cb0 con 0x55cb50c62a00 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.976+0000 7f8af8c00640 1 -- 172.21.15.82:0/1123371688 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f8b08023070 con 0x55cb50c62a00 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.979+0000 7f8b18fb5740 10 client.26552 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.979+0000 7f8b18fb5740 10 client.26552 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.979+0000 7f8b18fb5740 20 client.26552 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.979+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50c72810 0x55cb50c74c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.979+0000 7f8b18fb5740 4 client.26552 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.979+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb50bce880 con 0x55cb50c72810 2024-04-26T20:26:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.980+0000 7f8b0f400640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50c72810 0x55cb50c74c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.981+0000 7f8b0f400640 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50c72810 0x55cb50c74c20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3c6279b958c1dd5c server_cookie=bfb88974d9b16cab in_seq=0 out_seq=0 2024-04-26T20:26:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.981+0000 7f8af8c00640 10 client.26552 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:26:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.982+0000 7f8af8c00640 1 -- 172.21.15.82:0/1123371688 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cb50bce880 con 0x55cb50c72810 2024-04-26T20:26:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.982+0000 7f8af8c00640 10 client.26552 handle_command_reply: tid=0 2024-04-26T20:26:26.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.982+0000 7f8b18fb5740 1 client.26552 shutdown 2024-04-26T20:26:26.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 msgr2=0x55cb50c6e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:26.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c6e380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8b08012fd0 tx=0x7f8b08004ab0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 shutdown_connections 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50c72810 0x55cb50c74c20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c6e380 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c67340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/1123371688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5cea0 0x55cb50c66e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 >> 172.21.15.82:0/1123371688 conn(0x55cb50c58510 msgr2=0x55cb50c577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.983+0000 7f8af8c00640 0 client.26552 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:26:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.984+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 shutdown_connections 2024-04-26T20:26:26.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.984+0000 7f8b18fb5740 1 -- 172.21.15.82:0/1123371688 wait complete. 2024-04-26T20:26:26.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:26.984+0000 7f8b18fb5740 20 client.26552 trim_cache size 0 max 16384 2024-04-26T20:26:27.033 INFO:tasks.workunit.client.0.smithi082.stdout: 93 594583 347 393934 284 128263 447 2024-04-26T20:26:27.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:26 smithi135 ceph-mon[32816]: pgmap v521: 129 pgs: 129 active+clean; 329 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 2.6 MiB/s wr, 237 op/s 2024-04-26T20:26:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.121+0000 7f889b200640 1 -- 172.21.15.82:0/3510292397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a4c40 msgr2=0x7f88940a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.121+0000 7f889b200640 1 --2- 172.21.15.82:0/3510292397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a4c40 0x7f88940a5060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8888009900 tx=0x7f888802a410 comp rx=0 tx=0).stop 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.158+0000 7f889b200640 1 -- 172.21.15.82:0/3510292397 shutdown_connections 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.158+0000 7f889b200640 1 --2- 172.21.15.82:0/3510292397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a6710 0x7f88940aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.158+0000 7f889b200640 1 --2- 172.21.15.82:0/3510292397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a5d70 0x7f88940a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.158+0000 7f889b200640 1 --2- 172.21.15.82:0/3510292397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a4c40 0x7f88940a5060 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.158+0000 7f889b200640 1 -- 172.21.15.82:0/3510292397 >> 172.21.15.82:0/3510292397 conn(0x7f88940a00d0 msgr2=0x7f88940a2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.159+0000 7f889b200640 1 -- 172.21.15.82:0/3510292397 shutdown_connections 2024-04-26T20:26:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.160+0000 7f889b200640 1 -- 172.21.15.82:0/3510292397 wait complete. 2024-04-26T20:26:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.169+0000 7f889b200640 1 Processor -- start 2024-04-26T20:26:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.169+0000 7f889b200640 1 -- start start 2024-04-26T20:26:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.171+0000 7f889b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 0x7f8894143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.173+0000 7f8899e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 0x7f8894143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.174+0000 7f8899e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 0x7f8894143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59998/0 (socket says 172.21.15.82:59998) 2024-04-26T20:26:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.174+0000 7f8899e00640 1 -- 172.21.15.82:0/2266638891 learned_addr learned my addr 172.21.15.82:0/2266638891 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.174+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a5d70 0x7f8894143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:26 smithi082 ceph-mon[28105]: pgmap v521: 129 pgs: 129 active+clean; 329 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 2.6 MiB/s wr, 237 op/s 2024-04-26T20:26:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.175+0000 7f8899400640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a5d70 0x7f8894143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.177+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a6710 0x7f889414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.177+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88940b8ef0 con 0x7f88940a4c40 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.177+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f88940b8d70 con 0x7f88940a6710 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.177+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f88940b9070 con 0x7f88940a5d70 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.177+0000 7f889a800640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a6710 0x7f889414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.178+0000 7f8899e00640 1 -- 172.21.15.82:0/2266638891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a5d70 msgr2=0x7f8894143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.178+0000 7f8899e00640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a5d70 0x7f8894143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.178+0000 7f8899e00640 1 -- 172.21.15.82:0/2266638891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a6710 msgr2=0x7f889414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.178+0000 7f8899e00640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a6710 0x7f889414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.178+0000 7f8899e00640 1 -- 172.21.15.82:0/2266638891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889414b1d0 con 0x7f88940a4c40 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.179+0000 7f8899e00640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 0x7f8894143600 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8888031470 tx=0x7f8888003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.180+0000 7f8899400640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a5d70 0x7f8894143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.192+0000 7f8892a00640 1 -- 172.21.15.82:0/2266638891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888050070 con 0x7f88940a4c40 2024-04-26T20:26:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.192+0000 7f8892a00640 1 -- 172.21.15.82:0/2266638891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8888003e10 con 0x7f88940a4c40 2024-04-26T20:26:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.192+0000 7f8892a00640 1 -- 172.21.15.82:0/2266638891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888035030 con 0x7f88940a4c40 2024-04-26T20:26:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.192+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88940ac860 con 0x7f88940a4c40 2024-04-26T20:26:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.193+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88940accd0 con 0x7f88940a4c40 2024-04-26T20:26:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.214+0000 7f8b18fb5740 1 Processor -- start 2024-04-26T20:26:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.233+0000 7f8b18fb5740 1 -- start start 2024-04-26T20:26:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.234+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.234+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5d890 0x55cb50c6e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.234+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c57630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.234+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1007ee50 con 0x55cb50c5cea0 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.234+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10080b10 con 0x55cb50c62a00 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.234+0000 7f8b18fb5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1007f520 con 0x55cb50c5d890 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.235+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c57630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.235+0000 7f8b0fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c57630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60760/0 (socket says 172.21.15.82:60760) 2024-04-26T20:26:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.235+0000 7f8b0fe00640 1 -- 172.21.15.82:0/3650647307 learned_addr learned my addr 172.21.15.82:0/3650647307 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.235+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5d890 0x55cb50c6e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.236+0000 7f8b0fe00640 1 -- 172.21.15.82:0/3650647307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5d890 msgr2=0x55cb50c6e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.236+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5d890 0x55cb50c6e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.236+0000 7f8b0fe00640 1 -- 172.21.15.82:0/3650647307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 msgr2=0x55cb50c5bcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.236+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.236+0000 7f8b0fe00640 1 -- 172.21.15.82:0/3650647307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5099c7d0 con 0x55cb50c62a00 2024-04-26T20:26:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.237+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c57630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000f80 tx=0x7f8b08009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0565e488b73425 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.244+0000 7f8892a00640 1 -- 172.21.15.82:0/2266638891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8888053070 con 0x7f88940a4c40 2024-04-26T20:26:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.246+0000 7f8892a00640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88800a3e40 0x7f88800a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.247+0000 7f8892a00640 1 -- 172.21.15.82:0/2266638891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8888102190 con 0x7f88940a4c40 2024-04-26T20:26:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.250+0000 7f8899400640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88800a3e40 0x7f88800a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.257+0000 7f8afb400640 1 -- 172.21.15.82:0/3650647307 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08029040 con 0x55cb50c62a00 2024-04-26T20:26:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.257+0000 7f8afb400640 1 -- 172.21.15.82:0/3650647307 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08005bd0 con 0x55cb50c62a00 2024-04-26T20:26:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.257+0000 7f8afb400640 1 -- 172.21.15.82:0/3650647307 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08033080 con 0x55cb50c62a00 2024-04-26T20:26:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.262+0000 7f88a3dd9740 1 Processor -- start 2024-04-26T20:26:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.262+0000 7f88a3dd9740 1 -- start start 2024-04-26T20:26:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.263+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd0dc0 0x55fc95cd11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.263+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cd62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.263+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95cd8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.263+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fc95c35380 con 0x55fc95cd0dc0 2024-04-26T20:26:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.263+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc95bd1c30 con 0x55fc95cd17b0 2024-04-26T20:26:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.263+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fc95c31340 con 0x55fc95cd6920 2024-04-26T20:26:27.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.268+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3650647307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 msgr2=0x55cb50c57630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.268+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c57630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000f80 tx=0x7f8b08009ae0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.264+0000 7f889a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95cd8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95cd8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50058/0 (socket says 172.21.15.82:50058) 2024-04-26T20:26:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 -- 172.21.15.82:0/393562689 learned_addr learned my addr 172.21.15.82:0/393562689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 -- 172.21.15.82:0/393562689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 msgr2=0x55fc95cd62b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cd62b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 -- 172.21.15.82:0/393562689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd0dc0 msgr2=0x55fc95cd11e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd0dc0 0x55fc95cd11e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.265+0000 7f889a800640 1 -- 172.21.15.82:0/393562689 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc95bf3940 con 0x55fc95cd6920 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.266+0000 7f889a800640 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95cd8db0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b6b0 tx=0x7f888c004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9abe5e7fa5653b46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.268+0000 7f8887400640 1 -- 172.21.15.82:0/393562689 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c003b20 con 0x55fc95cd6920 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.268+0000 7f8887400640 1 -- 172.21.15.82:0/393562689 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c015070 con 0x55fc95cd6920 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.268+0000 7f8899400640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88800a3e40 0x7f88800a6300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f889c068210 tx=0x7f889c0515b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.268+0000 7f8887400640 1 -- 172.21.15.82:0/393562689 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0116a0 con 0x55fc95cd6920 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.269+0000 7f88a3dd9740 1 -- 172.21.15.82:0/393562689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 msgr2=0x55fc95cd8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.269+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95cd8db0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b6b0 tx=0x7f888c004610 comp rx=0 tx=0).stop 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.272+0000 7f88a3dd9740 1 -- 172.21.15.82:0/393562689 shutdown_connections 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.272+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95cd8db0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.272+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cd62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.272+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/393562689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd0dc0 0x55fc95cd11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.272+0000 7f88a3dd9740 1 -- 172.21.15.82:0/393562689 >> 172.21.15.82:0/393562689 conn(0x55fc95ccc430 msgr2=0x55fc95ccc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.278+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3650647307 shutdown_connections 2024-04-26T20:26:27.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.278+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c62a00 0x55cb50c57630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.278+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c5d890 0x55cb50c6e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.278+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3650647307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5cea0 0x55cb50c5bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.278+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3650647307 >> 172.21.15.82:0/3650647307 conn(0x55cb50c58510 msgr2=0x55cb50c56f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.280+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3650647307 shutdown_connections 2024-04-26T20:26:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.280+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3650647307 wait complete. 2024-04-26T20:26:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.280+0000 7f8b18fb5740 1 -- start start 2024-04-26T20:26:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.281+0000 7f8b18fb5740 1 Processor -- start 2024-04-26T20:26:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.281+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 0x55cb50c696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.282+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c69c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.282+0000 7f8b0f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 0x55cb50c696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.282+0000 7f8b0f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 0x55cb50c696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60766/0 (socket says 172.21.15.82:60766) 2024-04-26T20:26:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b0ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c69c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b0ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c69c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60010/0 (socket says 172.21.15.82:60010) 2024-04-26T20:26:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b18fb5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b0ea00640 1 -- 172.21.15.82:0/3347715510 learned_addr learned my addr 172.21.15.82:0/3347715510 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10080380 con 0x55cb50c5d890 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1007fbf0 con 0x55cb50c5cea0 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1007ce30 con 0x55cb50c62a00 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b0fe00640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.283+0000 7f8b18fb5740 10 client.0 _ll_register_callbacks cb 0x7f8b080098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0ea00640 1 -- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 msgr2=0x55cb50c6cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c6cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0ea00640 1 -- 172.21.15.82:0/3347715510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 msgr2=0x55cb50c696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 0x55cb50c696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0ea00640 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb50b672a0 con 0x55cb50c5d890 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0ea00640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c69c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0bcd10 tx=0x7f8afc0bcc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fa69d85e8d6ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8b0f400640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 0x55cb50c696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8af8c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.284+0000 7f8af8c00640 1 -- 172.21.15.82:0/3347715510 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0d5020 con 0x55cb50c5d890 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.285+0000 7f8af8c00640 1 -- 172.21.15.82:0/3347715510 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8afc03b460 con 0x55cb50c5d890 2024-04-26T20:26:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.285+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b08005bd0 con 0x55cb50c5d890 2024-04-26T20:26:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.286+0000 7f88a3dd9740 1 -- 172.21.15.82:0/393562689 shutdown_connections 2024-04-26T20:26:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.286+0000 7f8af8c00640 1 -- 172.21.15.82:0/3347715510 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8afc0efe60 con 0x55cb50c5d890 2024-04-26T20:26:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.286+0000 7f8b18fb5740 10 client.16446 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.286+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cb50c6e3a0 con 0x55cb50c5d890 2024-04-26T20:26:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.286+0000 7f88a3dd9740 1 -- 172.21.15.82:0/393562689 wait complete. 2024-04-26T20:26:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.287+0000 7f88a3dd9740 1 -- start start 2024-04-26T20:26:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.287+0000 7f88a3dd9740 1 Processor -- start 2024-04-26T20:26:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.288+0000 7f8af8c00640 1 -- 172.21.15.82:0/3347715510 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08005bd0 con 0x55cb50c5d890 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.288+0000 7f8af8c00640 1 -- 172.21.15.82:0/3347715510 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f8afc0eea90 con 0x55cb50c5d890 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.301+0000 7f8b18fb5740 10 client.16446 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.301+0000 7f8b18fb5740 10 client.16446 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.301+0000 7f8b18fb5740 20 client.16446 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.301+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50cea250 0x55cb50cec670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.301+0000 7f8b18fb5740 4 client.16446 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.301+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cb50bc86f0 con 0x55cb50cea250 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.305+0000 7f8b0f400640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50cea250 0x55cb50cec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.306+0000 7f8b0f400640 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50cea250 0x55cb50cec670 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb347eb1fa0482ab server_cookie=b6265760c5cead12 in_seq=0 out_seq=0 2024-04-26T20:26:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.306+0000 7f8af8c00640 10 client.16446 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:26:27.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.306+0000 7f8af8c00640 1 -- 172.21.15.82:0/3347715510 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cb50bc86f0 con 0x55cb50cea250 2024-04-26T20:26:27.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.306+0000 7f8af8c00640 10 client.16446 handle_command_reply: tid=0 2024-04-26T20:26:27.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.306+0000 7f8b18fb5740 1 client.16446 shutdown 2024-04-26T20:26:27.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.307+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 msgr2=0x55cb50c69c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.307+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c69c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0bcd10 tx=0x7f8afc0bcc80 comp rx=0 tx=0).stop 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 shutdown_connections 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55cb50cea250 0x55cb50cec670 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb50c62a00 0x55cb50c6cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb50c5d890 0x55cb50c69c10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8b18fb5740 1 --2- 172.21.15.82:0/3347715510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb50c5cea0 0x55cb50c696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 >> 172.21.15.82:0/3347715510 conn(0x55cb50c58510 msgr2=0x55cb50c577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.310+0000 7f8af8c00640 0 client.16446 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:26:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cdb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95ce25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fc95cd98d0 con 0x55fc95cd6920 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc95bbcc60 con 0x55fc95cd17b0 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fc95cd9a50 con 0x55fc95cd0dc0 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.308+0000 7f88a3dd9740 10 client.0 _ll_register_callbacks cb 0x55fc95be8e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8899400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cdb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8899400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cdb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60772/0 (socket says 172.21.15.82:60772) 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8899400640 1 -- 172.21.15.82:0/4111524986 learned_addr learned my addr 172.21.15.82:0/4111524986 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.309+0000 7f8899e00640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.310+0000 7f8899400640 1 -- 172.21.15.82:0/4111524986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 msgr2=0x55fc95cdb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.310+0000 7f8899400640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.310+0000 7f8899400640 1 -- 172.21.15.82:0/4111524986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 msgr2=0x55fc95ce25e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.310+0000 7f889a800640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95ce25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.311+0000 7f8899400640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95ce25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.311+0000 7f8899400640 1 -- 172.21.15.82:0/4111524986 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc95bcb510 con 0x55fc95cd17b0 2024-04-26T20:26:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.311+0000 7f889a800640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95ce25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:27.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.310+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 shutdown_connections 2024-04-26T20:26:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.312+0000 7f8899400640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cdb5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f889c0680a0 tx=0x7f889c0688a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7bde9a4cb77c25c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.312+0000 7f887be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:26:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.312+0000 7f887be00640 1 -- 172.21.15.82:0/4111524986 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c085600 con 0x55fc95cd17b0 2024-04-26T20:26:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.312+0000 7f887be00640 1 -- 172.21.15.82:0/4111524986 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f889c0843a0 con 0x55fc95cd17b0 2024-04-26T20:26:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.313+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888c015070 con 0x55fc95cd17b0 2024-04-26T20:26:27.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.312+0000 7f8b18fb5740 1 -- 172.21.15.82:0/3347715510 wait complete. 2024-04-26T20:26:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.313+0000 7f887be00640 1 -- 172.21.15.82:0/4111524986 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f889c0857a0 con 0x55fc95cd17b0 2024-04-26T20:26:27.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.313+0000 7f8b18fb5740 20 client.16446 trim_cache size 0 max 16384 2024-04-26T20:26:27.317 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:26:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.314+0000 7f88a3dd9740 10 client.26564 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.314+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fc95947210 con 0x55fc95cd17b0 2024-04-26T20:26:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.315+0000 7f887be00640 1 -- 172.21.15.82:0/4111524986 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c015070 con 0x55fc95cd17b0 2024-04-26T20:26:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.315+0000 7f887be00640 1 -- 172.21.15.82:0/4111524986 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f889c084ad0 con 0x55fc95cd17b0 2024-04-26T20:26:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.315+0000 7f88a3dd9740 10 client.26564 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.315+0000 7f88a3dd9740 10 client.26564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.315+0000 7f88a3dd9740 20 client.26564 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.315+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95ce69f0 0x55fc95ce8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.316+0000 7f88a3dd9740 4 client.26564 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.316+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc95c42f90 con 0x55fc95ce69f0 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.316+0000 7f8899e00640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95ce69f0 0x55fc95ce8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.318+0000 7f8899e00640 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95ce69f0 0x55fc95ce8e30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=320ccfa585f66cfa server_cookie=8df1cd8cc416ad41 in_seq=0 out_seq=0 2024-04-26T20:26:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:26 smithi139 ceph-mon[32999]: pgmap v521: 129 pgs: 129 active+clean; 329 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 2.6 MiB/s wr, 237 op/s 2024-04-26T20:26:27.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.318+0000 7f887be00640 10 client.26564 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:27.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f887be00640 1 -- 172.21.15.82:0/4111524986 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fc95c42f90 con 0x55fc95ce69f0 2024-04-26T20:26:27.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f887be00640 10 client.26564 handle_command_reply: tid=0 2024-04-26T20:26:27.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.318+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8af40a3e40 msgr2=0x7f8af40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.318+0000 7f8b16000640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8af40a3e40 0x7f8af40a6300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8b1006c650 tx=0x7f8b08009500 comp rx=0 tx=0).stop 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.318+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 msgr2=0x7f8b101a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.318+0000 7f8b16000640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b101a7dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8afc005740 tx=0x7f8afc003e50 comp rx=0 tx=0).stop 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 shutdown_connections 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f8b16000640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8af40a3e40 0x7f8af40a6300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f8b16000640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1010ec70 0x7f8b101aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f8b16000640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b1010c2a0 0x7f8b101a7dc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f8b16000640 1 --2- 172.21.15.82:0/4039262285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b10109930 0x7f8b101a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 >> 172.21.15.82:0/4039262285 conn(0x7f8b1006f7c0 msgr2=0x7f8b1010ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.319+0000 7f88a3dd9740 1 client.26564 shutdown 2024-04-26T20:26:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.320+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 msgr2=0x55fc95cdb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.320+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cdb5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f889c0680a0 tx=0x7f889c0688a0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.320+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 shutdown_connections 2024-04-26T20:26:27.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:27.320+0000 7f8b16000640 1 -- 172.21.15.82:0/4039262285 wait complete. 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.338+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 shutdown_connections 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.338+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95ce69f0 0x55fc95ce8e30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.338+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95ce25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.338+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95cdb5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.338+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/4111524986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.338+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 >> 172.21.15.82:0/4111524986 conn(0x55fc95ccc430 msgr2=0x55fc95ccb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.339+0000 7f887be00640 0 client.26564 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.351+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 shutdown_connections 2024-04-26T20:26:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.351+0000 7f88a3dd9740 1 -- 172.21.15.82:0/4111524986 wait complete. 2024-04-26T20:26:27.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.352+0000 7f88a3dd9740 20 client.26564 trim_cache size 0 max 16384 2024-04-26T20:26:27.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:26:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.588+0000 7f88a3dd9740 1 Processor -- start 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.613+0000 7f88a3dd9740 1 -- start start 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.616+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95ccfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.616+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95ce25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.616+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95cc72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.616+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f887c00fbf0 con 0x55fc95cd6920 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.616+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f887c0118b0 con 0x55fc95cd17b0 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.616+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f887c0102c0 con 0x55fc95cd0dc0 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.617+0000 7f8899e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95ccfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.618+0000 7f889a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95cc72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.618+0000 7f8899e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95ccfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50092/0 (socket says 172.21.15.82:50092) 2024-04-26T20:26:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.618+0000 7f8899e00640 1 -- 172.21.15.82:0/3682111772 learned_addr learned my addr 172.21.15.82:0/3682111772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.619+0000 7f889a800640 1 -- 172.21.15.82:0/3682111772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 msgr2=0x55fc95ccfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.619+0000 7f889a800640 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95ccfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.619+0000 7f889a800640 1 -- 172.21.15.82:0/3682111772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 msgr2=0x55fc95ce25a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.619+0000 7f889a800640 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95ce25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.619+0000 7f889a800640 1 -- 172.21.15.82:0/3682111772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc95a13620 con 0x55fc95cd6920 2024-04-26T20:26:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.620+0000 7f889a800640 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95cc72d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f888c0035f0 tx=0x7f888c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2cbfd1cb18a9ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.621+0000 7f8886a00640 1 -- 172.21.15.82:0/3682111772 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c005440 con 0x55fc95cd6920 2024-04-26T20:26:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.621+0000 7f8886a00640 1 -- 172.21.15.82:0/3682111772 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c015040 con 0x55fc95cd6920 2024-04-26T20:26:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.621+0000 7f8886a00640 1 -- 172.21.15.82:0/3682111772 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c003f20 con 0x55fc95cd6920 2024-04-26T20:26:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.622+0000 7f88a3dd9740 1 -- 172.21.15.82:0/3682111772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 msgr2=0x55fc95cc72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.622+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95cc72d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f888c0035f0 tx=0x7f888c01ac90 comp rx=0 tx=0).stop 2024-04-26T20:26:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.648+0000 7f88a3dd9740 1 -- 172.21.15.82:0/3682111772 shutdown_connections 2024-04-26T20:26:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.648+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd6920 0x55fc95cc72d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.648+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd17b0 0x55fc95ce25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.648+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/3682111772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd0dc0 0x55fc95ccfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.648+0000 7f88a3dd9740 1 -- 172.21.15.82:0/3682111772 >> 172.21.15.82:0/3682111772 conn(0x55fc95ccc430 msgr2=0x55fc95ccf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.652+0000 7f88a3dd9740 1 -- 172.21.15.82:0/3682111772 shutdown_connections 2024-04-26T20:26:27.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.655+0000 7f88a3dd9740 1 -- 172.21.15.82:0/3682111772 wait complete. 2024-04-26T20:26:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.656+0000 7f88a3dd9740 1 -- start start 2024-04-26T20:26:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.656+0000 7f88a3dd9740 1 Processor -- start 2024-04-26T20:26:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.663+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.663+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd17b0 0x55fc95ce0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.666+0000 7f88a3dd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95ce1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.670+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f887c011120 con 0x55fc95cd17b0 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.670+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f887c010990 con 0x55fc95cd0dc0 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.670+0000 7f88a3dd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f887c00dbd0 con 0x55fc95cd6920 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.670+0000 7f88a3dd9740 10 client.0 _ll_register_callbacks cb 0x7f889c068ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.672+0000 7f889a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95ce1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.672+0000 7f889a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95ce1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50096/0 (socket says 172.21.15.82:50096) 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.672+0000 7f889a800640 1 -- 172.21.15.82:0/186812409 learned_addr learned my addr 172.21.15.82:0/186812409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.672+0000 7f8899400640 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd17b0 0x55fc95ce0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.673+0000 7f8899400640 1 -- 172.21.15.82:0/186812409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 msgr2=0x55fc95ce1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.673+0000 7f8899400640 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95ce1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.673+0000 7f8899400640 1 -- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd0dc0 msgr2=0x55fc95cdfbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.673+0000 7f8899400640 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdfbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.673+0000 7f8899400640 1 -- 172.21.15.82:0/186812409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc95befcb0 con 0x55fc95cd17b0 2024-04-26T20:26:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.673+0000 7f8899400640 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd17b0 0x55fc95ce0120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f889c050990 tx=0x7f889c06b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e27c1fb731c22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.678+0000 7f887be00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.678+0000 7f887be00640 1 -- 172.21.15.82:0/186812409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c08f760 con 0x55fc95cd17b0 2024-04-26T20:26:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.678+0000 7f887be00640 1 -- 172.21.15.82:0/186812409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f889c08f9f0 con 0x55fc95cd17b0 2024-04-26T20:26:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.693+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888c015040 con 0x55fc95cd17b0 2024-04-26T20:26:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.697+0000 7f887be00640 1 -- 172.21.15.82:0/186812409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f889c085940 con 0x55fc95cd17b0 2024-04-26T20:26:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.697+0000 7f88a3dd9740 10 client.16452 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.697+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fc95ce2860 con 0x55fc95cd17b0 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.711+0000 7f887be00640 1 -- 172.21.15.82:0/186812409 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888c015040 con 0x55fc95cd17b0 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.711+0000 7f887be00640 1 -- 172.21.15.82:0/186812409 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f889c09a420 con 0x55fc95cd17b0 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.713+0000 7f88a3dd9740 10 client.16452 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.713+0000 7f88a3dd9740 10 client.16452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.713+0000 7f88a3dd9740 20 client.16452 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.713+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95d4d730 0x55fc95d4fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.713+0000 7f88a3dd9740 4 client.16452 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:26:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.713+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc95c3ce00 con 0x55fc95d4d730 2024-04-26T20:26:27.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.722+0000 7f8899e00640 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95d4d730 0x55fc95d4fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.733+0000 7f8899e00640 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95d4d730 0x55fc95d4fb50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e36cfc6282ab177 server_cookie=6545089b195d7ded in_seq=0 out_seq=0 2024-04-26T20:26:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:27.733+0000 7f887be00640 10 client.16452 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.375+0000 7f887be00640 1 -- 172.21.15.82:0/186812409 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc95c3ce00 con 0x55fc95d4d730 2024-04-26T20:26:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.375+0000 7f887be00640 10 client.16452 handle_command_reply: tid=0 2024-04-26T20:26:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.380+0000 7f88a3dd9740 1 client.16452 shutdown 2024-04-26T20:26:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.380+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd17b0 msgr2=0x55fc95ce0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.380+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd17b0 0x55fc95ce0120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f889c050990 tx=0x7f889c06b280 comp rx=0 tx=0).stop 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 shutdown_connections 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc95d4d730 0x55fc95d4fb50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc95cd6920 0x55fc95ce1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc95cd17b0 0x55fc95ce0120 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f88a3dd9740 1 --2- 172.21.15.82:0/186812409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc95cd0dc0 0x55fc95cdfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 >> 172.21.15.82:0/186812409 conn(0x55fc95ccc430 msgr2=0x55fc95cd9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.381+0000 7f887be00640 0 client.16452 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.399+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 shutdown_connections 2024-04-26T20:26:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.399+0000 7f88a3dd9740 1 -- 172.21.15.82:0/186812409 wait complete. 2024-04-26T20:26:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:26:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:26:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:26:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:26:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.404+0000 7f88a3dd9740 20 client.16452 trim_cache size 0 max 16384 2024-04-26T20:26:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.420+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88800a3e40 msgr2=0x7f88800a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.420+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88800a3e40 0x7f88800a6300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f889c068210 tx=0x7f889c0515b0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.420+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 msgr2=0x7f8894143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.420+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 0x7f8894143600 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8888031470 tx=0x7f8888003c20 comp rx=0 tx=0).stop 2024-04-26T20:26:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.423+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 shutdown_connections 2024-04-26T20:26:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.423+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88800a3e40 0x7f88800a6300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.423+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88940a6710 0x7f889414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.423+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88940a5d70 0x7f8894143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.423+0000 7f889b200640 1 --2- 172.21.15.82:0/2266638891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88940a4c40 0x7f8894143600 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.423+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 >> 172.21.15.82:0/2266638891 conn(0x7f88940a00d0 msgr2=0x7f88940a6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:28.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.459+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 shutdown_connections 2024-04-26T20:26:28.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:28.459+0000 7f889b200640 1 -- 172.21.15.82:0/2266638891 wait complete. 2024-04-26T20:26:30.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:29 smithi139 ceph-mon[32999]: pgmap v522: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-04-26T20:26:30.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:29 smithi135 ceph-mon[32816]: pgmap v522: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-04-26T20:26:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:29 smithi082 ceph-mon[28105]: pgmap v522: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-04-26T20:26:30.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 -- 172.21.15.82:0/4167851289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 msgr2=0x7f89f810e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 --2- 172.21.15.82:0/4167851289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f810e730 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009860 tx=0x7f89e402a380 comp rx=0 tx=0).stop 2024-04-26T20:26:30.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 -- 172.21.15.82:0/4167851289 shutdown_connections 2024-04-26T20:26:30.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 --2- 172.21.15.82:0/4167851289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f810ec70 0x7f89f810f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 --2- 172.21.15.82:0/4167851289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f810e730 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 --2- 172.21.15.82:0/4167851289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f8109930 0x7f89f810bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.945+0000 7f89fee00640 1 -- 172.21.15.82:0/4167851289 >> 172.21.15.82:0/4167851289 conn(0x7f89f806f7c0 msgr2=0x7f89f8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:30.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.952+0000 7f89fee00640 1 -- 172.21.15.82:0/4167851289 shutdown_connections 2024-04-26T20:26:30.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.952+0000 7f89fee00640 1 -- 172.21.15.82:0/4167851289 wait complete. 2024-04-26T20:26:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.953+0000 7f89fee00640 1 Processor -- start 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 -- start start 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f8109930 0x7f89f81a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f81a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f810ec70 0x7f89f81af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f811d350 con 0x7f89f8109930 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89f811d1d0 con 0x7f89f810c2a0 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.961+0000 7f89fee00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f89f811d4d0 con 0x7f89f810ec70 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.967+0000 7f89f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f81a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.967+0000 7f89f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f81a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39544/0 (socket says 172.21.15.82:39544) 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.967+0000 7f89f7400640 1 -- 172.21.15.82:0/4286687442 learned_addr learned my addr 172.21.15.82:0/4286687442 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.967+0000 7f89fce00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f810ec70 0x7f89f81af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.968+0000 7f89fce00640 1 -- 172.21.15.82:0/4286687442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 msgr2=0x7f89f81a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.968+0000 7f89fce00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f81a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.968+0000 7f89fce00640 1 -- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f8109930 msgr2=0x7f89f81a7b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.968+0000 7f89fce00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f8109930 0x7f89f81a7b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.968+0000 7f89fce00640 1 -- 172.21.15.82:0/4286687442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8111190 con 0x7f89f810ec70 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.969+0000 7f89fce00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f810ec70 0x7f89f81af0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f89f000bdf0 tx=0x7f89f000bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.972+0000 7f89f4c00640 1 -- 172.21.15.82:0/4286687442 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0019070 con 0x7f89f810ec70 2024-04-26T20:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.972+0000 7f89f4c00640 1 -- 172.21.15.82:0/4286687442 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f00148f0 con 0x7f89f810ec70 2024-04-26T20:26:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.972+0000 7f89f4c00640 1 -- 172.21.15.82:0/4286687442 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0012820 con 0x7f89f810ec70 2024-04-26T20:26:30.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.978+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f8111480 con 0x7f89f810ec70 2024-04-26T20:26:30.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:30.978+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f8111950 con 0x7f89f810ec70 2024-04-26T20:26:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.003+0000 7f8a01dcf740 1 Processor -- start 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.004+0000 7f89f4c00640 1 -- 172.21.15.82:0/4286687442 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f89f0014aa0 con 0x7f89f810ec70 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.006+0000 7f89f4c00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89dc0a3e40 0x7f89dc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.006+0000 7f89f4c00640 1 -- 172.21.15.82:0/4286687442 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f89f00d0200 con 0x7f89f810ec70 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 -- start start 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48ba42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48ba9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48babe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b48b07c70 con 0x561b48ba3ea0 2024-04-26T20:26:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b48ac0980 con 0x561b48ba4890 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.007+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561b48b03c30 con 0x561b48ba9a00 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.008+0000 7f89f7400640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89dc0a3e40 0x7f89dc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.009+0000 7f89f7400640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89dc0a3e40 0x7f89dc0a6300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f89f81a9020 tx=0x7f89e4009490 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.010+0000 7f89f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48ba9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.010+0000 7f89fce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48babe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.010+0000 7f89fce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48babe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44192/0 (socket says 172.21.15.82:44192) 2024-04-26T20:26:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.010+0000 7f89fce00640 1 -- 172.21.15.82:0/1489858689 learned_addr learned my addr 172.21.15.82:0/1489858689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:31.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.016+0000 7f89f7400640 1 -- 172.21.15.82:0/1489858689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 msgr2=0x561b48babe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:31.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.016+0000 7f89f7400640 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48babe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.016+0000 7f89f7400640 1 -- 172.21.15.82:0/1489858689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 msgr2=0x561b48ba42c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:31.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.016+0000 7f89f7400640 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48ba42c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.016+0000 7f89f7400640 1 -- 172.21.15.82:0/1489858689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b48a987b0 con 0x561b48ba4890 2024-04-26T20:26:31.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.020+0000 7f89f7400640 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48ba9390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000c00 tx=0x7f89e403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3cc2c6df3c4ee02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.036+0000 7f89ed600640 1 -- 172.21.15.82:0/1489858689 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4043070 con 0x561b48ba4890 2024-04-26T20:26:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.036+0000 7f89ed600640 1 -- 172.21.15.82:0/1489858689 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e404f070 con 0x561b48ba4890 2024-04-26T20:26:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.036+0000 7f89ed600640 1 -- 172.21.15.82:0/1489858689 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4037050 con 0x561b48ba4890 2024-04-26T20:26:31.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.037+0000 7f8a01dcf740 1 -- 172.21.15.82:0/1489858689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 msgr2=0x561b48ba9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:31.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.037+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48ba9390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000c00 tx=0x7f89e403d000 comp rx=0 tx=0).stop 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.067+0000 7f8a01dcf740 1 -- 172.21.15.82:0/1489858689 shutdown_connections 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.067+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48babe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.067+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48ba9390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.067+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/1489858689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48ba42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.067+0000 7f8a01dcf740 1 -- 172.21.15.82:0/1489858689 >> 172.21.15.82:0/1489858689 conn(0x561b48b9f510 msgr2=0x561b48b9f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.071+0000 7f8a01dcf740 1 -- 172.21.15.82:0/1489858689 shutdown_connections 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.071+0000 7f8a01dcf740 1 -- 172.21.15.82:0/1489858689 wait complete. 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.071+0000 7f8a01dcf740 1 -- start start 2024-04-26T20:26:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.072+0000 7f8a01dcf740 1 Processor -- start 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.083+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48badbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48bb5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b48b06f80 con 0x561b48ba3ea0 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b48ab4260 con 0x561b48ba4890 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561b48b0c2a0 con 0x561b48ba9a00 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f8a01dcf740 10 client.0 _ll_register_callbacks cb 0x561b48afe960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f89fce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48bb5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f89fce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48bb5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44206/0 (socket says 172.21.15.82:44206) 2024-04-26T20:26:31.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f89fce00640 1 -- 172.21.15.82:0/3087389036 learned_addr learned my addr 172.21.15.82:0/3087389036 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:31.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.084+0000 7f89f7e00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48badbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.085+0000 7f89fce00640 1 -- 172.21.15.82:0/3087389036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 msgr2=0x561b48bae110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:31.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.085+0000 7f89fce00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bae110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.085+0000 7f89fce00640 1 -- 172.21.15.82:0/3087389036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 msgr2=0x561b48badbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:31.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.085+0000 7f89fce00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48badbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.085+0000 7f89fce00640 1 -- 172.21.15.82:0/3087389036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b48a961c0 con 0x561b48ba9a00 2024-04-26T20:26:31.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.085+0000 7f89f7e00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48badbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:31.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.086+0000 7f89fce00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48bb5150 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89f0014d90 tx=0x7f89f009c0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3219b499a30d864 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:31.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.093+0000 7f89e2000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:26:31.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.093+0000 7f89e2000640 1 -- 172.21.15.82:0/3087389036 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f00b4020 con 0x561b48ba9a00 2024-04-26T20:26:31.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.093+0000 7f89e2000640 1 -- 172.21.15.82:0/3087389036 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f89f00a48b0 con 0x561b48ba9a00 2024-04-26T20:26:31.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.097+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e404f070 con 0x561b48ba9a00 2024-04-26T20:26:31.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.103+0000 7f89e2000640 1 -- 172.21.15.82:0/3087389036 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89f00a4d40 con 0x561b48ba9a00 2024-04-26T20:26:31.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f8a01dcf740 10 client.26617 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:31.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b488193f0 con 0x561b48ba9a00 2024-04-26T20:26:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f89e2000640 1 -- 172.21.15.82:0/3087389036 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e404f070 con 0x561b48ba9a00 2024-04-26T20:26:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f89e2000640 1 -- 172.21.15.82:0/3087389036 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f89f009b520 con 0x561b48ba9a00 2024-04-26T20:26:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f8a01dcf740 10 client.26617 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f8a01dcf740 10 client.26617 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:26:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.110+0000 7f8a01dcf740 20 client.26617 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.111+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48bb97f0 0x561b48bbbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.111+0000 7f8a01dcf740 4 client.26617 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.111+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b48b15880 con 0x561b48bb97f0 2024-04-26T20:26:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.112+0000 7f89f7e00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48bb97f0 0x561b48bbbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.113+0000 7f89f7e00640 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48bb97f0 0x561b48bbbc50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4e9b2f36a205e07b server_cookie=3dc75946de4fe64 in_seq=0 out_seq=0 2024-04-26T20:26:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f89e2000640 10 client.26617 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:26:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f89e2000640 1 -- 172.21.15.82:0/3087389036 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561b48b15880 con 0x561b48bb97f0 2024-04-26T20:26:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f89e2000640 10 client.26617 handle_command_reply: tid=0 2024-04-26T20:26:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 client.26617 shutdown 2024-04-26T20:26:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:30 smithi135 ceph-mon[32816]: pgmap v523: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 msgr2=0x561b48bb5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48bb5150 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89f0014d90 tx=0x7f89f009c0d0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 shutdown_connections 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba9a00 0x561b48bb5150 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48bb97f0 0x561b48bbbc50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3087389036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba3ea0 0x561b48badbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.117+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 >> 172.21.15.82:0/3087389036 conn(0x561b48b9f510 msgr2=0x561b48b9e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.118+0000 7f89e2000640 0 client.26617 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:26:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.122+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 shutdown_connections 2024-04-26T20:26:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.122+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3087389036 wait complete. 2024-04-26T20:26:31.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.123+0000 7f8a01dcf740 20 client.26617 trim_cache size 0 max 16384 2024-04-26T20:26:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:30 smithi082 ceph-mon[28105]: pgmap v523: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-04-26T20:26:31.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:30 smithi139 ceph-mon[32999]: pgmap v523: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-04-26T20:26:31.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.373+0000 7f8a01dcf740 1 Processor -- start 2024-04-26T20:26:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.375+0000 7f8a01dcf740 1 -- start start 2024-04-26T20:26:31.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.375+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba3ea0 0x561b48ba2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.376+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba4890 0x561b48b9de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.378+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba3ea0 0x561b48ba2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.378+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba3ea0 0x561b48ba2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39564/0 (socket says 172.21.15.82:39564) 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.378+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48b9e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.378+0000 7f89f7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba4890 0x561b48b9de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.378+0000 7f89f7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba4890 0x561b48b9de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44208/0 (socket says 172.21.15.82:44208) 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.379+0000 7f89fce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48b9e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.379+0000 7f89fce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48b9e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51006/0 (socket says 172.21.15.82:51006) 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.379+0000 7f89f7e00640 1 -- 172.21.15.82:0/3767891294 learned_addr learned my addr 172.21.15.82:0/3767891294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.379+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f81c2b00 con 0x561b48ba9a00 2024-04-26T20:26:31.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.379+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89f81c47c0 con 0x561b48ba3ea0 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.379+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f89f81c31d0 con 0x561b48ba4890 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.380+0000 7f89fce00640 1 -- 172.21.15.82:0/3767891294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba4890 msgr2=0x561b48b9de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.380+0000 7f89fce00640 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba4890 0x561b48b9de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.380+0000 7f89fce00640 1 -- 172.21.15.82:0/3767891294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba3ea0 msgr2=0x561b48ba2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.380+0000 7f89fce00640 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba3ea0 0x561b48ba2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.380+0000 7f89fce00640 1 -- 172.21.15.82:0/3767891294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b488e37d0 con 0x561b48ba9a00 2024-04-26T20:26:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.380+0000 7f89fce00640 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48b9e340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89f009a380 tx=0x7f89f009c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7512fb638e225598 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:31.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.384+0000 7f89ecc00640 1 -- 172.21.15.82:0/3767891294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f00b4070 con 0x561b48ba9a00 2024-04-26T20:26:31.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.384+0000 7f89ecc00640 1 -- 172.21.15.82:0/3767891294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f009b520 con 0x561b48ba9a00 2024-04-26T20:26:31.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.384+0000 7f89ecc00640 1 -- 172.21.15.82:0/3767891294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f00a4b10 con 0x561b48ba9a00 2024-04-26T20:26:31.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.394+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 msgr2=0x561b48b9e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:31.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.394+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48b9e340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f89f009a380 tx=0x7f89f009c910 comp rx=0 tx=0).stop 2024-04-26T20:26:31.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.406+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 shutdown_connections 2024-04-26T20:26:31.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.406+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48b9e340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.406+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba4890 0x561b48b9de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.406+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/3767891294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba3ea0 0x561b48ba2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.406+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 >> 172.21.15.82:0/3767891294 conn(0x561b48b9f510 msgr2=0x561b48ba23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:31.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.410+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 shutdown_connections 2024-04-26T20:26:31.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.420+0000 7f8a01dcf740 1 -- 172.21.15.82:0/3767891294 wait complete. 2024-04-26T20:26:31.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.420+0000 7f8a01dcf740 1 -- start start 2024-04-26T20:26:31.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.421+0000 7f8a01dcf740 1 Processor -- start 2024-04-26T20:26:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.423+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba3ea0 0x561b48bb1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.423+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bb2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba3ea0 0x561b48bb1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba3ea0 0x561b48bb1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44220/0 (socket says 172.21.15.82:44220) 2024-04-26T20:26:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f8a01dcf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48bb3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f81c4030 con 0x561b48ba9a00 2024-04-26T20:26:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89f81c38a0 con 0x561b48ba4890 2024-04-26T20:26:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f8a01dcf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f89f81c0ae0 con 0x561b48ba3ea0 2024-04-26T20:26:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.424+0000 7f8a01dcf740 10 client.0 _ll_register_callbacks cb 0x7f89f0098370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.425+0000 7f89f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bb2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.425+0000 7f89fce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48bb3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.425+0000 7f89fce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48bb3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51016/0 (socket says 172.21.15.82:51016) 2024-04-26T20:26:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.425+0000 7f89fce00640 1 -- 172.21.15.82:0/4052456528 learned_addr learned my addr 172.21.15.82:0/4052456528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:31.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.426+0000 7f89fce00640 1 -- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba3ea0 msgr2=0x561b48bb1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.426+0000 7f89fce00640 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba3ea0 0x561b48bb1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.426+0000 7f89fce00640 1 -- 172.21.15.82:0/4052456528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 msgr2=0x561b48bb2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.426+0000 7f89fce00640 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bb2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.426+0000 7f89fce00640 1 -- 172.21.15.82:0/4052456528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b48aae2a0 con 0x561b48ba9a00 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.427+0000 7f89fce00640 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48bb3470 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f89f000bfd0 tx=0x7f89f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8964433205605aed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.433+0000 7f89e2000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.433+0000 7f89e2000640 1 -- 172.21.15.82:0/4052456528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f007f060 con 0x561b48ba9a00 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.433+0000 7f89e2000640 1 -- 172.21.15.82:0/4052456528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f89f0014440 con 0x561b48ba9a00 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.437+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f009b520 con 0x561b48ba9a00 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.437+0000 7f89e2000640 1 -- 172.21.15.82:0/4052456528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89f00b4070 con 0x561b48ba9a00 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.437+0000 7f8a01dcf740 10 client.16461 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:31.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.437+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b48aae2a0 con 0x561b48ba9a00 2024-04-26T20:26:31.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.438+0000 7f89e2000640 1 -- 172.21.15.82:0/4052456528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f009b520 con 0x561b48ba9a00 2024-04-26T20:26:31.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.440+0000 7f89e2000640 1 -- 172.21.15.82:0/4052456528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f89f009af90 con 0x561b48ba9a00 2024-04-26T20:26:31.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.441+0000 7f8a01dcf740 10 client.16461 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:31.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.441+0000 7f8a01dcf740 10 client.16461 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:26:31.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.441+0000 7f8a01dcf740 20 client.16461 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:31.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.441+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48c20210 0x561b48c22600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:31.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.441+0000 7f8a01dcf740 4 client.16461 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:26:31.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.441+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b48b0f6f0 con 0x561b48c20210 2024-04-26T20:26:31.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.442+0000 7f89f7e00640 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48c20210 0x561b48c22600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:31.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.443+0000 7f89f7e00640 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48c20210 0x561b48c22600 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e9ee5ea41959097f server_cookie=e4f1d36f6d1ce9b5 in_seq=0 out_seq=0 2024-04-26T20:26:31.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.443+0000 7f89e2000640 10 client.16461 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:26:31.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.450+0000 7f89e2000640 1 -- 172.21.15.82:0/4052456528 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b48b0f6f0 con 0x561b48c20210 2024-04-26T20:26:31.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.450+0000 7f89e2000640 10 client.16461 handle_command_reply: tid=0 2024-04-26T20:26:31.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.454+0000 7f8a01dcf740 1 client.16461 shutdown 2024-04-26T20:26:31.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.455+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 msgr2=0x561b48bb3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:31.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.455+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48bb3470 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f89f000bfd0 tx=0x7f89f0004a40 comp rx=0 tx=0).stop 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 shutdown_connections 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b48ba9a00 0x561b48bb3470 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x561b48c20210 0x561b48c22600 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b48ba4890 0x561b48bb2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f8a01dcf740 1 --2- 172.21.15.82:0/4052456528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b48ba3ea0 0x561b48bb1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 >> 172.21.15.82:0/4052456528 conn(0x561b48b9f510 msgr2=0x561b48ba5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:31.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.459+0000 7f89e2000640 0 client.16461 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:26:31.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.473+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 shutdown_connections 2024-04-26T20:26:31.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.473+0000 7f8a01dcf740 1 -- 172.21.15.82:0/4052456528 wait complete. 2024-04-26T20:26:31.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.475+0000 7f8a01dcf740 20 client.16461 trim_cache size 0 max 16384 2024-04-26T20:26:31.478 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:26:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.538+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89dc0a3e40 msgr2=0x7f89dc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.538+0000 7f89fee00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89dc0a3e40 0x7f89dc0a6300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f89f81a9020 tx=0x7f89e4009490 comp rx=0 tx=0).stop 2024-04-26T20:26:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.538+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f810ec70 msgr2=0x7f89f81af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:31.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.538+0000 7f89fee00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f810ec70 0x7f89f81af0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f89f000bdf0 tx=0x7f89f000bee0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.546+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 shutdown_connections 2024-04-26T20:26:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.546+0000 7f89fee00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f89dc0a3e40 0x7f89dc0a6300 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.546+0000 7f89fee00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f810ec70 0x7f89f81af0c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.546+0000 7f89fee00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f810c2a0 0x7f89f81a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.546+0000 7f89fee00640 1 --2- 172.21.15.82:0/4286687442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f8109930 0x7f89f81a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.546+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 >> 172.21.15.82:0/4286687442 conn(0x7f89f806f7c0 msgr2=0x7f89f8109d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:31.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.571+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 shutdown_connections 2024-04-26T20:26:31.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:31.597+0000 7f89fee00640 1 -- 172.21.15.82:0/4286687442 wait complete. 2024-04-26T20:26:32.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:26:34.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:33 smithi139 ceph-mon[32999]: pgmap v524: 129 pgs: 129 active+clean; 339 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 214 op/s 2024-04-26T20:26:34.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:33 smithi135 ceph-mon[32816]: pgmap v524: 129 pgs: 129 active+clean; 339 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 214 op/s 2024-04-26T20:26:34.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:33 smithi082 ceph-mon[28105]: pgmap v524: 129 pgs: 129 active+clean; 339 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 214 op/s 2024-04-26T20:26:35.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:34 smithi139 ceph-mon[32999]: pgmap v525: 129 pgs: 129 active+clean; 351 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 2.2 MiB/s wr, 233 op/s 2024-04-26T20:26:35.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:34 smithi135 ceph-mon[32816]: pgmap v525: 129 pgs: 129 active+clean; 351 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 2.2 MiB/s wr, 233 op/s 2024-04-26T20:26:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.124+0000 7fbd68000640 1 -- 172.21.15.82:0/3684994566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6010ec70 msgr2=0x7fbd6010f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.124+0000 7fbd68000640 1 --2- 172.21.15.82:0/3684994566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6010ec70 0x7fbd6010f120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbd5801acb0 tx=0x7fbd5803b920 comp rx=0 tx=0).stop 2024-04-26T20:26:35.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.139+0000 7fbd68000640 1 -- 172.21.15.82:0/3684994566 shutdown_connections 2024-04-26T20:26:35.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.139+0000 7fbd68000640 1 --2- 172.21.15.82:0/3684994566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd6010ec70 0x7fbd6010f120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.139+0000 7fbd68000640 1 --2- 172.21.15.82:0/3684994566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010c2a0 0x7fbd6010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.139+0000 7fbd68000640 1 --2- 172.21.15.82:0/3684994566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd60109930 0x7fbd6010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.139+0000 7fbd68000640 1 -- 172.21.15.82:0/3684994566 >> 172.21.15.82:0/3684994566 conn(0x7fbd6006f7c0 msgr2=0x7fbd60071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:35.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.141+0000 7fbd68000640 1 -- 172.21.15.82:0/3684994566 shutdown_connections 2024-04-26T20:26:35.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.146+0000 7fbd68000640 1 -- 172.21.15.82:0/3684994566 wait complete. 2024-04-26T20:26:35.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.148+0000 7fbd68000640 1 Processor -- start 2024-04-26T20:26:35.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.150+0000 7fbd68000640 1 -- start start 2024-04-26T20:26:35.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.158+0000 7fbd68000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd60109930 0x7fbd6019f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.164+0000 7fbd68000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 0x7fbd6019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.164+0000 7fbd65600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd60109930 0x7fbd6019f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.164+0000 7fbd65600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd60109930 0x7fbd6019f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44232/0 (socket says 172.21.15.82:44232) 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.164+0000 7fbd64c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 0x7fbd6019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.165+0000 7fbd64c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 0x7fbd6019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51030/0 (socket says 172.21.15.82:51030) 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.165+0000 7fbd65600640 1 -- 172.21.15.82:0/38049315 learned_addr learned my addr 172.21.15.82:0/38049315 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.165+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010ec70 0x7fbd601a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.169+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60112ae0 con 0x7fbd6010c2a0 2024-04-26T20:26:35.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.169+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60112960 con 0x7fbd6010ec70 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.169+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60112c60 con 0x7fbd60109930 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.170+0000 7fbd64c00640 1 -- 172.21.15.82:0/38049315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd60109930 msgr2=0x7fbd6019f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.170+0000 7fbd64c00640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd60109930 0x7fbd6019f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.170+0000 7fbd64c00640 1 -- 172.21.15.82:0/38049315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010ec70 msgr2=0x7fbd601a67a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.170+0000 7fbd66000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010ec70 0x7fbd601a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.170+0000 7fbd64c00640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010ec70 0x7fbd601a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.170+0000 7fbd64c00640 1 -- 172.21.15.82:0/38049315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd601a6e10 con 0x7fbd6010c2a0 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.171+0000 7fbd64c00640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 0x7fbd6019f730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d6a0 tx=0x7fbd4c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:35.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.171+0000 7fbd66000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010ec70 0x7fbd601a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:34 smithi082 ceph-mon[28105]: pgmap v525: 129 pgs: 129 active+clean; 351 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 2.2 MiB/s wr, 233 op/s 2024-04-26T20:26:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.186+0000 7fbd5e000640 1 -- 172.21.15.82:0/38049315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c017070 con 0x7fbd6010c2a0 2024-04-26T20:26:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.186+0000 7fbd5e000640 1 -- 172.21.15.82:0/38049315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd4c009cd0 con 0x7fbd6010c2a0 2024-04-26T20:26:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.186+0000 7fbd5e000640 1 -- 172.21.15.82:0/38049315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c003c20 con 0x7fbd6010c2a0 2024-04-26T20:26:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.206+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd601a7100 con 0x7fbd6010c2a0 2024-04-26T20:26:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.206+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd601a75d0 con 0x7fbd6010c2a0 2024-04-26T20:26:35.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.214+0000 7fbd5e000640 1 -- 172.21.15.82:0/38049315 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbd4c009820 con 0x7fbd6010c2a0 2024-04-26T20:26:35.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.221+0000 7fbd5e000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd480a3dc0 0x7fbd480a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.221+0000 7fbd65600640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd480a3dc0 0x7fbd480a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.223+0000 7fbd65600640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd480a3dc0 0x7fbd480a6280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009a90 tx=0x7fbd540091c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:35.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.223+0000 7fbd5e000640 1 -- 172.21.15.82:0/38049315 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbd4c09a010 con 0x7fbd6010c2a0 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.280+0000 7fbd6ad8a740 1 Processor -- start 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.281+0000 7fbd6ad8a740 1 -- start start 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.282+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 0x55b7435452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.282+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.282+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.282+0000 7fbd6ad8a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b7434a8c70 con 0x55b74354aa00 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.282+0000 7fbd6ad8a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b743461980 con 0x55b743545890 2024-04-26T20:26:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.282+0000 7fbd6ad8a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b7434a4c30 con 0x55b743544ea0 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.289+0000 7fbd65600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 0x55b7435452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.289+0000 7fbd65600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 0x55b7435452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44240/0 (socket says 172.21.15.82:44240) 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.289+0000 7fbd65600640 1 -- 172.21.15.82:0/2035278909 learned_addr learned my addr 172.21.15.82:0/2035278909 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.290+0000 7fbd65600640 1 -- 172.21.15.82:0/2035278909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 msgr2=0x55b74354a390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.290+0000 7fbd65600640 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.290+0000 7fbd65600640 1 -- 172.21.15.82:0/2035278909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 msgr2=0x55b74354ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.290+0000 7fbd65600640 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.290+0000 7fbd65600640 1 -- 172.21.15.82:0/2035278909 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7434397b0 con 0x55b743544ea0 2024-04-26T20:26:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.291+0000 7fbd65600640 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 0x55b7435452c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400ec00 tx=0x7fbd54011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381e084796ebb807 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.306+0000 7fbd52600640 1 -- 172.21.15.82:0/2035278909 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5403c050 con 0x55b743544ea0 2024-04-26T20:26:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.307+0000 7fbd52600640 1 -- 172.21.15.82:0/2035278909 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54046070 con 0x55b743544ea0 2024-04-26T20:26:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.307+0000 7fbd52600640 1 -- 172.21.15.82:0/2035278909 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54041660 con 0x55b743544ea0 2024-04-26T20:26:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.328+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/2035278909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 msgr2=0x55b7435452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.328+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 0x55b7435452c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400ec00 tx=0x7fbd54011000 comp rx=0 tx=0).stop 2024-04-26T20:26:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.329+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/2035278909 shutdown_connections 2024-04-26T20:26:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.329+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.329+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.329+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/2035278909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743544ea0 0x55b7435452c0 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400ec00 tx=0x7fbd54011000 comp rx=0 tx=0).stop 2024-04-26T20:26:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.329+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/2035278909 >> 172.21.15.82:0/2035278909 conn(0x55b743540510 msgr2=0x55b743540910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.332+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/2035278909 shutdown_connections 2024-04-26T20:26:35.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.332+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/2035278909 wait complete. 2024-04-26T20:26:35.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.335+0000 7fbd6ad8a740 1 -- start start 2024-04-26T20:26:35.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.335+0000 7fbd6ad8a740 1 Processor -- start 2024-04-26T20:26:35.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.340+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.340+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.343+0000 7fbd64c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.343+0000 7fbd64c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51038/0 (socket says 172.21.15.82:51038) 2024-04-26T20:26:35.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.343+0000 7fbd65600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.343+0000 7fbd65600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39606/0 (socket says 172.21.15.82:39606) 2024-04-26T20:26:35.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.343+0000 7fbd64c00640 1 -- 172.21.15.82:0/602347834 learned_addr learned my addr 172.21.15.82:0/602347834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:35.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.344+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743556950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.344+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b7434a7f80 con 0x55b74354aa00 2024-04-26T20:26:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.344+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b743455260 con 0x55b743545890 2024-04-26T20:26:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.344+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b7434ad2a0 con 0x55b743554560 2024-04-26T20:26:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.344+0000 7fbd66000640 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743556950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.349+0000 7fbd6ad8a740 10 client.0 _ll_register_callbacks cb 0x55b74349f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.350+0000 7fbd64c00640 1 -- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 msgr2=0x55b743556950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.350+0000 7fbd64c00640 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743556950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.350+0000 7fbd64c00640 1 -- 172.21.15.82:0/602347834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 msgr2=0x55b74354f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.350+0000 7fbd64c00640 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.350+0000 7fbd64c00640 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7434371c0 con 0x55b74354aa00 2024-04-26T20:26:35.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.350+0000 7fbd64c00640 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354f5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0a46b0 tx=0x7fbd4c0a46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f48f26fbf40a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.368+0000 7fbd46a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.368+0000 7fbd46a00640 1 -- 172.21.15.82:0/602347834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0989a0 con 0x55b74354aa00 2024-04-26T20:26:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.368+0000 7fbd46a00640 1 -- 172.21.15.82:0/602347834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbd4c098040 con 0x55b74354aa00 2024-04-26T20:26:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.379+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd54046070 con 0x55b74354aa00 2024-04-26T20:26:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.382+0000 7fbd46a00640 1 -- 172.21.15.82:0/602347834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbd4c098b40 con 0x55b74354aa00 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.382+0000 7fbd6ad8a740 10 client.16467 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.382+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b7431ba3f0 con 0x55b74354aa00 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.383+0000 7fbd46a00640 1 -- 172.21.15.82:0/602347834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54046070 con 0x55b74354aa00 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd46a00640 1 -- 172.21.15.82:0/602347834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fbd4c0985e0 con 0x55b74354aa00 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd6ad8a740 10 client.16467 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd6ad8a740 10 client.16467 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd6ad8a740 20 client.16467 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74355ae20 0x55b74355d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd6ad8a740 4 client.16467 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7434b6880 con 0x55b74355ae20 2024-04-26T20:26:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.384+0000 7fbd65600640 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74355ae20 0x55b74355d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.404+0000 7fbd65600640 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74355ae20 0x55b74355d230 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8540485e699f5965 server_cookie=d614efc298c1838 in_seq=0 out_seq=0 2024-04-26T20:26:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.404+0000 7fbd46a00640 10 client.16467 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:26:35.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.405+0000 7fbd46a00640 1 -- 172.21.15.82:0/602347834 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b7434b6880 con 0x55b74355ae20 2024-04-26T20:26:35.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.405+0000 7fbd46a00640 10 client.16467 handle_command_reply: tid=0 2024-04-26T20:26:35.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.405+0000 7fbd6ad8a740 1 client.16467 shutdown 2024-04-26T20:26:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.427+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 msgr2=0x55b74354f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.427+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354f5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0a46b0 tx=0x7fbd4c0a46e0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 shutdown_connections 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74355ae20 0x55b74355d230 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743556950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74354aa00 0x55b74354f5a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/602347834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743545890 0x55b74354f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 >> 172.21.15.82:0/602347834 conn(0x55b743540510 msgr2=0x55b74353f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd46a00640 0 client.16467 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:26:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 shutdown_connections 2024-04-26T20:26:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.432+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/602347834 wait complete. 2024-04-26T20:26:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.449+0000 7fbd6ad8a740 20 client.16467 trim_cache size 0 max 16384 2024-04-26T20:26:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.604+0000 7fbd6ad8a740 1 Processor -- start 2024-04-26T20:26:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.604+0000 7fbd6ad8a740 1 -- start start 2024-04-26T20:26:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.605+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74354cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.606+0000 7fbd65600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74354cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.606+0000 7fbd65600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74354cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51052/0 (socket says 172.21.15.82:51052) 2024-04-26T20:26:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.606+0000 7fbd65600640 1 -- 172.21.15.82:0/917931295 learned_addr learned my addr 172.21.15.82:0/917931295 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.606+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b74354aa00 0x55b74353b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.607+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743543450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.607+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b1a50 con 0x55b743545890 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.607+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b3710 con 0x55b74354aa00 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.607+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b2120 con 0x55b743554560 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.607+0000 7fbd66000640 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743543450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.607+0000 7fbd64c00640 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b74354aa00 0x55b74353b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.608+0000 7fbd65600640 1 -- 172.21.15.82:0/917931295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 msgr2=0x55b743543450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.608+0000 7fbd65600640 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743543450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.608+0000 7fbd65600640 1 -- 172.21.15.82:0/917931295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b74354aa00 msgr2=0x55b74353b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.608+0000 7fbd65600640 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b74354aa00 0x55b74353b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.608+0000 7fbd65600640 1 -- 172.21.15.82:0/917931295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7432847d0 con 0x55b743545890 2024-04-26T20:26:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.609+0000 7fbd65600640 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74354cdf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbd54015910 tx=0x7fbd54015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9151c5c1d9d7d0af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.617+0000 7fbd51c00640 1 -- 172.21.15.82:0/917931295 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54053bc0 con 0x55b743545890 2024-04-26T20:26:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.617+0000 7fbd51c00640 1 -- 172.21.15.82:0/917931295 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54058070 con 0x55b743545890 2024-04-26T20:26:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.617+0000 7fbd51c00640 1 -- 172.21.15.82:0/917931295 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540139d0 con 0x55b743545890 2024-04-26T20:26:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.619+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 msgr2=0x55b74354cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.619+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74354cdf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbd54015910 tx=0x7fbd54015000 comp rx=0 tx=0).stop 2024-04-26T20:26:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.620+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 shutdown_connections 2024-04-26T20:26:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.620+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b743554560 0x55b743543450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.621+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b74354aa00 0x55b74353b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.621+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/917931295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74354cdf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.625+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 >> 172.21.15.82:0/917931295 conn(0x55b743540510 msgr2=0x55b7435408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.625+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 shutdown_connections 2024-04-26T20:26:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.625+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/917931295 wait complete. 2024-04-26T20:26:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.625+0000 7fbd6ad8a740 1 -- start start 2024-04-26T20:26:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.626+0000 7fbd6ad8a740 1 Processor -- start 2024-04-26T20:26:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.627+0000 7fbd6ad8a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74356b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.628+0000 7fbd65600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74356b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.628+0000 7fbd65600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74356b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51064/0 (socket says 172.21.15.82:51064) 2024-04-26T20:26:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.628+0000 7fbd65600640 1 -- 172.21.15.82:0/227183299 learned_addr learned my addr 172.21.15.82:0/227183299 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.628+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b74354aa00 0x55b74356bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.628+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743554560 0x55b74356cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.628+0000 7fbd64c00640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b74354aa00 0x55b74356bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b2f80 con 0x55b743545890 2024-04-26T20:26:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601b27f0 con 0x55b743554560 2024-04-26T20:26:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601afa30 con 0x55b74354aa00 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd66000640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743554560 0x55b74356cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd64c00640 1 -- 172.21.15.82:0/227183299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743554560 msgr2=0x55b74356cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd64c00640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743554560 0x55b74356cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.629+0000 7fbd64c00640 1 -- 172.21.15.82:0/227183299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 msgr2=0x55b74356b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.630+0000 7fbd64c00640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74356b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.630+0000 7fbd64c00640 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b74344f2a0 con 0x55b74354aa00 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.630+0000 7fbd65600640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74356b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.630+0000 7fbd6ad8a740 10 client.0 _ll_register_callbacks cb 0x7fbd54009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.630+0000 7fbd64c00640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b74354aa00 0x55b74356bdf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0993c0 tx=0x7fbd4c0a0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3afa4d93a20de894 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.630+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd54058070 con 0x55b74354aa00 2024-04-26T20:26:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.660+0000 7fbd46a00640 10 client.26641 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:26:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.660+0000 7fbd46a00640 1 -- 172.21.15.82:0/227183299 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c098ce0 con 0x55b74354aa00 2024-04-26T20:26:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.660+0000 7fbd46a00640 1 -- 172.21.15.82:0/227183299 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbd4c09b8d0 con 0x55b74354aa00 2024-04-26T20:26:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.660+0000 7fbd46a00640 1 -- 172.21.15.82:0/227183299 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbd4c098eb0 con 0x55b74354aa00 2024-04-26T20:26:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 10 client.26641 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55b74356e070 con 0x55b74354aa00 2024-04-26T20:26:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd46a00640 1 -- 172.21.15.82:0/227183299 <== mon.1 v2:172.21.15.139:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7fbd4c096ae0 con 0x55b74354aa00 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 10 client.26641 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 10 client.26641 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 20 client.26641 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74356e6c0 0x55b7435c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 4 client.26641 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.679+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbd54058070 con 0x55b74356e6c0 2024-04-26T20:26:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.680+0000 7fbd65600640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74356e6c0 0x55b7435c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd46a00640 10 client.26641 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:26:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd65600640 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74356e6c0 0x55b7435c2e60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=86bf5cc2dfcaad7b server_cookie=5256001b4eeb7581 in_seq=0 out_seq=0 2024-04-26T20:26:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd46a00640 1 -- 172.21.15.82:0/227183299 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbd54058070 con 0x55b74356e6c0 2024-04-26T20:26:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd46a00640 10 client.26641 handle_command_reply: tid=0 2024-04-26T20:26:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd6ad8a740 1 client.26641 shutdown 2024-04-26T20:26:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b74354aa00 msgr2=0x55b74356bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b74354aa00 0x55b74356bdf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0993c0 tx=0x7fbd4c0a0000 comp rx=0 tx=0).stop 2024-04-26T20:26:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 shutdown_connections 2024-04-26T20:26:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.681+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55b74356e6c0 0x55b7435c2e60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.682+0000 7fbd46a00640 0 client.26641 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:26:35.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.682+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b743554560 0x55b74356cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.682+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b74354aa00 0x55b74356bdf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.682+0000 7fbd6ad8a740 1 --2- 172.21.15.82:0/227183299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b743545890 0x55b74356b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.682+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 >> 172.21.15.82:0/227183299 conn(0x55b743540510 msgr2=0x55b74353b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:35.689 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:26:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.687+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 shutdown_connections 2024-04-26T20:26:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.687+0000 7fbd6ad8a740 1 -- 172.21.15.82:0/227183299 wait complete. 2024-04-26T20:26:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.687+0000 7fbd6ad8a740 20 client.26641 trim_cache size 0 max 16384 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd480a3dc0 msgr2=0x7fbd480a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd480a3dc0 0x7fbd480a6280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009a90 tx=0x7fbd540091c0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 msgr2=0x7fbd6019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 0x7fbd6019f730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d6a0 tx=0x7fbd4c00db60 comp rx=0 tx=0).stop 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 shutdown_connections 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd480a3dc0 0x7fbd480a6280 secure :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009a90 tx=0x7fbd540091c0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.714+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6010ec70 0x7fbd601a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.715+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd6010c2a0 0x7fbd6019f730 secure :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00d6a0 tx=0x7fbd4c00db60 comp rx=0 tx=0).stop 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.715+0000 7fbd68000640 1 --2- 172.21.15.82:0/38049315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd60109930 0x7fbd6019f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.715+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 >> 172.21.15.82:0/38049315 conn(0x7fbd6006f7c0 msgr2=0x7fbd6010a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.716+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 shutdown_connections 2024-04-26T20:26:35.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:35.716+0000 7fbd68000640 1 -- 172.21.15.82:0/38049315 wait complete. 2024-04-26T20:26:35.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:26:37.040 INFO:tasks.workunit.client.0.smithi082.stdout: 99 597162 327 398471 395 139185 512 2024-04-26T20:26:37.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:36 smithi135 ceph-mon[32816]: pgmap v526: 129 pgs: 129 active+clean; 367 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-04-26T20:26:37.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:36 smithi082 ceph-mon[28105]: pgmap v526: 129 pgs: 129 active+clean; 367 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-04-26T20:26:37.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:36 smithi139 ceph-mon[32999]: pgmap v526: 129 pgs: 129 active+clean; 367 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-04-26T20:26:37.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.840+0000 7f71ef200640 1 -- 172.21.15.82:0/580110521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810c2a0 msgr2=0x7f71e810e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.840+0000 7f71ef200640 1 --2- 172.21.15.82:0/580110521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810c2a0 0x7f71e810e730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009900 tx=0x7f71d402a410 comp rx=0 tx=0).stop 2024-04-26T20:26:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.860+0000 7f71ef200640 1 -- 172.21.15.82:0/580110521 shutdown_connections 2024-04-26T20:26:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.860+0000 7f71ef200640 1 --2- 172.21.15.82:0/580110521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e810ec70 0x7f71e810f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.860+0000 7f71ef200640 1 --2- 172.21.15.82:0/580110521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810c2a0 0x7f71e810e730 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.860+0000 7f71ef200640 1 --2- 172.21.15.82:0/580110521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e810bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.860+0000 7f71ef200640 1 -- 172.21.15.82:0/580110521 >> 172.21.15.82:0/580110521 conn(0x7f71e806f7c0 msgr2=0x7f71e8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:37.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.862+0000 7f71ef200640 1 -- 172.21.15.82:0/580110521 shutdown_connections 2024-04-26T20:26:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.864+0000 7f71ef200640 1 -- 172.21.15.82:0/580110521 wait complete. 2024-04-26T20:26:37.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.875+0000 7f71ef200640 1 Processor -- start 2024-04-26T20:26:37.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.887+0000 7f71ef200640 1 -- start start 2024-04-26T20:26:37.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.888+0000 7f71ef200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e81a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.888+0000 7f71ef200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e810c2a0 0x7f71e81a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.888+0000 7f71ef200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810ec70 0x7f71e81aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.888+0000 7f71ef200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71e811d2d0 con 0x7f71e8109930 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.888+0000 7f71ef200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71e811d150 con 0x7f71e810c2a0 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.888+0000 7f71ef200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f71e811d450 con 0x7f71e810ec70 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.889+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e81a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.889+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e81a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51090/0 (socket says 172.21.15.82:51090) 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.889+0000 7f71e7e00640 1 -- 172.21.15.82:0/3474033585 learned_addr learned my addr 172.21.15.82:0/3474033585 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.893+0000 7f71ed200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810ec70 0x7f71e81aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.894+0000 7f71e7400640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e810c2a0 0x7f71e81a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.899+0000 7f71ed200640 1 -- 172.21.15.82:0/3474033585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e810c2a0 msgr2=0x7f71e81a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.899+0000 7f71ed200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e810c2a0 0x7f71e81a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.899+0000 7f71ed200640 1 -- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 msgr2=0x7f71e81a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:37.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.903+0000 7f71ed200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e81a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:37.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.903+0000 7f71ed200640 1 -- 172.21.15.82:0/3474033585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e81af630 con 0x7f71e810ec70 2024-04-26T20:26:37.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.903+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e81a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:37.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.904+0000 7f71ed200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810ec70 0x7f71e81aefc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005fd0 tx=0x7f71e000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.914+0000 7f71e4c00640 1 -- 172.21.15.82:0/3474033585 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e000cdf0 con 0x7f71e810ec70 2024-04-26T20:26:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.914+0000 7f71e4c00640 1 -- 172.21.15.82:0/3474033585 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e0005020 con 0x7f71e810ec70 2024-04-26T20:26:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.914+0000 7f71e4c00640 1 -- 172.21.15.82:0/3474033585 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0010690 con 0x7f71e810ec70 2024-04-26T20:26:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.930+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e8074bc0 con 0x7f71e810ec70 2024-04-26T20:26:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:37.930+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e8075090 con 0x7f71e810ec70 2024-04-26T20:26:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.003+0000 7f71e4c00640 1 -- 172.21.15.82:0/3474033585 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f71e0005440 con 0x7f71e810ec70 2024-04-26T20:26:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.005+0000 7f71e4c00640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71cc0a3e40 0x7f71cc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.005+0000 7f71e4c00640 1 -- 172.21.15.82:0/3474033585 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f71e00d0d80 con 0x7f71e810ec70 2024-04-26T20:26:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.006+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71cc0a3e40 0x7f71cc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.007+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71cc0a3e40 0x7f71cc0a6300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005fd0 tx=0x7f71d800b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:38.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.022+0000 7f71f21e2740 1 Processor -- start 2024-04-26T20:26:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 -- start start 2024-04-26T20:26:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77dd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c4b773bc70 con 0x55c4b77d7ea0 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4b76f4980 con 0x55c4b77dda00 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.033+0000 7f71f21e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c4b7737c30 con 0x55c4b77d8890 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.038+0000 7f71ed200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.038+0000 7f71ed200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77dfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39656/0 (socket says 172.21.15.82:39656) 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.038+0000 7f71ed200640 1 -- 172.21.15.82:0/1616584054 learned_addr learned my addr 172.21.15.82:0/1616584054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.038+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.039+0000 7f71e7e00640 1 -- 172.21.15.82:0/1616584054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 msgr2=0x55c4b77dd390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.039+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77dd390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.039+0000 7f71e7e00640 1 -- 172.21.15.82:0/1616584054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 msgr2=0x55c4b77dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.039+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.039+0000 7f71e7e00640 1 -- 172.21.15.82:0/1616584054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b76cc7b0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.039+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77d82c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f71d8011930 tx=0x7f71d8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704f58c6115eb6ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.041+0000 7f71dd600640 1 -- 172.21.15.82:0/1616584054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d800eab0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.041+0000 7f71dd600640 1 -- 172.21.15.82:0/1616584054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71d80054d0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.041+0000 7f71dd600640 1 -- 172.21.15.82:0/1616584054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8004c10 con 0x55c4b77d7ea0 2024-04-26T20:26:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.042+0000 7f71f21e2740 1 -- 172.21.15.82:0/1616584054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 msgr2=0x55c4b77d82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.042+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77d82c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f71d8011930 tx=0x7f71d8013000 comp rx=0 tx=0).stop 2024-04-26T20:26:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.042+0000 7f71f21e2740 1 -- 172.21.15.82:0/1616584054 shutdown_connections 2024-04-26T20:26:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.042+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.042+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.042+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1616584054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77d82c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.043+0000 7f71f21e2740 1 -- 172.21.15.82:0/1616584054 >> 172.21.15.82:0/1616584054 conn(0x55c4b77d3510 msgr2=0x55c4b77d3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.054+0000 7f71f21e2740 1 -- 172.21.15.82:0/1616584054 shutdown_connections 2024-04-26T20:26:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.055+0000 7f71f21e2740 1 -- 172.21.15.82:0/1616584054 wait complete. 2024-04-26T20:26:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.055+0000 7f71f21e2740 1 -- start start 2024-04-26T20:26:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.055+0000 7f71f21e2740 1 Processor -- start 2024-04-26T20:26:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.056+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51108/0 (socket says 172.21.15.82:51108) 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71e7e00640 1 -- 172.21.15.82:0/1527305462 learned_addr learned my addr 172.21.15.82:0/1527305462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77fa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c4b773af80 con 0x55c4b77d7ea0 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4b76e8260 con 0x55c4b77dda00 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.057+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c4b77402a0 con 0x55c4b77d8890 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.058+0000 7f71ed200640 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.058+0000 7f71e7e00640 1 -- 172.21.15.82:0/1527305462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 msgr2=0x55c4b77f3340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.058+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f3340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.058+0000 7f71e7e00640 1 -- 172.21.15.82:0/1527305462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 msgr2=0x55c4b77fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.058+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77fa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.058+0000 7f71e7e00640 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b76ca1c0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.059+0000 7f71e7e00640 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f2e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e780 tx=0x7f71d8004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822c8445688fdc03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.060+0000 7f71f21e2740 10 client.0 _ll_register_callbacks cb 0x55c4b7732960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.060+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d80054d0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.067+0000 7f71d2000640 10 client.16485 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.067+0000 7f71d2000640 1 -- 172.21.15.82:0/1527305462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8036060 con 0x55c4b77d7ea0 2024-04-26T20:26:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.067+0000 7f71d2000640 1 -- 172.21.15.82:0/1527305462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f71d800e8b0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.067+0000 7f71d2000640 1 -- 172.21.15.82:0/1527305462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f71d803d050 con 0x55c4b77d7ea0 2024-04-26T20:26:38.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.075+0000 7f71f21e2740 10 client.16485 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:38.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.075+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55c4b744d3f0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.082+0000 7f71d2000640 1 -- 172.21.15.82:0/1527305462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f71d800eab0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71f21e2740 10 client.16485 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71f21e2740 10 client.16485 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71f21e2740 20 client.16485 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77fe4b0 0x55c4b7800970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71f21e2740 4 client.16485 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f71d80054d0 con 0x55c4b77fe4b0 2024-04-26T20:26:38.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.083+0000 7f71e7400640 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77fe4b0 0x55c4b7800970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.084+0000 7f71e7400640 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77fe4b0 0x55c4b7800970 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1894372873120612 server_cookie=d8002d7b0756849b in_seq=0 out_seq=0 2024-04-26T20:26:38.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.085+0000 7f71d2000640 10 client.16485 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:26:38.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.086+0000 7f71d2000640 1 -- 172.21.15.82:0/1527305462 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f71d80054d0 con 0x55c4b77fe4b0 2024-04-26T20:26:38.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.086+0000 7f71d2000640 10 client.16485 handle_command_reply: tid=0 2024-04-26T20:26:38.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.087+0000 7f71f21e2740 1 client.16485 shutdown 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 msgr2=0x55c4b77f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f2e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e780 tx=0x7f71d8004be0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 shutdown_connections 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77fe4b0 0x55c4b7800970 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77fa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 --2- 172.21.15.82:0/1527305462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f2e00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 >> 172.21.15.82:0/1527305462 conn(0x55c4b77d3510 msgr2=0x55c4b77d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.095+0000 7f71d2000640 0 client.16485 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:26:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.096+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 shutdown_connections 2024-04-26T20:26:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.097+0000 7f71f21e2740 1 -- 172.21.15.82:0/1527305462 wait complete. 2024-04-26T20:26:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.097+0000 7f71f21e2740 20 client.16485 trim_cache size 0 max 16384 2024-04-26T20:26:38.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.276+0000 7f71f21e2740 1 Processor -- start 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.282+0000 7f71f21e2740 1 -- start start 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.282+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.285+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.285+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51110/0 (socket says 172.21.15.82:51110) 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.285+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77d8890 0x55c4b77d6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.285+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77dda00 0x55c4b77d91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.289+0000 7f71f21e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8076e00 con 0x55c4b77d7ea0 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.289+0000 7f71f21e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8078ac0 con 0x55c4b77d8890 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.289+0000 7f71f21e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f71e80774d0 con 0x55c4b77dda00 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.289+0000 7f71e7e00640 1 -- 172.21.15.82:0/3087927114 learned_addr learned my addr 172.21.15.82:0/3087927114 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.290+0000 7f71e7e00640 1 -- 172.21.15.82:0/3087927114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77dda00 msgr2=0x55c4b77d91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.290+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77dda00 0x55c4b77d91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.290+0000 7f71e7e00640 1 -- 172.21.15.82:0/3087927114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77d8890 msgr2=0x55c4b77d6c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:26:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.290+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77d8890 0x55c4b77d6c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.290+0000 7f71e7e00640 1 -- 172.21.15.82:0/3087927114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b75177d0 con 0x55c4b77d7ea0 2024-04-26T20:26:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.290+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f32a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71d8010f70 tx=0x7f71d802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa0cb27ac70f621 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.291+0000 7f71dcc00640 1 -- 172.21.15.82:0/3087927114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8036040 con 0x55c4b77d7ea0 2024-04-26T20:26:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.291+0000 7f71dcc00640 1 -- 172.21.15.82:0/3087927114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71d8011560 con 0x55c4b77d7ea0 2024-04-26T20:26:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.291+0000 7f71dcc00640 1 -- 172.21.15.82:0/3087927114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8063680 con 0x55c4b77d7ea0 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.301+0000 7f71f21e2740 1 -- 172.21.15.82:0/3087927114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 msgr2=0x55c4b77f32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.301+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f32a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71d8010f70 tx=0x7f71d802e000 comp rx=0 tx=0).stop 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.302+0000 7f71f21e2740 1 -- 172.21.15.82:0/3087927114 shutdown_connections 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.302+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77dda00 0x55c4b77d91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.302+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77d8890 0x55c4b77d6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.302+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3087927114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77d7ea0 0x55c4b77f32a0 secure :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71d8010f70 tx=0x7f71d802e000 comp rx=0 tx=0).stop 2024-04-26T20:26:38.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.302+0000 7f71f21e2740 1 -- 172.21.15.82:0/3087927114 >> 172.21.15.82:0/3087927114 conn(0x55c4b77d3510 msgr2=0x55c4b77d6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.305+0000 7f71f21e2740 1 -- 172.21.15.82:0/3087927114 shutdown_connections 2024-04-26T20:26:38.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.305+0000 7f71f21e2740 1 -- 172.21.15.82:0/3087927114 wait complete. 2024-04-26T20:26:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.308+0000 7f71f21e2740 1 -- start start 2024-04-26T20:26:38.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.308+0000 7f71f21e2740 1 Processor -- start 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.309+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.309+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77f7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.309+0000 7f71f21e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77f8830 0x55c4b77f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.310+0000 7f71f21e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8078330 con 0x55c4b77f8830 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.310+0000 7f71f21e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8077ba0 con 0x55c4b77dda00 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.310+0000 7f71f21e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f71e81192d0 con 0x55c4b77d8890 2024-04-26T20:26:38.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.310+0000 7f71f21e2740 10 client.0 _ll_register_callbacks cb 0x7f71e0098740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39678/0 (socket says 172.21.15.82:39678) 2024-04-26T20:26:38.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 -- 172.21.15.82:0/3386776177 learned_addr learned my addr 172.21.15.82:0/3386776177 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 -- 172.21.15.82:0/3386776177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 msgr2=0x55c4b77f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 -- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77f8830 msgr2=0x55c4b77f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77f8830 0x55c4b77f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.312+0000 7f71e7400640 1 -- 172.21.15.82:0/3386776177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b76e22a0 con 0x55c4b77dda00 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.313+0000 7f71e7400640 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77f7890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009230 tx=0x7f71d4004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71bbf0720c99ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:38.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.313+0000 7f71d2000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:26:38.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.323+0000 7f71d2000640 1 -- 172.21.15.82:0/3386776177 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4035040 con 0x55c4b77dda00 2024-04-26T20:26:38.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.323+0000 7f71d2000640 1 -- 172.21.15.82:0/3386776177 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f71d4065070 con 0x55c4b77dda00 2024-04-26T20:26:38.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.323+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d8011560 con 0x55c4b77dda00 2024-04-26T20:26:38.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.323+0000 7f71d2000640 1 -- 172.21.15.82:0/3386776177 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f71d4066bc0 con 0x55c4b77dda00 2024-04-26T20:26:38.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.324+0000 7f71f21e2740 10 client.26600 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:38.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.324+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c4b77e6b00 con 0x55c4b77dda00 2024-04-26T20:26:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.324+0000 7f71d2000640 1 -- 172.21.15.82:0/3386776177 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71d4066d60 con 0x55c4b77dda00 2024-04-26T20:26:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.325+0000 7f71d2000640 1 -- 172.21.15.82:0/3386776177 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f71d405b040 con 0x55c4b77dda00 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.325+0000 7f71f21e2740 10 client.26600 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.325+0000 7f71f21e2740 10 client.26600 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.325+0000 7f71f21e2740 20 client.26600 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.326+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77e74c0 0x55c4b77e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.326+0000 7f71f21e2740 4 client.26600 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.326+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f71d8011560 con 0x55c4b77e74c0 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.326+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77e74c0 0x55c4b77e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.327+0000 7f71e7e00640 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77e74c0 0x55c4b77e98e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=22ea7ee016b98b0 server_cookie=206ea78f7fbb828c in_seq=0 out_seq=0 2024-04-26T20:26:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.327+0000 7f71d2000640 10 client.26600 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:26:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71d2000640 1 -- 172.21.15.82:0/3386776177 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f71d8011560 con 0x55c4b77e74c0 2024-04-26T20:26:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71d2000640 10 client.26600 handle_command_reply: tid=0 2024-04-26T20:26:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 client.26600 shutdown 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 msgr2=0x55c4b77f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77f7890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009230 tx=0x7f71d4004320 comp rx=0 tx=0).stop 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 shutdown_connections 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x55c4b77e74c0 0x55c4b77e98e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b77f8830 0x55c4b77f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4b77dda00 0x55c4b77f7890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 --2- 172.21.15.82:0/3386776177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c4b77d8890 0x55c4b77f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 >> 172.21.15.82:0/3386776177 conn(0x55c4b77d3510 msgr2=0x55c4b77d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.328+0000 7f71d2000640 0 client.26600 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.329+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 shutdown_connections 2024-04-26T20:26:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.329+0000 7f71f21e2740 1 -- 172.21.15.82:0/3386776177 wait complete. 2024-04-26T20:26:38.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.329+0000 7f71f21e2740 20 client.26600 trim_cache size 0 max 16384 2024-04-26T20:26:38.332 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:26:38.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71cc0a3e40 msgr2=0x7f71cc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:38.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71cc0a3e40 0x7f71cc0a6300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005fd0 tx=0x7f71d800b480 comp rx=0 tx=0).stop 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810ec70 msgr2=0x7f71e81aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810ec70 0x7f71e81aefc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005fd0 tx=0x7f71e000ef10 comp rx=0 tx=0).stop 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 shutdown_connections 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f71cc0a3e40 0x7f71cc0a6300 secure :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005fd0 tx=0x7f71d800b480 comp rx=0 tx=0).stop 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71e810ec70 0x7f71e81aefc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e810c2a0 0x7f71e81a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 --2- 172.21.15.82:0/3474033585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71e8109930 0x7f71e81a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.334+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 >> 172.21.15.82:0/3474033585 conn(0x7f71e806f7c0 msgr2=0x7f71e8109d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.335+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 shutdown_connections 2024-04-26T20:26:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:38.335+0000 7f71ef200640 1 -- 172.21.15.82:0/3474033585 wait complete. 2024-04-26T20:26:38.444 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:26:39.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:38 smithi135 ceph-mon[32816]: pgmap v527: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 314 op/s 2024-04-26T20:26:39.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:38 smithi082 ceph-mon[28105]: pgmap v527: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 314 op/s 2024-04-26T20:26:39.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:38 smithi139 ceph-mon[32999]: pgmap v527: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 314 op/s 2024-04-26T20:26:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.392+0000 7f654fe00640 1 -- 172.21.15.82:0/2362754894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 msgr2=0x7f6550113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.392+0000 7f654fe00640 1 --2- 172.21.15.82:0/2362754894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 0x7f6550113060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6540009900 tx=0x7f654002a440 comp rx=0 tx=0).stop 2024-04-26T20:26:40.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.437+0000 7f654fe00640 1 -- 172.21.15.82:0/2362754894 shutdown_connections 2024-04-26T20:26:40.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.437+0000 7f654fe00640 1 --2- 172.21.15.82:0/2362754894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 0x7f6550113060 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.437+0000 7f654fe00640 1 --2- 172.21.15.82:0/2362754894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550073e50 0x7f65500742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.437+0000 7f654fe00640 1 --2- 172.21.15.82:0/2362754894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655010a510 0x7f6550073910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.437+0000 7f654fe00640 1 -- 172.21.15.82:0/2362754894 >> 172.21.15.82:0/2362754894 conn(0x7f655006f780 msgr2=0x7f6550071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.458+0000 7f654fe00640 1 -- 172.21.15.82:0/2362754894 shutdown_connections 2024-04-26T20:26:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.463+0000 7f654fe00640 1 -- 172.21.15.82:0/2362754894 wait complete. 2024-04-26T20:26:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.464+0000 7f654fe00640 1 Processor -- start 2024-04-26T20:26:40.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 -- start start 2024-04-26T20:26:40.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6550073e50 0x7f655010c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 0x7f655010ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 0x7f655010b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6550116af0 con 0x7f655010a510 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6550116970 con 0x7f6550073e50 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.490+0000 7f654fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6550116c70 con 0x7f6550110c70 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.491+0000 7f654f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 0x7f655010b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.491+0000 7f654e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 0x7f655010ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 0x7f655010ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51134/0 (socket says 172.21.15.82:51134) 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 -- 172.21.15.82:0/1416317713 learned_addr learned my addr 172.21.15.82:0/1416317713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 -- 172.21.15.82:0/1416317713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 msgr2=0x7f655010b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 0x7f655010b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 -- 172.21.15.82:0/1416317713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6550073e50 msgr2=0x7f655010c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6550073e50 0x7f655010c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.492+0000 7f654e000640 1 -- 172.21.15.82:0/1416317713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65501a4fc0 con 0x7f655010a510 2024-04-26T20:26:40.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.493+0000 7f654e000640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 0x7f655010ac00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6548007ea0 tx=0x7f6548007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:40.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.521+0000 7f6547400640 1 -- 172.21.15.82:0/1416317713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548003970 con 0x7f655010a510 2024-04-26T20:26:40.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.521+0000 7f6547400640 1 -- 172.21.15.82:0/1416317713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6548004030 con 0x7f655010a510 2024-04-26T20:26:40.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.521+0000 7f6547400640 1 -- 172.21.15.82:0/1416317713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654800f790 con 0x7f655010a510 2024-04-26T20:26:40.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.539+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65501a52b0 con 0x7f655010a510 2024-04-26T20:26:40.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.539+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65501a5780 con 0x7f655010a510 2024-04-26T20:26:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.593+0000 7f6558965740 1 Processor -- start 2024-04-26T20:26:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.594+0000 7f6547400640 1 -- 172.21.15.82:0/1416317713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f65480041e0 con 0x7f655010a510 2024-04-26T20:26:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.596+0000 7f6547400640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f65340a3e40 0x7f65340a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.612+0000 7f6547400640 1 -- 172.21.15.82:0/1416317713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f65480d0d00 con 0x7f655010a510 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 -- start start 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e789a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e789f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e8e77fdc70 con 0x55e8e789aab0 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8e77b6980 con 0x55e8e789a0c0 2024-04-26T20:26:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.613+0000 7f6558965740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8e77f9c30 con 0x55e8e789fc20 2024-04-26T20:26:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.614+0000 7f654f400640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f65340a3e40 0x7f65340a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.614+0000 7f654ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e789a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.615+0000 7f654f400640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f65340a3e40 0x7f65340a6300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6540005dc0 tx=0x7f6540005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.615+0000 7f654ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e789a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39718/0 (socket says 172.21.15.82:39718) 2024-04-26T20:26:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.615+0000 7f654ea00640 1 -- 172.21.15.82:0/1464989992 learned_addr learned my addr 172.21.15.82:0/1464989992 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.618+0000 7f654e000640 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e789f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.619+0000 7f654e000640 1 -- 172.21.15.82:0/1464989992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 msgr2=0x55e8e78a20b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.619+0000 7f654e000640 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78a20b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.619+0000 7f654e000640 1 -- 172.21.15.82:0/1464989992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 msgr2=0x55e8e789a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.619+0000 7f654e000640 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e789a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.619+0000 7f654e000640 1 -- 172.21.15.82:0/1464989992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e778e7b0 con 0x55e8e789aab0 2024-04-26T20:26:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.620+0000 7f654e000640 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e789f5b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f65480ce2f0 tx=0x7f654809d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7167ab0ad62086 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.631+0000 7f653be00640 1 -- 172.21.15.82:0/1464989992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480a57b0 con 0x55e8e789aab0 2024-04-26T20:26:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.631+0000 7f653be00640 1 -- 172.21.15.82:0/1464989992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6548004500 con 0x55e8e789aab0 2024-04-26T20:26:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.631+0000 7f653be00640 1 -- 172.21.15.82:0/1464989992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480a5580 con 0x55e8e789aab0 2024-04-26T20:26:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.646+0000 7f6558965740 1 -- 172.21.15.82:0/1464989992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 msgr2=0x55e8e789f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.646+0000 7f6558965740 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e789f5b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f65480ce2f0 tx=0x7f654809d380 comp rx=0 tx=0).stop 2024-04-26T20:26:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.649+0000 7f6558965740 1 -- 172.21.15.82:0/1464989992 shutdown_connections 2024-04-26T20:26:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.649+0000 7f6558965740 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78a20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.649+0000 7f6558965740 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e789f5b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.649+0000 7f6558965740 1 --2- 172.21.15.82:0/1464989992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e789a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.649+0000 7f6558965740 1 -- 172.21.15.82:0/1464989992 >> 172.21.15.82:0/1464989992 conn(0x55e8e7895730 msgr2=0x55e8e7895b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:40.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.680+0000 7f6558965740 1 -- 172.21.15.82:0/1464989992 shutdown_connections 2024-04-26T20:26:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.694+0000 7f6558965740 1 -- 172.21.15.82:0/1464989992 wait complete. 2024-04-26T20:26:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.694+0000 7f6558965740 1 -- start start 2024-04-26T20:26:40.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.695+0000 7f6558965740 1 Processor -- start 2024-04-26T20:26:40.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.706+0000 7f6558965740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.706+0000 7f6558965740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e78a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.707+0000 7f654ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.707+0000 7f654ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39734/0 (socket says 172.21.15.82:39734) 2024-04-26T20:26:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.714+0000 7f6558965740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.714+0000 7f6558965740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e8e77fcf80 con 0x55e8e789aab0 2024-04-26T20:26:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.714+0000 7f6558965740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8e77aa260 con 0x55e8e789a0c0 2024-04-26T20:26:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.714+0000 7f6558965740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8e78022a0 con 0x55e8e789fc20 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.714+0000 7f6558965740 10 client.0 _ll_register_callbacks cb 0x55e8e77f4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.715+0000 7f654f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.715+0000 7f654f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44336/0 (socket says 172.21.15.82:44336) 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.715+0000 7f654f400640 1 -- 172.21.15.82:0/1253227055 learned_addr learned my addr 172.21.15.82:0/1253227055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.715+0000 7f654e000640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e78a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.715+0000 7f654f400640 1 -- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 msgr2=0x55e8e78a4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.716+0000 7f654f400640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.716+0000 7f654f400640 1 -- 172.21.15.82:0/1253227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 msgr2=0x55e8e78a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.716+0000 7f654f400640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e78a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.716+0000 7f654f400640 1 -- 172.21.15.82:0/1253227055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e778c1c0 con 0x55e8e789fc20 2024-04-26T20:26:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.716+0000 7f654e000640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e78a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.719+0000 7f654f400640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78ab5c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6540009900 tx=0x7f6540009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4754f6011c4812 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.731+0000 7f6538c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:26:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.731+0000 7f6538c00640 1 -- 172.21.15.82:0/1253227055 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65400037f0 con 0x55e8e789fc20 2024-04-26T20:26:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.731+0000 7f6538c00640 1 -- 172.21.15.82:0/1253227055 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6540003990 con 0x55e8e789fc20 2024-04-26T20:26:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.746+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6548004500 con 0x55e8e789fc20 2024-04-26T20:26:40.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.766+0000 7f6538c00640 1 -- 172.21.15.82:0/1253227055 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65400054f0 con 0x55e8e789fc20 2024-04-26T20:26:40.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.773+0000 7f6558965740 10 client.26656 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:40.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.773+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e8e750f3f0 con 0x55e8e789fc20 2024-04-26T20:26:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.789+0000 7f6538c00640 1 -- 172.21.15.82:0/1253227055 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6548004500 con 0x55e8e789fc20 2024-04-26T20:26:40.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.789+0000 7f6538c00640 1 -- 172.21.15.82:0/1253227055 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f654003a040 con 0x55e8e789fc20 2024-04-26T20:26:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.802+0000 7f6558965740 10 client.26656 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.802+0000 7f6558965740 10 client.26656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.802+0000 7f6558965740 20 client.26656 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.802+0000 7f6558965740 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e78afcc0 0x55e8e78b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.802+0000 7f6558965740 4 client.26656 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.802+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8e780b880 con 0x55e8e78afcc0 2024-04-26T20:26:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.808+0000 7f654ea00640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e78afcc0 0x55e8e78b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.811+0000 7f654ea00640 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e78afcc0 0x55e8e78b2120 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19068b2b9545e6c server_cookie=7e69b767236ac455 in_seq=0 out_seq=0 2024-04-26T20:26:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.811+0000 7f6538c00640 10 client.26656 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.812+0000 7f6538c00640 1 -- 172.21.15.82:0/1253227055 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e8e780b880 con 0x55e8e78afcc0 2024-04-26T20:26:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.812+0000 7f6538c00640 10 client.26656 handle_command_reply: tid=0 2024-04-26T20:26:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.812+0000 7f6558965740 1 client.26656 shutdown 2024-04-26T20:26:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.812+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 msgr2=0x55e8e78ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.812+0000 7f6558965740 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78ab5c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6540009900 tx=0x7f6540009260 comp rx=0 tx=0).stop 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 shutdown_connections 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6558965740 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e78afcc0 0x55e8e78b2120 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6558965740 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789fc20 0x55e8e78ab5c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6558965740 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789aab0 0x55e8e78a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6558965740 1 --2- 172.21.15.82:0/1253227055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 >> 172.21.15.82:0/1253227055 conn(0x55e8e7895730 msgr2=0x55e8e7894890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:40.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.820+0000 7f6538c00640 0 client.26656 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.864+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 shutdown_connections 2024-04-26T20:26:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.902+0000 7f6558965740 1 -- 172.21.15.82:0/1253227055 wait complete. 2024-04-26T20:26:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:40.926+0000 7f6558965740 20 client.26656 trim_cache size 0 max 16384 2024-04-26T20:26:41.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:40 smithi135 ceph-mon[32816]: pgmap v528: 129 pgs: 129 active+clean; 383 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.6 MiB/s wr, 314 op/s 2024-04-26T20:26:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:40 smithi082 ceph-mon[28105]: pgmap v528: 129 pgs: 129 active+clean; 383 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.6 MiB/s wr, 314 op/s 2024-04-26T20:26:41.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:40 smithi139 ceph-mon[32999]: pgmap v528: 129 pgs: 129 active+clean; 383 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.6 MiB/s wr, 314 op/s 2024-04-26T20:26:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.500+0000 7f6558965740 1 Processor -- start 2024-04-26T20:26:41.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.522+0000 7f6558965740 1 -- start start 2024-04-26T20:26:41.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.522+0000 7f6558965740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789a0c0 0x55e8e7898ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.522+0000 7f6558965740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789aab0 0x55e8e78ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.523+0000 7f6558965740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e789f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.523+0000 7f6558965740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65501c2770 con 0x55e8e789fc20 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.523+0000 7f6558965740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65501c4430 con 0x55e8e789aab0 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.523+0000 7f6558965740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f65501c2e40 con 0x55e8e789a0c0 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.524+0000 7f654f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e789f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.524+0000 7f654f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e789f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48376/0 (socket says 172.21.15.82:48376) 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.524+0000 7f654f400640 1 -- 172.21.15.82:0/736002344 learned_addr learned my addr 172.21.15.82:0/736002344 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:41.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.524+0000 7f654e000640 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789aab0 0x55e8e78ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.534+0000 7f654e000640 1 -- 172.21.15.82:0/736002344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789a0c0 msgr2=0x55e8e7898ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:41.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.534+0000 7f654e000640 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789a0c0 0x55e8e7898ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.534+0000 7f654e000640 1 -- 172.21.15.82:0/736002344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 msgr2=0x55e8e789f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:41.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.534+0000 7f654e000640 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e789f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.534+0000 7f654e000640 1 -- 172.21.15.82:0/736002344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e75d97d0 con 0x55e8e789aab0 2024-04-26T20:26:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.543+0000 7f654e000640 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789aab0 0x55e8e78ab4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55e8e78a27a0 tx=0x7f65480b6180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ccdd778a8ef6d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.548+0000 7f653b400640 1 -- 172.21.15.82:0/736002344 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480a9070 con 0x55e8e789aab0 2024-04-26T20:26:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.548+0000 7f653b400640 1 -- 172.21.15.82:0/736002344 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65480a57b0 con 0x55e8e789aab0 2024-04-26T20:26:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.548+0000 7f653b400640 1 -- 172.21.15.82:0/736002344 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480a5320 con 0x55e8e789aab0 2024-04-26T20:26:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.552+0000 7f6558965740 1 -- 172.21.15.82:0/736002344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789aab0 msgr2=0x55e8e78ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.552+0000 7f6558965740 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789aab0 0x55e8e78ab4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55e8e78a27a0 tx=0x7f65480b6180 comp rx=0 tx=0).stop 2024-04-26T20:26:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.558+0000 7f6558965740 1 -- 172.21.15.82:0/736002344 shutdown_connections 2024-04-26T20:26:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.558+0000 7f6558965740 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e789f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.558+0000 7f6558965740 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789aab0 0x55e8e78ab4e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.558+0000 7f6558965740 1 --2- 172.21.15.82:0/736002344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789a0c0 0x55e8e7898ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.558+0000 7f6558965740 1 -- 172.21.15.82:0/736002344 >> 172.21.15.82:0/736002344 conn(0x55e8e7895730 msgr2=0x55e8e7894000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.562+0000 7f6558965740 1 -- 172.21.15.82:0/736002344 shutdown_connections 2024-04-26T20:26:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.567+0000 7f6558965740 1 -- 172.21.15.82:0/736002344 wait complete. 2024-04-26T20:26:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.568+0000 7f6558965740 1 -- start start 2024-04-26T20:26:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.568+0000 7f6558965740 1 Processor -- start 2024-04-26T20:26:41.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.572+0000 7f6558965740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f6558965740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789aab0 0x55e8e78a9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f6558965740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e78aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f654e000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789aab0 0x55e8e78a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f654e000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789aab0 0x55e8e78a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48614/0 (socket says 172.21.15.82:48614) 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f654ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f654f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e78aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f654ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34230/0 (socket says 172.21.15.82:34230) 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.574+0000 7f654f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e78aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48390/0 (socket says 172.21.15.82:48390) 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.575+0000 7f6558965740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65501c3ca0 con 0x55e8e789fc20 2024-04-26T20:26:41.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.575+0000 7f6558965740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65501c3510 con 0x55e8e789a0c0 2024-04-26T20:26:41.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.575+0000 7f6558965740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f65501c0890 con 0x55e8e789aab0 2024-04-26T20:26:41.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.575+0000 7f654e000640 1 -- 172.21.15.82:0/4214997451 learned_addr learned my addr 172.21.15.82:0/4214997451 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:41.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.575+0000 7f6558965740 10 client.0 _ll_register_callbacks cb 0x7f6540009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:41.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.576+0000 7f654f400640 1 -- 172.21.15.82:0/4214997451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789aab0 msgr2=0x55e8e78a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:41.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.576+0000 7f654f400640 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789aab0 0x55e8e78a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.576+0000 7f654f400640 1 -- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 msgr2=0x55e8e78a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:41.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.576+0000 7f654f400640 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.576+0000 7f654f400640 1 -- 172.21.15.82:0/4214997451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e77a42a0 con 0x55e8e789fc20 2024-04-26T20:26:41.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.576+0000 7f654f400640 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e78aa920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55e8e78b2900 tx=0x7f6540031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70114c2dbefd08d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:41.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.624+0000 7f6538c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:41.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.625+0000 7f6538c00640 1 -- 172.21.15.82:0/4214997451 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65400037f0 con 0x55e8e789fc20 2024-04-26T20:26:41.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.625+0000 7f6538c00640 1 -- 172.21.15.82:0/4214997451 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6540003990 con 0x55e8e789fc20 2024-04-26T20:26:41.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.636+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65480a57b0 con 0x55e8e789fc20 2024-04-26T20:26:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.636+0000 7f6538c00640 1 -- 172.21.15.82:0/4214997451 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6540003b90 con 0x55e8e789fc20 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.636+0000 7f6558965740 10 client.16503 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.636+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e8e79168f0 con 0x55e8e789fc20 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.638+0000 7f6538c00640 1 -- 172.21.15.82:0/4214997451 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65480a57b0 con 0x55e8e789fc20 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.638+0000 7f6538c00640 1 -- 172.21.15.82:0/4214997451 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f654005a070 con 0x55e8e789fc20 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f6558965740 10 client.16503 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f6558965740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f6558965740 20 client.16503 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f6558965740 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e7917300 0x55e8e7919720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f6558965740 4 client.16503 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8e78056f0 con 0x55e8e7917300 2024-04-26T20:26:41.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.640+0000 7f654ea00640 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e7917300 0x55e8e7919720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:41.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.641+0000 7f654ea00640 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e7917300 0x55e8e7919720 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da63fb724a95b71a server_cookie=8a6f2cf3e8263413 in_seq=0 out_seq=0 2024-04-26T20:26:41.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.641+0000 7f6538c00640 10 client.16503 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:41.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.641+0000 7f6538c00640 1 -- 172.21.15.82:0/4214997451 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8e78056f0 con 0x55e8e7917300 2024-04-26T20:26:41.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.641+0000 7f6538c00640 10 client.16503 handle_command_reply: tid=0 2024-04-26T20:26:41.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.641+0000 7f6558965740 1 client.16503 shutdown 2024-04-26T20:26:41.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.642+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 msgr2=0x55e8e78aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.642+0000 7f6558965740 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e78aa920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55e8e78b2900 tx=0x7f6540031b50 comp rx=0 tx=0).stop 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 shutdown_connections 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6558965740 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8e7917300 0x55e8e7919720 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6558965740 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e789fc20 0x55e8e78aa920 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6558965740 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8e789aab0 0x55e8e78a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6558965740 1 --2- 172.21.15.82:0/4214997451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8e789a0c0 0x55e8e78a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 >> 172.21.15.82:0/4214997451 conn(0x55e8e7895730 msgr2=0x55e8e7894000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.643+0000 7f6538c00640 0 client.16503 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:41.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.648+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 shutdown_connections 2024-04-26T20:26:41.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.648+0000 7f6558965740 1 -- 172.21.15.82:0/4214997451 wait complete. 2024-04-26T20:26:41.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.652+0000 7f6558965740 20 client.16503 trim_cache size 0 max 16384 2024-04-26T20:26:41.667 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:26:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.671+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f65340a3e40 msgr2=0x7f65340a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.671+0000 7f654fe00640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f65340a3e40 0x7f65340a6300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6540005dc0 tx=0x7f6540005fd0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.671+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 msgr2=0x7f655010ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.671+0000 7f654fe00640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 0x7f655010ac00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6548007ea0 tx=0x7f6548007f90 comp rx=0 tx=0).stop 2024-04-26T20:26:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.673+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 shutdown_connections 2024-04-26T20:26:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.673+0000 7f654fe00640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f65340a3e40 0x7f65340a6300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.673+0000 7f654fe00640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6550110c70 0x7f655010b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.673+0000 7f654fe00640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f655010a510 0x7f655010ac00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.673+0000 7f654fe00640 1 --2- 172.21.15.82:0/1416317713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6550073e50 0x7f655010c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.673+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 >> 172.21.15.82:0/1416317713 conn(0x7f655006f780 msgr2=0x7f655010cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:41.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.674+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 shutdown_connections 2024-04-26T20:26:41.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:41.678+0000 7f654fe00640 1 -- 172.21.15.82:0/1416317713 wait complete. 2024-04-26T20:26:42.989 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:26:42.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:26:42.990 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:26:43.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:42 smithi135 ceph-mon[32816]: pgmap v529: 129 pgs: 129 active+clean; 394 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-04-26T20:26:43.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:42 smithi082 ceph-mon[28105]: pgmap v529: 129 pgs: 129 active+clean; 394 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-04-26T20:26:43.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:42 smithi139 ceph-mon[32999]: pgmap v529: 129 pgs: 129 active+clean; 394 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-04-26T20:26:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.635+0000 7f2f6fe00640 1 -- 172.21.15.82:0/4019848022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 msgr2=0x7f2f70074080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.635+0000 7f2f6fe00640 1 --2- 172.21.15.82:0/4019848022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f70074080 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009860 tx=0x7f2f6002a340 comp rx=0 tx=0).stop 2024-04-26T20:26:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 -- 172.21.15.82:0/4019848022 shutdown_connections 2024-04-26T20:26:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 --2- 172.21.15.82:0/4019848022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f7010f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 --2- 172.21.15.82:0/4019848022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f70109f40 0x7f2f7010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 --2- 172.21.15.82:0/4019848022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f70074080 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 -- 172.21.15.82:0/4019848022 >> 172.21.15.82:0/4019848022 conn(0x7f2f7006f7d0 msgr2=0x7f2f70071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 -- 172.21.15.82:0/4019848022 shutdown_connections 2024-04-26T20:26:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.637+0000 7f2f6fe00640 1 -- 172.21.15.82:0/4019848022 wait complete. 2024-04-26T20:26:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.639+0000 7f2f6fe00640 1 Processor -- start 2024-04-26T20:26:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.639+0000 7f2f6fe00640 1 -- start start 2024-04-26T20:26:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.640+0000 7f2f6fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f7019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.643+0000 7f2f6fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f70109f40 0x7f2f7019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.643+0000 7f2f6fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f701a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.643+0000 7f2f6fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70112940 con 0x7f2f70073c60 2024-04-26T20:26:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.643+0000 7f2f6fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701127c0 con 0x7f2f70109f40 2024-04-26T20:26:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.643+0000 7f2f6fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70112ac0 con 0x7f2f7010a900 2024-04-26T20:26:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.644+0000 7f2f6f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f701a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.644+0000 7f2f6f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f701a6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48636/0 (socket says 172.21.15.82:48636) 2024-04-26T20:26:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.644+0000 7f2f6f400640 1 -- 172.21.15.82:0/3797485921 learned_addr learned my addr 172.21.15.82:0/3797485921 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.644+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f7019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.644+0000 7f2f6e000640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f70109f40 0x7f2f7019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6f400640 1 -- 172.21.15.82:0/3797485921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f70109f40 msgr2=0x7f2f7019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6f400640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f70109f40 0x7f2f7019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6f400640 1 -- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 msgr2=0x7f2f7019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6f400640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f7019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6f400640 1 -- 172.21.15.82:0/3797485921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f701a6bb0 con 0x7f2f7010a900 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f7019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.645+0000 7f2f6f400640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f701a6540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f6801fd90 tx=0x7f2f6801d750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.646+0000 7f2f67400640 1 -- 172.21.15.82:0/3797485921 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6801de60 con 0x7f2f7010a900 2024-04-26T20:26:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.646+0000 7f2f67400640 1 -- 172.21.15.82:0/3797485921 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f68003970 con 0x7f2f7010a900 2024-04-26T20:26:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.647+0000 7f2f67400640 1 -- 172.21.15.82:0/3797485921 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68004320 con 0x7f2f7010a900 2024-04-26T20:26:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.647+0000 7f2f6fe00640 1 -- 172.21.15.82:0/3797485921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f701a6e40 con 0x7f2f7010a900 2024-04-26T20:26:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.647+0000 7f2f6fe00640 1 -- 172.21.15.82:0/3797485921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f701a71f0 con 0x7f2f7010a900 2024-04-26T20:26:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.655+0000 7f2f78764740 1 Processor -- start 2024-04-26T20:26:44.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.657+0000 7f2f67400640 1 -- 172.21.15.82:0/3797485921 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2f68003b20 con 0x7f2f7010a900 2024-04-26T20:26:44.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 -- start start 2024-04-26T20:26:44.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e8cf81b380 con 0x55e8cf8b77b0 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8cf7b7c30 con 0x55e8cf8bc920 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.658+0000 7f2f78764740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8cf817340 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8bc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48408/0 (socket says 172.21.15.82:48408) 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 -- 172.21.15.82:0/1519697578 learned_addr learned my addr 172.21.15.82:0/1519697578 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6e000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6e000640 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 -- 172.21.15.82:0/1519697578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b6dc0 msgr2=0x55e8cf8b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 -- 172.21.15.82:0/1519697578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 msgr2=0x55e8cf8bedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8bedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.659+0000 7f2f6ea00640 1 -- 172.21.15.82:0/1519697578 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8cf7d9940 con 0x55e8cf8b77b0 2024-04-26T20:26:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.660+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8bc2b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009860 tx=0x7f2f60005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c198477d629cf833 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.661+0000 7f2f5be00640 1 -- 172.21.15.82:0/1519697578 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60042020 con 0x55e8cf8b77b0 2024-04-26T20:26:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.661+0000 7f2f5be00640 1 -- 172.21.15.82:0/1519697578 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f600307f0 con 0x55e8cf8b77b0 2024-04-26T20:26:44.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.661+0000 7f2f5be00640 1 -- 172.21.15.82:0/1519697578 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60037040 con 0x55e8cf8b77b0 2024-04-26T20:26:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.662+0000 7f2f67400640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2f540a3bd0 0x7f2f540a6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.663+0000 7f2f78764740 1 -- 172.21.15.82:0/1519697578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 msgr2=0x55e8cf8bc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.663+0000 7f2f78764740 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8bc2b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009860 tx=0x7f2f60005a90 comp rx=0 tx=0).stop 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.664+0000 7f2f6e000640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2f540a3bd0 0x7f2f540a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.669+0000 7f2f67400640 1 -- 172.21.15.82:0/3797485921 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2f6802c070 con 0x7f2f7010a900 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f6e000640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2f540a3bd0 0x7f2f540a6090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009730 tx=0x7f2f5c004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 -- 172.21.15.82:0/1519697578 shutdown_connections 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8bc2b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 --2- 172.21.15.82:0/1519697578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 -- 172.21.15.82:0/1519697578 >> 172.21.15.82:0/1519697578 conn(0x55e8cf8b2430 msgr2=0x55e8cf8b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 -- 172.21.15.82:0/1519697578 shutdown_connections 2024-04-26T20:26:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.670+0000 7f2f78764740 1 -- 172.21.15.82:0/1519697578 wait complete. 2024-04-26T20:26:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.671+0000 7f2f78764740 1 -- start start 2024-04-26T20:26:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.671+0000 7f2f78764740 1 Processor -- start 2024-04-26T20:26:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.672+0000 7f2f78764740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.672+0000 7f2f78764740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.674+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.674+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48420/0 (socket says 172.21.15.82:48420) 2024-04-26T20:26:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f6ea00640 1 -- 172.21.15.82:0/1042017325 learned_addr learned my addr 172.21.15.82:0/1042017325 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e8cf8bf870 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f6e000640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8cf7a2c60 con 0x55e8cf8b77b0 2024-04-26T20:26:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8cf8bf9f0 con 0x55e8cf8bc920 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f78764740 10 client.0 _ll_register_callbacks cb 0x55e8cf7cee50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.675+0000 7f2f6f400640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6e000640 1 -- 172.21.15.82:0/1042017325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 msgr2=0x55e8cf8c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6e000640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6e000640 1 -- 172.21.15.82:0/1042017325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 msgr2=0x55e8cf8c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6e000640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6e000640 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8cf7b1510 con 0x55e8cf8b77b0 2024-04-26T20:26:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.676+0000 7f2f6e000640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c1560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55e8cf8b8010 tx=0x7f2f5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6405806dbc2182 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.677+0000 7f2f58c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:26:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.677+0000 7f2f58c00640 1 -- 172.21.15.82:0/1042017325 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c02f060 con 0x55e8cf8b77b0 2024-04-26T20:26:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.677+0000 7f2f58c00640 1 -- 172.21.15.82:0/1042017325 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2f5c019030 con 0x55e8cf8b77b0 2024-04-26T20:26:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.677+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f600307f0 con 0x55e8cf8b77b0 2024-04-26T20:26:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.678+0000 7f2f58c00640 1 -- 172.21.15.82:0/1042017325 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2f5c02a420 con 0x55e8cf8b77b0 2024-04-26T20:26:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.678+0000 7f2f78764740 10 client.26621 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.678+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e8cf52d210 con 0x55e8cf8b77b0 2024-04-26T20:26:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.678+0000 7f2f58c00640 1 -- 172.21.15.82:0/1042017325 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f600307f0 con 0x55e8cf8b77b0 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.679+0000 7f2f58c00640 1 -- 172.21.15.82:0/1042017325 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f2f5c02a5c0 con 0x55e8cf8b77b0 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f78764740 10 client.26621 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f78764740 10 client.26621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f78764740 20 client.26621 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf8ccb60 0x55e8cf8cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f78764740 4 client.26621 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8cf828f90 con 0x55e8cf8ccb60 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.680+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf8ccb60 0x55e8cf8cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.681+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf8ccb60 0x55e8cf8cefc0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b4c3f3c2866fd1d server_cookie=a7f9ef62f3c1951c in_seq=0 out_seq=0 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f58c00640 10 client.26621 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f58c00640 1 -- 172.21.15.82:0/1042017325 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e8cf828f90 con 0x55e8cf8ccb60 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f58c00640 10 client.26621 handle_command_reply: tid=0 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 client.26621 shutdown 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 msgr2=0x55e8cf8c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c1560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55e8cf8b8010 tx=0x7f2f5c0046c0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 shutdown_connections 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf8ccb60 0x55e8cf8cefc0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c1560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 --2- 172.21.15.82:0/1042017325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.684+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 >> 172.21.15.82:0/1042017325 conn(0x55e8cf8b2430 msgr2=0x55e8cf8b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.685+0000 7f2f58c00640 0 client.26621 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:44.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.685+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 shutdown_connections 2024-04-26T20:26:44.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.685+0000 7f2f78764740 1 -- 172.21.15.82:0/1042017325 wait complete. 2024-04-26T20:26:44.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.685+0000 7f2f78764740 20 client.26621 trim_cache size 0 max 16384 2024-04-26T20:26:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.767+0000 7f2f78764740 1 Processor -- start 2024-04-26T20:26:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.775+0000 7f2f78764740 1 -- start start 2024-04-26T20:26:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.775+0000 7f2f78764740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.775+0000 7f2f78764740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8bc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48422/0 (socket says 172.21.15.82:48422) 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f78764740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f78764740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701b1750 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f78764740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701b3410 con 0x55e8cf8b77b0 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f78764740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701b1e20 con 0x55e8cf8bc920 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f6ea00640 1 -- 172.21.15.82:0/2315461992 learned_addr learned my addr 172.21.15.82:0/2315461992 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.776+0000 7f2f6f400640 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.777+0000 7f2f6e000640 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.777+0000 7f2f6f400640 1 -- 172.21.15.82:0/2315461992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 msgr2=0x55e8cf8c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.777+0000 7f2f6f400640 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.777+0000 7f2f6f400640 1 -- 172.21.15.82:0/2315461992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 msgr2=0x55e8cf8bc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.777+0000 7f2f6f400640 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8bc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.777+0000 7f2f6f400640 1 -- 172.21.15.82:0/2315461992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8cf5f9620 con 0x55e8cf8bc920 2024-04-26T20:26:44.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.778+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:44.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.778+0000 7f2f6f400640 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8b0da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2f680de5a0 tx=0x7f2f680ad5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982e7664c4064fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.779+0000 7f2f5b400640 1 -- 172.21.15.82:0/2315461992 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f680c5020 con 0x55e8cf8bc920 2024-04-26T20:26:44.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.779+0000 7f2f5b400640 1 -- 172.21.15.82:0/2315461992 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f680ab070 con 0x55e8cf8bc920 2024-04-26T20:26:44.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.779+0000 7f2f5b400640 1 -- 172.21.15.82:0/2315461992 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6802b050 con 0x55e8cf8bc920 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.780+0000 7f2f78764740 1 -- 172.21.15.82:0/2315461992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 msgr2=0x55e8cf8b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.780+0000 7f2f78764740 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8b0da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2f680de5a0 tx=0x7f2f680ad5b0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 -- 172.21.15.82:0/2315461992 shutdown_connections 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8bc920 0x55e8cf8b0da0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 --2- 172.21.15.82:0/2315461992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 -- 172.21.15.82:0/2315461992 >> 172.21.15.82:0/2315461992 conn(0x55e8cf8b2430 msgr2=0x55e8cf8b8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 -- 172.21.15.82:0/2315461992 shutdown_connections 2024-04-26T20:26:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.787+0000 7f2f78764740 1 -- 172.21.15.82:0/2315461992 wait complete. 2024-04-26T20:26:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.788+0000 7f2f78764740 1 -- start start 2024-04-26T20:26:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.788+0000 7f2f78764740 1 Processor -- start 2024-04-26T20:26:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.790+0000 7f2f78764740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.791+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.791+0000 7f2f6ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48428/0 (socket says 172.21.15.82:48428) 2024-04-26T20:26:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.791+0000 7f2f6ea00640 1 -- 172.21.15.82:0/2542309063 learned_addr learned my addr 172.21.15.82:0/2542309063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.791+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.791+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.792+0000 7f2f6e000640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.792+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701b2c80 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.792+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701b24f0 con 0x55e8cf8bc920 2024-04-26T20:26:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.792+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701af730 con 0x55e8cf8b77b0 2024-04-26T20:26:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.792+0000 7f2f6f400640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.793+0000 7f2f6ea00640 1 -- 172.21.15.82:0/2542309063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b77b0 msgr2=0x55e8cf8c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.793+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.793+0000 7f2f78764740 10 client.0 _ll_register_callbacks cb 0x7f2f5c009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.793+0000 7f2f6ea00640 1 -- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 msgr2=0x55e8cf8c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.793+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.793+0000 7f2f6ea00640 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8cf7d5cb0 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.803+0000 7f2f6ea00640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c58f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2f60035040 tx=0x7f2f600327f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd393ab43b98c916 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.803+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f680ab070 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.803+0000 7f2f6f400640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.803+0000 7f2f58c00640 10 client.16521 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.804+0000 7f2f58c00640 1 -- 172.21.15.82:0/2542309063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60037040 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.804+0000 7f2f58c00640 1 -- 172.21.15.82:0/2542309063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2f6004eb50 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.805+0000 7f2f58c00640 1 -- 172.21.15.82:0/2542309063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2f60042040 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.805+0000 7f2f78764740 10 client.16521 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:44.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.805+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55e8cf8c84a0 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f58c00640 1 -- 172.21.15.82:0/2542309063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f2f60004040 con 0x55e8cf8b6dc0 2024-04-26T20:26:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f78764740 10 client.16521 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f78764740 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f78764740 20 client.16521 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf933140 0x55e8cf935530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f78764740 4 client.16521 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:26:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8cf822e00 con 0x55e8cf933140 2024-04-26T20:26:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.812+0000 7f2f6e000640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf933140 0x55e8cf935530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.822+0000 7f2f6e000640 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf933140 0x55e8cf935530 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0b6ec264fbb0b26 server_cookie=d1429fff9525657e in_seq=0 out_seq=0 2024-04-26T20:26:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:44.825+0000 7f2f58c00640 10 client.16521 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:45.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:44 smithi135 ceph-mon[32816]: pgmap v530: 129 pgs: 129 active+clean; 397 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 5.1 MiB/s wr, 273 op/s 2024-04-26T20:26:45.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:44 smithi082 ceph-mon[28105]: pgmap v530: 129 pgs: 129 active+clean; 397 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 5.1 MiB/s wr, 273 op/s 2024-04-26T20:26:45.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:44 smithi139 ceph-mon[32999]: pgmap v530: 129 pgs: 129 active+clean; 397 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 5.1 MiB/s wr, 273 op/s 2024-04-26T20:26:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.926+0000 7f2f58c00640 1 -- 172.21.15.82:0/2542309063 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8cf822e00 con 0x55e8cf933140 2024-04-26T20:26:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.926+0000 7f2f58c00640 10 client.16521 handle_command_reply: tid=0 2024-04-26T20:26:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.926+0000 7f2f78764740 1 client.16521 shutdown 2024-04-26T20:26:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.926+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 msgr2=0x55e8cf8c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.926+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c58f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2f60035040 tx=0x7f2f600327f0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 shutdown_connections 2024-04-26T20:26:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55e8cf933140 0x55e8cf935530 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8cf8bc920 0x55e8cf8c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8cf8b77b0 0x55e8cf8c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 --2- 172.21.15.82:0/2542309063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cf8b6dc0 0x55e8cf8c58f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 >> 172.21.15.82:0/2542309063 conn(0x55e8cf8b2430 msgr2=0x55e8cf8b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f58c00640 0 client.16521 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.927+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 shutdown_connections 2024-04-26T20:26:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.928+0000 7f2f78764740 1 -- 172.21.15.82:0/2542309063 wait complete. 2024-04-26T20:26:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:45.935+0000 7f2f78764740 20 client.16521 trim_cache size 0 max 16384 2024-04-26T20:26:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:26:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:26:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:26:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.025+0000 7f2f64c00640 1 -- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2f540a3bd0 msgr2=0x7f2f540a6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.025+0000 7f2f64c00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2f540a3bd0 0x7f2f540a6090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009730 tx=0x7f2f5c004730 comp rx=0 tx=0).stop 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.025+0000 7f2f64c00640 1 -- 172.21.15.82:0/3797485921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 msgr2=0x7f2f701a6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.025+0000 7f2f64c00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f701a6540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f6801fd90 tx=0x7f2f6801d750 comp rx=0 tx=0).stop 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.026+0000 7f2f64c00640 1 -- 172.21.15.82:0/3797485921 shutdown_connections 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.026+0000 7f2f64c00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2f540a3bd0 0x7f2f540a6090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.026+0000 7f2f64c00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f7010a900 0x7f2f701a6540 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.026+0000 7f2f64c00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f70109f40 0x7f2f7019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.026+0000 7f2f64c00640 1 --2- 172.21.15.82:0/3797485921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f70073c60 0x7f2f7019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.026+0000 7f2f64c00640 1 -- 172.21.15.82:0/3797485921 >> 172.21.15.82:0/3797485921 conn(0x7f2f7006f7d0 msgr2=0x7f2f7010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.039+0000 7f2f64c00640 1 -- 172.21.15.82:0/3797485921 shutdown_connections 2024-04-26T20:26:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:26:46.044+0000 7f2f64c00640 1 -- 172.21.15.82:0/3797485921 wait complete. 2024-04-26T20:26:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:45 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:46.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:45 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.223+0000 7f2ded800640 1 -- 172.21.15.82:0/4254812299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810c2a0 msgr2=0x7f2de810e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.223+0000 7f2ded800640 1 --2- 172.21.15.82:0/4254812299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810c2a0 0x7f2de810e730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009860 tx=0x7f2dd402a380 comp rx=0 tx=0).stop 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.225+0000 7f2ded800640 1 -- 172.21.15.82:0/4254812299 shutdown_connections 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.225+0000 7f2ded800640 1 --2- 172.21.15.82:0/4254812299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de810ec70 0x7f2de810f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.225+0000 7f2ded800640 1 --2- 172.21.15.82:0/4254812299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810c2a0 0x7f2de810e730 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.225+0000 7f2ded800640 1 --2- 172.21.15.82:0/4254812299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de810bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.225+0000 7f2ded800640 1 -- 172.21.15.82:0/4254812299 >> 172.21.15.82:0/4254812299 conn(0x7f2de806f7c0 msgr2=0x7f2de8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.226+0000 7f2ded800640 1 -- 172.21.15.82:0/4254812299 shutdown_connections 2024-04-26T20:26:46.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.226+0000 7f2ded800640 1 -- 172.21.15.82:0/4254812299 wait complete. 2024-04-26T20:26:46.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.227+0000 7f2ded800640 1 Processor -- start 2024-04-26T20:26:46.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.228+0000 7f2ded800640 1 -- start start 2024-04-26T20:26:46.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.228+0000 7f2ded800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.229+0000 7f2ded800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 0x7f2de819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.229+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.229+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de819f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34284/0 (socket says 172.21.15.82:34284) 2024-04-26T20:26:46.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.229+0000 7f2de6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 0x7f2de819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2de6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 0x7f2de819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48440/0 (socket says 172.21.15.82:48440) 2024-04-26T20:26:46.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2de6a00640 1 -- 172.21.15.82:0/3765884264 learned_addr learned my addr 172.21.15.82:0/3765884264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81a4a30 0x7f2de81a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8112af0 con 0x7f2de810ec70 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8112970 con 0x7f2de8109930 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8112c70 con 0x7f2de81a4a30 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.230+0000 7f2de7400640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81a4a30 0x7f2de81a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6000640 1 -- 172.21.15.82:0/3765884264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81a4a30 msgr2=0x7f2de81a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6000640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81a4a30 0x7f2de81a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6000640 1 -- 172.21.15.82:0/3765884264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 msgr2=0x7f2de819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6000640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6000640 1 -- 172.21.15.82:0/3765884264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de81a7490 con 0x7f2de810ec70 2024-04-26T20:26:46.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6a00640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.231+0000 7f2de6000640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 0x7f2de819f9d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2de8073dc0 tx=0x7f2dd40307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.232+0000 7f2ddf400640 1 -- 172.21.15.82:0/3765884264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4037050 con 0x7f2de810ec70 2024-04-26T20:26:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.232+0000 7f2ddf400640 1 -- 172.21.15.82:0/3765884264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd4038040 con 0x7f2de810ec70 2024-04-26T20:26:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.233+0000 7f2ddf400640 1 -- 172.21.15.82:0/3765884264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4003b10 con 0x7f2de810ec70 2024-04-26T20:26:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.233+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de81a7720 con 0x7f2de810ec70 2024-04-26T20:26:46.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.233+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de81a7b90 con 0x7f2de810ec70 2024-04-26T20:26:46.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.238+0000 7f2df0637740 1 Processor -- start 2024-04-26T20:26:46.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.238+0000 7f2ddf400640 1 -- 172.21.15.82:0/3765884264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2dd4045020 con 0x7f2de810ec70 2024-04-26T20:26:46.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.238+0000 7f2df0637740 1 -- start start 2024-04-26T20:26:46.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.239+0000 7f2df0637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f07c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.239+0000 7f2df0637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f0cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.239+0000 7f2de7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f07c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2df0637740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f0f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2df0637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ac53e6c980 con 0x55ac53f07860 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2df0637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac53e09220 con 0x55ac53f08250 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2df0637740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ac53e68940 con 0x55ac53f0d3c0 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2ddf400640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2dcc0a3d80 0x7f2dcc0a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2de7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f07c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48454/0 (socket says 172.21.15.82:48454) 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2de7400640 1 -- 172.21.15.82:0/2190292216 learned_addr learned my addr 172.21.15.82:0/2190292216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2de6000640 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f0f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f0cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2ddf400640 1 -- 172.21.15.82:0/3765884264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2dd40f08c0 con 0x7f2de810ec70 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.240+0000 7f2de6000640 1 -- 172.21.15.82:0/2190292216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 msgr2=0x55ac53f0cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de6000640 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f0cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de6000640 1 -- 172.21.15.82:0/2190292216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 msgr2=0x55ac53f07c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de6000640 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f07c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de6000640 1 -- 172.21.15.82:0/2190292216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac53c467e0 con 0x55ac53f0d3c0 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f0cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de7400640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2dcc0a3d80 0x7f2dcc0a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2de6000640 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f0f850 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40edfc0 tx=0x7f2dd4032e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c15c3b70971716d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.241+0000 7f2dd3e00640 1 -- 172.21.15.82:0/2190292216 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40bc560 con 0x55ac53f0d3c0 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.242+0000 7f2de7400640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2dcc0a3d80 0x7f2dcc0a6240 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55ac53f08ab0 tx=0x7f2de0004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.242+0000 7f2dd3e00640 1 -- 172.21.15.82:0/2190292216 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd40bce90 con 0x55ac53f0d3c0 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.242+0000 7f2dd3e00640 1 -- 172.21.15.82:0/2190292216 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4003cb0 con 0x55ac53f0d3c0 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 -- 172.21.15.82:0/2190292216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 msgr2=0x55ac53f0f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f0f850 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40edfc0 tx=0x7f2dd4032e10 comp rx=0 tx=0).stop 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 -- 172.21.15.82:0/2190292216 shutdown_connections 2024-04-26T20:26:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f0f850 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f0cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 --2- 172.21.15.82:0/2190292216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f07c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 -- 172.21.15.82:0/2190292216 >> 172.21.15.82:0/2190292216 conn(0x55ac53f02ed0 msgr2=0x55ac53f032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 -- 172.21.15.82:0/2190292216 shutdown_connections 2024-04-26T20:26:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.243+0000 7f2df0637740 1 -- 172.21.15.82:0/2190292216 wait complete. 2024-04-26T20:26:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.244+0000 7f2df0637740 1 -- start start 2024-04-26T20:26:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.244+0000 7f2df0637740 1 Processor -- start 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f11b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 0x55ac53f12040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ac53f10130 con 0x55ac53f0d3c0 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac53df4170 con 0x55ac53f07860 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ac53f102b0 con 0x55ac53f08250 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2df0637740 10 client.0 _ll_register_callbacks cb 0x55ac53e63770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.245+0000 7f2de6000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 0x55ac53f12040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 0x55ac53f12040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48688/0 (socket says 172.21.15.82:48688) 2024-04-26T20:26:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 -- 172.21.15.82:0/2706462413 learned_addr learned my addr 172.21.15.82:0/2706462413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f11b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de7400640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 -- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 msgr2=0x55ac53f11b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f11b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 -- 172.21.15.82:0/2706462413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f0d3c0 msgr2=0x55ac53f19080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 -- 172.21.15.82:0/2706462413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac53ca6f70 con 0x55ac53f08250 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de7400640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2de6000640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 0x55ac53f12040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40bc720 tx=0x7f2dd4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c80a9b7542f62b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.246+0000 7f2dd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.247+0000 7f2dd0c00640 1 -- 172.21.15.82:0/2706462413 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40bc0f0 con 0x55ac53f08250 2024-04-26T20:26:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.247+0000 7f2dd0c00640 1 -- 172.21.15.82:0/2706462413 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2dd40c5180 con 0x55ac53f08250 2024-04-26T20:26:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.248+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd40bce90 con 0x55ac53f08250 2024-04-26T20:26:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.249+0000 7f2dd0c00640 1 -- 172.21.15.82:0/2706462413 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2dd40bc2d0 con 0x55ac53f08250 2024-04-26T20:26:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.249+0000 7f2df0637740 10 client.26686 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.249+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ac53b3e170 con 0x55ac53f08250 2024-04-26T20:26:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.249+0000 7f2dd0c00640 1 -- 172.21.15.82:0/2706462413 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd40bce90 con 0x55ac53f08250 2024-04-26T20:26:46.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2dd0c00640 1 -- 172.21.15.82:0/2706462413 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f2dd40b86e0 con 0x55ac53f08250 2024-04-26T20:26:46.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2df0637740 10 client.26686 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2df0637740 10 client.26686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2df0637740 20 client.26686 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2df0637740 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f1d280 0x55ac53f1f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2df0637740 4 client.26686 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac53e7a590 con 0x55ac53f1d280 2024-04-26T20:26:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.251+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f1d280 0x55ac53f1f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.253+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f1d280 0x55ac53f1f6a0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b7aed92d94a310 server_cookie=89e838693200625a in_seq=0 out_seq=0 2024-04-26T20:26:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.253+0000 7f2dd0c00640 10 client.26686 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.254+0000 7f2dd0c00640 1 -- 172.21.15.82:0/2706462413 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ac53e7a590 con 0x55ac53f1d280 2024-04-26T20:26:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.254+0000 7f2dd0c00640 10 client.26686 handle_command_reply: tid=0 2024-04-26T20:26:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.254+0000 7f2df0637740 1 client.26686 shutdown 2024-04-26T20:26:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 msgr2=0x55ac53f12040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 0x55ac53f12040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40bc720 tx=0x7f2dd4000bc0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 shutdown_connections 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f1d280 0x55ac53f1f6a0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f08250 0x55ac53f12040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 --2- 172.21.15.82:0/2706462413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f11b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 >> 172.21.15.82:0/2706462413 conn(0x55ac53f02ed0 msgr2=0x55ac53f01ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2dd0c00640 0 client.26686 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.255+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 shutdown_connections 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.256+0000 7f2df0637740 1 -- 172.21.15.82:0/2706462413 wait complete. 2024-04-26T20:26:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.256+0000 7f2df0637740 20 client.26686 trim_cache size 0 max 16384 2024-04-26T20:26:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.293+0000 7f2df0637740 1 Processor -- start 2024-04-26T20:26:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.293+0000 7f2df0637740 1 -- start start 2024-04-26T20:26:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.293+0000 7f2df0637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f06590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.293+0000 7f2df0637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f08250 0x55ac53f06ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2df0637740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2df0637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b1ff0 con 0x55ac53f08250 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2df0637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b3cb0 con 0x55ac53f07860 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2df0637740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b26c0 con 0x55ac53f0d3c0 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f06590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f06590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34322/0 (socket says 172.21.15.82:34322) 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6a00640 1 -- 172.21.15.82:0/2206665857 learned_addr learned my addr 172.21.15.82:0/2206665857 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6000640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f08250 0x55ac53f06ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de7400640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6a00640 1 -- 172.21.15.82:0/2206665857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 msgr2=0x55ac53f19040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.294+0000 7f2de6a00640 1 -- 172.21.15.82:0/2206665857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f08250 msgr2=0x55ac53f06ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.295+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f08250 0x55ac53f06ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.295+0000 7f2de6a00640 1 -- 172.21.15.82:0/2206665857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac53f08ae0 con 0x55ac53f07860 2024-04-26T20:26:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.295+0000 7f2de7400640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.295+0000 7f2de6000640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f08250 0x55ac53f06ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:26:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.295+0000 7f2de6a00640 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f06590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55ac53f08cc0 tx=0x7f2dd801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e445c547b03b7b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.295+0000 7f2dd3400640 1 -- 172.21.15.82:0/2206665857 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8031270 con 0x55ac53f07860 2024-04-26T20:26:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.296+0000 7f2dd3400640 1 -- 172.21.15.82:0/2206665857 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd80318c0 con 0x55ac53f07860 2024-04-26T20:26:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.296+0000 7f2dd3400640 1 -- 172.21.15.82:0/2206665857 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8021440 con 0x55ac53f07860 2024-04-26T20:26:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 -- 172.21.15.82:0/2206665857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 msgr2=0x55ac53f06590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f06590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55ac53f08cc0 tx=0x7f2dd801c490 comp rx=0 tx=0).stop 2024-04-26T20:26:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 -- 172.21.15.82:0/2206665857 shutdown_connections 2024-04-26T20:26:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f19040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f08250 0x55ac53f06ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 --2- 172.21.15.82:0/2206665857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f07860 0x55ac53f06590 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.297+0000 7f2df0637740 1 -- 172.21.15.82:0/2206665857 >> 172.21.15.82:0/2206665857 conn(0x55ac53f02ed0 msgr2=0x55ac53f05e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.298+0000 7f2df0637740 1 -- 172.21.15.82:0/2206665857 shutdown_connections 2024-04-26T20:26:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.298+0000 7f2df0637740 1 -- 172.21.15.82:0/2206665857 wait complete. 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.298+0000 7f2df0637740 1 -- start start 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 Processor -- start 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f17000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f17540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f18550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b3520 con 0x55ac53f07860 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b2d90 con 0x55ac53f08250 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81affd0 con 0x55ac53f0d3c0 2024-04-26T20:26:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.299+0000 7f2df0637740 10 client.0 _ll_register_callbacks cb 0x7f2de000a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.300+0000 7f2de6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f17540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.300+0000 7f2de6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f17540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:34334/0 (socket says 172.21.15.82:34334) 2024-04-26T20:26:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.300+0000 7f2de7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f18550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.300+0000 7f2de7400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f18550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48696/0 (socket says 172.21.15.82:48696) 2024-04-26T20:26:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.300+0000 7f2de7400640 1 -- 172.21.15.82:0/3411166434 learned_addr learned my addr 172.21.15.82:0/3411166434 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.300+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f17000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.301+0000 7f2de6a00640 1 -- 172.21.15.82:0/3411166434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 msgr2=0x55ac53f18550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.301+0000 7f2de6a00640 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f18550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.301+0000 7f2de6a00640 1 -- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 msgr2=0x55ac53f17540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.301+0000 7f2de6a00640 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f17540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.301+0000 7f2de6a00640 1 -- 172.21.15.82:0/3411166434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac53f18b10 con 0x55ac53f07860 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.302+0000 7f2de6a00640 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f17000 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55ac53c63e00 tx=0x7f2dd8022740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b9f1300e2bf1df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.302+0000 7f2dd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:26:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.302+0000 7f2dd0c00640 1 -- 172.21.15.82:0/3411166434 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8031480 con 0x55ac53f07860 2024-04-26T20:26:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.302+0000 7f2dd0c00640 1 -- 172.21.15.82:0/3411166434 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2dd8031620 con 0x55ac53f07860 2024-04-26T20:26:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.303+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd80318c0 con 0x55ac53f07860 2024-04-26T20:26:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.303+0000 7f2dd0c00640 1 -- 172.21.15.82:0/3411166434 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2dd8005050 con 0x55ac53f07860 2024-04-26T20:26:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.303+0000 7f2df0637740 10 client.16539 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.303+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ac53f84090 con 0x55ac53f07860 2024-04-26T20:26:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.304+0000 7f2dd0c00640 1 -- 172.21.15.82:0/3411166434 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd80318c0 con 0x55ac53f07860 2024-04-26T20:26:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.304+0000 7f2dd0c00640 1 -- 172.21.15.82:0/3411166434 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f2dd801f040 con 0x55ac53f07860 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.304+0000 7f2df0637740 10 client.16539 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.304+0000 7f2df0637740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.304+0000 7f2df0637740 20 client.16539 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.304+0000 7f2df0637740 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f84a80 0x55ac53f86ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.305+0000 7f2df0637740 4 client.16539 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.305+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac53e74400 con 0x55ac53f84a80 2024-04-26T20:26:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.305+0000 7f2de6000640 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f84a80 0x55ac53f86ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.305+0000 7f2de6000640 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f84a80 0x55ac53f86ea0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c8b560d6d52241c server_cookie=16d72a28b4c583ef in_seq=0 out_seq=0 2024-04-26T20:26:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.305+0000 7f2dd0c00640 10 client.16539 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.306+0000 7f2dd0c00640 1 -- 172.21.15.82:0/3411166434 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac53e74400 con 0x55ac53f84a80 2024-04-26T20:26:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.306+0000 7f2dd0c00640 10 client.16539 handle_command_reply: tid=0 2024-04-26T20:26:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.306+0000 7f2df0637740 1 client.16539 shutdown 2024-04-26T20:26:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.307+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 msgr2=0x55ac53f17000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.307+0000 7f2df0637740 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f17000 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55ac53c63e00 tx=0x7f2dd8022740 comp rx=0 tx=0).stop 2024-04-26T20:26:46.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 shutdown_connections 2024-04-26T20:26:46.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2df0637740 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55ac53f84a80 0x55ac53f86ea0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2df0637740 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ac53f0d3c0 0x55ac53f18550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2df0637740 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac53f08250 0x55ac53f17540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2df0637740 1 --2- 172.21.15.82:0/3411166434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac53f07860 0x55ac53f17000 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 >> 172.21.15.82:0/3411166434 conn(0x55ac53f02ed0 msgr2=0x55ac53f06710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.311+0000 7f2dd0c00640 0 client.16539 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.312+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 shutdown_connections 2024-04-26T20:26:46.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.312+0000 7f2df0637740 1 -- 172.21.15.82:0/3411166434 wait complete. 2024-04-26T20:26:46.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.312+0000 7f2df0637740 20 client.16539 trim_cache size 0 max 16384 2024-04-26T20:26:46.315 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:26:46.315 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:26:46.315 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "2422cc1b-1716-4323-a02d-ede94cc3cd94", 2024-04-26T20:26:46.315 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:26:46.316 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:26:46.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.316+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2dcc0a3d80 msgr2=0x7f2dcc0a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.316+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2dcc0a3d80 0x7f2dcc0a6240 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55ac53f08ab0 tx=0x7f2de0004a40 comp rx=0 tx=0).stop 2024-04-26T20:26:46.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.316+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 msgr2=0x7f2de819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.317+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 0x7f2de819f9d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2de8073dc0 tx=0x7f2dd40307f0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.319+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 shutdown_connections 2024-04-26T20:26:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.319+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2dcc0a3d80 0x7f2dcc0a6240 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.319+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81a4a30 0x7f2de81a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.319+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de810ec70 0x7f2de819f9d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.319+0000 7f2ded800640 1 --2- 172.21.15.82:0/3765884264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8109930 0x7f2de819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.319+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 >> 172.21.15.82:0/3765884264 conn(0x7f2de806f7c0 msgr2=0x7f2de810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:45 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.321+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 shutdown_connections 2024-04-26T20:26:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.321+0000 7f2ded800640 1 -- 172.21.15.82:0/3765884264 wait complete. 2024-04-26T20:26:46.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:26:46.346 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.618+0000 7f074bc00640 1 -- 172.21.15.82:0/2206119277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744108670 msgr2=0x7f074410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.618+0000 7f074bc00640 1 --2- 172.21.15.82:0/2206119277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744108670 0x7f074410aac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f073c009be0 tx=0x7f073c02a6d0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 -- 172.21.15.82:0/2206119277 shutdown_connections 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 --2- 172.21.15.82:0/2206119277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744108670 0x7f074410aac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 --2- 172.21.15.82:0/2206119277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744105d40 0x7f0744108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 --2- 172.21.15.82:0/2206119277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0744103410 0x7f0744105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 -- 172.21.15.82:0/2206119277 >> 172.21.15.82:0/2206119277 conn(0x7f07440fce20 msgr2=0x7f07440ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 -- 172.21.15.82:0/2206119277 shutdown_connections 2024-04-26T20:26:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.619+0000 7f074bc00640 1 -- 172.21.15.82:0/2206119277 wait complete. 2024-04-26T20:26:46.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.621+0000 7f074bc00640 1 Processor -- start 2024-04-26T20:26:46.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.621+0000 7f074bc00640 1 -- start start 2024-04-26T20:26:46.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f074bc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744103410 0x7f0744196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f074bc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0744105d40 0x7f0744196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f074bc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744108670 0x7f07441a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f074bc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f074410e4c0 con 0x7f0744108670 2024-04-26T20:26:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f074bc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f074410e340 con 0x7f0744103410 2024-04-26T20:26:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f0749c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744108670 0x7f07441a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f0749c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744108670 0x7f07441a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48488/0 (socket says 172.21.15.82:48488) 2024-04-26T20:26:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f0749c00640 1 -- 172.21.15.82:0/3884844093 learned_addr learned my addr 172.21.15.82:0/3884844093 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.622+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f074410e640 con 0x7f0744105d40 2024-04-26T20:26:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0749200640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744103410 0x7f0744196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0743e00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0744105d40 0x7f0744196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0749200640 1 -- 172.21.15.82:0/3884844093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0744105d40 msgr2=0x7f0744196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0749200640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0744105d40 0x7f0744196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0749200640 1 -- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744108670 msgr2=0x7f07441a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0749200640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744108670 0x7f07441a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.623+0000 7f0749200640 1 -- 172.21.15.82:0/3884844093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07441a6db0 con 0x7f0744103410 2024-04-26T20:26:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.625+0000 7f0749200640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744103410 0x7f0744196960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f073800d6d0 tx=0x7f073800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.625+0000 7f0741600640 1 -- 172.21.15.82:0/3884844093 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738017070 con 0x7f0744103410 2024-04-26T20:26:46.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.625+0000 7f0741600640 1 -- 172.21.15.82:0/3884844093 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0738009820 con 0x7f0744103410 2024-04-26T20:26:46.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.625+0000 7f0741600640 1 -- 172.21.15.82:0/3884844093 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738004c10 con 0x7f0744103410 2024-04-26T20:26:46.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.625+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07441a70a0 con 0x7f0744103410 2024-04-26T20:26:46.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.626+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07441a75a0 con 0x7f0744103410 2024-04-26T20:26:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.633+0000 7f074e99b740 1 Processor -- start 2024-04-26T20:26:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.634+0000 7f0741600640 1 -- 172.21.15.82:0/3884844093 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0738010460 con 0x7f0744103410 2024-04-26T20:26:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 -- start start 2024-04-26T20:26:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb12bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb13180 0x563bbbb17c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb182f0 0x563bbbb1a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563bbba23030 con 0x563bbbb13180 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563bbba3e7f0 con 0x563bbbb182f0 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.636+0000 7f074e99b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563bbb9f97e0 con 0x563bbbb12790 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.637+0000 7f0749c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb12bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.637+0000 7f0743e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb182f0 0x563bbbb1a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.637+0000 7f0749c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb12bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48726/0 (socket says 172.21.15.82:48726) 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.637+0000 7f0749c00640 1 -- 172.21.15.82:0/2381862969 learned_addr learned my addr 172.21.15.82:0/2381862969 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.637+0000 7f0741600640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f072c0a3e10 0x7f072c0a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.637+0000 7f0741600640 1 -- 172.21.15.82:0/3884844093 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f07380d0340 con 0x7f0744103410 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.638+0000 7f0749c00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f072c0a3e10 0x7f072c0a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.638+0000 7f0749200640 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb13180 0x563bbbb17c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.638+0000 7f0749c00640 1 -- 172.21.15.82:0/2381862969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb182f0 msgr2=0x563bbbb1a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.638+0000 7f0749c00640 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb182f0 0x563bbbb1a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.638+0000 7f0749c00640 1 -- 172.21.15.82:0/2381862969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb13180 msgr2=0x563bbbb17c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.639+0000 7f0749c00640 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb13180 0x563bbbb17c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.639+0000 7f0749c00640 1 -- 172.21.15.82:0/2381862969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bbba05050 con 0x563bbbb12790 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.639+0000 7f0743e00640 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb182f0 0x563bbbb1a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.639+0000 7f0749200640 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb13180 0x563bbbb17c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.639+0000 7f0749c00640 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb12bb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f073c034040 tx=0x7f073c030c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c0a61e20b17a1cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.640+0000 7f0736000640 1 -- 172.21.15.82:0/2381862969 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c05f070 con 0x563bbbb12790 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.640+0000 7f0749c00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f072c0a3e10 0x7f072c0a62d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f073c056000 tx=0x7f073c058000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.640+0000 7f0736000640 1 -- 172.21.15.82:0/2381862969 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f073c0044f0 con 0x563bbbb12790 2024-04-26T20:26:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.640+0000 7f0736000640 1 -- 172.21.15.82:0/2381862969 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c036040 con 0x563bbbb12790 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 -- 172.21.15.82:0/2381862969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 msgr2=0x563bbbb12bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb12bb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f073c034040 tx=0x7f073c030c50 comp rx=0 tx=0).stop 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 -- 172.21.15.82:0/2381862969 shutdown_connections 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb182f0 0x563bbbb1a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb13180 0x563bbbb17c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 --2- 172.21.15.82:0/2381862969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb12bb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 -- 172.21.15.82:0/2381862969 >> 172.21.15.82:0/2381862969 conn(0x563bbbb0ddb0 msgr2=0x563bbbb0e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 -- 172.21.15.82:0/2381862969 shutdown_connections 2024-04-26T20:26:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.641+0000 7f074e99b740 1 -- 172.21.15.82:0/2381862969 wait complete. 2024-04-26T20:26:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.642+0000 7f074e99b740 1 -- start start 2024-04-26T20:26:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.643+0000 7f074e99b740 1 Processor -- start 2024-04-26T20:26:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.643+0000 7f074e99b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb1c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f074e99b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb13180 0x563bbbb1cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f074e99b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f074e99b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563bbba7b200 con 0x563bbbb182f0 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f074e99b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563bbba75ee0 con 0x563bbbb13180 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f074e99b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563bbba82e70 con 0x563bbbb12790 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f074e99b740 10 client.0 _ll_register_callbacks cb 0x563bbba6c270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb1c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb1c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48730/0 (socket says 172.21.15.82:48730) 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 -- 172.21.15.82:0/1726587379 learned_addr learned my addr 172.21.15.82:0/1726587379 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 -- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb13180 msgr2=0x563bbbb1cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb13180 0x563bbbb1cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 -- 172.21.15.82:0/1726587379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 msgr2=0x563bbbb23b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749c00640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb23b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.644+0000 7f0749200640 1 -- 172.21.15.82:0/1726587379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bbb8527d0 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f0749c00640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f0749200640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb1c5c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f073800d6a0 tx=0x7f073809d0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca0873fa39cdd3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f072aa00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f072aa00640 1 -- 172.21.15.82:0/1726587379 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738020040 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f072aa00640 1 -- 172.21.15.82:0/1726587379 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f073809c500 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c0044f0 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f072aa00640 1 -- 172.21.15.82:0/1726587379 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f073809c700 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f074e99b740 10 client.26701 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.645+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563bbb7883f0 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f072aa00640 1 -- 172.21.15.82:0/1726587379 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f073c0044f0 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f072aa00640 1 -- 172.21.15.82:0/1726587379 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f07380a10d0 con 0x563bbbb12790 2024-04-26T20:26:46.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f074e99b740 10 client.26701 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:46.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f074e99b740 10 client.26701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:46.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f074e99b740 20 client.26701 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:46.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f074e99b740 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb28100 0x563bbbb2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f074e99b740 4 client.26701 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:26:46.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bbba847e0 con 0x563bbbb28100 2024-04-26T20:26:46.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.646+0000 7f0743e00640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb28100 0x563bbbb2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.647+0000 7f0743e00640 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb28100 0x563bbbb2a5a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=647eefb9815ee773 server_cookie=b1a3453d65a33fae in_seq=0 out_seq=0 2024-04-26T20:26:46.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.647+0000 7f072aa00640 10 client.26701 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.647+0000 7f072aa00640 1 -- 172.21.15.82:0/1726587379 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563bbba847e0 con 0x563bbbb28100 2024-04-26T20:26:46.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.647+0000 7f072aa00640 10 client.26701 handle_command_reply: tid=0 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 client.26701 shutdown 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 msgr2=0x563bbbb1c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb1c5c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f073800d6a0 tx=0x7f073809d0b0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 shutdown_connections 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb28100 0x563bbbb2a5a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb13180 0x563bbbb1cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 --2- 172.21.15.82:0/1726587379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb12790 0x563bbbb1c5c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 >> 172.21.15.82:0/1726587379 conn(0x563bbbb0ddb0 msgr2=0x563bbbb0d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f072aa00640 0 client.26701 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 shutdown_connections 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.648+0000 7f074e99b740 1 -- 172.21.15.82:0/1726587379 wait complete. 2024-04-26T20:26:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.649+0000 7f074e99b740 20 client.26701 trim_cache size 0 max 16384 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.679+0000 7f074e99b740 1 Processor -- start 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.680+0000 7f074e99b740 1 -- start start 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f074e99b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb11720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f074e99b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb23ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f074e99b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb2a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f074e99b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0724011790 con 0x563bbbb182f0 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f074e99b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07240101a0 con 0x563bbbb12790 2024-04-26T20:26:46.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f074e99b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0724010870 con 0x563bbbb13180 2024-04-26T20:26:46.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f0743e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb23ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f0743e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb23ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48732/0 (socket says 172.21.15.82:48732) 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.681+0000 7f0743e00640 1 -- 172.21.15.82:0/2638609813 learned_addr learned my addr 172.21.15.82:0/2638609813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0743e00640 1 -- 172.21.15.82:0/2638609813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 msgr2=0x563bbbb11720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0743e00640 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb11720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0749c00640 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb2a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0743e00640 1 -- 172.21.15.82:0/2638609813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 msgr2=0x563bbbb2a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0743e00640 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb2a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0743e00640 1 -- 172.21.15.82:0/2638609813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bbb7480f0 con 0x563bbbb13180 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0749c00640 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:26:46.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.682+0000 7f0743e00640 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb23ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0730009530 tx=0x7f0730010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fba8906a00b99d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.683+0000 7f0735600640 1 -- 172.21.15.82:0/2638609813 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730005050 con 0x563bbbb13180 2024-04-26T20:26:46.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.683+0000 7f0735600640 1 -- 172.21.15.82:0/2638609813 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0730004730 con 0x563bbbb13180 2024-04-26T20:26:46.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.683+0000 7f0735600640 1 -- 172.21.15.82:0/2638609813 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073001d280 con 0x563bbbb13180 2024-04-26T20:26:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.686+0000 7f074e99b740 1 -- 172.21.15.82:0/2638609813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 msgr2=0x563bbbb23ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.686+0000 7f074e99b740 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb23ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0730009530 tx=0x7f0730010800 comp rx=0 tx=0).stop 2024-04-26T20:26:46.688 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:46.481+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c3d [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13/ auth{0=1,2=1,3=1,4=1} v93530 ap=2 DIRTYPARENT f(v3 m2024-04-26T20:26:09.001287+0000 89=89+0) n(v7 rc2024-04-26T20:26:09.001287+0000 b2006444 90=89+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@144} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642a87c4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x20000000c3d:[<0x10000000971/blog-13 v93530>,<0x100000007e0/blogtest_in v1350>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:52.966601+0000 67=67+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:09.001287+0000 b2006444 90=89+1)","memory_value.dirstat":"f(v3 m2024-04-26T20:26:09.001287+0000 89=89+0)","memory_value.rstat":"n(v7 rc2024-04-26T20:26:09.001287+0000 b2006444 90=89+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:46.688 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:46.579+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ce9 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-15/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v78208 ap=1 DIRTYPARENT f(v2 m2024-04-26T20:25:36.280927+0000 127=127+0) n(v4 rc2024-04-26T20:25:36.280927+0000 b1313314 128=127+1) caps={25436=pAsLsXsFs/pAsLsXsFsx@227} | ptrwaiter=4 dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5642a9077180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x20000000ce9:[<0x10000000971/blog-15 v78208>,<0x100000007e0/blogtest_in v1350>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:13.260377+0000 126=126+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:25:36.280927+0000 b1313314 128=127+1)","memory_value.dirstat":"f(v2 m2024-04-26T20:25:36.280927+0000 127=127+0)","memory_value.rstat":"n(v4 rc2024-04-26T20:25:36.280927+0000 b1313314 128=127+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.687+0000 7f074e99b740 1 -- 172.21.15.82:0/2638609813 shutdown_connections 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.687+0000 7f074e99b740 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.687+0000 7f074e99b740 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb23ad0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.687+0000 7f074e99b740 1 --2- 172.21.15.82:0/2638609813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb11720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.687+0000 7f074e99b740 1 -- 172.21.15.82:0/2638609813 >> 172.21.15.82:0/2638609813 conn(0x563bbbb0ddb0 msgr2=0x563bbbb1c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.688+0000 7f074e99b740 1 -- 172.21.15.82:0/2638609813 shutdown_connections 2024-04-26T20:26:46.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.688+0000 7f074e99b740 1 -- 172.21.15.82:0/2638609813 wait complete. 2024-04-26T20:26:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.689+0000 7f074e99b740 1 -- start start 2024-04-26T20:26:46.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.689+0000 7f074e99b740 1 Processor -- start 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.690+0000 7f074e99b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb20c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.690+0000 7f074e99b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.690+0000 7f074e99b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.690+0000 7f074e99b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f072400dab0 con 0x563bbbb182f0 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.690+0000 7f074e99b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0724011000 con 0x563bbbb12790 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.690+0000 7f074e99b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f072400e120 con 0x563bbbb13180 2024-04-26T20:26:46.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.691+0000 7f074e99b740 10 client.0 _ll_register_callbacks cb 0x7f0738099350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:26:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.691+0000 7f0749c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.691+0000 7f0749c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48520/0 (socket says 172.21.15.82:48520) 2024-04-26T20:26:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.691+0000 7f0749c00640 1 -- 172.21.15.82:0/3360299830 learned_addr learned my addr 172.21.15.82:0/3360299830 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:26:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb20c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0743e00640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 -- 172.21.15.82:0/3360299830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 msgr2=0x563bbbb211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 -- 172.21.15.82:0/3360299830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 msgr2=0x563bbbb220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:26:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 -- 172.21.15.82:0/3360299830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bbba3ea30 con 0x563bbbb12790 2024-04-26T20:26:46.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.692+0000 7f0749200640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb20c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f07380a15a0 tx=0x7f07380a1300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b93ed01cb46756 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:26:46.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f072aa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:26:46.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f072aa00640 1 -- 172.21.15.82:0/3360299830 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738014070 con 0x563bbbb12790 2024-04-26T20:26:46.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f072aa00640 1 -- 172.21.15.82:0/3360299830 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f07380b0db0 con 0x563bbbb12790 2024-04-26T20:26:46.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0730004730 con 0x563bbbb12790 2024-04-26T20:26:46.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f072aa00640 1 -- 172.21.15.82:0/3360299830 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f07380af050 con 0x563bbbb12790 2024-04-26T20:26:46.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f074e99b740 10 client.26657 fetch_fsmap learned FSMap version 34 2024-04-26T20:26:46.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563bbbb23800 con 0x563bbbb12790 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.694+0000 7f072aa00640 1 -- 172.21.15.82:0/3360299830 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0730004730 con 0x563bbbb12790 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f072aa00640 1 -- 172.21.15.82:0/3360299830 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8394+0+0 (secure 0 0 0) 0x7f0738005220 con 0x563bbbb12790 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f074e99b740 10 client.26657 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f074e99b740 10 client.26657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f074e99b740 20 client.26657 populate_metadata read hostname 'smithi082' 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f074e99b740 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb8e8f0 0x563bbbb90d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f074e99b740 4 client.26657 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:26:46.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.695+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563bbba7e650 con 0x563bbbb8e8f0 2024-04-26T20:26:46.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.697+0000 7f0743e00640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb8e8f0 0x563bbbb90d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:26:46.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.698+0000 7f0743e00640 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb8e8f0 0x563bbbb90d10 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f4795c3cc5c370 server_cookie=1df991c45fbc10b3 in_seq=0 out_seq=0 2024-04-26T20:26:46.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.698+0000 7f072aa00640 10 client.26657 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.699+0000 7f072aa00640 1 -- 172.21.15.82:0/3360299830 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563bbba7e650 con 0x563bbbb8e8f0 2024-04-26T20:26:46.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.699+0000 7f072aa00640 10 client.26657 handle_command_reply: tid=0 2024-04-26T20:26:46.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.699+0000 7f074e99b740 1 client.26657 shutdown 2024-04-26T20:26:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.704+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 msgr2=0x563bbbb20c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.704+0000 7f074e99b740 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb20c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f07380a15a0 tx=0x7f07380a1300 comp rx=0 tx=0).stop 2024-04-26T20:26:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 shutdown_connections 2024-04-26T20:26:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f074e99b740 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563bbbb8e8f0 0x563bbbb90d10 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f074e99b740 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563bbbb182f0 0x563bbbb220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f072aa00640 0 client.26657 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:26:46.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f074e99b740 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bbbb13180 0x563bbbb211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f074e99b740 1 --2- 172.21.15.82:0/3360299830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bbbb12790 0x563bbbb20c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.705+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 >> 172.21.15.82:0/3360299830 conn(0x563bbbb0ddb0 msgr2=0x563bbbb0c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.706+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 shutdown_connections 2024-04-26T20:26:46.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.706+0000 7f074e99b740 1 -- 172.21.15.82:0/3360299830 wait complete. 2024-04-26T20:26:46.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.706+0000 7f074e99b740 20 client.26657 trim_cache size 0 max 16384 2024-04-26T20:26:46.708 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:26:46.708 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: "2422cc1b-1716-4323-a02d-ede94cc3cd94": { 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2422cc1b-1716-4323-a02d-ede94cc3cd94", 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:26:46.709 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:26:46.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.709+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f072c0a3e10 msgr2=0x7f072c0a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.709+0000 7f074bc00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f072c0a3e10 0x7f072c0a62d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f073c056000 tx=0x7f073c058000 comp rx=0 tx=0).stop 2024-04-26T20:26:46.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.709+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744103410 msgr2=0x7f0744196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:26:46.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.709+0000 7f074bc00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744103410 0x7f0744196960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f073800d6d0 tx=0x7f073800db90 comp rx=0 tx=0).stop 2024-04-26T20:26:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.711+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 shutdown_connections 2024-04-26T20:26:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.711+0000 7f074bc00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f072c0a3e10 0x7f072c0a62d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.711+0000 7f074bc00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0744108670 0x7f07441a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.711+0000 7f074bc00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0744105d40 0x7f0744196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.711+0000 7f074bc00640 1 --2- 172.21.15.82:0/3884844093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744103410 0x7f0744196960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:26:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.711+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 >> 172.21.15.82:0/3884844093 conn(0x7f07440fce20 msgr2=0x7f0744102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:26:46.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.712+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 shutdown_connections 2024-04-26T20:26:46.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:26:46.713+0000 7f074bc00640 1 -- 172.21.15.82:0/3884844093 wait complete. 2024-04-26T20:26:46.738 INFO:tasks.cephfs.filesystem:scrub status for tag:2422cc1b-1716-4323-a02d-ede94cc3cd94 - {'path': '/', 'tag': '2422cc1b-1716-4323-a02d-ede94cc3cd94', 'options': 'recursive,force'} 2024-04-26T20:26:47.044 INFO:tasks.workunit.client.0.smithi082.stdout: 106 596024 326 403936 439 147133 368 2024-04-26T20:26:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:46 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:46 smithi082 ceph-mon[28105]: pgmap v531: 129 pgs: 129 active+clean; 399 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-04-26T20:26:47.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:46 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:47.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:46 smithi139 ceph-mon[32999]: pgmap v531: 129 pgs: 129 active+clean; 399 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-04-26T20:26:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:46 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:46 smithi135 ceph-mon[32816]: pgmap v531: 129 pgs: 129 active+clean; 399 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-04-26T20:26:47.821 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: 2024-04-26T20:26:47.377+0000 7f09036e3700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019fa [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40/ auth{0=1,1=1,2=1,3=1} v94680 ap=2 DIRTYPARENT f(v2 m2024-04-26T20:26:06.172343+0000 87=87+0) n(v5 rc2024-04-26T20:26:06.172343+0000 b2530591 88=87+1) (inest sync->mix g=0,1,2,3) caps={25436=pAsLsXsFs/pAsLsXsFsx@1} | lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirtyparent=1 dirwaiter=0 replicated=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5582847b9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x200000019fa:[<0x10000000971/blog-40 v94680>,<0x100000007e0/blogtest_in v1346>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:37.301907+0000 85=85+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:06.172343+0000 b2530591 88=87+1)","memory_value.dirstat":"f(v2 m2024-04-26T20:26:06.172343+0000 87=87+0)","memory_value.rstat":"n(v5 rc2024-04-26T20:26:06.172343+0000 b2530591 88=87+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-26T20:26:47.869 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:47.577+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019e7 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/ auth{0=1,2=1,3=1,4=1} v93520 ap=2 DIRTYPARENT f(v1 m2024-04-26T20:26:04.030385+0000 88=88+0) n(v4 rc2024-04-26T20:26:04.030385+0000 b3052881 89=88+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@204} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642a9237180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x200000019e7:[<0x10000000971/blog-39 v93520>,<0x100000007e0/blogtest_in v1357>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:28.088087+0000 86=86+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:04.030385+0000 b3052881 89=88+1)","memory_value.dirstat":"f(v1 m2024-04-26T20:26:04.030385+0000 88=88+0)","memory_value.rstat":"n(v4 rc2024-04-26T20:26:04.030385+0000 b3052881 89=88+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:47.869 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:47.653+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000025a0 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v101370 ap=2 DIRTYPARENT f(v2 m2024-04-26T20:26:25.360968+0000 155=155+0) n(v3 rc2024-04-26T20:26:25.360968+0000 b1953589 156=155+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@246} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642a85e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x200000025a0:[<0x10000000971/blog-66 v101370>,<0x100000007e0/blogtest_in v1357>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:26:04.663372+0000 89=89+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:25.360968+0000 b1953589 156=155+1)","memory_value.dirstat":"f(v2 m2024-04-26T20:26:25.360968+0000 155=155+0)","memory_value.rstat":"n(v3 rc2024-04-26T20:26:25.360968+0000 b1953589 156=155+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:47.869 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:47.866+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019c3 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38/ auth{0=1,2=1,3=1,4=1} v94690 ap=2 DIRTYPARENT f(v3 m2024-04-26T20:26:07.771311+0000 32=32+0) n(v5 rc2024-04-26T20:26:07.771311+0000 b1035345 33=32+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@64} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642aaaf4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x200000019c3:[<0x10000000971/blog-38 v94690>,<0x100000007e0/blogtest_in v1369>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:53.002600+0000 30=30+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:07.771311+0000 b1035345 33=32+1)","memory_value.dirstat":"f(v3 m2024-04-26T20:26:07.771311+0000 32=32+0)","memory_value.rstat":"n(v5 rc2024-04-26T20:26:07.771311+0000 b1035345 33=32+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000c3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13) see mds.g log and `damage ls` output for details 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000ce9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-15) see mds.g log and `damage ls` output for details 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:48.185 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:47.886+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016a3 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/ auth{0=1,2=1,3=1,4=1} v94766 ap=2 DIRTYPARENT f(v3 m2024-04-26T20:26:05.159362+0000 80=80+0) n(v5 rc2024-04-26T20:26:05.159362+0000 b1649315 81=80+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@220} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642a8798100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x200000016a3:[<0x10000000971/blog-30 v94766>,<0x100000007e0/blogtest_in v1369>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:54.231576+0000 79=79+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:05.159362+0000 b1649315 81=80+1)","memory_value.dirstat":"f(v3 m2024-04-26T20:26:05.159362+0000 80=80+0)","memory_value.rstat":"n(v5 rc2024-04-26T20:26:05.159362+0000 b1649315 81=80+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-26T20:26:48.185 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:48.051+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000196f [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v94668 ap=2 DIRTYPARENT f(v3 m2024-04-26T20:26:04.875368+0000 137=137+0) n(v5 rc2024-04-26T20:26:04.875368+0000 b1566291 138=137+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@118} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642a7a42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x2000000196f:[<0x10000000971/blog-37 v94668>,<0x100000007e0/blogtest_in v1369>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:49.950660+0000 135=135+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:04.875368+0000 b1566291 138=137+1)","memory_value.dirstat":"f(v3 m2024-04-26T20:26:04.875368+0000 137=137+0)","memory_value.rstat":"n(v5 rc2024-04-26T20:26:04.875368+0000 b1566291 138=137+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:48.185 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:48.177+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000001f7 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v68885 ap=2 DIRTYPARENT f(v5 m2024-04-26T20:25:32.397003+0000 256=256+0) n(v5 rc2024-04-26T20:25:32.397003+0000 b4611604 257=256+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@2576} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5642a7d32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x200000001f7:[<0x10000000971/blog-2 v68885>,<0x100000007e0/blogtest_in v1375>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:26.252123+0000 257=257+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:25:32.397003+0000 b4611604 257=256+1)","memory_value.dirstat":"f(v5 m2024-04-26T20:25:32.397003+0000 256=256+0)","memory_value.rstat":"n(v5 rc2024-04-26T20:25:32.397003+0000 b4611604 257=256+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000c3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13) see mds.g log and `damage ls` output for details 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000ce9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-15) see mds.g log and `damage ls` output for details 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:47 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:48.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:26:48.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000c3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13) see mds.g log and `damage ls` output for details 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000ce9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-15) see mds.g log and `damage ls` output for details 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:48.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:47 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:48.437 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:26:48.344+0000 7f109a200700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bdc [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/ auth{0=1,2=1,3=1,4=1} fragtree_t(*^3) v94670 ap=2 DIRTYPARENT f(v2 m2024-04-26T20:26:05.544355+0000 134=134+0) n(v6 rc2024-04-26T20:26:05.544355+0000 b1741271 135=134+1) (inest sync->mix g=0,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@277} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5642a84c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x20000000bdc:[<0x10000000971/blog-12 v94670>,<0x100000007e0/blogtest_in v1389>,<0x100000007d9/src v1703>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:25:42.359808+0000 131=131+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:05.544355+0000 b1741271 135=134+1)","memory_value.dirstat":"f(v2 m2024-04-26T20:26:05.544355+0000 134=134+0)","memory_value.rstat":"n(v6 rc2024-04-26T20:26:05.544355+0000 b1741271 135=134+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019fa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40) see mds.l log and `damage ls` output for details 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000025a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000016a3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000196f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000001f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bdc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:48 smithi082 ceph-mon[28105]: pgmap v532: 129 pgs: 129 active+clean; 399 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019fa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40) see mds.l log and `damage ls` output for details 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000025a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000016a3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000196f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000001f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bdc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:48 smithi139 ceph-mon[32999]: pgmap v532: 129 pgs: 129 active+clean; 399 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019fa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40) see mds.l log and `damage ls` output for details 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000025a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000016a3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000196f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000001f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bdc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12) see mds.g log and `damage ls` output for details 2024-04-26T20:26:49.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:49.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:49.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:48 smithi135 ceph-mon[32816]: pgmap v532: 129 pgs: 129 active+clean; 399 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-04-26T20:26:50.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:50.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:49 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:50.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:49 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:50.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:49 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:51.217 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:50 smithi082 ceph-mon[28105]: pgmap v533: 129 pgs: 129 active+clean; 401 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2024-04-26T20:26:51.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:50 smithi139 ceph-mon[32999]: pgmap v533: 129 pgs: 129 active+clean; 401 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2024-04-26T20:26:51.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:50 smithi135 ceph-mon[32816]: pgmap v533: 129 pgs: 129 active+clean; 401 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2024-04-26T20:26:52.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:51 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:26:52.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:51 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:52.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:51 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:26:52.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:51 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:52.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:51 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:26:52.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:51 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:52 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:52 smithi082 ceph-mon[28105]: pgmap v534: 129 pgs: 129 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 345 op/s 2024-04-26T20:26:53.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:52 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:53.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:52 smithi139 ceph-mon[32999]: pgmap v534: 129 pgs: 129 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 345 op/s 2024-04-26T20:26:53.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:52 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:26:53.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:52 smithi135 ceph-mon[32816]: pgmap v534: 129 pgs: 129 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 345 op/s 2024-04-26T20:26:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:53 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:26:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:53 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:26:54.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:54.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:54.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:53 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:26:55.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:54 smithi139 ceph-mon[32999]: pgmap v535: 129 pgs: 129 active+clean; 405 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 302 op/s 2024-04-26T20:26:55.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:54 smithi135 ceph-mon[32816]: pgmap v535: 129 pgs: 129 active+clean; 405 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 302 op/s 2024-04-26T20:26:55.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:54 smithi082 ceph-mon[28105]: pgmap v535: 129 pgs: 129 active+clean; 405 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 302 op/s 2024-04-26T20:26:57.041 INFO:tasks.workunit.client.0.smithi082.stdout: 120 572809 857 393312 574 153098 706 2024-04-26T20:26:57.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:57 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:26:57.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:57 smithi139 ceph-mon[32999]: pgmap v536: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 322 op/s 2024-04-26T20:26:57.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:57 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:26:57.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:57 smithi135 ceph-mon[32816]: pgmap v536: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 322 op/s 2024-04-26T20:26:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:57 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:26:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:57 smithi082 ceph-mon[28105]: pgmap v536: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 322 op/s 2024-04-26T20:26:59.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:26:58 smithi135 ceph-mon[32816]: pgmap v537: 129 pgs: 129 active+clean; 412 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 308 op/s 2024-04-26T20:26:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:26:58 smithi082 ceph-mon[28105]: pgmap v537: 129 pgs: 129 active+clean; 412 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 308 op/s 2024-04-26T20:26:59.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:26:58 smithi139 ceph-mon[32999]: pgmap v537: 129 pgs: 129 active+clean; 412 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 308 op/s 2024-04-26T20:27:01.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:00 smithi135 ceph-mon[32816]: pgmap v538: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 309 op/s 2024-04-26T20:27:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:00 smithi082 ceph-mon[28105]: pgmap v538: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 309 op/s 2024-04-26T20:27:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:00 smithi139 ceph-mon[32999]: pgmap v538: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 309 op/s 2024-04-26T20:27:02.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:01 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:27:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:01 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:27:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:01 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:27:02.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:01 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:27:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:01 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:27:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:01 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:27:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:01 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:27:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:01 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:27:02.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:01 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:27:02.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:01 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:27:02.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:01 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:27:02.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:01 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:27:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.389+0000 7fe782600640 1 -- 172.21.15.82:0/1589216327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c10ec50 msgr2=0x7fe77c10f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.389+0000 7fe782600640 1 --2- 172.21.15.82:0/1589216327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c10ec50 0x7fe77c10f0d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe774009be0 tx=0x7fe77402a6f0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.431+0000 7fe782600640 1 -- 172.21.15.82:0/1589216327 shutdown_connections 2024-04-26T20:27:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.431+0000 7fe782600640 1 --2- 172.21.15.82:0/1589216327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c10ec50 0x7fe77c10f0d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.431+0000 7fe782600640 1 --2- 172.21.15.82:0/1589216327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe77c10c2a0 0x7fe77c10e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.431+0000 7fe782600640 1 --2- 172.21.15.82:0/1589216327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe77c109930 0x7fe77c10bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.431+0000 7fe782600640 1 -- 172.21.15.82:0/1589216327 >> 172.21.15.82:0/1589216327 conn(0x7fe77c06f9a0 msgr2=0x7fe77c071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.440+0000 7fe782600640 1 -- 172.21.15.82:0/1589216327 shutdown_connections 2024-04-26T20:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.445+0000 7fe782600640 1 -- 172.21.15.82:0/1589216327 wait complete. 2024-04-26T20:27:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.448+0000 7fe782600640 1 Processor -- start 2024-04-26T20:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.457+0000 7fe782600640 1 -- start start 2024-04-26T20:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.457+0000 7fe782600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 0x7fe77c115fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.465+0000 7fe77b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 0x7fe77c115fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.465+0000 7fe77b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 0x7fe77c115fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47008/0 (socket says 172.21.15.82:47008) 2024-04-26T20:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.466+0000 7fe77b400640 1 -- 172.21.15.82:0/3245288100 learned_addr learned my addr 172.21.15.82:0/3245288100 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.466+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe77c10c2a0 0x7fe77c116520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.468+0000 7fe77aa00640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe77c10c2a0 0x7fe77c116520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.469+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe77c10ec50 0x7fe77c1b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.469+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c11d2d0 con 0x7fe77c109930 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.469+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c11d150 con 0x7fe77c10c2a0 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.469+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c11d450 con 0x7fe77c10ec50 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.470+0000 7fe77b400640 1 -- 172.21.15.82:0/3245288100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe77c10ec50 msgr2=0x7fe77c1b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.470+0000 7fe77b400640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe77c10ec50 0x7fe77c1b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.470+0000 7fe77b400640 1 -- 172.21.15.82:0/3245288100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe77c10c2a0 msgr2=0x7fe77c116520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.470+0000 7fe77b400640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe77c10c2a0 0x7fe77c116520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.470+0000 7fe77b400640 1 -- 172.21.15.82:0/3245288100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c116c00 con 0x7fe77c109930 2024-04-26T20:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.470+0000 7fe77b400640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 0x7fe77c115fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe76800ccb0 tx=0x7fe768007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.488+0000 7fe773e00640 1 -- 172.21.15.82:0/3245288100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768007ca0 con 0x7fe77c109930 2024-04-26T20:27:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.488+0000 7fe773e00640 1 -- 172.21.15.82:0/3245288100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe768007e40 con 0x7fe77c109930 2024-04-26T20:27:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.488+0000 7fe773e00640 1 -- 172.21.15.82:0/3245288100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768004a00 con 0x7fe77c109930 2024-04-26T20:27:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.517+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77c1b7fe0 con 0x7fe77c109930 2024-04-26T20:27:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.518+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77c1b8390 con 0x7fe77c109930 2024-04-26T20:27:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.586+0000 7fe773e00640 1 -- 172.21.15.82:0/3245288100 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe768004ba0 con 0x7fe77c109930 2024-04-26T20:27:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.594+0000 7fe773e00640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7600a3f00 0x7fe7600a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.595+0000 7fe77aa00640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7600a3f00 0x7fe7600a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.596+0000 7fe77aa00640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7600a3f00 0x7fe7600a63c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe76c005fd0 tx=0x7fe76c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.604+0000 7fe78541a740 1 Processor -- start 2024-04-26T20:27:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.611+0000 7fe78541a740 1 -- start start 2024-04-26T20:27:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.612+0000 7fe78541a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee01f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.612+0000 7fe78541a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f85c0 0x555ee01fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.612+0000 7fe78541a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee01ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.621+0000 7fe78541a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ee015c380 con 0x555ee01fd730 2024-04-26T20:27:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.621+0000 7fe78541a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555ee00f8c30 con 0x555ee01f85c0 2024-04-26T20:27:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.621+0000 7fe78541a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555ee0158340 con 0x555ee01f7bd0 2024-04-26T20:27:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee01ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee01ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47020/0 (socket says 172.21.15.82:47020) 2024-04-26T20:27:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 -- 172.21.15.82:0/2651146621 learned_addr learned my addr 172.21.15.82:0/2651146621 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 -- 172.21.15.82:0/2651146621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 msgr2=0x555ee01f7ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee01f7ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 -- 172.21.15.82:0/2651146621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f85c0 msgr2=0x555ee01fd0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f85c0 0x555ee01fd0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.623+0000 7fe77be00640 1 -- 172.21.15.82:0/2651146621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee011a940 con 0x555ee01fd730 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.624+0000 7fe77be00640 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee01ffbc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe774034040 tx=0x7fe7740304a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b6809a6c91a803 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.601+0000 7fe773e00640 1 -- 172.21.15.82:0/3245288100 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe7680d0990 con 0x7fe77c109930 2024-04-26T20:27:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.634+0000 7fe770c00640 1 -- 172.21.15.82:0/2651146621 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774040020 con 0x555ee01fd730 2024-04-26T20:27:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.634+0000 7fe770c00640 1 -- 172.21.15.82:0/2651146621 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe774003970 con 0x555ee01fd730 2024-04-26T20:27:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.634+0000 7fe770c00640 1 -- 172.21.15.82:0/2651146621 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774036040 con 0x555ee01fd730 2024-04-26T20:27:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.647+0000 7fe78541a740 1 -- 172.21.15.82:0/2651146621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 msgr2=0x555ee01ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.647+0000 7fe78541a740 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee01ffbc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe774034040 tx=0x7fe7740304a0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.666+0000 7fe78541a740 1 -- 172.21.15.82:0/2651146621 shutdown_connections 2024-04-26T20:27:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.666+0000 7fe78541a740 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee01ffbc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.666+0000 7fe78541a740 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f85c0 0x555ee01fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.666+0000 7fe78541a740 1 --2- 172.21.15.82:0/2651146621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee01f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.666+0000 7fe78541a740 1 -- 172.21.15.82:0/2651146621 >> 172.21.15.82:0/2651146621 conn(0x555ee01f3240 msgr2=0x555ee01f3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.667+0000 7fe78541a740 1 -- 172.21.15.82:0/2651146621 shutdown_connections 2024-04-26T20:27:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.667+0000 7fe78541a740 1 -- 172.21.15.82:0/2651146621 wait complete. 2024-04-26T20:27:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.667+0000 7fe78541a740 1 -- start start 2024-04-26T20:27:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.668+0000 7fe78541a740 1 Processor -- start 2024-04-26T20:27:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.669+0000 7fe78541a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee0201e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.669+0000 7fe78541a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 0x555ee02023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.670+0000 7fe78541a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01fd730 0x555ee02093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.670+0000 7fe77aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 0x555ee02023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.670+0000 7fe77aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 0x555ee02023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47024/0 (socket says 172.21.15.82:47024) 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.670+0000 7fe77b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee0201e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.670+0000 7fe77b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee0201e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:59510/0 (socket says 172.21.15.82:59510) 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.670+0000 7fe78541a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555ee0200680 con 0x555ee01f85c0 2024-04-26T20:27:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.671+0000 7fe77aa00640 1 -- 172.21.15.82:0/934842805 learned_addr learned my addr 172.21.15.82:0/934842805 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.671+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555ee00e3c60 con 0x555ee01fd730 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.671+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555ee0200800 con 0x555ee01f7bd0 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.671+0000 7fe77be00640 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01fd730 0x555ee02093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.672+0000 7fe77aa00640 1 -- 172.21.15.82:0/934842805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 msgr2=0x555ee0201e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.672+0000 7fe77aa00640 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee0201e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.672+0000 7fe77aa00640 1 -- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01fd730 msgr2=0x555ee02093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.672+0000 7fe77aa00640 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01fd730 0x555ee02093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.672+0000 7fe77aa00640 1 -- 172.21.15.82:0/934842805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee00f2510 con 0x555ee01f85c0 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.673+0000 7fe77aa00640 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 0x555ee02023b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0119f0 tx=0x7fe76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b638a4e3a8e3f11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.673+0000 7fe78541a740 10 client.0 _ll_register_callbacks cb 0x555ee010fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.674+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe774003970 con 0x555ee01f85c0 2024-04-26T20:27:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.677+0000 7fe765600640 10 client.16560 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.677+0000 7fe765600640 1 -- 172.21.15.82:0/934842805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c022030 con 0x555ee01f85c0 2024-04-26T20:27:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.677+0000 7fe765600640 1 -- 172.21.15.82:0/934842805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe76c0108d0 con 0x555ee01f85c0 2024-04-26T20:27:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.677+0000 7fe765600640 1 -- 172.21.15.82:0/934842805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe76c02c050 con 0x555ee01f85c0 2024-04-26T20:27:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.692+0000 7fe78541a740 10 client.16560 fetch_fsmap learned FSMap version 35 2024-04-26T20:27:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.692+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=35}) -- 0x555edfe6e210 con 0x555ee01f85c0 2024-04-26T20:27:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe765600640 1 -- 172.21.15.82:0/934842805 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 35) ==== 8382+0+0 (secure 0 0 0) 0x7fe76c00f040 con 0x555ee01f85c0 2024-04-26T20:27:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe78541a740 10 client.16560 fetch_fsmap finished waiting for FSMap version 35 2024-04-26T20:27:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe78541a740 10 client.16560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe78541a740 20 client.16560 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe78541a740 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee020d750 0x555ee020fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe78541a740 4 client.16560 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.701+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ee0169f90 con 0x555ee020d750 2024-04-26T20:27:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.703+0000 7fe77b400640 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee020d750 0x555ee020fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.707+0000 7fe77b400640 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee020d750 0x555ee020fbe0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fb938ac138b19f8 server_cookie=c0f61c9337c6d1e9 in_seq=0 out_seq=0 2024-04-26T20:27:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.712+0000 7fe765600640 10 client.16560 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.717+0000 7fe765600640 1 -- 172.21.15.82:0/934842805 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555ee0169f90 con 0x555ee020d750 2024-04-26T20:27:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.717+0000 7fe765600640 10 client.16560 handle_command_reply: tid=0 2024-04-26T20:27:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.717+0000 7fe78541a740 1 client.16560 shutdown 2024-04-26T20:27:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 msgr2=0x555ee02023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 0x555ee02023b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0119f0 tx=0x7fe76c0046c0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 shutdown_connections 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee020d750 0x555ee020fbe0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01fd730 0x555ee02093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f85c0 0x555ee02023b0 secure :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0119f0 tx=0x7fe76c0046c0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 --2- 172.21.15.82:0/934842805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f7bd0 0x555ee0201e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 >> 172.21.15.82:0/934842805 conn(0x555ee01f3240 msgr2=0x555ee01f2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.738+0000 7fe765600640 0 client.16560 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.751+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 shutdown_connections 2024-04-26T20:27:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.751+0000 7fe78541a740 1 -- 172.21.15.82:0/934842805 wait complete. 2024-04-26T20:27:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.751+0000 7fe78541a740 20 client.16560 trim_cache size 0 max 16384 2024-04-26T20:27:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.843+0000 7fe78541a740 1 Processor -- start 2024-04-26T20:27:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.844+0000 7fe78541a740 1 -- start start 2024-04-26T20:27:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.844+0000 7fe78541a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 0x555ee01f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.845+0000 7fe77b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 0x555ee01f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.845+0000 7fe77b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 0x555ee01f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47038/0 (socket says 172.21.15.82:47038) 2024-04-26T20:27:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.846+0000 7fe77b400640 1 -- 172.21.15.82:0/1207047039 learned_addr learned my addr 172.21.15.82:0/1207047039 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.846+0000 7fe78541a740 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01fd730 0x555ee020fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.846+0000 7fe78541a740 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f9ef0 0x555ee02093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.846+0000 7fe77aa00640 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01fd730 0x555ee020fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.847+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1c28f0 con 0x555ee01f7bd0 2024-04-26T20:27:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.847+0000 7fe77be00640 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f9ef0 0x555ee02093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.847+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1c4520 con 0x555ee01f9ef0 2024-04-26T20:27:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.847+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1c2fc0 con 0x555ee01fd730 2024-04-26T20:27:02.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.848+0000 7fe77b400640 1 -- 172.21.15.82:0/1207047039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01fd730 msgr2=0x555ee020fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.848+0000 7fe77b400640 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01fd730 0x555ee020fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.848+0000 7fe77b400640 1 -- 172.21.15.82:0/1207047039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f9ef0 msgr2=0x555ee02093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.848+0000 7fe77b400640 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f9ef0 0x555ee02093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.848+0000 7fe77b400640 1 -- 172.21.15.82:0/1207047039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edff3a620 con 0x555ee01f7bd0 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.849+0000 7fe77b400640 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 0x555ee01f6a80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe76809c760 tx=0x7fe76801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78abce24cc6304 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.850+0000 7fe767e00640 1 -- 172.21.15.82:0/1207047039 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680a5440 con 0x555ee01f7bd0 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.850+0000 7fe767e00640 1 -- 172.21.15.82:0/1207047039 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7680b9030 con 0x555ee01f7bd0 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.850+0000 7fe767e00640 1 -- 172.21.15.82:0/1207047039 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680ce1d0 con 0x555ee01f7bd0 2024-04-26T20:27:02.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.851+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 msgr2=0x555ee01f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.851+0000 7fe78541a740 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 0x555ee01f6a80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe76809c760 tx=0x7fe76801a040 comp rx=0 tx=0).stop 2024-04-26T20:27:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.852+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 shutdown_connections 2024-04-26T20:27:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.852+0000 7fe78541a740 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f9ef0 0x555ee02093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.852+0000 7fe78541a740 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01fd730 0x555ee020fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.852+0000 7fe78541a740 1 --2- 172.21.15.82:0/1207047039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01f7bd0 0x555ee01f6a80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.852+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 >> 172.21.15.82:0/1207047039 conn(0x555ee01f3240 msgr2=0x555ee01f1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.893+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 shutdown_connections 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.894+0000 7fe78541a740 1 -- 172.21.15.82:0/1207047039 wait complete. 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.894+0000 7fe78541a740 1 -- start start 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.894+0000 7fe78541a740 1 Processor -- start 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f7bd0 0x555ee0206d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 0x555ee0207260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee0208270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1c3e20 con 0x555ee01fd730 2024-04-26T20:27:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1c3690 con 0x555ee01f7bd0 2024-04-26T20:27:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1c08d0 con 0x555ee01f9ef0 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.895+0000 7fe78541a740 10 client.0 _ll_register_callbacks cb 0x7fe76c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.896+0000 7fe77aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 0x555ee0207260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.896+0000 7fe77aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 0x555ee0207260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:59514/0 (socket says 172.21.15.82:59514) 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.896+0000 7fe77aa00640 1 -- 172.21.15.82:0/1114369174 learned_addr learned my addr 172.21.15.82:0/1114369174 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.896+0000 7fe77be00640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee0208270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.897+0000 7fe77aa00640 1 -- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f7bd0 msgr2=0x555ee0206d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.897+0000 7fe77aa00640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f7bd0 0x555ee0206d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.897+0000 7fe77aa00640 1 -- 172.21.15.82:0/1114369174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 msgr2=0x555ee0208270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.900+0000 7fe77aa00640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee0208270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.900+0000 7fe77aa00640 1 -- 172.21.15.82:0/1114369174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee0116cb0 con 0x555ee01f9ef0 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.904+0000 7fe77aa00640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 0x555ee0207260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe76c005c20 tx=0x7fe76c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7e5d33c63899da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.905+0000 7fe765600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.905+0000 7fe765600640 1 -- 172.21.15.82:0/1114369174 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c022040 con 0x555ee01f9ef0 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.906+0000 7fe765600640 1 -- 172.21.15.82:0/1114369174 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe76c010850 con 0x555ee01f9ef0 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.916+0000 7fe77be00640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee0208270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.928+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7680b9030 con 0x555ee01f9ef0 2024-04-26T20:27:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.931+0000 7fe765600640 1 -- 172.21.15.82:0/1114369174 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe76c041050 con 0x555ee01f9ef0 2024-04-26T20:27:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.959+0000 7fe78541a740 10 client.26716 fetch_fsmap learned FSMap version 35 2024-04-26T20:27:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.959+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555ee0295e40 con 0x555ee01f9ef0 2024-04-26T20:27:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe765600640 1 -- 172.21.15.82:0/1114369174 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7680b9030 con 0x555ee01f9ef0 2024-04-26T20:27:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe765600640 1 -- 172.21.15.82:0/1114369174 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) ==== 8382+0+0 (secure 0 0 0) 0x7fe76c004680 con 0x555ee01f9ef0 2024-04-26T20:27:02.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe78541a740 10 client.26716 fetch_fsmap finished waiting for FSMap version 35 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe78541a740 10 client.26716 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe78541a740 20 client.26716 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe78541a740 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee02967f0 0x555ee0298c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe78541a740 4 client.26716 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ee0163e00 con 0x555ee02967f0 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.960+0000 7fe77b400640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee02967f0 0x555ee0298c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.961+0000 7fe765600640 10 client.26716 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:02.961+0000 7fe77b400640 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee02967f0 0x555ee0298c10 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4983b599a6015ce0 server_cookie=ee49d6b2aa392da8 in_seq=0 out_seq=0 2024-04-26T20:27:03.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:02 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:27:03.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:02 smithi082 ceph-mon[28105]: pgmap v539: 129 pgs: 129 active+clean; 436 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 337 op/s 2024-04-26T20:27:03.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:02 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:27:03.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:02 smithi139 ceph-mon[32999]: pgmap v539: 129 pgs: 129 active+clean; 436 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 337 op/s 2024-04-26T20:27:03.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:02 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:27:03.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:02 smithi135 ceph-mon[32816]: pgmap v539: 129 pgs: 129 active+clean; 436 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 337 op/s 2024-04-26T20:27:05.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:04 smithi135 ceph-mon[32816]: pgmap v540: 129 pgs: 129 active+clean; 452 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 402 op/s 2024-04-26T20:27:05.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:04 smithi082 ceph-mon[28105]: pgmap v540: 129 pgs: 129 active+clean; 452 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 402 op/s 2024-04-26T20:27:05.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:04 smithi139 ceph-mon[32999]: pgmap v540: 129 pgs: 129 active+clean; 452 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 402 op/s 2024-04-26T20:27:07.044 INFO:tasks.workunit.client.0.smithi082.stdout: 128 550640 235 374098 349 139607 65 2024-04-26T20:27:07.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:06 smithi135 ceph-mon[32816]: pgmap v541: 129 pgs: 129 active+clean; 465 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 557 op/s 2024-04-26T20:27:07.122 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:06 smithi139 ceph-mon[32999]: pgmap v541: 129 pgs: 129 active+clean; 465 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 557 op/s 2024-04-26T20:27:07.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:06 smithi082 ceph-mon[28105]: pgmap v541: 129 pgs: 129 active+clean; 465 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 557 op/s 2024-04-26T20:27:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.717+0000 7fe765600640 1 -- 172.21.15.82:0/1114369174 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ee0163e00 con 0x555ee02967f0 2024-04-26T20:27:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.717+0000 7fe765600640 10 client.26716 handle_command_reply: tid=0 2024-04-26T20:27:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.717+0000 7fe78541a740 1 client.26716 shutdown 2024-04-26T20:27:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.719+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 msgr2=0x555ee0207260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.719+0000 7fe78541a740 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 0x555ee0207260 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe76c005c20 tx=0x7fe76c013000 comp rx=0 tx=0).stop 2024-04-26T20:27:07.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 shutdown_connections 2024-04-26T20:27:07.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555ee02967f0 0x555ee0298c10 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ee01fd730 0x555ee0208270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555ee01f9ef0 0x555ee0207260 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 --2- 172.21.15.82:0/1114369174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee01f7bd0 0x555ee0206d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 >> 172.21.15.82:0/1114369174 conn(0x555ee01f3240 msgr2=0x555ee01f6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe765600640 0 client.26716 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 shutdown_connections 2024-04-26T20:27:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.722+0000 7fe78541a740 1 -- 172.21.15.82:0/1114369174 wait complete. 2024-04-26T20:27:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.723+0000 7fe78541a740 20 client.26716 trim_cache size 0 max 16384 2024-04-26T20:27:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:27:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:27:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:27:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:27:07.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.726+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7600a3f00 msgr2=0x7fe7600a63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.726+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7600a3f00 0x7fe7600a63c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe76c005fd0 tx=0x7fe76c005850 comp rx=0 tx=0).stop 2024-04-26T20:27:07.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.726+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 msgr2=0x7fe77c115fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:07.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.726+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 0x7fe77c115fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe76800ccb0 tx=0x7fe768007590 comp rx=0 tx=0).stop 2024-04-26T20:27:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.733+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 shutdown_connections 2024-04-26T20:27:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.733+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7600a3f00 0x7fe7600a63c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.733+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe77c10ec50 0x7fe77c1b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.733+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe77c10c2a0 0x7fe77c116520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.733+0000 7fe782600640 1 --2- 172.21.15.82:0/3245288100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c109930 0x7fe77c115fe0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.733+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 >> 172.21.15.82:0/3245288100 conn(0x7fe77c06f9a0 msgr2=0x7fe77c10e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.736+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 shutdown_connections 2024-04-26T20:27:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:07.736+0000 7fe782600640 1 -- 172.21.15.82:0/3245288100 wait complete. 2024-04-26T20:27:09.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:08 smithi135 ceph-mon[32816]: pgmap v542: 129 pgs: 129 active+clean; 479 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 6.2 MiB/s wr, 777 op/s 2024-04-26T20:27:09.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:08 smithi082 ceph-mon[28105]: pgmap v542: 129 pgs: 129 active+clean; 479 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 6.2 MiB/s wr, 777 op/s 2024-04-26T20:27:09.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:08 smithi139 ceph-mon[32999]: pgmap v542: 129 pgs: 129 active+clean; 479 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 6.2 MiB/s wr, 777 op/s 2024-04-26T20:27:11.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:10 smithi135 ceph-mon[32816]: pgmap v543: 129 pgs: 129 active+clean; 491 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.1 MiB/s wr, 881 op/s 2024-04-26T20:27:11.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:10 smithi082 ceph-mon[28105]: pgmap v543: 129 pgs: 129 active+clean; 491 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.1 MiB/s wr, 881 op/s 2024-04-26T20:27:11.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:10 smithi139 ceph-mon[32999]: pgmap v543: 129 pgs: 129 active+clean; 491 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.1 MiB/s wr, 881 op/s 2024-04-26T20:27:13.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:12 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:13.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:12 smithi082 ceph-mon[28105]: pgmap v544: 129 pgs: 129 active+clean; 488 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 850 op/s 2024-04-26T20:27:13.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:12 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:13.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:12 smithi139 ceph-mon[32999]: pgmap v544: 129 pgs: 129 active+clean; 488 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 850 op/s 2024-04-26T20:27:13.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:12 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:13.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:12 smithi135 ceph-mon[32816]: pgmap v544: 129 pgs: 129 active+clean; 488 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.5 MiB/s wr, 850 op/s 2024-04-26T20:27:15.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:14 smithi082 ceph-mon[28105]: pgmap v545: 129 pgs: 129 active+clean; 496 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 794 op/s 2024-04-26T20:27:15.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:14 smithi139 ceph-mon[32999]: pgmap v545: 129 pgs: 129 active+clean; 496 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 794 op/s 2024-04-26T20:27:15.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:14 smithi135 ceph-mon[32816]: pgmap v545: 129 pgs: 129 active+clean; 496 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 794 op/s 2024-04-26T20:27:16.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:27:16.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:27:17.044 INFO:tasks.workunit.client.0.smithi082.stdout: 148 585135 898 395976 1079 154872 1357 2024-04-26T20:27:17.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:16 smithi135 ceph-mon[32816]: pgmap v546: 129 pgs: 129 active+clean; 498 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 630 op/s 2024-04-26T20:27:17.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:16 smithi082 ceph-mon[28105]: pgmap v546: 129 pgs: 129 active+clean; 498 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 630 op/s 2024-04-26T20:27:17.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:16 smithi139 ceph-mon[32999]: pgmap v546: 129 pgs: 129 active+clean; 498 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 630 op/s 2024-04-26T20:27:19.278 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:18 smithi082 ceph-mon[28105]: pgmap v547: 129 pgs: 129 active+clean; 502 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2024-04-26T20:27:19.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:18 smithi139 ceph-mon[32999]: pgmap v547: 129 pgs: 129 active+clean; 502 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2024-04-26T20:27:19.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:18 smithi135 ceph-mon[32816]: pgmap v547: 129 pgs: 129 active+clean; 502 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 487 op/s 2024-04-26T20:27:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.088+0000 7ff316400640 1 -- 172.21.15.82:0/4064526615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010ec70 msgr2=0x7ff31010f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.088+0000 7ff316400640 1 --2- 172.21.15.82:0/4064526615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010ec70 0x7ff31010f120 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff308009f00 tx=0x7ff30802ab60 comp rx=0 tx=0).stop 2024-04-26T20:27:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 -- 172.21.15.82:0/4064526615 shutdown_connections 2024-04-26T20:27:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 --2- 172.21.15.82:0/4064526615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010ec70 0x7ff31010f120 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 --2- 172.21.15.82:0/4064526615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff31010c2a0 0x7ff31010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 --2- 172.21.15.82:0/4064526615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff310109930 0x7ff31010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 -- 172.21.15.82:0/4064526615 >> 172.21.15.82:0/4064526615 conn(0x7ff31006f7c0 msgr2=0x7ff310071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 -- 172.21.15.82:0/4064526615 shutdown_connections 2024-04-26T20:27:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.089+0000 7ff316400640 1 -- 172.21.15.82:0/4064526615 wait complete. 2024-04-26T20:27:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.091+0000 7ff316400640 1 Processor -- start 2024-04-26T20:27:21.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 -- start start 2024-04-26T20:27:21.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff310109930 0x7ff3101190f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 0x7ff310119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff31010ec70 0x7ff31011a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff310111900 con 0x7ff31010c2a0 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff310111780 con 0x7ff310109930 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.095+0000 7ff316400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff310111a80 con 0x7ff31010ec70 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.096+0000 7ff30ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 0x7ff310119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.096+0000 7ff30ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 0x7ff310119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46400/0 (socket says 172.21.15.82:46400) 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.096+0000 7ff30ea00640 1 -- 172.21.15.82:0/495095505 learned_addr learned my addr 172.21.15.82:0/495095505 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.097+0000 7ff30ea00640 1 -- 172.21.15.82:0/495095505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff31010ec70 msgr2=0x7ff31011a670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.097+0000 7ff30ea00640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff31010ec70 0x7ff31011a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.097+0000 7ff30ea00640 1 -- 172.21.15.82:0/495095505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff310109930 msgr2=0x7ff3101190f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.097+0000 7ff30ea00640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff310109930 0x7ff3101190f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.097+0000 7ff30ea00640 1 -- 172.21.15.82:0/495095505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31011ace0 con 0x7ff31010c2a0 2024-04-26T20:27:21.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.097+0000 7ff30ea00640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 0x7ff310119630 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00cce0 tx=0x7ff2fc007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.098+0000 7ff307e00640 1 -- 172.21.15.82:0/495095505 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc007ca0 con 0x7ff31010c2a0 2024-04-26T20:27:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.098+0000 7ff307e00640 1 -- 172.21.15.82:0/495095505 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc007e40 con 0x7ff31010c2a0 2024-04-26T20:27:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.098+0000 7ff307e00640 1 -- 172.21.15.82:0/495095505 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00f450 con 0x7ff31010c2a0 2024-04-26T20:27:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.098+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31011afd0 con 0x7ff31010c2a0 2024-04-26T20:27:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.098+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31011b4d0 con 0x7ff31010c2a0 2024-04-26T20:27:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.115+0000 7ff319219740 1 Processor -- start 2024-04-26T20:27:21.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.115+0000 7ff319219740 1 -- start start 2024-04-26T20:27:21.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.116+0000 7ff319219740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d0329790 0x55f8d0329bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.117+0000 7ff319219740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d032ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.117+0000 7ff30f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d032ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.118+0000 7ff30f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d032ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46410/0 (socket says 172.21.15.82:46410) 2024-04-26T20:27:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.118+0000 7ff30f400640 1 -- 172.21.15.82:0/3831488488 learned_addr learned my addr 172.21.15.82:0/3831488488 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.118+0000 7ff319219740 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d032f2f0 0x55f8d0331780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.118+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f8d023a030 con 0x55f8d032a180 2024-04-26T20:27:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.118+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f8d02557f0 con 0x55f8d032f2f0 2024-04-26T20:27:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.118+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f8d02107e0 con 0x55f8d0329790 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.123+0000 7ff30fe00640 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d0329790 0x55f8d0329bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.133+0000 7ff30fe00640 1 -- 172.21.15.82:0/3831488488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d032f2f0 msgr2=0x55f8d0331780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.134+0000 7ff30fe00640 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d032f2f0 0x55f8d0331780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.134+0000 7ff30fe00640 1 -- 172.21.15.82:0/3831488488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 msgr2=0x55f8d032ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.137+0000 7ff30fe00640 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d032ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.137+0000 7ff307e00640 1 -- 172.21.15.82:0/495095505 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff2fc003610 con 0x7ff31010c2a0 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.137+0000 7ff30fe00640 1 -- 172.21.15.82:0/3831488488 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d021c050 con 0x55f8d0329790 2024-04-26T20:27:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.137+0000 7ff30f400640 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d032ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.137+0000 7ff30fe00640 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d0329790 0x55f8d0329bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff308036040 tx=0x7ff308034b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0dc48e67928ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.139+0000 7ff307e00640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2f40a3e40 0x7ff2f40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.140+0000 7ff304c00640 1 -- 172.21.15.82:0/3831488488 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308042020 con 0x55f8d0329790 2024-04-26T20:27:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.140+0000 7ff304c00640 1 -- 172.21.15.82:0/3831488488 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff308034e50 con 0x55f8d0329790 2024-04-26T20:27:21.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.140+0000 7ff304c00640 1 -- 172.21.15.82:0/3831488488 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3080047d0 con 0x55f8d0329790 2024-04-26T20:27:21.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.141+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d0329790 msgr2=0x55f8d0329bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.141+0000 7ff319219740 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d0329790 0x55f8d0329bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff308036040 tx=0x7ff308034b60 comp rx=0 tx=0).stop 2024-04-26T20:27:21.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.141+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 shutdown_connections 2024-04-26T20:27:21.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.141+0000 7ff319219740 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d032f2f0 0x55f8d0331780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.142+0000 7ff319219740 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d032ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.142+0000 7ff319219740 1 --2- 172.21.15.82:0/3831488488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d0329790 0x55f8d0329bb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.142+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 >> 172.21.15.82:0/3831488488 conn(0x55f8d0324db0 msgr2=0x55f8d03251b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.149+0000 7ff30f400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2f40a3e40 0x7ff2f40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.151+0000 7ff307e00640 1 -- 172.21.15.82:0/495095505 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff2fc0d07c0 con 0x7ff31010c2a0 2024-04-26T20:27:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.152+0000 7ff30f400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2f40a3e40 0x7ff2f40a6300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55f8d032a580 tx=0x7ff30000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.152+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 shutdown_connections 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.152+0000 7ff319219740 1 -- 172.21.15.82:0/3831488488 wait complete. 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.153+0000 7ff319219740 1 -- start start 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.153+0000 7ff319219740 1 Processor -- start 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.156+0000 7ff319219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0333490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.156+0000 7ff319219740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d03339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.157+0000 7ff319219740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d033aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.157+0000 7ff30fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d033aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.157+0000 7ff30fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d033aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46424/0 (socket says 172.21.15.82:46424) 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.157+0000 7ff319219740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f8d0292200 con 0x55f8d032f2f0 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.157+0000 7ff319219740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f8d028cee0 con 0x55f8d0329790 2024-04-26T20:27:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.157+0000 7ff319219740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f8d0299e70 con 0x55f8d032a180 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.158+0000 7ff30fe00640 1 -- 172.21.15.82:0/867612351 learned_addr learned my addr 172.21.15.82:0/867612351 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.158+0000 7ff30fe00640 1 -- 172.21.15.82:0/867612351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 msgr2=0x55f8d03339d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.158+0000 7ff30fe00640 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d03339d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.158+0000 7ff30fe00640 1 -- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 msgr2=0x55f8d0333490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.158+0000 7ff30fe00640 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0333490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.158+0000 7ff30fe00640 1 -- 172.21.15.82:0/867612351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d00697d0 con 0x55f8d032f2f0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.159+0000 7ff30fe00640 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d033aa10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff30802b150 tx=0x7ff308003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f486f391bdd020d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.159+0000 7ff2f9600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.159+0000 7ff2f9600640 1 -- 172.21.15.82:0/867612351 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308050070 con 0x55f8d032f2f0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.159+0000 7ff2f9600640 1 -- 172.21.15.82:0/867612351 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff308004010 con 0x55f8d032f2f0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.159+0000 7ff319219740 10 client.0 _ll_register_callbacks cb 0x55f8d0283270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.159+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff308034e50 con 0x55f8d032f2f0 2024-04-26T20:27:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.160+0000 7ff2f9600640 1 -- 172.21.15.82:0/867612351 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff308042030 con 0x55f8d032f2f0 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.160+0000 7ff319219740 10 client.16578 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.160+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55f8cff9f3f0 con 0x55f8d032f2f0 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.160+0000 7ff2f9600640 1 -- 172.21.15.82:0/867612351 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7ff30805d020 con 0x55f8d032f2f0 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.161+0000 7ff319219740 10 client.16578 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.161+0000 7ff319219740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.161+0000 7ff319219740 20 client.16578 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.161+0000 7ff319219740 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d0362ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.161+0000 7ff319219740 4 client.16578 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.161+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8d029b7e0 con 0x55f8d03608f0 2024-04-26T20:27:21.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.168+0000 7ff30f400640 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d0362ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:20 smithi082 ceph-mon[28105]: pgmap v548: 129 pgs: 129 active+clean; 508 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-04-26T20:27:21.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.185+0000 7ff30f400640 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d0362ce0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5404886a9b48113 server_cookie=ca6ff2554d60ebb5 in_seq=0 out_seq=0 2024-04-26T20:27:21.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.190+0000 7ff2f9600640 10 client.16578 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff2f9600640 1 -- 172.21.15.82:0/867612351 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f8d029b7e0 con 0x55f8d03608f0 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff2f9600640 10 client.16578 handle_command_reply: tid=0 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 client.16578 shutdown 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 msgr2=0x55f8d033aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d033aa10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff30802b150 tx=0x7ff308003bf0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 shutdown_connections 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d0362ce0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff2f9600640 0 client.16578 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d033aa10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d03339d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 --2- 172.21.15.82:0/867612351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0333490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.194+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 >> 172.21.15.82:0/867612351 conn(0x55f8d0324db0 msgr2=0x55f8d0324040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.195+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 shutdown_connections 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.195+0000 7ff319219740 1 -- 172.21.15.82:0/867612351 wait complete. 2024-04-26T20:27:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.200+0000 7ff319219740 20 client.16578 trim_cache size 0 max 16384 2024-04-26T20:27:21.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:20 smithi139 ceph-mon[32999]: pgmap v548: 129 pgs: 129 active+clean; 508 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-04-26T20:27:21.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:20 smithi135 ceph-mon[32816]: pgmap v548: 129 pgs: 129 active+clean; 508 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-04-26T20:27:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.423+0000 7ff319219740 1 Processor -- start 2024-04-26T20:27:21.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.458+0000 7ff319219740 1 -- start start 2024-04-26T20:27:21.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.458+0000 7ff319219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d03283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.460+0000 7ff319219740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d033a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.460+0000 7ff319219740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032f2f0 0x55f8d0332760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.460+0000 7ff319219740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0011630 con 0x55f8d032a180 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.460+0000 7ff319219740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0010100 con 0x55f8d0329790 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.460+0000 7ff319219740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00107d0 con 0x55f8d032f2f0 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.461+0000 7ff30f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d03283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.461+0000 7ff30f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d03283f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50778/0 (socket says 172.21.15.82:50778) 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.461+0000 7ff30f400640 1 -- 172.21.15.82:0/3711942685 learned_addr learned my addr 172.21.15.82:0/3711942685 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.461+0000 7ff30fe00640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032f2f0 0x55f8d0332760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.461+0000 7ff30ea00640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d033a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.462+0000 7ff30f400640 1 -- 172.21.15.82:0/3711942685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032f2f0 msgr2=0x55f8d0332760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.462+0000 7ff30f400640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032f2f0 0x55f8d0332760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.462+0000 7ff30f400640 1 -- 172.21.15.82:0/3711942685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 msgr2=0x55f8d033a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.462+0000 7ff30f400640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d033a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.462+0000 7ff30f400640 1 -- 172.21.15.82:0/3711942685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d0363050 con 0x55f8d0329790 2024-04-26T20:27:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.462+0000 7ff30fe00640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032f2f0 0x55f8d0332760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:21.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.468+0000 7ff30ea00640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d033a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:21.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.486+0000 7ff30f400640 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d03283f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff30000fd50 tx=0x7ff300012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=956c8684ba375643 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.505+0000 7ff2fbe00640 1 -- 172.21.15.82:0/3711942685 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300016070 con 0x55f8d0329790 2024-04-26T20:27:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.506+0000 7ff2fbe00640 1 -- 172.21.15.82:0/3711942685 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3000257e0 con 0x55f8d0329790 2024-04-26T20:27:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.506+0000 7ff2fbe00640 1 -- 172.21.15.82:0/3711942685 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000055e0 con 0x55f8d0329790 2024-04-26T20:27:21.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.516+0000 7ff319219740 1 -- 172.21.15.82:0/3711942685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 msgr2=0x55f8d03283f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.516+0000 7ff319219740 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d03283f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff30000fd50 tx=0x7ff300012000 comp rx=0 tx=0).stop 2024-04-26T20:27:21.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.516+0000 7ff319219740 1 -- 172.21.15.82:0/3711942685 shutdown_connections 2024-04-26T20:27:21.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.517+0000 7ff319219740 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032f2f0 0x55f8d0332760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.517+0000 7ff319219740 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032a180 0x55f8d033a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.517+0000 7ff319219740 1 --2- 172.21.15.82:0/3711942685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d03283f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.517+0000 7ff319219740 1 -- 172.21.15.82:0/3711942685 >> 172.21.15.82:0/3711942685 conn(0x55f8d0324db0 msgr2=0x55f8d0324040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.517+0000 7ff319219740 1 -- 172.21.15.82:0/3711942685 shutdown_connections 2024-04-26T20:27:21.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.518+0000 7ff319219740 1 -- 172.21.15.82:0/3711942685 wait complete. 2024-04-26T20:27:21.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.518+0000 7ff319219740 1 -- start start 2024-04-26T20:27:21.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.531+0000 7ff319219740 1 Processor -- start 2024-04-26T20:27:21.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.532+0000 7ff319219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0337f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.537+0000 7ff319219740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d0338480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.538+0000 7ff30f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0337f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.538+0000 7ff30f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0337f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:50794/0 (socket says 172.21.15.82:50794) 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.539+0000 7ff30ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d0338480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.539+0000 7ff30ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d0338480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:36034/0 (socket says 172.21.15.82:36034) 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.539+0000 7ff30f400640 1 -- 172.21.15.82:0/560533066 learned_addr learned my addr 172.21.15.82:0/560533066 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.539+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d0339420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.543+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f000da10 con 0x55f8d032f2f0 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.543+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0010f60 con 0x55f8d0329790 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.543+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f000e080 con 0x55f8d032a180 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.543+0000 7ff319219740 10 client.0 _ll_register_callbacks cb 0x7ff300005ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.543+0000 7ff30fe00640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d0339420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.544+0000 7ff30fe00640 1 -- 172.21.15.82:0/560533066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 msgr2=0x55f8d0338480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.544+0000 7ff30fe00640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d0338480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.544+0000 7ff30fe00640 1 -- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 msgr2=0x55f8d0337f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.544+0000 7ff30fe00640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0337f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.544+0000 7ff30fe00640 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cff5f0f0 con 0x55f8d032f2f0 2024-04-26T20:27:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.545+0000 7ff30fe00640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d0339420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff308009a60 tx=0x7ff30802ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b672dda184b22f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.546+0000 7ff30f400640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0337f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.546+0000 7ff30ea00640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d0338480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.550+0000 7ff2f9600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.550+0000 7ff2f9600640 1 -- 172.21.15.82:0/560533066 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308064060 con 0x55f8d032f2f0 2024-04-26T20:27:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.550+0000 7ff2f9600640 1 -- 172.21.15.82:0/560533066 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7ff30802ca80 con 0x55f8d032f2f0 2024-04-26T20:27:21.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.560+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3000257e0 con 0x55f8d032f2f0 2024-04-26T20:27:21.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.564+0000 7ff2f9600640 1 -- 172.21.15.82:0/560533066 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff308050040 con 0x55f8d032f2f0 2024-04-26T20:27:21.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.564+0000 7ff319219740 10 client.16584 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:21.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.564+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f8d0255a30 con 0x55f8d032f2f0 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.579+0000 7ff2f9600640 1 -- 172.21.15.82:0/560533066 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3000257e0 con 0x55f8d032f2f0 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.579+0000 7ff2f9600640 1 -- 172.21.15.82:0/560533066 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7ff308067050 con 0x55f8d032f2f0 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.579+0000 7ff319219740 10 client.16584 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.579+0000 7ff319219740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.579+0000 7ff319219740 20 client.16584 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.580+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d03c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.580+0000 7ff319219740 4 client.16584 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:27:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.580+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8d0295650 con 0x55f8d03608f0 2024-04-26T20:27:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.580+0000 7ff30f400640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d03c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.581+0000 7ff2f9600640 10 client.16584 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.582+0000 7ff30f400640 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d03c91d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fdd0f8854dabfe3 server_cookie=270559778454ae5e in_seq=0 out_seq=0 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.582+0000 7ff2f9600640 1 -- 172.21.15.82:0/560533066 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f8d0295650 con 0x55f8d03608f0 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.582+0000 7ff2f9600640 10 client.16584 handle_command_reply: tid=0 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.583+0000 7ff319219740 1 client.16584 shutdown 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.583+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 msgr2=0x55f8d0339420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.583+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d0339420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff308009a60 tx=0x7ff30802ab60 comp rx=0 tx=0).stop 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.584+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 shutdown_connections 2024-04-26T20:27:21.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.584+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f8d03608f0 0x55f8d03c91d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.584+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8d032f2f0 0x55f8d0339420 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.584+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f8d032a180 0x55f8d0338480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.584+0000 7ff319219740 1 --2- 172.21.15.82:0/560533066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f8d0329790 0x55f8d0337f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.584+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 >> 172.21.15.82:0/560533066 conn(0x55f8d0324db0 msgr2=0x55f8d0324040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.587+0000 7ff2f9600640 0 client.16584 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:21.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.587+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 shutdown_connections 2024-04-26T20:27:21.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.587+0000 7ff319219740 1 -- 172.21.15.82:0/560533066 wait complete. 2024-04-26T20:27:21.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.588+0000 7ff319219740 20 client.16584 trim_cache size 0 max 16384 2024-04-26T20:27:21.594 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:27:21.594 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:27:21.595 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:27:21.595 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:27:21.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2f40a3e40 msgr2=0x7ff2f40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2f40a3e40 0x7ff2f40a6300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55f8d032a580 tx=0x7ff30000a2d0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 msgr2=0x7ff310119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 0x7ff310119630 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00cce0 tx=0x7ff2fc007590 comp rx=0 tx=0).stop 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 shutdown_connections 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2f40a3e40 0x7ff2f40a6300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff31010ec70 0x7ff31011a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff31010c2a0 0x7ff310119630 secure :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00cce0 tx=0x7ff2fc007590 comp rx=0 tx=0).stop 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 --2- 172.21.15.82:0/495095505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff310109930 0x7ff3101190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:21.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.601+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 >> 172.21.15.82:0/495095505 conn(0x7ff31006f7c0 msgr2=0x7ff31010c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.603+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 shutdown_connections 2024-04-26T20:27:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:21.605+0000 7ff316400640 1 -- 172.21.15.82:0/495095505 wait complete. 2024-04-26T20:27:21.896 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:27:21.897 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:27:22.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:22 smithi082 ceph-mon[28105]: pgmap v549: 129 pgs: 129 active+clean; 533 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 255 op/s 2024-04-26T20:27:23.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:22 smithi139 ceph-mon[32999]: pgmap v549: 129 pgs: 129 active+clean; 533 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 255 op/s 2024-04-26T20:27:23.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:22 smithi135 ceph-mon[32816]: pgmap v549: 129 pgs: 129 active+clean; 533 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 255 op/s 2024-04-26T20:27:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.570+0000 7fb0c9000640 1 -- 172.21.15.82:0/1434017401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c410a900 msgr2=0x7fb0c410f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.570+0000 7fb0c9000640 1 --2- 172.21.15.82:0/1434017401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c410a900 0x7fb0c410f270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009be0 tx=0x7fb0bc02a710 comp rx=0 tx=0).stop 2024-04-26T20:27:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.573+0000 7fb0c9000640 1 -- 172.21.15.82:0/1434017401 shutdown_connections 2024-04-26T20:27:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.573+0000 7fb0c9000640 1 --2- 172.21.15.82:0/1434017401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c410a900 0x7fb0c410f270 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.573+0000 7fb0c9000640 1 --2- 172.21.15.82:0/1434017401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c4109f40 0x7fb0c410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.573+0000 7fb0c9000640 1 --2- 172.21.15.82:0/1434017401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 0x7fb0c4074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.573+0000 7fb0c9000640 1 -- 172.21.15.82:0/1434017401 >> 172.21.15.82:0/1434017401 conn(0x7fb0c406f7d0 msgr2=0x7fb0c4071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:23.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.580+0000 7fb0c9000640 1 -- 172.21.15.82:0/1434017401 shutdown_connections 2024-04-26T20:27:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.580+0000 7fb0c9000640 1 -- 172.21.15.82:0/1434017401 wait complete. 2024-04-26T20:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.585+0000 7fb0c9000640 1 Processor -- start 2024-04-26T20:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.589+0000 7fb0c9000640 1 -- start start 2024-04-26T20:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.589+0000 7fb0c9000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 0x7fb0c4119310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.589+0000 7fb0c9000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c4109f40 0x7fb0c4115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.594+0000 7fb0c3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 0x7fb0c4119310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.594+0000 7fb0c3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 0x7fb0c4119310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:36052/0 (socket says 172.21.15.82:36052) 2024-04-26T20:27:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.594+0000 7fb0c3400640 1 -- 172.21.15.82:0/3875517620 learned_addr learned my addr 172.21.15.82:0/3875517620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.595+0000 7fb0c2a00640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c4109f40 0x7fb0c4115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.595+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410a900 0x7fb0c41163c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.596+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c411d110 con 0x7fb0c410a900 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.596+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c411cf90 con 0x7fb0c4109f40 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.596+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c411d290 con 0x7fb0c4073c60 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.597+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410a900 0x7fb0c41163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.598+0000 7fb0c3e00640 1 -- 172.21.15.82:0/3875517620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 msgr2=0x7fb0c4119310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.598+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 0x7fb0c4119310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.598+0000 7fb0c3e00640 1 -- 172.21.15.82:0/3875517620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c4109f40 msgr2=0x7fb0c4115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.598+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c4109f40 0x7fb0c4115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.598+0000 7fb0c3e00640 1 -- 172.21.15.82:0/3875517620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c41b7910 con 0x7fb0c410a900 2024-04-26T20:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.599+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410a900 0x7fb0c41163c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc02ad00 tx=0x7fb0bc02f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.600+0000 7fb0bbe00640 1 -- 172.21.15.82:0/3875517620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc041020 con 0x7fb0c410a900 2024-04-26T20:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.600+0000 7fb0bbe00640 1 -- 172.21.15.82:0/3875517620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0bc02fcd0 con 0x7fb0c410a900 2024-04-26T20:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.600+0000 7fb0bbe00640 1 -- 172.21.15.82:0/3875517620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc036040 con 0x7fb0c410a900 2024-04-26T20:27:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.608+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c41b7ba0 con 0x7fb0c410a900 2024-04-26T20:27:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.608+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c41b8040 con 0x7fb0c410a900 2024-04-26T20:27:23.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.637+0000 7fb0cd3f3740 1 Processor -- start 2024-04-26T20:27:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.651+0000 7fb0cd3f3740 1 -- start start 2024-04-26T20:27:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.651+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da22200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.652+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da272d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.652+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da27940 0x55fc8da29dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.652+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fc8d986380 con 0x55fc8da21de0 2024-04-26T20:27:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.652+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc8d922c30 con 0x55fc8da27940 2024-04-26T20:27:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.652+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fc8d982340 con 0x55fc8da227d0 2024-04-26T20:27:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.654+0000 7fb0c2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da22200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.654+0000 7fb0c2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da22200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46480/0 (socket says 172.21.15.82:46480) 2024-04-26T20:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.654+0000 7fb0c2a00640 1 -- 172.21.15.82:0/3113492005 learned_addr learned my addr 172.21.15.82:0/3113492005 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.655+0000 7fb0c2a00640 1 -- 172.21.15.82:0/3113492005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 msgr2=0x55fc8da272d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.655+0000 7fb0c2a00640 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da272d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.655+0000 7fb0c2a00640 1 -- 172.21.15.82:0/3113492005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da27940 msgr2=0x55fc8da29dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.655+0000 7fb0c2a00640 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da27940 0x55fc8da29dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.655+0000 7fb0c2a00640 1 -- 172.21.15.82:0/3113492005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc8d944940 con 0x55fc8da21de0 2024-04-26T20:27:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.656+0000 7fb0c2a00640 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da22200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000ae20 tx=0x7fb0b000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c16988aceb0c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.660+0000 7fb0bbe00640 1 -- 172.21.15.82:0/3875517620 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb0bc044020 con 0x7fb0c410a900 2024-04-26T20:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.663+0000 7fb0bbe00640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb0a80a3e40 0x7fb0a80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.663+0000 7fb0bbe00640 1 -- 172.21.15.82:0/3875517620 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb0bc0f1300 con 0x7fb0c410a900 2024-04-26T20:27:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.664+0000 7fb0c3400640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb0a80a3e40 0x7fb0a80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.666+0000 7fb0c3400640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb0a80a3e40 0x7fb0a80a6300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005ed0 tx=0x7fb0b4005e60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.672+0000 7fb0b8c00640 1 -- 172.21.15.82:0/3113492005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0005220 con 0x55fc8da21de0 2024-04-26T20:27:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.672+0000 7fb0b8c00640 1 -- 172.21.15.82:0/3113492005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b00047a0 con 0x55fc8da21de0 2024-04-26T20:27:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.672+0000 7fb0b8c00640 1 -- 172.21.15.82:0/3113492005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00187b0 con 0x55fc8da21de0 2024-04-26T20:27:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.682+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/3113492005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 msgr2=0x55fc8da22200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:23.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.682+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da22200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000ae20 tx=0x7fb0b000f790 comp rx=0 tx=0).stop 2024-04-26T20:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.691+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/3113492005 shutdown_connections 2024-04-26T20:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.691+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da27940 0x55fc8da29dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.691+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da272d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.691+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/3113492005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da22200 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.691+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/3113492005 >> 172.21.15.82:0/3113492005 conn(0x55fc8da1d450 msgr2=0x55fc8da1d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.701+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/3113492005 shutdown_connections 2024-04-26T20:27:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.721+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/3113492005 wait complete. 2024-04-26T20:27:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.721+0000 7fb0cd3f3740 1 -- start start 2024-04-26T20:27:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.722+0000 7fb0cd3f3740 1 Processor -- start 2024-04-26T20:27:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.737+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.737+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.737+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da33600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.737+0000 7fb0c2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.737+0000 7fb0c2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:36074/0 (socket says 172.21.15.82:36074) 2024-04-26T20:27:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.738+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fc8da2a8f0 con 0x55fc8da27940 2024-04-26T20:27:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.738+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc8d90dc60 con 0x55fc8da21de0 2024-04-26T20:27:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.738+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fc8da2aa70 con 0x55fc8da227d0 2024-04-26T20:27:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.738+0000 7fb0cd3f3740 10 client.0 _ll_register_callbacks cb 0x55fc8d939e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da33600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da33600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46484/0 (socket says 172.21.15.82:46484) 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 -- 172.21.15.82:0/2840839627 learned_addr learned my addr 172.21.15.82:0/2840839627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3400640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 -- 172.21.15.82:0/2840839627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 msgr2=0x55fc8da2c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 -- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da21de0 msgr2=0x55fc8da2c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.739+0000 7fb0c3e00640 1 -- 172.21.15.82:0/2840839627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc8d91c510 con 0x55fc8da27940 2024-04-26T20:27:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.740+0000 7fb0c2a00640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T20:27:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.740+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da33600 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0c5800 tx=0x7fb0bc0bd850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c90d857c095ab85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.740+0000 7fb0ad600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.741+0000 7fb0ad600640 1 -- 172.21.15.82:0/2840839627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0c1500 con 0x55fc8da27940 2024-04-26T20:27:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.741+0000 7fb0ad600640 1 -- 172.21.15.82:0/2840839627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb0bc0d64f0 con 0x55fc8da27940 2024-04-26T20:27:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.760+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b00047a0 con 0x55fc8da27940 2024-04-26T20:27:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.780+0000 7fb0ad600640 1 -- 172.21.15.82:0/2840839627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb0bc0c5d30 con 0x55fc8da27940 2024-04-26T20:27:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.780+0000 7fb0cd3f3740 10 client.16593 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.780+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55fc8d698210 con 0x55fc8da27940 2024-04-26T20:27:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0ad600640 1 -- 172.21.15.82:0/2840839627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0b00047a0 con 0x55fc8da27940 2024-04-26T20:27:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0ad600640 1 -- 172.21.15.82:0/2840839627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fb0bc0c1120 con 0x55fc8da27940 2024-04-26T20:27:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0cd3f3740 10 client.16593 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0cd3f3740 10 client.16593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0cd3f3740 20 client.16593 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da37cc0 0x55fc8da3a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0cd3f3740 4 client.16593 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.787+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc8d993f90 con 0x55fc8da37cc0 2024-04-26T20:27:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.788+0000 7fb0c3400640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da37cc0 0x55fc8da3a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.813+0000 7fb0c3400640 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da37cc0 0x55fc8da3a160 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916153df540ffdc6 server_cookie=2e454e94d73fa8d5 in_seq=0 out_seq=0 2024-04-26T20:27:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.821+0000 7fb0ad600640 10 client.16593 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.821+0000 7fb0ad600640 1 -- 172.21.15.82:0/2840839627 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fc8d993f90 con 0x55fc8da37cc0 2024-04-26T20:27:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.821+0000 7fb0ad600640 10 client.16593 handle_command_reply: tid=0 2024-04-26T20:27:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.821+0000 7fb0cd3f3740 1 client.16593 shutdown 2024-04-26T20:27:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.823+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 msgr2=0x55fc8da33600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.823+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da33600 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0c5800 tx=0x7fb0bc0bd850 comp rx=0 tx=0).stop 2024-04-26T20:27:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 shutdown_connections 2024-04-26T20:27:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da37cc0 0x55fc8da3a160 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da33600 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/2840839627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 >> 172.21.15.82:0/2840839627 conn(0x55fc8da1d450 msgr2=0x55fc8da1c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.824+0000 7fb0ad600640 0 client.16593 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.841+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 shutdown_connections 2024-04-26T20:27:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.846+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/2840839627 wait complete. 2024-04-26T20:27:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:23.846+0000 7fb0cd3f3740 20 client.16593 trim_cache size 0 max 16384 2024-04-26T20:27:24.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.203+0000 7fb0cd3f3740 1 Processor -- start 2024-04-26T20:27:24.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.205+0000 7fb0cd3f3740 1 -- start start 2024-04-26T20:27:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.210+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.210+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.210+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.210+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400fa00 con 0x55fc8da27940 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.210+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4011600 con 0x55fc8da227d0 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.210+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a40100d0 con 0x55fc8da21de0 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.211+0000 7fb0c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.211+0000 7fb0c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46498/0 (socket says 172.21.15.82:46498) 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.211+0000 7fb0c3e00640 1 -- 172.21.15.82:0/879406459 learned_addr learned my addr 172.21.15.82:0/879406459 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.212+0000 7fb0c3e00640 1 -- 172.21.15.82:0/879406459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da21de0 msgr2=0x55fc8da2c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.212+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.212+0000 7fb0c3e00640 1 -- 172.21.15.82:0/879406459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 msgr2=0x55fc8da2c5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.212+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.212+0000 7fb0c3e00640 1 -- 172.21.15.82:0/879406459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc8d764620 con 0x55fc8da27940 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.212+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da335c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc031040 tx=0x7fb0bc0bb660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fbb77effae905 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.253+0000 7fb0afe00640 1 -- 172.21.15.82:0/879406459 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0c1500 con 0x55fc8da27940 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.253+0000 7fb0afe00640 1 -- 172.21.15.82:0/879406459 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0bc0097e0 con 0x55fc8da27940 2024-04-26T20:27:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.253+0000 7fb0afe00640 1 -- 172.21.15.82:0/879406459 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0eeb40 con 0x55fc8da27940 2024-04-26T20:27:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.301+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/879406459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 msgr2=0x55fc8da335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.301+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da335c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc031040 tx=0x7fb0bc0bb660 comp rx=0 tx=0).stop 2024-04-26T20:27:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.336+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/879406459 shutdown_connections 2024-04-26T20:27:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.336+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da27940 0x55fc8da335c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.336+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da2c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.336+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/879406459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da21de0 0x55fc8da2c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.336+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/879406459 >> 172.21.15.82:0/879406459 conn(0x55fc8da1d450 msgr2=0x55fc8da27020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.389+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/879406459 shutdown_connections 2024-04-26T20:27:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.396+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/879406459 wait complete. 2024-04-26T20:27:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.396+0000 7fb0cd3f3740 1 -- start start 2024-04-26T20:27:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.396+0000 7fb0cd3f3740 1 Processor -- start 2024-04-26T20:27:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da30270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 0x55fc8da9c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4010f30 con 0x55fc8da21de0 2024-04-26T20:27:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a40107a0 con 0x55fc8da227d0 2024-04-26T20:27:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a400d9e0 con 0x55fc8da27940 2024-04-26T20:27:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.401+0000 7fb0cd3f3740 10 client.0 _ll_register_callbacks cb 0x7fb0bc030e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.402+0000 7fb0c3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 0x55fc8da9c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.402+0000 7fb0c2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.402+0000 7fb0c3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 0x55fc8da9c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:36098/0 (socket says 172.21.15.82:36098) 2024-04-26T20:27:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.402+0000 7fb0c3e00640 1 -- 172.21.15.82:0/32344693 learned_addr learned my addr 172.21.15.82:0/32344693 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.403+0000 7fb0c3e00640 1 -- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 msgr2=0x55fc8da307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.403+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da307b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.403+0000 7fb0c3e00640 1 -- 172.21.15.82:0/32344693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 msgr2=0x55fc8da30270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.403+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da30270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.403+0000 7fb0c3e00640 1 -- 172.21.15.82:0/32344693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc8d940cb0 con 0x55fc8da27940 2024-04-26T20:27:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.403+0000 7fb0c3e00640 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 0x55fc8da9c2d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc03c040 tx=0x7fb0bc0bcab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e44851ed029fc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:24.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.406+0000 7fb0ad600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:27:24.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.406+0000 7fb0ad600640 1 -- 172.21.15.82:0/32344693 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0c1500 con 0x55fc8da27940 2024-04-26T20:27:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.406+0000 7fb0ad600640 1 -- 172.21.15.82:0/32344693 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb0bc0bd520 con 0x55fc8da27940 2024-04-26T20:27:24.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.408+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0bc0097e0 con 0x55fc8da27940 2024-04-26T20:27:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.460+0000 7fb0ad600640 1 -- 172.21.15.82:0/32344693 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb0bc0c1120 con 0x55fc8da27940 2024-04-26T20:27:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.462+0000 7fb0cd3f3740 10 client.26728 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.462+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55fc8d940cb0 con 0x55fc8da27940 2024-04-26T20:27:24.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.463+0000 7fb0ad600640 1 -- 172.21.15.82:0/32344693 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0bc0097e0 con 0x55fc8da27940 2024-04-26T20:27:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.485+0000 7fb0ad600640 1 -- 172.21.15.82:0/32344693 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fb0bc004bd0 con 0x55fc8da27940 2024-04-26T20:27:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.487+0000 7fb0cd3f3740 10 client.26728 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.487+0000 7fb0cd3f3740 10 client.26728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.487+0000 7fb0cd3f3740 20 client.26728 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.487+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da9da20 0x55fc8da9fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.487+0000 7fb0cd3f3740 4 client.26728 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.487+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc8d98de00 con 0x55fc8da9da20 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.488+0000 7fb0c3400640 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da9da20 0x55fc8da9fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.488+0000 7fb0c3400640 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da9da20 0x55fc8da9fe10 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24fb3bcc40395633 server_cookie=99bcc5a409b676a5 in_seq=0 out_seq=0 2024-04-26T20:27:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:24.488+0000 7fb0ad600640 10 client.26728 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.513+0000 7f087a600640 1 -- 172.21.15.82:0/3526871888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087410ec70 msgr2=0x7f087410f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.513+0000 7f087a600640 1 --2- 172.21.15.82:0/3526871888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087410ec70 0x7f087410f120 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f086c009be0 tx=0x7f086c02a6d0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.515+0000 7f087a600640 1 -- 172.21.15.82:0/3526871888 shutdown_connections 2024-04-26T20:27:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.515+0000 7f087a600640 1 --2- 172.21.15.82:0/3526871888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f087410ec70 0x7f087410f120 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.516+0000 7f087a600640 1 --2- 172.21.15.82:0/3526871888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410c2a0 0x7f087410e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.516+0000 7f087a600640 1 --2- 172.21.15.82:0/3526871888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0874109930 0x7f087410bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.516+0000 7f087a600640 1 -- 172.21.15.82:0/3526871888 >> 172.21.15.82:0/3526871888 conn(0x7f087406f7c0 msgr2=0x7f0874071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:24.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.562+0000 7f087a600640 1 -- 172.21.15.82:0/3526871888 shutdown_connections 2024-04-26T20:27:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.566+0000 7f087a600640 1 -- 172.21.15.82:0/3526871888 wait complete. 2024-04-26T20:27:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.567+0000 7f087a600640 1 Processor -- start 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.599+0000 7f087a600640 1 -- start start 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.600+0000 7f087a600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0874109930 0x7f087419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.600+0000 7f087a600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f087410c2a0 0x7f087419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.600+0000 7f087a600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410ec70 0x7f08741a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.600+0000 7f087a600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0874112a90 con 0x7f0874109930 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.600+0000 7f087a600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0874112910 con 0x7f087410c2a0 2024-04-26T20:27:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.600+0000 7f087a600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0874112c10 con 0x7f087410ec70 2024-04-26T20:27:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.603+0000 7f0872a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f087410c2a0 0x7f087419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.603+0000 7f0873e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410ec70 0x7f08741a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.603+0000 7f0873e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410ec70 0x7f08741a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:36122/0 (socket says 172.21.15.82:36122) 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.603+0000 7f0873e00640 1 -- 172.21.15.82:0/2064132512 learned_addr learned my addr 172.21.15.82:0/2064132512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.612+0000 7f0872a00640 1 -- 172.21.15.82:0/2064132512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410ec70 msgr2=0x7f08741a6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.612+0000 7f0872a00640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410ec70 0x7f08741a6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.612+0000 7f0872a00640 1 -- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0874109930 msgr2=0x7f087419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.612+0000 7f0872a00640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0874109930 0x7f087419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.612+0000 7f0872a00640 1 -- 172.21.15.82:0/2064132512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08741a6b70 con 0x7f087410c2a0 2024-04-26T20:27:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.628+0000 7f0872a00640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f087410c2a0 0x7f087419f490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f086001f9b0 tx=0x7f086001fe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.649+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086001db90 con 0x7f087410c2a0 2024-04-26T20:27:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.649+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f086001dd30 con 0x7f087410c2a0 2024-04-26T20:27:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.649+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860029710 con 0x7f087410c2a0 2024-04-26T20:27:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.663+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08741a6e60 con 0x7f087410c2a0 2024-04-26T20:27:24.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.664+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08741a72d0 con 0x7f087410c2a0 2024-04-26T20:27:24.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.678+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08741a75c0 con 0x7f087410c2a0 2024-04-26T20:27:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.753+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0860030020 con 0x7f087410c2a0 2024-04-26T20:27:24.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.772+0000 7f086be00640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f08580a3e40 0x7f08580a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:24.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.779+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f08600e1750 con 0x7f087410c2a0 2024-04-26T20:27:24.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.782+0000 7f0873400640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f08580a3e40 0x7f08580a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:24.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.784+0000 7f0873400640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f08580a3e40 0x7f08580a6300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0874073a20 tx=0x7f0864005c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:24.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:24.842+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f08600e3d00 con 0x7f087410c2a0 2024-04-26T20:27:25.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:24 smithi082 ceph-mon[28105]: pgmap v550: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 314 op/s 2024-04-26T20:27:25.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:24 smithi139 ceph-mon[32999]: pgmap v550: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 314 op/s 2024-04-26T20:27:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:24 smithi135 ceph-mon[32816]: pgmap v550: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 314 op/s 2024-04-26T20:27:27.082 INFO:tasks.workunit.client.0.smithi082.stdout: 166 531993 1030 362207 875 144161 550 2024-04-26T20:27:27.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:26 smithi082 ceph-mon[28105]: pgmap v551: 129 pgs: 129 active+clean; 569 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 535 op/s 2024-04-26T20:27:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:26 smithi139 ceph-mon[32999]: pgmap v551: 129 pgs: 129 active+clean; 569 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 535 op/s 2024-04-26T20:27:27.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:26 smithi135 ceph-mon[32816]: pgmap v551: 129 pgs: 129 active+clean; 569 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 535 op/s 2024-04-26T20:27:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:28 smithi082 ceph-mon[28105]: pgmap v552: 129 pgs: 129 active+clean; 586 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.1 MiB/s wr, 824 op/s 2024-04-26T20:27:29.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:28 smithi139 ceph-mon[32999]: pgmap v552: 129 pgs: 129 active+clean; 586 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.1 MiB/s wr, 824 op/s 2024-04-26T20:27:29.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:28 smithi135 ceph-mon[32816]: pgmap v552: 129 pgs: 129 active+clean; 586 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.1 MiB/s wr, 824 op/s 2024-04-26T20:27:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.881+0000 7fb0ad600640 1 -- 172.21.15.82:0/32344693 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc8d98de00 con 0x55fc8da9da20 2024-04-26T20:27:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.881+0000 7fb0ad600640 10 client.26728 handle_command_reply: tid=0 2024-04-26T20:27:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.890+0000 7fb0cd3f3740 1 client.26728 shutdown 2024-04-26T20:27:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.951+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 msgr2=0x55fc8da9c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.951+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 0x55fc8da9c2d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc03c040 tx=0x7fb0bc0bcab0 comp rx=0 tx=0).stop 2024-04-26T20:27:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 shutdown_connections 2024-04-26T20:27:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fc8da9da20 0x55fc8da9fe10 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc8da27940 0x55fc8da9c2d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:29.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc8da227d0 0x55fc8da307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0cd3f3740 1 --2- 172.21.15.82:0/32344693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fc8da21de0 0x55fc8da30270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 >> 172.21.15.82:0/32344693 conn(0x55fc8da1d450 msgr2=0x55fc8da2bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:29.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:29.984+0000 7fb0ad600640 0 client.26728 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.033+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 shutdown_connections 2024-04-26T20:27:30.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.043+0000 7fb0cd3f3740 1 -- 172.21.15.82:0/32344693 wait complete. 2024-04-26T20:27:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.043+0000 7fb0cd3f3740 20 client.26728 trim_cache size 0 max 16384 2024-04-26T20:27:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:27:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:27:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:27:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:27:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.170+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb0a80a3e40 msgr2=0x7fb0a80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.170+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb0a80a3e40 0x7fb0a80a6300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005ed0 tx=0x7fb0b4005e60 comp rx=0 tx=0).stop 2024-04-26T20:27:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.170+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410a900 msgr2=0x7fb0c41163c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.170+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410a900 0x7fb0c41163c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc02ad00 tx=0x7fb0bc02f530 comp rx=0 tx=0).stop 2024-04-26T20:27:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.176+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 shutdown_connections 2024-04-26T20:27:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.176+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb0a80a3e40 0x7fb0a80a6300 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.176+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410a900 0x7fb0c41163c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.176+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0c4109f40 0x7fb0c4115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.176+0000 7fb0c9000640 1 --2- 172.21.15.82:0/3875517620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0c4073c60 0x7fb0c4119310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.176+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 >> 172.21.15.82:0/3875517620 conn(0x7fb0c406f7d0 msgr2=0x7fb0c410b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.196+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 shutdown_connections 2024-04-26T20:27:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:30.197+0000 7fb0c9000640 1 -- 172.21.15.82:0/3875517620 wait complete. 2024-04-26T20:27:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:30 smithi082 ceph-mon[28105]: pgmap v553: 129 pgs: 129 active+clean; 599 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.8 MiB/s wr, 984 op/s 2024-04-26T20:27:31.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:30 smithi139 ceph-mon[32999]: pgmap v553: 129 pgs: 129 active+clean; 599 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.8 MiB/s wr, 984 op/s 2024-04-26T20:27:31.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:30 smithi135 ceph-mon[32816]: pgmap v553: 129 pgs: 129 active+clean; 599 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.8 MiB/s wr, 984 op/s 2024-04-26T20:27:33.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:32 smithi082 ceph-mon[28105]: pgmap v554: 129 pgs: 129 active+clean; 609 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-04-26T20:27:33.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:32 smithi139 ceph-mon[32999]: pgmap v554: 129 pgs: 129 active+clean; 609 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-04-26T20:27:33.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:32 smithi135 ceph-mon[32816]: pgmap v554: 129 pgs: 129 active+clean; 609 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-04-26T20:27:34.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.553+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f084c005120 con 0x7f087410c2a0 2024-04-26T20:27:34.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.554+0000 7f086be00640 1 -- 172.21.15.82:0/2064132512 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11958 (secure 0 0 0) 0x7f08600adc10 con 0x7f087410c2a0 2024-04-26T20:27:34.562 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:27:34.562 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:27:11.210891+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/1503486498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":1503486498},{"type":"v1","addr":"172.21.15.135:6837","nonce":1503486498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:27:34.563 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 36 2024-04-26T20:27:34.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f08580a3e40 msgr2=0x7f08580a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:34.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f08580a3e40 0x7f08580a6300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0874073a20 tx=0x7f0864005c10 comp rx=0 tx=0).stop 2024-04-26T20:27:34.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f087410c2a0 msgr2=0x7f087419f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:34.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f087410c2a0 0x7f087419f490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f086001f9b0 tx=0x7f086001fe70 comp rx=0 tx=0).stop 2024-04-26T20:27:34.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 shutdown_connections 2024-04-26T20:27:34.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f08580a3e40 0x7f08580a6300 secure :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0874073a20 tx=0x7f0864005c10 comp rx=0 tx=0).stop 2024-04-26T20:27:34.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f087410ec70 0x7f08741a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:34.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f087410c2a0 0x7f087419f490 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f086001f9b0 tx=0x7f086001fe70 comp rx=0 tx=0).stop 2024-04-26T20:27:34.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 --2- 172.21.15.82:0/2064132512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0874109930 0x7f087419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:34.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.590+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 >> 172.21.15.82:0/2064132512 conn(0x7f087406f7c0 msgr2=0x7f087410c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.616+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 shutdown_connections 2024-04-26T20:27:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:34.616+0000 7f087a600640 1 -- 172.21.15.82:0/2064132512 wait complete. 2024-04-26T20:27:34.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:34 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2064132512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:34.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:34 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2064132512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:35.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:34 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2064132512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:27:35.250 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:27:35.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:35 smithi082 ceph-mon[28105]: pgmap v555: 129 pgs: 129 active+clean; 612 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.6 MiB/s wr, 1.02k op/s 2024-04-26T20:27:36.070 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:35 smithi139 ceph-mon[32999]: pgmap v555: 129 pgs: 129 active+clean; 612 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.6 MiB/s wr, 1.02k op/s 2024-04-26T20:27:36.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:35 smithi135 ceph-mon[32816]: pgmap v555: 129 pgs: 129 active+clean; 612 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.6 MiB/s wr, 1.02k op/s 2024-04-26T20:27:37.082 INFO:tasks.workunit.client.0.smithi082.stdout: 181 554606 1023 372892 813 154888 770 2024-04-26T20:27:37.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:36 smithi082 ceph-mon[28105]: pgmap v556: 129 pgs: 129 active+clean; 611 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 972 op/s 2024-04-26T20:27:37.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:36 smithi139 ceph-mon[32999]: pgmap v556: 129 pgs: 129 active+clean; 611 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 972 op/s 2024-04-26T20:27:37.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:36 smithi135 ceph-mon[32816]: pgmap v556: 129 pgs: 129 active+clean; 611 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 972 op/s 2024-04-26T20:27:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.013+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3233855583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 msgr2=0x7f0ed4113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.013+0000 7f0ed9c00640 1 --2- 172.21.15.82:0/3233855583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4113060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009900 tx=0x7f0ec402a440 comp rx=0 tx=0).stop 2024-04-26T20:27:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3233855583 shutdown_connections 2024-04-26T20:27:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 --2- 172.21.15.82:0/3233855583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4113060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 --2- 172.21.15.82:0/3233855583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4073e70 0x7f0ed40742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 --2- 172.21.15.82:0/3233855583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ed410a530 0x7f0ed4073930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3233855583 >> 172.21.15.82:0/3233855583 conn(0x7f0ed406f780 msgr2=0x7f0ed4071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:38.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3233855583 shutdown_connections 2024-04-26T20:27:38.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.028+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3233855583 wait complete. 2024-04-26T20:27:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.039+0000 7f0ed9c00640 1 Processor -- start 2024-04-26T20:27:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.043+0000 7f0ed9c00640 1 -- start start 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.049+0000 7f0ed9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4073e70 0x7f0ed411a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.049+0000 7f0ed9c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ed410a530 0x7f0ed411a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.051+0000 7f0ed9c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.051+0000 7f0ed9c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410baf0 con 0x7f0ed410a530 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.051+0000 7f0ed9c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410b970 con 0x7f0ed4073e70 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.051+0000 7f0ed9c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410bc70 con 0x7f0ed4110c70 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.052+0000 7f0ed3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.052+0000 7f0ed3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58024/0 (socket says 172.21.15.82:58024) 2024-04-26T20:27:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.052+0000 7f0ed3400640 1 -- 172.21.15.82:0/2558275984 learned_addr learned my addr 172.21.15.82:0/2558275984 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.054+0000 7f0ed3400640 1 -- 172.21.15.82:0/2558275984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4073e70 msgr2=0x7f0ed411a090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.054+0000 7f0ed3400640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4073e70 0x7f0ed411a090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.054+0000 7f0ed3400640 1 -- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ed410a530 msgr2=0x7f0ed411a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.054+0000 7f0ed3400640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ed410a530 0x7f0ed411a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.054+0000 7f0ed3400640 1 -- 172.21.15.82:0/2558275984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed4121cb0 con 0x7f0ed4110c70 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.054+0000 7f0ed3400640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4121640 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4005ab0 tx=0x7f0ec4003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.055+0000 7f0ecb400640 1 -- 172.21.15.82:0/2558275984 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec403f070 con 0x7f0ed4110c70 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.055+0000 7f0ed9c00640 1 -- 172.21.15.82:0/2558275984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed4121f40 con 0x7f0ed4110c70 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.055+0000 7f0ecb400640 1 -- 172.21.15.82:0/2558275984 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec4031d60 con 0x7f0ed4110c70 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.055+0000 7f0ecb400640 1 -- 172.21.15.82:0/2558275984 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4035030 con 0x7f0ed4110c70 2024-04-26T20:27:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.056+0000 7f0ed9c00640 1 -- 172.21.15.82:0/2558275984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed4122480 con 0x7f0ed4110c70 2024-04-26T20:27:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.067+0000 7f0ecb400640 1 -- 172.21.15.82:0/2558275984 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0ec4042070 con 0x7f0ed4110c70 2024-04-26T20:27:38.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.070+0000 7f0ecb400640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0eb80a3d80 0x7f0eb80a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.070+0000 7f0ecb400640 1 -- 172.21.15.82:0/2558275984 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0ec40318b0 con 0x7f0ed4110c70 2024-04-26T20:27:38.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.070+0000 7f0edc999740 1 Processor -- start 2024-04-26T20:27:38.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.073+0000 7f0edc999740 1 -- start start 2024-04-26T20:27:38.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.073+0000 7f0edc999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c522b090 0x55d3c522b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.073+0000 7f0edc999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522ba80 0x55d3c5230580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.073+0000 7f0edc999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5233080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.075+0000 7f0ed3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5233080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.076+0000 7f0ed3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5233080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45470/0 (socket says 172.21.15.82:45470) 2024-04-26T20:27:38.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.077+0000 7f0ed3400640 1 -- 172.21.15.82:0/3905965820 learned_addr learned my addr 172.21.15.82:0/3905965820 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:38.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.078+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d3c518ec70 con 0x55d3c5230bf0 2024-04-26T20:27:38.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.078+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d3c5147980 con 0x55d3c522ba80 2024-04-26T20:27:38.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.079+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d3c518ac30 con 0x55d3c522b090 2024-04-26T20:27:38.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.080+0000 7f0ed3400640 1 -- 172.21.15.82:0/3905965820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c522b090 msgr2=0x55d3c522b4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:38.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.080+0000 7f0ed3400640 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c522b090 0x55d3c522b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.080+0000 7f0ed3400640 1 -- 172.21.15.82:0/3905965820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522ba80 msgr2=0x55d3c5230580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:38.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.080+0000 7f0ed3400640 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522ba80 0x55d3c5230580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.080+0000 7f0ed3400640 1 -- 172.21.15.82:0/3905965820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c511f7b0 con 0x55d3c5230bf0 2024-04-26T20:27:38.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.083+0000 7f0ed3400640 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5233080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40bdd10 tx=0x7f0ec4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abad193334020be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:38.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.084+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3905965820 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40d7070 con 0x55d3c5230bf0 2024-04-26T20:27:38.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.084+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3905965820 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec40c2130 con 0x55d3c5230bf0 2024-04-26T20:27:38.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.084+0000 7f0ed9c00640 1 -- 172.21.15.82:0/3905965820 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4049040 con 0x55d3c5230bf0 2024-04-26T20:27:38.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.085+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 msgr2=0x55d3c5233080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.085+0000 7f0edc999740 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5233080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40bdd10 tx=0x7f0ec4005fd0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.090+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 shutdown_connections 2024-04-26T20:27:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.090+0000 7f0edc999740 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5233080 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.090+0000 7f0edc999740 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522ba80 0x55d3c5230580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.090+0000 7f0edc999740 1 --2- 172.21.15.82:0/3905965820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c522b090 0x55d3c522b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.090+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 >> 172.21.15.82:0/3905965820 conn(0x55d3c52268a0 msgr2=0x55d3c5226ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.100+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0eb80a3d80 0x7f0eb80a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.101+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0eb80a3d80 0x7f0eb80a6240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55d3c52277f0 tx=0x7f0ecc009440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.116+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 shutdown_connections 2024-04-26T20:27:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.116+0000 7f0edc999740 1 -- 172.21.15.82:0/3905965820 wait complete. 2024-04-26T20:27:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.117+0000 7f0edc999740 1 -- start start 2024-04-26T20:27:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.117+0000 7f0edc999740 1 Processor -- start 2024-04-26T20:27:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.121+0000 7f0edc999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5230bf0 0x55d3c5234fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.121+0000 7f0edc999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 0x55d3c523a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.122+0000 7f0ed2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5230bf0 0x55d3c5234fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.122+0000 7f0ed2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5230bf0 0x55d3c5234fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40784/0 (socket says 172.21.15.82:40784) 2024-04-26T20:27:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.122+0000 7f0ed2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 0x55d3c523a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.122+0000 7f0ed2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 0x55d3c523a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45482/0 (socket says 172.21.15.82:45482) 2024-04-26T20:27:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.122+0000 7f0edc999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c523cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.123+0000 7f0ed2000640 1 -- 172.21.15.82:0/1796634854 learned_addr learned my addr 172.21.15.82:0/1796634854 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.123+0000 7f0ed3400640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c523cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.123+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d3c518df80 con 0x55d3c52354f0 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.123+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d3c513b260 con 0x55d3c5230bf0 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.123+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d3c51932a0 con 0x55d3c5235970 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.129+0000 7f0ed2000640 1 -- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 msgr2=0x55d3c523cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.129+0000 7f0ed2000640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c523cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.129+0000 7f0ed2000640 1 -- 172.21.15.82:0/1796634854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5230bf0 msgr2=0x55d3c5234fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.129+0000 7f0ed2000640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5230bf0 0x55d3c5234fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.129+0000 7f0ed2000640 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c511d1c0 con 0x55d3c52354f0 2024-04-26T20:27:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.130+0000 7f0ed2000640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 0x55d3c523a520 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55d3c522c4f0 tx=0x7f0ec000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf3cb25d56e4e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.130+0000 7f0ed3400640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c523cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.131+0000 7f0edc999740 10 client.0 _ll_register_callbacks cb 0x55d3c5185960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.131+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec40c2130 con 0x55d3c52354f0 2024-04-26T20:27:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.136+0000 7f0ebcc00640 10 client.16608 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.136+0000 7f0ebcc00640 1 -- 172.21.15.82:0/1796634854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0015020 con 0x55d3c52354f0 2024-04-26T20:27:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.136+0000 7f0ebcc00640 1 -- 172.21.15.82:0/1796634854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0ec0011420 con 0x55d3c52354f0 2024-04-26T20:27:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.136+0000 7f0ebcc00640 1 -- 172.21.15.82:0/1796634854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0ec0020050 con 0x55d3c52354f0 2024-04-26T20:27:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.140+0000 7f0edc999740 10 client.16608 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.140+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55d3c4ea03f0 con 0x55d3c52354f0 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0ebcc00640 1 -- 172.21.15.82:0/1796634854 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f0ec0011660 con 0x55d3c52354f0 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0edc999740 10 client.16608 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0edc999740 10 client.16608 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0edc999740 20 client.16608 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0edc999740 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c5241010 0x55d3c52434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0edc999740 4 client.16608 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.143+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ec40c2130 con 0x55d3c5241010 2024-04-26T20:27:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.144+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c5241010 0x55d3c52434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.145+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c5241010 0x55d3c52434a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3fc502c33f5d9bb9 server_cookie=8c0d12eeac79dfa4 in_seq=0 out_seq=0 2024-04-26T20:27:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.145+0000 7f0ebcc00640 10 client.16608 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.146+0000 7f0ebcc00640 1 -- 172.21.15.82:0/1796634854 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f0ec40c2130 con 0x55d3c5241010 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.146+0000 7f0ebcc00640 10 client.16608 handle_command_reply: tid=0 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 client.16608 shutdown 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 msgr2=0x55d3c523a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 0x55d3c523a520 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55d3c522c4f0 tx=0x7f0ec000b4b0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 shutdown_connections 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c5241010 0x55d3c52434a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c523cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c52354f0 0x55d3c523a520 secure :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55d3c522c4f0 tx=0x7f0ec000b4b0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 --2- 172.21.15.82:0/1796634854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5230bf0 0x55d3c5234fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 >> 172.21.15.82:0/1796634854 conn(0x55d3c52268a0 msgr2=0x55d3c5225a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:38.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.151+0000 7f0ebcc00640 0 client.16608 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:27:38.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.152+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 shutdown_connections 2024-04-26T20:27:38.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.161+0000 7f0edc999740 1 -- 172.21.15.82:0/1796634854 wait complete. 2024-04-26T20:27:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.164+0000 7f0edc999740 20 client.16608 trim_cache size 0 max 16384 2024-04-26T20:27:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.263+0000 7f0edc999740 1 Processor -- start 2024-04-26T20:27:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.264+0000 7f0edc999740 1 -- start start 2024-04-26T20:27:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.270+0000 7f0edc999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5234f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.270+0000 7f0edc999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c52261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.270+0000 7f0edc999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522a0c0 0x55d3c523c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.271+0000 7f0edc999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41c26c0 con 0x55d3c5230bf0 2024-04-26T20:27:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.271+0000 7f0edc999740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41c42c0 con 0x55d3c522a0c0 2024-04-26T20:27:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.271+0000 7f0edc999740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41c2d90 con 0x55d3c5235970 2024-04-26T20:27:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.278+0000 7f0ed2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5234f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.278+0000 7f0ed2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5234f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45484/0 (socket says 172.21.15.82:45484) 2024-04-26T20:27:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.278+0000 7f0ed2a00640 1 -- 172.21.15.82:0/311432325 learned_addr learned my addr 172.21.15.82:0/311432325 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.279+0000 7f0ed2a00640 1 -- 172.21.15.82:0/311432325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 msgr2=0x55d3c52261e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.279+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c52261e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.279+0000 7f0ed2a00640 1 -- 172.21.15.82:0/311432325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522a0c0 msgr2=0x55d3c523c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:38.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.279+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522a0c0 0x55d3c523c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.279+0000 7f0ed2a00640 1 -- 172.21.15.82:0/311432325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c4f6a7d0 con 0x55d3c5230bf0 2024-04-26T20:27:38.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.279+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5234f90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0105b0 tx=0x7f0ecc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d70156b7d7a631 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.286+0000 7f0ebf400640 1 -- 172.21.15.82:0/311432325 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc02b070 con 0x55d3c5230bf0 2024-04-26T20:27:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.286+0000 7f0ebf400640 1 -- 172.21.15.82:0/311432325 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ecc016070 con 0x55d3c5230bf0 2024-04-26T20:27:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.286+0000 7f0ebf400640 1 -- 172.21.15.82:0/311432325 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00f3c0 con 0x55d3c5230bf0 2024-04-26T20:27:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.289+0000 7f0edc999740 1 -- 172.21.15.82:0/311432325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 msgr2=0x55d3c5234f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.289+0000 7f0edc999740 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5234f90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0105b0 tx=0x7f0ecc013000 comp rx=0 tx=0).stop 2024-04-26T20:27:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.301+0000 7f0edc999740 1 -- 172.21.15.82:0/311432325 shutdown_connections 2024-04-26T20:27:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.301+0000 7f0edc999740 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c522a0c0 0x55d3c523c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.301+0000 7f0edc999740 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5235970 0x55d3c52261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.301+0000 7f0edc999740 1 --2- 172.21.15.82:0/311432325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c5230bf0 0x55d3c5234f90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.301+0000 7f0edc999740 1 -- 172.21.15.82:0/311432325 >> 172.21.15.82:0/311432325 conn(0x55d3c52268a0 msgr2=0x55d3c522c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:38.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.336+0000 7f0edc999740 1 -- 172.21.15.82:0/311432325 shutdown_connections 2024-04-26T20:27:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.338+0000 7f0edc999740 1 -- 172.21.15.82:0/311432325 wait complete. 2024-04-26T20:27:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.339+0000 7f0edc999740 1 -- start start 2024-04-26T20:27:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.339+0000 7f0edc999740 1 Processor -- start 2024-04-26T20:27:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.345+0000 7f0edc999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 0x55d3c523a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.345+0000 7f0edc999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 0x55d3c523aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.346+0000 7f0ed2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 0x55d3c523a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.347+0000 7f0ed2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 0x55d3c523a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45492/0 (socket says 172.21.15.82:45492) 2024-04-26T20:27:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.347+0000 7f0edc999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5235970 0x55d3c523ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.348+0000 7f0ed2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 0x55d3c523aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.348+0000 7f0ed2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 0x55d3c523aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58054/0 (socket says 172.21.15.82:58054) 2024-04-26T20:27:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.348+0000 7f0ed2a00640 1 -- 172.21.15.82:0/2088121888 learned_addr learned my addr 172.21.15.82:0/2088121888 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:38.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.348+0000 7f0ed3400640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5235970 0x55d3c523ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.349+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41c3bf0 con 0x55d3c522a0c0 2024-04-26T20:27:38.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.350+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41c3460 con 0x55d3c5235970 2024-04-26T20:27:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.351+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41c06a0 con 0x55d3c5230bf0 2024-04-26T20:27:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.353+0000 7f0ed2a00640 1 -- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 msgr2=0x55d3c523aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.353+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 0x55d3c523aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.353+0000 7f0ed2a00640 1 -- 172.21.15.82:0/2088121888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5235970 msgr2=0x55d3c523ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.353+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5235970 0x55d3c523ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.353+0000 7f0ed2a00640 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c51352a0 con 0x55d3c522a0c0 2024-04-26T20:27:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.353+0000 7f0ed2000640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 0x55d3c523aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.354+0000 7f0edc999740 10 client.0 _ll_register_callbacks cb 0x7f0ec0006e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.354+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ecc016070 con 0x55d3c522a0c0 2024-04-26T20:27:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.359+0000 7f0ed2a00640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 0x55d3c523a540 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc010fd0 tx=0x7f0ecc01e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5d7393b128e3f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.359+0000 7f0ebcc00640 10 client.16614 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.359+0000 7f0ebcc00640 1 -- 172.21.15.82:0/2088121888 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc034020 con 0x55d3c522a0c0 2024-04-26T20:27:38.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.364+0000 7f0ebcc00640 1 -- 172.21.15.82:0/2088121888 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f0ecc01eda0 con 0x55d3c522a0c0 2024-04-26T20:27:38.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.364+0000 7f0ebcc00640 1 -- 172.21.15.82:0/2088121888 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0ecc03f050 con 0x55d3c522a0c0 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.368+0000 7f0edc999740 10 client.16614 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.368+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55d3c52a75e0 con 0x55d3c522a0c0 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0ebcc00640 1 -- 172.21.15.82:0/2088121888 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f0ecc004a40 con 0x55d3c522a0c0 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0edc999740 10 client.16614 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0edc999740 10 client.16614 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0edc999740 20 client.16614 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0edc999740 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c52a7c90 0x55d3c52aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0edc999740 4 client.16614 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3c519c880 con 0x55d3c52a7c90 2024-04-26T20:27:38.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.369+0000 7f0ed2000640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c52a7c90 0x55d3c52aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.370+0000 7f0ed2000640 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c52a7c90 0x55d3c52aa0a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9a859a9308e2111 server_cookie=74a06d24ce3b3b92 in_seq=0 out_seq=0 2024-04-26T20:27:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.370+0000 7f0ebcc00640 10 client.16614 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:27:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.371+0000 7f0ebcc00640 1 -- 172.21.15.82:0/2088121888 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3c519c880 con 0x55d3c52a7c90 2024-04-26T20:27:38.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.371+0000 7f0ebcc00640 10 client.16614 handle_command_reply: tid=0 2024-04-26T20:27:38.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.371+0000 7f0edc999740 1 client.16614 shutdown 2024-04-26T20:27:38.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.371+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 msgr2=0x55d3c523a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.371+0000 7f0edc999740 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 0x55d3c523a540 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc010fd0 tx=0x7f0ecc01e620 comp rx=0 tx=0).stop 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 shutdown_connections 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0edc999740 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x55d3c52a7c90 0x55d3c52aa0a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0edc999740 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3c5235970 0x55d3c523ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0edc999740 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d3c5230bf0 0x55d3c523aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0edc999740 1 --2- 172.21.15.82:0/2088121888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3c522a0c0 0x55d3c523a540 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 >> 172.21.15.82:0/2088121888 conn(0x55d3c52268a0 msgr2=0x55d3c522cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.372+0000 7f0ebcc00640 0 client.16614 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:27:38.402 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:27:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.401+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 shutdown_connections 2024-04-26T20:27:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.401+0000 7f0edc999740 1 -- 172.21.15.82:0/2088121888 wait complete. 2024-04-26T20:27:38.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.401+0000 7f0edc999740 20 client.16614 trim_cache size 0 max 16384 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.402+0000 7f0ec8c00640 1 -- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0eb80a3d80 msgr2=0x7f0eb80a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.402+0000 7f0ec8c00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0eb80a3d80 0x7f0eb80a6240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55d3c52277f0 tx=0x7f0ecc009440 comp rx=0 tx=0).stop 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 -- 172.21.15.82:0/2558275984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 msgr2=0x7f0ed4121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4121640 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4005ab0 tx=0x7f0ec4003f00 comp rx=0 tx=0).stop 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 -- 172.21.15.82:0/2558275984 shutdown_connections 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0eb80a3d80 0x7f0eb80a6240 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ed4110c70 0x7f0ed4121640 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ed410a530 0x7f0ed411a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 --2- 172.21.15.82:0/2558275984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed4073e70 0x7f0ed411a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:38.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 -- 172.21.15.82:0/2558275984 >> 172.21.15.82:0/2558275984 conn(0x7f0ed406f780 msgr2=0x7f0ed40720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:38.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 -- 172.21.15.82:0/2558275984 shutdown_connections 2024-04-26T20:27:38.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:38.403+0000 7f0ec8c00640 1 -- 172.21.15.82:0/2558275984 wait complete. 2024-04-26T20:27:38.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:27:39.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:38 smithi082 ceph-mon[28105]: pgmap v557: 129 pgs: 129 active+clean; 613 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 744 op/s 2024-04-26T20:27:39.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:38 smithi139 ceph-mon[32999]: pgmap v557: 129 pgs: 129 active+clean; 613 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 744 op/s 2024-04-26T20:27:39.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:38 smithi135 ceph-mon[32816]: pgmap v557: 129 pgs: 129 active+clean; 613 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 744 op/s 2024-04-26T20:27:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:40 smithi139 ceph-mon[32999]: pgmap v558: 129 pgs: 129 active+clean; 619 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 452 op/s 2024-04-26T20:27:41.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:40 smithi135 ceph-mon[32816]: pgmap v558: 129 pgs: 129 active+clean; 619 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 452 op/s 2024-04-26T20:27:41.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:40 smithi082 ceph-mon[28105]: pgmap v558: 129 pgs: 129 active+clean; 619 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 452 op/s 2024-04-26T20:27:42.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.393+0000 7f6429800640 1 -- 172.21.15.82:0/3166764172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 msgr2=0x7f642410f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.393+0000 7f6429800640 1 --2- 172.21.15.82:0/3166764172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 0x7f642410f120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f641c009ca0 tx=0x7f641c02a8f0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.426+0000 7f6429800640 1 -- 172.21.15.82:0/3166764172 shutdown_connections 2024-04-26T20:27:42.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.426+0000 7f6429800640 1 --2- 172.21.15.82:0/3166764172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 0x7f642410f120 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.426+0000 7f6429800640 1 --2- 172.21.15.82:0/3166764172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f642410c2a0 0x7f642410e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.426+0000 7f6429800640 1 --2- 172.21.15.82:0/3166764172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6424109930 0x7f642410bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.426+0000 7f6429800640 1 -- 172.21.15.82:0/3166764172 >> 172.21.15.82:0/3166764172 conn(0x7f642406f7c0 msgr2=0x7f6424071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:42.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.427+0000 7f6429800640 1 -- 172.21.15.82:0/3166764172 shutdown_connections 2024-04-26T20:27:42.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.427+0000 7f6429800640 1 -- 172.21.15.82:0/3166764172 wait complete. 2024-04-26T20:27:42.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.428+0000 7f6429800640 1 Processor -- start 2024-04-26T20:27:42.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.429+0000 7f6429800640 1 -- start start 2024-04-26T20:27:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.442+0000 7f6429800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 0x7f64241a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.444+0000 7f6429800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 0x7f64241a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.445+0000 7f6422000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 0x7f64241a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.445+0000 7f6422000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 0x7f64241a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40634/0 (socket says 172.21.15.82:40634) 2024-04-26T20:27:42.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.445+0000 7f6422a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 0x7f64241a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.445+0000 7f6422a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 0x7f64241a79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50820/0 (socket says 172.21.15.82:50820) 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.445+0000 7f6422a00640 1 -- 172.21.15.82:0/1025050493 learned_addr learned my addr 172.21.15.82:0/1025050493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.445+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 0x7f642407ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.446+0000 7f6423400640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 0x7f642407ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.446+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f642411d2b0 con 0x7f642410c2a0 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.446+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f642411d130 con 0x7f642410ec70 2024-04-26T20:27:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.446+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f642411d430 con 0x7f6424109930 2024-04-26T20:27:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.447+0000 7f6422a00640 1 -- 172.21.15.82:0/1025050493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 msgr2=0x7f642407ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.447+0000 7f6422a00640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 0x7f642407ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.447+0000 7f6422a00640 1 -- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 msgr2=0x7f64241a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.447+0000 7f6422a00640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 0x7f64241a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.447+0000 7f6422a00640 1 -- 172.21.15.82:0/1025050493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642407b200 con 0x7f6424109930 2024-04-26T20:27:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.447+0000 7f6422000640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 0x7f64241a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T20:27:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.457+0000 7f6422a00640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 0x7f64241a79a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:42.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.471+0000 7f641b400640 1 -- 172.21.15.82:0/1025050493 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414017070 con 0x7f6424109930 2024-04-26T20:27:42.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.471+0000 7f641b400640 1 -- 172.21.15.82:0/1025050493 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6414009c30 con 0x7f6424109930 2024-04-26T20:27:42.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.471+0000 7f641b400640 1 -- 172.21.15.82:0/1025050493 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641400f620 con 0x7f6424109930 2024-04-26T20:27:42.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.479+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642407b4f0 con 0x7f6424109930 2024-04-26T20:27:42.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.479+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642407b9c0 con 0x7f6424109930 2024-04-26T20:27:42.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.516+0000 7f641b400640 1 -- 172.21.15.82:0/1025050493 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6414010460 con 0x7f6424109930 2024-04-26T20:27:42.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.520+0000 7f641b400640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f64080a3e40 0x7f64080a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.520+0000 7f641b400640 1 -- 172.21.15.82:0/1025050493 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f64140d02c0 con 0x7f6424109930 2024-04-26T20:27:42.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.528+0000 7f642c7eb740 1 Processor -- start 2024-04-26T20:27:42.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.527+0000 7f6422000640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f64080a3e40 0x7f64080a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.548+0000 7f6422000640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f64080a3e40 0x7f64080a6300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f64241a8eb0 tx=0x7f6410005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 -- start start 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5cea0 0x56032ac5d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5d890 0x56032ac62390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac64e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56032abc0c70 con 0x56032ac5d890 2024-04-26T20:27:42.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56032ab79980 con 0x56032ac5cea0 2024-04-26T20:27:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.551+0000 7f642c7eb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56032abbcc30 con 0x56032ac62a00 2024-04-26T20:27:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.565+0000 7f6423400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac64e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.565+0000 7f6423400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac64e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50836/0 (socket says 172.21.15.82:50836) 2024-04-26T20:27:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.565+0000 7f6423400640 1 -- 172.21.15.82:0/2981675325 learned_addr learned my addr 172.21.15.82:0/2981675325 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.567+0000 7f6422000640 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5d890 0x56032ac62390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.569+0000 7f6422a00640 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5cea0 0x56032ac5d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.569+0000 7f6423400640 1 -- 172.21.15.82:0/2981675325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5cea0 msgr2=0x56032ac5d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.569+0000 7f6423400640 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5cea0 0x56032ac5d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.569+0000 7f6423400640 1 -- 172.21.15.82:0/2981675325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5d890 msgr2=0x56032ac62390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.569+0000 7f6423400640 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5d890 0x56032ac62390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.569+0000 7f6423400640 1 -- 172.21.15.82:0/2981675325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032ab517b0 con 0x56032ac62a00 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.570+0000 7f6423400640 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac64e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f641c035000 tx=0x7f641c0099a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3072ab0e2eae510a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.571+0000 7f640fe00640 1 -- 172.21.15.82:0/2981675325 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c048070 con 0x56032ac62a00 2024-04-26T20:27:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.572+0000 7f640fe00640 1 -- 172.21.15.82:0/2981675325 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f641c036040 con 0x56032ac62a00 2024-04-26T20:27:42.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.572+0000 7f640fe00640 1 -- 172.21.15.82:0/2981675325 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c030ca0 con 0x56032ac62a00 2024-04-26T20:27:42.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.580+0000 7f642c7eb740 1 -- 172.21.15.82:0/2981675325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 msgr2=0x56032ac64e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:42.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.580+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac64e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f641c035000 tx=0x7f641c0099a0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.590+0000 7f642c7eb740 1 -- 172.21.15.82:0/2981675325 shutdown_connections 2024-04-26T20:27:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.590+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac64e90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.590+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5d890 0x56032ac62390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.590+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2981675325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5cea0 0x56032ac5d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.590+0000 7f642c7eb740 1 -- 172.21.15.82:0/2981675325 >> 172.21.15.82:0/2981675325 conn(0x56032ac58510 msgr2=0x56032ac58910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.594+0000 7f642c7eb740 1 -- 172.21.15.82:0/2981675325 shutdown_connections 2024-04-26T20:27:42.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.595+0000 7f642c7eb740 1 -- 172.21.15.82:0/2981675325 wait complete. 2024-04-26T20:27:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.598+0000 7f642c7eb740 1 -- start start 2024-04-26T20:27:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.598+0000 7f642c7eb740 1 Processor -- start 2024-04-26T20:27:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.602+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5cea0 0x56032ac77d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.630+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac78270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.630+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac62a00 0x56032ac7f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.630+0000 7f642c7eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56032abbff80 con 0x56032ac62a00 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.630+0000 7f642c7eb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56032ab6d260 con 0x56032ac5d890 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.630+0000 7f642c7eb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56032abc52a0 con 0x56032ac5cea0 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.630+0000 7f642c7eb740 10 client.0 _ll_register_callbacks cb 0x56032abb7960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.631+0000 7f6422000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac78270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.631+0000 7f6422000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac78270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40782/0 (socket says 172.21.15.82:40782) 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.631+0000 7f6422000640 1 -- 172.21.15.82:0/1251473662 learned_addr learned my addr 172.21.15.82:0/1251473662 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.633+0000 7f6423400640 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac62a00 0x56032ac7f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.637+0000 7f6423400640 1 -- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5cea0 msgr2=0x56032ac77d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.637+0000 7f6423400640 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5cea0 0x56032ac77d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.637+0000 7f6423400640 1 -- 172.21.15.82:0/1251473662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 msgr2=0x56032ac78270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:42.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.637+0000 7f6423400640 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac78270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.637+0000 7f6423400640 1 -- 172.21.15.82:0/1251473662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56032ab4f1c0 con 0x56032ac62a00 2024-04-26T20:27:42.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.647+0000 7f6423400640 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac62a00 0x56032ac7f2b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f641c009bf0 tx=0x7f641c031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b036174d1d91e532 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:42.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.648+0000 7f640cc00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:42.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.672+0000 7f640cc00640 1 -- 172.21.15.82:0/1251473662 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c048070 con 0x56032ac62a00 2024-04-26T20:27:42.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.672+0000 7f640cc00640 1 -- 172.21.15.82:0/1251473662 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f641c030c10 con 0x56032ac62a00 2024-04-26T20:27:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.685+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641c036040 con 0x56032ac62a00 2024-04-26T20:27:42.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.688+0000 7f640cc00640 1 -- 172.21.15.82:0/1251473662 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f641c0305f0 con 0x56032ac62a00 2024-04-26T20:27:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.714+0000 7f642c7eb740 10 client.16620 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.714+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56032a8d23f0 con 0x56032ac62a00 2024-04-26T20:27:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.715+0000 7f640cc00640 1 -- 172.21.15.82:0/1251473662 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f641c036040 con 0x56032ac62a00 2024-04-26T20:27:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.721+0000 7f640cc00640 1 -- 172.21.15.82:0/1251473662 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f641c056c50 con 0x56032ac62a00 2024-04-26T20:27:42.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.723+0000 7f642c7eb740 10 client.16620 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:42.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.723+0000 7f642c7eb740 10 client.16620 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:27:42.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.723+0000 7f642c7eb740 20 client.16620 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:42.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.723+0000 7f642c7eb740 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ac837f0 0x56032ac85c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:42.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.723+0000 7f642c7eb740 4 client.16620 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.723+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56032abce880 con 0x56032ac837f0 2024-04-26T20:27:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.724+0000 7f6422a00640 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ac837f0 0x56032ac85c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:42.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.728+0000 7f6422a00640 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ac837f0 0x56032ac85c10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a10f103643a90401 server_cookie=afbfab21e22ac9 in_seq=0 out_seq=0 2024-04-26T20:27:42.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.730+0000 7f640cc00640 10 client.16620 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:27:42.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.731+0000 7f640cc00640 1 -- 172.21.15.82:0/1251473662 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56032abce880 con 0x56032ac837f0 2024-04-26T20:27:42.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.733+0000 7f640cc00640 10 client.16620 handle_command_reply: tid=0 2024-04-26T20:27:42.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.734+0000 7f642c7eb740 1 client.16620 shutdown 2024-04-26T20:27:42.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.739+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac62a00 msgr2=0x56032ac7f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:42.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.742+0000 7f642c7eb740 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac62a00 0x56032ac7f2b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f641c009bf0 tx=0x7f641c031d10 comp rx=0 tx=0).stop 2024-04-26T20:27:42.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.766+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 shutdown_connections 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.766+0000 7f642c7eb740 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac62a00 0x56032ac7f2b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.766+0000 7f642c7eb740 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ac837f0 0x56032ac85c10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.766+0000 7f642c7eb740 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac78270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.766+0000 7f642c7eb740 1 --2- 172.21.15.82:0/1251473662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5cea0 0x56032ac77d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.766+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 >> 172.21.15.82:0/1251473662 conn(0x56032ac58510 msgr2=0x56032ac57690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.768+0000 7f640cc00640 0 client.16620 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.768+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 shutdown_connections 2024-04-26T20:27:42.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.771+0000 7f642c7eb740 1 -- 172.21.15.82:0/1251473662 wait complete. 2024-04-26T20:27:42.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:42.772+0000 7f642c7eb740 20 client.16620 trim_cache size 0 max 16384 2024-04-26T20:27:43.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:42 smithi082 ceph-mon[28105]: pgmap v559: 129 pgs: 129 active+clean; 640 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 369 op/s 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.216+0000 7f642c7eb740 1 Processor -- start 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.217+0000 7f642c7eb740 1 -- start start 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.217+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac57510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.217+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac57a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.232+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac7f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.232+0000 7f642c7eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f642407d5d0 con 0x56032ac5cea0 2024-04-26T20:27:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.232+0000 7f642c7eb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f642407f1d0 con 0x56032ac5d890 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.232+0000 7f642c7eb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f642407dca0 con 0x56032ac62a00 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.233+0000 7f6422000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac57a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.234+0000 7f6422a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.234+0000 7f6422a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac57510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40674/0 (socket says 172.21.15.82:40674) 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.234+0000 7f6422a00640 1 -- 172.21.15.82:0/2802188830 learned_addr learned my addr 172.21.15.82:0/2802188830 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.234+0000 7f6423400640 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac7f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.235+0000 7f6422a00640 1 -- 172.21.15.82:0/2802188830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 msgr2=0x56032ac7f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.245+0000 7f6422a00640 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac7f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.245+0000 7f6422a00640 1 -- 172.21.15.82:0/2802188830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 msgr2=0x56032ac57a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.245+0000 7f6422a00640 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac57a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.245+0000 7f6422a00640 1 -- 172.21.15.82:0/2802188830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56032a99c7d0 con 0x56032ac5cea0 2024-04-26T20:27:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.245+0000 7f6422a00640 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac57510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6414098ad0 tx=0x7f6414000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c435fcd4d7ff2cad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:43.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.258+0000 7f6423400640 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac7f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:43.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.265+0000 7f6422000640 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac57a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.267+0000 7f640f400640 1 -- 172.21.15.82:0/2802188830 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140a4d70 con 0x56032ac5cea0 2024-04-26T20:27:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.267+0000 7f640f400640 1 -- 172.21.15.82:0/2802188830 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f641409a400 con 0x56032ac5cea0 2024-04-26T20:27:43.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.267+0000 7f640f400640 1 -- 172.21.15.82:0/2802188830 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140cdb00 con 0x56032ac5cea0 2024-04-26T20:27:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.293+0000 7f642c7eb740 1 -- 172.21.15.82:0/2802188830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 msgr2=0x56032ac57510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.293+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac57510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6414098ad0 tx=0x7f6414000bc0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.307+0000 7f642c7eb740 1 -- 172.21.15.82:0/2802188830 shutdown_connections 2024-04-26T20:27:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.307+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac62a00 0x56032ac7f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.307+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac5d890 0x56032ac57a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.307+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2802188830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac57510 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.307+0000 7f642c7eb740 1 -- 172.21.15.82:0/2802188830 >> 172.21.15.82:0/2802188830 conn(0x56032ac58510 msgr2=0x56032ac56e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:43.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:42 smithi139 ceph-mon[32999]: pgmap v559: 129 pgs: 129 active+clean; 640 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 369 op/s 2024-04-26T20:27:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.337+0000 7f642c7eb740 1 -- 172.21.15.82:0/2802188830 shutdown_connections 2024-04-26T20:27:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.337+0000 7f642c7eb740 1 -- 172.21.15.82:0/2802188830 wait complete. 2024-04-26T20:27:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.338+0000 7f642c7eb740 1 -- start start 2024-04-26T20:27:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.338+0000 7f642c7eb740 1 Processor -- start 2024-04-26T20:27:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac7ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5d890 0x56032ac7ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac62a00 0x56032ac7bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f642407eb00 con 0x56032ac5cea0 2024-04-26T20:27:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f642407e370 con 0x56032ac62a00 2024-04-26T20:27:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6424119200 con 0x56032ac5d890 2024-04-26T20:27:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.356+0000 7f642c7eb740 10 client.0 _ll_register_callbacks cb 0x7f641c046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.360+0000 7f6422a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac7ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.361+0000 7f6422a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac7ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40680/0 (socket says 172.21.15.82:40680) 2024-04-26T20:27:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.361+0000 7f6422a00640 1 -- 172.21.15.82:0/2598114318 learned_addr learned my addr 172.21.15.82:0/2598114318 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:43.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:42 smithi135 ceph-mon[32816]: pgmap v559: 129 pgs: 129 active+clean; 640 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 369 op/s 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6422000640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5d890 0x56032ac7ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6423400640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac62a00 0x56032ac7bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6422a00640 1 -- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5d890 msgr2=0x56032ac7ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6422a00640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5d890 0x56032ac7ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6422a00640 1 -- 172.21.15.82:0/2598114318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac62a00 msgr2=0x56032ac7bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6422a00640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac62a00 0x56032ac7bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.363+0000 7f6422a00640 1 -- 172.21.15.82:0/2598114318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56032ab672a0 con 0x56032ac5cea0 2024-04-26T20:27:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.373+0000 7f6422a00640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac7ee70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f641409c090 tx=0x7f6414010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658e121f0e58ca60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:43.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.384+0000 7f640cc00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:43.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.385+0000 7f640cc00640 1 -- 172.21.15.82:0/2598114318 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140a9060 con 0x56032ac5cea0 2024-04-26T20:27:43.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.385+0000 7f640cc00640 1 -- 172.21.15.82:0/2598114318 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f64140cdb00 con 0x56032ac5cea0 2024-04-26T20:27:43.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.390+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641409a400 con 0x56032ac5cea0 2024-04-26T20:27:43.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.393+0000 7f640cc00640 1 -- 172.21.15.82:0/2598114318 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f64140b9050 con 0x56032ac5cea0 2024-04-26T20:27:43.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.393+0000 7f642c7eb740 10 client.16626 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:43.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.393+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56032ace8a00 con 0x56032ac5cea0 2024-04-26T20:27:43.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.394+0000 7f640cc00640 1 -- 172.21.15.82:0/2598114318 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f641409a400 con 0x56032ac5cea0 2024-04-26T20:27:43.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.394+0000 7f640cc00640 1 -- 172.21.15.82:0/2598114318 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7f64140bc390 con 0x56032ac5cea0 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.395+0000 7f642c7eb740 10 client.16626 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.395+0000 7f642c7eb740 10 client.16626 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.395+0000 7f642c7eb740 20 client.16626 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.395+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ace9270 0x56032aceb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.395+0000 7f642c7eb740 4 client.16626 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.395+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56032abc86f0 con 0x56032ace9270 2024-04-26T20:27:43.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.396+0000 7f6422000640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ace9270 0x56032aceb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:43.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.397+0000 7f6422000640 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ace9270 0x56032aceb690 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d135bd15f94e5172 server_cookie=fdddfe49fb4f35ee in_seq=0 out_seq=0 2024-04-26T20:27:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.408+0000 7f640cc00640 10 client.16626 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:27:43.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.408+0000 7f640cc00640 1 -- 172.21.15.82:0/2598114318 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56032abc86f0 con 0x56032ace9270 2024-04-26T20:27:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.408+0000 7f640cc00640 10 client.16626 handle_command_reply: tid=0 2024-04-26T20:27:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.408+0000 7f642c7eb740 1 client.16626 shutdown 2024-04-26T20:27:43.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 msgr2=0x56032ac7ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac7ee70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f641409c090 tx=0x7f6414010cb0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 shutdown_connections 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x56032ace9270 0x56032aceb690 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56032ac62a00 0x56032ac7bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56032ac5d890 0x56032ac7ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 --2- 172.21.15.82:0/2598114318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56032ac5cea0 0x56032ac7ee70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 >> 172.21.15.82:0/2598114318 conn(0x56032ac58510 msgr2=0x56032ac57690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:43.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.409+0000 7f640cc00640 0 client.16626 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:27:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.418+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 shutdown_connections 2024-04-26T20:27:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.418+0000 7f642c7eb740 1 -- 172.21.15.82:0/2598114318 wait complete. 2024-04-26T20:27:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.418+0000 7f642c7eb740 20 client.16626 trim_cache size 0 max 16384 2024-04-26T20:27:43.439 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:27:43.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.499+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f64080a3e40 msgr2=0x7f64080a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:43.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.499+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f64080a3e40 0x7f64080a6300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f64241a8eb0 tx=0x7f6410005f90 comp rx=0 tx=0).stop 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.499+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 msgr2=0x7f64241a79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.499+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 0x7f64241a79a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400de10 comp rx=0 tx=0).stop 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.500+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 shutdown_connections 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.500+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f64080a3e40 0x7f64080a6300 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.500+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f642410ec70 0x7f642407ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.500+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f642410c2a0 0x7f64241a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.500+0000 7f6429800640 1 --2- 172.21.15.82:0/1025050493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6424109930 0x7f64241a79a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.500+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 >> 172.21.15.82:0/1025050493 conn(0x7f642406f7c0 msgr2=0x7f642410d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.501+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 shutdown_connections 2024-04-26T20:27:43.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:43.502+0000 7f6429800640 1 -- 172.21.15.82:0/1025050493 wait complete. 2024-04-26T20:27:43.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:27:46.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:45 smithi135 ceph-mon[32816]: pgmap v560: 129 pgs: 129 active+clean; 657 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 300 op/s 2024-04-26T20:27:46.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:45 smithi082 ceph-mon[28105]: pgmap v560: 129 pgs: 129 active+clean; 657 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 300 op/s 2024-04-26T20:27:46.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:45 smithi139 ceph-mon[32999]: pgmap v560: 129 pgs: 129 active+clean; 657 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 300 op/s 2024-04-26T20:27:47.095 INFO:tasks.workunit.client.0.smithi082.stdout: 200 539239 1014 360159 1103 152472 1545 2024-04-26T20:27:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:46 smithi082 ceph-mon[28105]: pgmap v561: 129 pgs: 129 active+clean; 676 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.3 MiB/s wr, 326 op/s 2024-04-26T20:27:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.228+0000 7fc21be00640 1 -- 172.21.15.82:0/1273147495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 msgr2=0x7fc20c0a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.234+0000 7fc21be00640 1 --2- 172.21.15.82:0/1273147495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c0a4c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc200009860 tx=0x7fc20002a360 comp rx=0 tx=0).stop 2024-04-26T20:27:47.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:46 smithi139 ceph-mon[32999]: pgmap v561: 129 pgs: 129 active+clean; 676 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.3 MiB/s wr, 326 op/s 2024-04-26T20:27:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.362+0000 7fc21be00640 1 -- 172.21.15.82:0/1273147495 shutdown_connections 2024-04-26T20:27:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.362+0000 7fc21be00640 1 --2- 172.21.15.82:0/1273147495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc20c0a5180 0x7fc20c005c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.362+0000 7fc21be00640 1 --2- 172.21.15.82:0/1273147495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c0a4c40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.362+0000 7fc21be00640 1 --2- 172.21.15.82:0/1273147495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a6100 0x7fc20c0a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.362+0000 7fc21be00640 1 -- 172.21.15.82:0/1273147495 >> 172.21.15.82:0/1273147495 conn(0x7fc20c0a0100 msgr2=0x7fc20c0a2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:46 smithi135 ceph-mon[32816]: pgmap v561: 129 pgs: 129 active+clean; 676 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.3 MiB/s wr, 326 op/s 2024-04-26T20:27:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.378+0000 7fc21be00640 1 -- 172.21.15.82:0/1273147495 shutdown_connections 2024-04-26T20:27:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.380+0000 7fc21be00640 1 -- 172.21.15.82:0/1273147495 wait complete. 2024-04-26T20:27:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.396+0000 7fc21be00640 1 Processor -- start 2024-04-26T20:27:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.403+0000 7fc21be00640 1 -- start start 2024-04-26T20:27:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.410+0000 7fc21be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.424+0000 7fc219400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.424+0000 7fc219400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c1502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40830/0 (socket says 172.21.15.82:40830) 2024-04-26T20:27:47.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.433+0000 7fc219400640 1 -- 172.21.15.82:0/4020169276 learned_addr learned my addr 172.21.15.82:0/4020169276 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.439+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a5180 0x7fc20c150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.445+0000 7fc218a00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a5180 0x7fc20c150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.447+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc20c0a6100 0x7fc20c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.452+0000 7fc219e00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc20c0a6100 0x7fc20c1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.460+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c0138a0 con 0x7fc20c0a5180 2024-04-26T20:27:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.463+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c013720 con 0x7fc20c0a47c0 2024-04-26T20:27:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.465+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c013a20 con 0x7fc20c0a6100 2024-04-26T20:27:47.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.467+0000 7fc218a00640 1 -- 172.21.15.82:0/4020169276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc20c0a6100 msgr2=0x7fc20c1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.467+0000 7fc218a00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc20c0a6100 0x7fc20c1578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.467+0000 7fc218a00640 1 -- 172.21.15.82:0/4020169276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 msgr2=0x7fc20c1502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.467+0000 7fc218a00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c1502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.467+0000 7fc218a00640 1 -- 172.21.15.82:0/4020169276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c157f10 con 0x7fc20c0a5180 2024-04-26T20:27:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.468+0000 7fc218a00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a5180 0x7fc20c150830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc200009780 tx=0x7fc200030780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.486+0000 7fc212000640 1 -- 172.21.15.82:0/4020169276 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200037040 con 0x7fc20c0a5180 2024-04-26T20:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.486+0000 7fc212000640 1 -- 172.21.15.82:0/4020169276 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000308f0 con 0x7fc20c0a5180 2024-04-26T20:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.486+0000 7fc212000640 1 -- 172.21.15.82:0/4020169276 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000046c0 con 0x7fc20c0a5180 2024-04-26T20:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.494+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c1581a0 con 0x7fc20c0a5180 2024-04-26T20:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.494+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c1585e0 con 0x7fc20c0a5180 2024-04-26T20:27:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.557+0000 7fc212000640 1 -- 172.21.15.82:0/4020169276 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc200043020 con 0x7fc20c0a5180 2024-04-26T20:27:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.602+0000 7fc212000640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc1fc0a3e40 0x7fc1fc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.612+0000 7fc21ec37740 1 Processor -- start 2024-04-26T20:27:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.616+0000 7fc212000640 1 -- 172.21.15.82:0/4020169276 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc2000efd90 con 0x7fc20c0a5180 2024-04-26T20:27:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.622+0000 7fc21ec37740 1 -- start start 2024-04-26T20:27:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.625+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.625+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.625+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.625+0000 7fc21ec37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bdf1418380 con 0x55bdf14c2130 2024-04-26T20:27:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.625+0000 7fc21ec37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bdf13b4c30 con 0x55bdf14bc5d0 2024-04-26T20:27:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.625+0000 7fc21ec37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bdf1414340 con 0x55bdf14bcfc0 2024-04-26T20:27:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.630+0000 7fc219400640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc1fc0a3e40 0x7fc1fc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.638+0000 7fc219e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.640+0000 7fc219e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40706/0 (socket says 172.21.15.82:40706) 2024-04-26T20:27:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.640+0000 7fc219e00640 1 -- 172.21.15.82:0/264717320 learned_addr learned my addr 172.21.15.82:0/264717320 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.645+0000 7fc219e00640 1 -- 172.21.15.82:0/264717320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 msgr2=0x55bdf14c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.645+0000 7fc219e00640 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.645+0000 7fc219e00640 1 -- 172.21.15.82:0/264717320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 msgr2=0x55bdf14bc9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.645+0000 7fc219e00640 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14bc9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.645+0000 7fc219e00640 1 -- 172.21.15.82:0/264717320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf13d6940 con 0x55bdf14c2130 2024-04-26T20:27:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.652+0000 7fc219e00640 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14c45c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc214000b60 tx=0x7fc2140688a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16903eec55e58ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.653+0000 7fc219400640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc1fc0a3e40 0x7fc1fc0a6300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55bdf14bd820 tx=0x7fc208008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.705+0000 7fc206600640 1 -- 172.21.15.82:0/264717320 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214080070 con 0x55bdf14c2130 2024-04-26T20:27:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.711+0000 7fc206600640 1 -- 172.21.15.82:0/264717320 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc21406d9c0 con 0x55bdf14c2130 2024-04-26T20:27:47.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.716+0000 7fc21ec37740 1 -- 172.21.15.82:0/264717320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 msgr2=0x55bdf14c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:47.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.716+0000 7fc21ec37740 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14c45c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc214000b60 tx=0x7fc2140688a0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.725+0000 7fc206600640 1 -- 172.21.15.82:0/264717320 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21406bb90 con 0x55bdf14c2130 2024-04-26T20:27:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.734+0000 7fc21ec37740 1 -- 172.21.15.82:0/264717320 shutdown_connections 2024-04-26T20:27:47.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.737+0000 7fc21ec37740 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14c45c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.740+0000 7fc21ec37740 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.741+0000 7fc21ec37740 1 --2- 172.21.15.82:0/264717320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.746+0000 7fc21ec37740 1 -- 172.21.15.82:0/264717320 >> 172.21.15.82:0/264717320 conn(0x55bdf14af430 msgr2=0x55bdf14af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.802+0000 7fc21ec37740 1 -- 172.21.15.82:0/264717320 shutdown_connections 2024-04-26T20:27:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.802+0000 7fc21ec37740 1 -- 172.21.15.82:0/264717320 wait complete. 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.803+0000 7fc21ec37740 1 -- start start 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.803+0000 7fc21ec37740 1 Processor -- start 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.803+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.804+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.804+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.804+0000 7fc21ec37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bdf14b3ec0 con 0x55bdf14c2130 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.804+0000 7fc21ec37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bdf139fc60 con 0x55bdf14bc5d0 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.804+0000 7fc21ec37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bdf14b4040 con 0x55bdf14bcfc0 2024-04-26T20:27:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.804+0000 7fc21ec37740 10 client.0 _ll_register_callbacks cb 0x55bdf13cbe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.817+0000 7fc219e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.817+0000 7fc219e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14bab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40718/0 (socket says 172.21.15.82:40718) 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.817+0000 7fc219e00640 1 -- 172.21.15.82:0/624340504 learned_addr learned my addr 172.21.15.82:0/624340504 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.818+0000 7fc219e00640 1 -- 172.21.15.82:0/624340504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 msgr2=0x55bdf14b5ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.818+0000 7fc219e00640 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14b5ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.818+0000 7fc219e00640 1 -- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 msgr2=0x55bdf14b55a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.818+0000 7fc219e00640 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14b55a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:47.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.818+0000 7fc219e00640 1 -- 172.21.15.82:0/624340504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdf13ae510 con 0x55bdf14c2130 2024-04-26T20:27:47.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.819+0000 7fc219e00640 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14bab10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc214068130 tx=0x7fc21406b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c5be3aa9839e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:47.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.822+0000 7fc1faa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:47.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.858+0000 7fc1faa00640 1 -- 172.21.15.82:0/624340504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214089020 con 0x55bdf14c2130 2024-04-26T20:27:47.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.858+0000 7fc1faa00640 1 -- 172.21.15.82:0/624340504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc21406b910 con 0x55bdf14c2130 2024-04-26T20:27:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.877+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc21406d9c0 con 0x55bdf14c2130 2024-04-26T20:27:47.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.905+0000 7fc1faa00640 1 -- 172.21.15.82:0/624340504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc214080070 con 0x55bdf14c2130 2024-04-26T20:27:47.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.932+0000 7fc21ec37740 10 client.16635 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.932+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bdf112a210 con 0x55bdf14c2130 2024-04-26T20:27:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.941+0000 7fc1faa00640 1 -- 172.21.15.82:0/624340504 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc21406d9c0 con 0x55bdf14c2130 2024-04-26T20:27:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.941+0000 7fc1faa00640 1 -- 172.21.15.82:0/624340504 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fc214085440 con 0x55bdf14c2130 2024-04-26T20:27:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.945+0000 7fc21ec37740 10 client.16635 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:47.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.945+0000 7fc21ec37740 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.945+0000 7fc21ec37740 20 client.16635 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.945+0000 7fc21ec37740 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf14da4d0 0x55bdf14dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.945+0000 7fc21ec37740 4 client.16635 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:47.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.945+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdf1425f90 con 0x55bdf14da4d0 2024-04-26T20:27:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.947+0000 7fc219400640 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf14da4d0 0x55bdf14dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.950+0000 7fc219400640 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf14da4d0 0x55bdf14dc8c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84663d6816fc4b6a server_cookie=34b6c4b5437e7656 in_seq=0 out_seq=0 2024-04-26T20:27:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.953+0000 7fc1faa00640 10 client.16635 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.953+0000 7fc1faa00640 1 -- 172.21.15.82:0/624340504 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bdf1425f90 con 0x55bdf14da4d0 2024-04-26T20:27:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.953+0000 7fc1faa00640 10 client.16635 handle_command_reply: tid=0 2024-04-26T20:27:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:47.969+0000 7fc21ec37740 1 client.16635 shutdown 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 msgr2=0x55bdf14bab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14bab10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc214068130 tx=0x7fc21406b730 comp rx=0 tx=0).stop 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 shutdown_connections 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf14da4d0 0x55bdf14dc8c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14bab10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 --2- 172.21.15.82:0/624340504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.015+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 >> 172.21.15.82:0/624340504 conn(0x55bdf14af430 msgr2=0x55bdf14ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.016+0000 7fc1faa00640 0 client.16635 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.034+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 shutdown_connections 2024-04-26T20:27:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.049+0000 7fc21ec37740 1 -- 172.21.15.82:0/624340504 wait complete. 2024-04-26T20:27:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:48.076+0000 7fc21ec37740 20 client.16635 trim_cache size 0 max 16384 2024-04-26T20:27:48.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.234+0000 7fc97b200640 1 -- 172.21.15.82:0/1694272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 msgr2=0x7fc97c10f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:48.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.236+0000 7fc97b200640 1 --2- 172.21.15.82:0/1694272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c10f240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc974009be0 tx=0x7fc97402a710 comp rx=0 tx=0).stop 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.285+0000 7fc97b200640 1 -- 172.21.15.82:0/1694272538 shutdown_connections 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.285+0000 7fc97b200640 1 --2- 172.21.15.82:0/1694272538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c10f240 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.285+0000 7fc97b200640 1 --2- 172.21.15.82:0/1694272538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc97c109f10 0x7fc97c10a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.285+0000 7fc97b200640 1 --2- 172.21.15.82:0/1694272538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c074030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.285+0000 7fc97b200640 1 -- 172.21.15.82:0/1694272538 >> 172.21.15.82:0/1694272538 conn(0x7fc97c06f780 msgr2=0x7fc97c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.288+0000 7fc97b200640 1 -- 172.21.15.82:0/1694272538 shutdown_connections 2024-04-26T20:27:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.288+0000 7fc97b200640 1 -- 172.21.15.82:0/1694272538 wait complete. 2024-04-26T20:27:48.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.311+0000 7fc97b200640 1 Processor -- start 2024-04-26T20:27:48.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.313+0000 7fc97b200640 1 -- start start 2024-04-26T20:27:48.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.331+0000 7fc97b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.336+0000 7fc979e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.336+0000 7fc979e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40722/0 (socket says 172.21.15.82:40722) 2024-04-26T20:27:48.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.336+0000 7fc979e00640 1 -- 172.21.15.82:0/1359625348 learned_addr learned my addr 172.21.15.82:0/1359625348 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:48.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.337+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc97c109f10 0x7fc97c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.338+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c1a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.338+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c112900 con 0x7fc97c073c10 2024-04-26T20:27:48.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.338+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c112780 con 0x7fc97c10a8d0 2024-04-26T20:27:48.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.338+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c112a80 con 0x7fc97c109f10 2024-04-26T20:27:48.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.346+0000 7fc97a800640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c1a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.346+0000 7fc979400640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc97c109f10 0x7fc97c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.350+0000 7fc979e00640 1 -- 172.21.15.82:0/1359625348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc97c109f10 msgr2=0x7fc97c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.350+0000 7fc979e00640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc97c109f10 0x7fc97c19f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.350+0000 7fc979e00640 1 -- 172.21.15.82:0/1359625348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 msgr2=0x7fc97c1a6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.350+0000 7fc979e00640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c1a6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.350+0000 7fc979e00640 1 -- 172.21.15.82:0/1359625348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c1a6bd0 con 0x7fc97c073c10 2024-04-26T20:27:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.350+0000 7fc97a800640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c1a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:48.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.360+0000 7fc979e00640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c19efb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00b4a0 tx=0x7fc96c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:48.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.365+0000 7fc972a00640 1 -- 172.21.15.82:0/1359625348 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c014070 con 0x7fc97c073c10 2024-04-26T20:27:48.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.365+0000 7fc972a00640 1 -- 172.21.15.82:0/1359625348 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96c010ac0 con 0x7fc97c073c10 2024-04-26T20:27:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.365+0000 7fc972a00640 1 -- 172.21.15.82:0/1359625348 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c017c30 con 0x7fc97c073c10 2024-04-26T20:27:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.387+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c1a6ec0 con 0x7fc97c073c10 2024-04-26T20:27:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.387+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1a7350 con 0x7fc97c073c10 2024-04-26T20:27:48.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.458+0000 7fc9839a6740 1 Processor -- start 2024-04-26T20:27:48.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.460+0000 7fc972a00640 1 -- 172.21.15.82:0/1359625348 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc96c017070 con 0x7fc97c073c10 2024-04-26T20:27:48.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.480+0000 7fc972a00640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9600a3e40 0x7fc9600a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.481+0000 7fc972a00640 1 -- 172.21.15.82:0/1359625348 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc96c0cfb30 con 0x7fc97c073c10 2024-04-26T20:27:48.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.485+0000 7fc97a800640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9600a3e40 0x7fc9600a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 -- start start 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb771c20 0x55aeeb7740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aeeb6cfc70 con 0x55aeeb76cab0 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aeeb688980 con 0x55aeeb771c20 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.497+0000 7fc9839a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55aeeb6cbc30 con 0x55aeeb76c0c0 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.500+0000 7fc979400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.500+0000 7fc979400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40730/0 (socket says 172.21.15.82:40730) 2024-04-26T20:27:48.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.500+0000 7fc979400640 1 -- 172.21.15.82:0/1041751056 learned_addr learned my addr 172.21.15.82:0/1041751056 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:48.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.508+0000 7fc97a800640 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb771c20 0x55aeeb7740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.508+0000 7fc97a800640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9600a3e40 0x7fc9600a6300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc9740099a0 tx=0x7fc974005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:48.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.508+0000 7fc979400640 1 -- 172.21.15.82:0/1041751056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb76c0c0 msgr2=0x55aeeb76c4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:48.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.508+0000 7fc979400640 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.508+0000 7fc979400640 1 -- 172.21.15.82:0/1041751056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb771c20 msgr2=0x55aeeb7740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:48.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.508+0000 7fc979400640 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb771c20 0x55aeeb7740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.509+0000 7fc979400640 1 -- 172.21.15.82:0/1041751056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeeb6607b0 con 0x55aeeb76cab0 2024-04-26T20:27:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.527+0000 7fc979400640 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7715b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc96801ab30 tx=0x7fc96801f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccccdc72081f7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.564+0000 7fc967000640 1 -- 172.21.15.82:0/1041751056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968027070 con 0x55aeeb76cab0 2024-04-26T20:27:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.564+0000 7fc967000640 1 -- 172.21.15.82:0/1041751056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96801fd40 con 0x55aeeb76cab0 2024-04-26T20:27:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.564+0000 7fc967000640 1 -- 172.21.15.82:0/1041751056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968022480 con 0x55aeeb76cab0 2024-04-26T20:27:48.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.582+0000 7fc9839a6740 1 -- 172.21.15.82:0/1041751056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 msgr2=0x55aeeb7715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:48.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.582+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7715b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc96801ab30 tx=0x7fc96801f300 comp rx=0 tx=0).stop 2024-04-26T20:27:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.650+0000 7fc9839a6740 1 -- 172.21.15.82:0/1041751056 shutdown_connections 2024-04-26T20:27:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.650+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb771c20 0x55aeeb7740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.650+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7715b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.650+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1041751056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.650+0000 7fc9839a6740 1 -- 172.21.15.82:0/1041751056 >> 172.21.15.82:0/1041751056 conn(0x55aeeb767730 msgr2=0x55aeeb767b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:48.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.653+0000 7fc9839a6740 1 -- 172.21.15.82:0/1041751056 shutdown_connections 2024-04-26T20:27:48.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.655+0000 7fc9839a6740 1 -- 172.21.15.82:0/1041751056 wait complete. 2024-04-26T20:27:48.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.655+0000 7fc9839a6740 1 -- start start 2024-04-26T20:27:48.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.656+0000 7fc9839a6740 1 Processor -- start 2024-04-26T20:27:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb776060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7765a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aeeb6cef80 con 0x55aeeb76cab0 2024-04-26T20:27:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aeeb67c260 con 0x55aeeb76c0c0 2024-04-26T20:27:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55aeeb6d42a0 con 0x55aeeb771c20 2024-04-26T20:27:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.713+0000 7fc9839a6740 10 client.0 _ll_register_callbacks cb 0x55aeeb6c6960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.714+0000 7fc979e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb776060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.714+0000 7fc979e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb776060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40880/0 (socket says 172.21.15.82:40880) 2024-04-26T20:27:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.714+0000 7fc979e00640 1 -- 172.21.15.82:0/1106916596 learned_addr learned my addr 172.21.15.82:0/1106916596 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.715+0000 7fc979e00640 1 -- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 msgr2=0x55aeeb77d5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.715+0000 7fc979e00640 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77d5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.715+0000 7fc979e00640 1 -- 172.21.15.82:0/1106916596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 msgr2=0x55aeeb7765a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.715+0000 7fc979e00640 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7765a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.715+0000 7fc979e00640 1 -- 172.21.15.82:0/1106916596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeeb65e1c0 con 0x55aeeb76c0c0 2024-04-26T20:27:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.716+0000 7fc979e00640 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb776060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0983d0 tx=0x7fc96c0047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3013a47df432e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:48.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.738+0000 7fc95b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:27:48.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.738+0000 7fc95b400640 1 -- 172.21.15.82:0/1106916596 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c09ba00 con 0x55aeeb76c0c0 2024-04-26T20:27:48.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.738+0000 7fc95b400640 1 -- 172.21.15.82:0/1106916596 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc96c098070 con 0x55aeeb76c0c0 2024-04-26T20:27:48.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.755+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96801fd40 con 0x55aeeb76c0c0 2024-04-26T20:27:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.787+0000 7fc95b400640 1 -- 172.21.15.82:0/1106916596 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc96c09fdb0 con 0x55aeeb76c0c0 2024-04-26T20:27:48.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.792+0000 7fc9839a6740 10 client.26720 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:48.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.792+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55aeeb3e13f0 con 0x55aeeb76c0c0 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.793+0000 7fc95b400640 1 -- 172.21.15.82:0/1106916596 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96801fd40 con 0x55aeeb76c0c0 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.793+0000 7fc95b400640 1 -- 172.21.15.82:0/1106916596 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fc96c0bacd0 con 0x55aeeb76c0c0 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.795+0000 7fc9839a6740 10 client.26720 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.795+0000 7fc9839a6740 10 client.26720 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.795+0000 7fc9839a6740 20 client.26720 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.795+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb781bb0 0x55aeeb783ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:48.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.795+0000 7fc9839a6740 4 client.26720 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:48.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.795+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeeb6dd880 con 0x55aeeb781bb0 2024-04-26T20:27:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.801+0000 7fc979400640 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb781bb0 0x55aeeb783ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:48.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.820+0000 7fc979400640 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb781bb0 0x55aeeb783ff0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f507163c74713076 server_cookie=a213911edced41c1 in_seq=0 out_seq=0 2024-04-26T20:27:48.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.821+0000 7fc95b400640 10 client.26720 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:27:48.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.828+0000 7fc95b400640 1 -- 172.21.15.82:0/1106916596 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aeeb6dd880 con 0x55aeeb781bb0 2024-04-26T20:27:48.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.828+0000 7fc95b400640 10 client.26720 handle_command_reply: tid=0 2024-04-26T20:27:48.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.838+0000 7fc9839a6740 1 client.26720 shutdown 2024-04-26T20:27:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.867+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 msgr2=0x55aeeb776060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.867+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb776060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0983d0 tx=0x7fc96c0047d0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.883+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 shutdown_connections 2024-04-26T20:27:48.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.883+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb781bb0 0x55aeeb783ff0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.887+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.887+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb7765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.887+0000 7fc9839a6740 1 --2- 172.21.15.82:0/1106916596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb776060 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:48.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.888+0000 7fc95b400640 0 client.26720 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:27:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.892+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 >> 172.21.15.82:0/1106916596 conn(0x55aeeb767730 msgr2=0x55aeeb766890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:48.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.969+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 shutdown_connections 2024-04-26T20:27:48.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.975+0000 7fc9839a6740 1 -- 172.21.15.82:0/1106916596 wait complete. 2024-04-26T20:27:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:48.980+0000 7fc9839a6740 20 client.26720 trim_cache size 0 max 16384 2024-04-26T20:27:49.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 Processor -- start 2024-04-26T20:27:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 -- start start 2024-04-26T20:27:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15e740 con 0x55bdf14c2130 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c160340 con 0x55bdf14bc5d0 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.026+0000 7fc21ec37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15ee10 con 0x55bdf14bcfc0 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.027+0000 7fc218a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.027+0000 7fc219e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.027+0000 7fc219e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40740/0 (socket says 172.21.15.82:40740) 2024-04-26T20:27:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.027+0000 7fc219e00640 1 -- 172.21.15.82:0/4141903499 learned_addr learned my addr 172.21.15.82:0/4141903499 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.027+0000 7fc219400640 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.028+0000 7fc218a00640 1 -- 172.21.15.82:0/4141903499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 msgr2=0x55bdf14be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.028+0000 7fc218a00640 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.028+0000 7fc218a00640 1 -- 172.21.15.82:0/4141903499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 msgr2=0x55bdf14b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.028+0000 7fc218a00640 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.028+0000 7fc218a00640 1 -- 172.21.15.82:0/4141903499 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf11f6620 con 0x55bdf14bcfc0 2024-04-26T20:27:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.028+0000 7fc219e00640 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.029+0000 7fc219400640 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:27:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.029+0000 7fc218a00640 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14be6e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc2000ed490 tx=0x7fc2000b7fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1526a286e29f7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.044+0000 7fc205c00640 1 -- 172.21.15.82:0/4141903499 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000d5070 con 0x55bdf14bcfc0 2024-04-26T20:27:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.044+0000 7fc205c00640 1 -- 172.21.15.82:0/4141903499 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000328f0 con 0x55bdf14bcfc0 2024-04-26T20:27:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.044+0000 7fc205c00640 1 -- 172.21.15.82:0/4141903499 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000c4950 con 0x55bdf14bcfc0 2024-04-26T20:27:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.052+0000 7fc21ec37740 1 -- 172.21.15.82:0/4141903499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 msgr2=0x55bdf14be6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.052+0000 7fc21ec37740 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14be6e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc2000ed490 tx=0x7fc2000b7fb0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.071+0000 7fc9839a6740 1 Processor -- start 2024-04-26T20:27:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.086+0000 7fc21ec37740 1 -- 172.21.15.82:0/4141903499 shutdown_connections 2024-04-26T20:27:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.086+0000 7fc21ec37740 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.086+0000 7fc21ec37740 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bcfc0 0x55bdf14be6e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.086+0000 7fc21ec37740 1 --2- 172.21.15.82:0/4141903499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bc5d0 0x55bdf14be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.086+0000 7fc21ec37740 1 -- 172.21.15.82:0/4141903499 >> 172.21.15.82:0/4141903499 conn(0x55bdf14af430 msgr2=0x55bdf14c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.093+0000 7fc9839a6740 1 -- start start 2024-04-26T20:27:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.095+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.095+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb77d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.095+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb76ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.095+0000 7fc9839a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1b1980 con 0x55aeeb76cab0 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.095+0000 7fc9839a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1b3580 con 0x55aeeb76c0c0 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.095+0000 7fc9839a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1b2050 con 0x55aeeb771c20 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.098+0000 7fc979e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.098+0000 7fc979e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40900/0 (socket says 172.21.15.82:40900) 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.098+0000 7fc979e00640 1 -- 172.21.15.82:0/4230154592 learned_addr learned my addr 172.21.15.82:0/4230154592 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:49.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.099+0000 7fc979e00640 1 -- 172.21.15.82:0/4230154592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 msgr2=0x55aeeb76ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:49.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.099+0000 7fc979e00640 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb76ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.099+0000 7fc979e00640 1 -- 172.21.15.82:0/4230154592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 msgr2=0x55aeeb77d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:49.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.099+0000 7fc979e00640 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb77d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.099+0000 7fc979e00640 1 -- 172.21.15.82:0/4230154592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeeb4ab7d0 con 0x55aeeb76c0c0 2024-04-26T20:27:49.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.100+0000 7fc979e00640 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76a640 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc96c09ff70 tx=0x7fc96c099f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b16d91745b28734 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.101+0000 7fc966600640 1 -- 172.21.15.82:0/4230154592 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c09ba00 con 0x55aeeb76c0c0 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.101+0000 7fc966600640 1 -- 172.21.15.82:0/4230154592 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96c0b6060 con 0x55aeeb76c0c0 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.101+0000 7fc966600640 1 -- 172.21.15.82:0/4230154592 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c010d90 con 0x55aeeb76c0c0 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.102+0000 7fc9839a6740 1 -- 172.21.15.82:0/4230154592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 msgr2=0x55aeeb76a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.102+0000 7fc9839a6740 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76a640 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc96c09ff70 tx=0x7fc96c099f10 comp rx=0 tx=0).stop 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 -- 172.21.15.82:0/4230154592 shutdown_connections 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb76ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76cab0 0x55aeeb77d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 --2- 172.21.15.82:0/4230154592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76c0c0 0x55aeeb76a640 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 -- 172.21.15.82:0/4230154592 >> 172.21.15.82:0/4230154592 conn(0x55aeeb767730 msgr2=0x55aeeb775c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:49.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 -- 172.21.15.82:0/4230154592 shutdown_connections 2024-04-26T20:27:49.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.104+0000 7fc9839a6740 1 -- 172.21.15.82:0/4230154592 wait complete. 2024-04-26T20:27:49.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.107+0000 7fc9839a6740 1 -- start start 2024-04-26T20:27:49.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.108+0000 7fc9839a6740 1 Processor -- start 2024-04-26T20:27:49.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.111+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76c0c0 0x55aeeb77a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.111+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76cab0 0x55aeeb77ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.111+0000 7fc9839a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.112+0000 7fc97a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.112+0000 7fc97a800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50946/0 (socket says 172.21.15.82:50946) 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.114+0000 7fc9839a6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1b2eb0 con 0x55aeeb76c0c0 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.114+0000 7fc9839a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1b2720 con 0x55aeeb76cab0 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.114+0000 7fc9839a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1af960 con 0x55aeeb771c20 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.114+0000 7fc9839a6740 10 client.0 _ll_register_callbacks cb 0x7fc96c09b850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.114+0000 7fc97a800640 1 -- 172.21.15.82:0/2753001089 learned_addr learned my addr 172.21.15.82:0/2753001089 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.116+0000 7fc97a800640 1 -- 172.21.15.82:0/2753001089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76cab0 msgr2=0x55aeeb77ad00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.116+0000 7fc97a800640 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76cab0 0x55aeeb77ad00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.116+0000 7fc97a800640 1 -- 172.21.15.82:0/2753001089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76c0c0 msgr2=0x55aeeb77a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.116+0000 7fc97a800640 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76c0c0 0x55aeeb77a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.116+0000 7fc97a800640 1 -- 172.21.15.82:0/2753001089 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeeb6762a0 con 0x55aeeb771c20 2024-04-26T20:27:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.110+0000 7fc21ec37740 1 -- 172.21.15.82:0/4141903499 shutdown_connections 2024-04-26T20:27:49.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.118+0000 7fc97a800640 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77bd10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc974009be0 tx=0x7fc974009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d022553dbd380 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:49.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.118+0000 7fc95b400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:27:49.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.118+0000 7fc95b400640 1 -- 172.21.15.82:0/2753001089 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97404e030 con 0x55aeeb771c20 2024-04-26T20:27:49.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.118+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96c0b6060 con 0x55aeeb771c20 2024-04-26T20:27:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.118+0000 7fc21ec37740 1 -- 172.21.15.82:0/4141903499 wait complete. 2024-04-26T20:27:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.119+0000 7fc21ec37740 1 -- start start 2024-04-26T20:27:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.119+0000 7fc21ec37740 1 Processor -- start 2024-04-26T20:27:49.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 0x55bdf14eb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bcfc0 0x55bdf14eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14ec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15fc70 con 0x55bdf14c2130 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15f4e0 con 0x55bdf14bcfc0 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15c720 con 0x55bdf14bc5d0 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.137+0000 7fc21ec37740 10 client.0 _ll_register_callbacks cb 0x7fc21406dea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:49.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.138+0000 7fc219400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 0x55bdf14eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.138+0000 7fc219400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 0x55bdf14eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:50950/0 (socket says 172.21.15.82:50950) 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.138+0000 7fc219400640 1 -- 172.21.15.82:0/3282537534 learned_addr learned my addr 172.21.15.82:0/3282537534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.140+0000 7fc218a00640 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bcfc0 0x55bdf14eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.140+0000 7fc219400640 1 -- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bcfc0 msgr2=0x55bdf14eb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.140+0000 7fc219400640 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bcfc0 0x55bdf14eb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.140+0000 7fc219400640 1 -- 172.21.15.82:0/3282537534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 msgr2=0x55bdf14ec740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.140+0000 7fc219400640 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.140+0000 7fc219400640 1 -- 172.21.15.82:0/3282537534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdf13d2cb0 con 0x55bdf14bc5d0 2024-04-26T20:27:49.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.143+0000 7fc219400640 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 0x55bdf14eb260 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc20800d960 tx=0x7fc2080047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfaffb7d16930ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:49.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.142+0000 7fc95b400640 1 -- 172.21.15.82:0/2753001089 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc97404a480 con 0x55aeeb771c20 2024-04-26T20:27:49.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.142+0000 7fc95b400640 1 -- 172.21.15.82:0/2753001089 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc97405b050 con 0x55aeeb771c20 2024-04-26T20:27:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.159+0000 7fc1faa00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:27:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.159+0000 7fc1faa00640 1 -- 172.21.15.82:0/3282537534 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208006310 con 0x55bdf14bc5d0 2024-04-26T20:27:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.159+0000 7fc1faa00640 1 -- 172.21.15.82:0/3282537534 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc2080064b0 con 0x55bdf14bc5d0 2024-04-26T20:27:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.168+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2000328f0 con 0x55bdf14bc5d0 2024-04-26T20:27:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.169+0000 7fc1faa00640 1 -- 172.21.15.82:0/3282537534 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc2080066b0 con 0x55bdf14bc5d0 2024-04-26T20:27:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.169+0000 7fc21ec37740 10 client.26770 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.169+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bdf14edeb0 con 0x55bdf14bc5d0 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc1faa00640 1 -- 172.21.15.82:0/3282537534 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2000328f0 con 0x55bdf14bc5d0 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc1faa00640 1 -- 172.21.15.82:0/3282537534 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fc208013070 con 0x55bdf14bc5d0 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc21ec37740 10 client.26770 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc21ec37740 10 client.26770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc21ec37740 20 client.26770 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc21ec37740 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf1540b90 0x55bdf1542fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc21ec37740 4 client.26770 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:27:49.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.172+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bdf141fe00 con 0x55bdf1540b90 2024-04-26T20:27:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.173+0000 7fc218a00640 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf1540b90 0x55bdf1542fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.174+0000 7fc9839a6740 10 client.26767 fetch_fsmap learned FSMap version 36 2024-04-26T20:27:49.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.174+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55aeeb77d520 con 0x55aeeb771c20 2024-04-26T20:27:49.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:48 smithi082 ceph-mon[28105]: pgmap v562: 129 pgs: 129 active+clean; 704 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.5 MiB/s wr, 430 op/s 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.185+0000 7fc95b400640 1 -- 172.21.15.82:0/2753001089 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96c0b6060 con 0x55aeeb771c20 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.185+0000 7fc95b400640 1 -- 172.21.15.82:0/2753001089 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 36) ==== 8378+0+0 (secure 0 0 0) 0x7fc974047050 con 0x55aeeb771c20 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc9839a6740 10 client.26767 fetch_fsmap finished waiting for FSMap version 36 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc9839a6740 10 client.26767 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc9839a6740 20 client.26767 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc9839a6740 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb7e8590 0x55aeeb7ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc9839a6740 4 client.26767 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aeeb6d76f0 con 0x55aeeb7e8590 2024-04-26T20:27:49.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.188+0000 7fc979e00640 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb7e8590 0x55aeeb7ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.194+0000 7fc218a00640 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf1540b90 0x55bdf1542fb0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7676ae45797db259 server_cookie=f16194b0b54f1640 in_seq=0 out_seq=0 2024-04-26T20:27:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:49.199+0000 7fc1faa00640 10 client.26770 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:49.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.210+0000 7fc979e00640 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb7e8590 0x55aeeb7ea9b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d63e908df22c077 server_cookie=7239f3ecac944546 in_seq=0 out_seq=0 2024-04-26T20:27:49.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.227+0000 7fc95b400640 10 client.26767 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:27:49.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.227+0000 7fc95b400640 1 -- 172.21.15.82:0/2753001089 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aeeb6d76f0 con 0x55aeeb7e8590 2024-04-26T20:27:49.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.227+0000 7fc95b400640 10 client.26767 handle_command_reply: tid=0 2024-04-26T20:27:49.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.231+0000 7fc9839a6740 1 client.26767 shutdown 2024-04-26T20:27:49.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.294+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 msgr2=0x55aeeb77bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:49.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.294+0000 7fc9839a6740 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77bd10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc974009be0 tx=0x7fc974009500 comp rx=0 tx=0).stop 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 shutdown_connections 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc9839a6740 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55aeeb7e8590 0x55aeeb7ea9b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc9839a6740 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aeeb771c20 0x55aeeb77bd10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc9839a6740 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aeeb76cab0 0x55aeeb77ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc9839a6740 1 --2- 172.21.15.82:0/2753001089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeeb76c0c0 0x55aeeb77a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 >> 172.21.15.82:0/2753001089 conn(0x55aeeb767730 msgr2=0x55aeeb76a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.306+0000 7fc95b400640 0 client.26767 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:27:49.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:48 smithi139 ceph-mon[32999]: pgmap v562: 129 pgs: 129 active+clean; 704 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.5 MiB/s wr, 430 op/s 2024-04-26T20:27:49.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.324+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 shutdown_connections 2024-04-26T20:27:49.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.325+0000 7fc9839a6740 1 -- 172.21.15.82:0/2753001089 wait complete. 2024-04-26T20:27:49.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.362+0000 7fc9839a6740 20 client.26767 trim_cache size 0 max 16384 2024-04-26T20:27:49.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:48 smithi135 ceph-mon[32816]: pgmap v562: 129 pgs: 129 active+clean; 704 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.5 MiB/s wr, 430 op/s 2024-04-26T20:27:49.434 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:27:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.468+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9600a3e40 msgr2=0x7fc9600a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.468+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9600a3e40 0x7fc9600a6300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc9740099a0 tx=0x7fc974005fd0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.468+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 msgr2=0x7fc97c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.468+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c19efb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00b4a0 tx=0x7fc96c00b960 comp rx=0 tx=0).stop 2024-04-26T20:27:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.538+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 shutdown_connections 2024-04-26T20:27:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.538+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9600a3e40 0x7fc9600a6300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.538+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c10a8d0 0x7fc97c1a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.538+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc97c109f10 0x7fc97c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.538+0000 7fc97b200640 1 --2- 172.21.15.82:0/1359625348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc97c073c10 0x7fc97c19efb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.538+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 >> 172.21.15.82:0/1359625348 conn(0x7fc97c06f780 msgr2=0x7fc97c10d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:49.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.542+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 shutdown_connections 2024-04-26T20:27:49.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:49.544+0000 7fc97b200640 1 -- 172.21.15.82:0/1359625348 wait complete. 2024-04-26T20:27:50.108 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:27:51.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:50 smithi082 ceph-mon[28105]: pgmap v563: 129 pgs: 129 active+clean; 719 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.6 MiB/s wr, 499 op/s 2024-04-26T20:27:51.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:50 smithi139 ceph-mon[32999]: pgmap v563: 129 pgs: 129 active+clean; 719 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.6 MiB/s wr, 499 op/s 2024-04-26T20:27:51.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:50 smithi135 ceph-mon[32816]: pgmap v563: 129 pgs: 129 active+clean; 719 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.6 MiB/s wr, 499 op/s 2024-04-26T20:27:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.654+0000 7fc1faa00640 1 -- 172.21.15.82:0/3282537534 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bdf141fe00 con 0x55bdf1540b90 2024-04-26T20:27:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.654+0000 7fc1faa00640 10 client.26770 handle_command_reply: tid=0 2024-04-26T20:27:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.659+0000 7fc21ec37740 1 client.26770 shutdown 2024-04-26T20:27:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 msgr2=0x55bdf14eb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 0x55bdf14eb260 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc20800d960 tx=0x7fc2080047d0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 shutdown_connections 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55bdf1540b90 0x55bdf1542fb0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bdf14c2130 0x55bdf14ec740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf14bcfc0 0x55bdf14eb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 --2- 172.21.15.82:0/3282537534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bdf14bc5d0 0x55bdf14eb260 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.681+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 >> 172.21.15.82:0/3282537534 conn(0x55bdf14af430 msgr2=0x55bdf14be1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.682+0000 7fc1faa00640 0 client.26770 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.710+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 shutdown_connections 2024-04-26T20:27:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.710+0000 7fc21ec37740 1 -- 172.21.15.82:0/3282537534 wait complete. 2024-04-26T20:27:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.710+0000 7fc21ec37740 20 client.26770 trim_cache size 0 max 16384 2024-04-26T20:27:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:27:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:27:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:27:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:27:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.770+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc1fc0a3e40 msgr2=0x7fc1fc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.770+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc1fc0a3e40 0x7fc1fc0a6300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55bdf14bd820 tx=0x7fc208008040 comp rx=0 tx=0).stop 2024-04-26T20:27:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.770+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a5180 msgr2=0x7fc20c150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.770+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a5180 0x7fc20c150830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc200009780 tx=0x7fc200030780 comp rx=0 tx=0).stop 2024-04-26T20:27:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.776+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 shutdown_connections 2024-04-26T20:27:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.776+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc1fc0a3e40 0x7fc1fc0a6300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.776+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc20c0a6100 0x7fc20c1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.776+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc20c0a5180 0x7fc20c150830 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.776+0000 7fc21be00640 1 --2- 172.21.15.82:0/4020169276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c0a47c0 0x7fc20c1502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.776+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 >> 172.21.15.82:0/4020169276 conn(0x7fc20c0a0100 msgr2=0x7fc20c014240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.803+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 shutdown_connections 2024-04-26T20:27:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:27:53.827+0000 7fc21be00640 1 -- 172.21.15.82:0/4020169276 wait complete. 2024-04-26T20:27:54.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:53 smithi135 ceph-mon[32816]: pgmap v564: 129 pgs: 129 active+clean; 753 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 988 op/s 2024-04-26T20:27:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:53 smithi082 ceph-mon[28105]: pgmap v564: 129 pgs: 129 active+clean; 753 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 988 op/s 2024-04-26T20:27:54.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:53 smithi139 ceph-mon[32999]: pgmap v564: 129 pgs: 129 active+clean; 753 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 988 op/s 2024-04-26T20:27:55.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:55.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:54 smithi135 ceph-mon[32816]: pgmap v565: 129 pgs: 129 active+clean; 760 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-04-26T20:27:55.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:55.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:54 smithi082 ceph-mon[28105]: pgmap v565: 129 pgs: 129 active+clean; 760 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-04-26T20:27:55.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:54 smithi139 ceph-mon[32999]: pgmap v565: 129 pgs: 129 active+clean; 760 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-04-26T20:27:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.962+0000 7fe747c00640 1 -- 172.21.15.82:0/2203365952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 msgr2=0x7fe74010f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.962+0000 7fe747c00640 1 --2- 172.21.15.82:0/2203365952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 0x7fe74010f120 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe73801acb0 tx=0x7fe73803b920 comp rx=0 tx=0).stop 2024-04-26T20:27:55.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.975+0000 7fe747c00640 1 -- 172.21.15.82:0/2203365952 shutdown_connections 2024-04-26T20:27:55.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.975+0000 7fe747c00640 1 --2- 172.21.15.82:0/2203365952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 0x7fe74010f120 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:55.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.975+0000 7fe747c00640 1 --2- 172.21.15.82:0/2203365952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:55.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.975+0000 7fe747c00640 1 --2- 172.21.15.82:0/2203365952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe740109930 0x7fe74010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:55.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:55.975+0000 7fe747c00640 1 -- 172.21.15.82:0/2203365952 >> 172.21.15.82:0/2203365952 conn(0x7fe74006f7c0 msgr2=0x7fe740071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:56.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.011+0000 7fe747c00640 1 -- 172.21.15.82:0/2203365952 shutdown_connections 2024-04-26T20:27:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.012+0000 7fe747c00640 1 -- 172.21.15.82:0/2203365952 wait complete. 2024-04-26T20:27:56.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.013+0000 7fe747c00640 1 Processor -- start 2024-04-26T20:27:56.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 -- start start 2024-04-26T20:27:56.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe740109930 0x7fe74019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 0x7fe7401a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe740112aa0 con 0x7fe74010ec70 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe740112920 con 0x7fe740109930 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.041+0000 7fe747c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe740112c20 con 0x7fe74010c2a0 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.042+0000 7fe73fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.042+0000 7fe73fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74019f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34036/0 (socket says 172.21.15.82:34036) 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.042+0000 7fe73fe00640 1 -- 172.21.15.82:0/3357194414 learned_addr learned my addr 172.21.15.82:0/3357194414 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.042+0000 7fe745c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 0x7fe7401a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.043+0000 7fe73fe00640 1 -- 172.21.15.82:0/3357194414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe740109930 msgr2=0x7fe74019f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.043+0000 7fe73fe00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe740109930 0x7fe74019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.043+0000 7fe73fe00640 1 -- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 msgr2=0x7fe7401a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.043+0000 7fe73fe00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 0x7fe7401a6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.043+0000 7fe73fe00640 1 -- 172.21.15.82:0/3357194414 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7401a6d90 con 0x7fe74010c2a0 2024-04-26T20:27:56.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.047+0000 7fe73fe00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74019f6b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00d770 tx=0x7fe72c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:56.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.071+0000 7fe73d600640 1 -- 172.21.15.82:0/3357194414 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c017070 con 0x7fe74010c2a0 2024-04-26T20:27:56.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.071+0000 7fe73d600640 1 -- 172.21.15.82:0/3357194414 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe72c009c30 con 0x7fe74010c2a0 2024-04-26T20:27:56.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.071+0000 7fe73d600640 1 -- 172.21.15.82:0/3357194414 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c003cc0 con 0x7fe74010c2a0 2024-04-26T20:27:56.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.081+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7401a7080 con 0x7fe74010c2a0 2024-04-26T20:27:56.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.081+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7401a7550 con 0x7fe74010c2a0 2024-04-26T20:27:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.136+0000 7fe74a9f8740 1 Processor -- start 2024-04-26T20:27:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.162+0000 7fe74a9f8740 1 -- start start 2024-04-26T20:27:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bc42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 0x562d76bc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bcbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562d76b27c70 con 0x562d76bc3ea0 2024-04-26T20:27:56.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562d76ae0980 con 0x562d76bc9a00 2024-04-26T20:27:56.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d76b23c30 con 0x562d76bc4890 2024-04-26T20:27:56.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe745200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 0x562d76bc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe745200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 0x562d76bc9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34040/0 (socket says 172.21.15.82:34040) 2024-04-26T20:27:56.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.163+0000 7fe745200640 1 -- 172.21.15.82:0/2035249924 learned_addr learned my addr 172.21.15.82:0/2035249924 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:56.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.172+0000 7fe745200640 1 -- 172.21.15.82:0/2035249924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 msgr2=0x562d76bcbe90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:56.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.172+0000 7fe745200640 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bcbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.172+0000 7fe745200640 1 -- 172.21.15.82:0/2035249924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 msgr2=0x562d76bc42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:56.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.172+0000 7fe745200640 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bc42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.172+0000 7fe745200640 1 -- 172.21.15.82:0/2035249924 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d76ab87b0 con 0x562d76bc4890 2024-04-26T20:27:56.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.175+0000 7fe745200640 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 0x562d76bc9390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe73000a9f0 tx=0x7fe73000aeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14ee69100ce9229 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:56.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.176+0000 7fe73d600640 1 -- 172.21.15.82:0/3357194414 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe72c003e60 con 0x7fe74010c2a0 2024-04-26T20:27:56.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.186+0000 7fe736000640 1 -- 172.21.15.82:0/2035249924 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73000cde0 con 0x562d76bc4890 2024-04-26T20:27:56.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.186+0000 7fe736000640 1 -- 172.21.15.82:0/2035249924 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe73000f900 con 0x562d76bc4890 2024-04-26T20:27:56.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.186+0000 7fe736000640 1 -- 172.21.15.82:0/2035249924 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300188b0 con 0x562d76bc4890 2024-04-26T20:27:56.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.195+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2035249924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 msgr2=0x562d76bc9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.195+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 0x562d76bc9390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe73000a9f0 tx=0x7fe73000aeb0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.220+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2035249924 shutdown_connections 2024-04-26T20:27:56.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.220+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bcbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.220+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc4890 0x562d76bc9390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.220+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2035249924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bc42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.220+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2035249924 >> 172.21.15.82:0/2035249924 conn(0x562d76bbf510 msgr2=0x562d76bbf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.221+0000 7fe73d600640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7240a3e40 0x7fe7240a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.222+0000 7fe73d600640 1 -- 172.21.15.82:0/3357194414 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe72c0d0220 con 0x7fe74010c2a0 2024-04-26T20:27:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.222+0000 7fe745200640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7240a3e40 0x7fe7240a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.224+0000 7fe745200640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7240a3e40 0x7fe7240a6300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe73000a560 tx=0x7fe7300046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:56.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.234+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2035249924 shutdown_connections 2024-04-26T20:27:56.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.238+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2035249924 wait complete. 2024-04-26T20:27:56.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.238+0000 7fe74a9f8740 1 -- start start 2024-04-26T20:27:56.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.239+0000 7fe74a9f8740 1 Processor -- start 2024-04-26T20:27:56.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bcdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 0x562d76bce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562d76b26f80 con 0x562d76bc4890 2024-04-26T20:27:56.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562d76ad4260 con 0x562d76bc9a00 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d76b2c2a0 con 0x562d76bc3ea0 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.254+0000 7fe74a9f8740 10 client.0 _ll_register_callbacks cb 0x562d76b1e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.255+0000 7fe73fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 0x562d76bce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.255+0000 7fe73fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 0x562d76bce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53256/0 (socket says 172.21.15.82:53256) 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.255+0000 7fe73fe00640 1 -- 172.21.15.82:0/2416208999 learned_addr learned my addr 172.21.15.82:0/2416208999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.256+0000 7fe73fe00640 1 -- 172.21.15.82:0/2416208999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 msgr2=0x562d76bcdda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.256+0000 7fe73fe00640 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bcdda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.256+0000 7fe73fe00640 1 -- 172.21.15.82:0/2416208999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 msgr2=0x562d76bd5320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.256+0000 7fe73fe00640 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.256+0000 7fe73fe00640 1 -- 172.21.15.82:0/2416208999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d76ab61c0 con 0x562d76bc4890 2024-04-26T20:27:56.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.256+0000 7fe73fe00640 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 0x562d76bce2e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c098a30 tx=0x7fe72c09ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eabb25939e5bb7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:56.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.277+0000 7fe72aa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:56.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.277+0000 7fe72aa00640 1 -- 172.21.15.82:0/2416208999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b5060 con 0x562d76bc4890 2024-04-26T20:27:56.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.277+0000 7fe72aa00640 1 -- 172.21.15.82:0/2416208999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe72c004150 con 0x562d76bc4890 2024-04-26T20:27:56.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.281+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe73000f900 con 0x562d76bc4890 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.290+0000 7fe72aa00640 1 -- 172.21.15.82:0/2416208999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe72c0ba050 con 0x562d76bc4890 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.294+0000 7fe74a9f8740 10 client.16653 fetch_fsmap learned FSMap version 37 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.294+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562d768393f0 con 0x562d76bc4890 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe72aa00640 1 -- 172.21.15.82:0/2416208999 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe73000f900 con 0x562d76bc4890 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe72aa00640 1 -- 172.21.15.82:0/2416208999 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fe72c0cda60 con 0x562d76bc4890 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe74a9f8740 10 client.16653 fetch_fsmap finished waiting for FSMap version 37 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe74a9f8740 10 client.16653 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe74a9f8740 20 client.16653 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76bd98f0 0x562d76bdbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe74a9f8740 4 client.16653 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.295+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d76b35880 con 0x562d76bd98f0 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.296+0000 7fe745200640 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76bd98f0 0x562d76bdbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.297+0000 7fe745200640 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76bd98f0 0x562d76bdbd90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2ea28f912a75660c server_cookie=17e944c0479cbb53 in_seq=0 out_seq=0 2024-04-26T20:27:56.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.298+0000 7fe72aa00640 10 client.16653 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:27:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe72aa00640 1 -- 172.21.15.82:0/2416208999 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d76b35880 con 0x562d76bd98f0 2024-04-26T20:27:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe72aa00640 10 client.16653 handle_command_reply: tid=0 2024-04-26T20:27:56.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 client.16653 shutdown 2024-04-26T20:27:56.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 msgr2=0x562d76bce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 0x562d76bce2e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c098a30 tx=0x7fe72c09ba80 comp rx=0 tx=0).stop 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 shutdown_connections 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76bd98f0 0x562d76bdbd90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc4890 0x562d76bce2e0 secure :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c098a30 tx=0x7fe72c09ba80 comp rx=0 tx=0).stop 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.314+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2416208999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bcdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.315+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 >> 172.21.15.82:0/2416208999 conn(0x562d76bbf510 msgr2=0x562d76bbe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:56.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.315+0000 7fe72aa00640 0 client.16653 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:27:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.330+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 shutdown_connections 2024-04-26T20:27:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.358+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2416208999 wait complete. 2024-04-26T20:27:56.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.384+0000 7fe74a9f8740 20 client.16653 trim_cache size 0 max 16384 2024-04-26T20:27:56.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.596+0000 7fe74a9f8740 1 Processor -- start 2024-04-26T20:27:56.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.597+0000 7fe74a9f8740 1 -- start start 2024-04-26T20:27:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.605+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bdb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.605+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc9a00 0x562d76bd52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.605+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc2b30 0x562d76bc5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.605+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7401b1b70 con 0x562d76bc3ea0 2024-04-26T20:27:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.605+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7401b37a0 con 0x562d76bc2b30 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.605+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe7401b2240 con 0x562d76bc9a00 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.606+0000 7fe745c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc2b30 0x562d76bc5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.606+0000 7fe745c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc2b30 0x562d76bc5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39548/0 (socket says 172.21.15.82:39548) 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.606+0000 7fe745c00640 1 -- 172.21.15.82:0/3487256810 learned_addr learned my addr 172.21.15.82:0/3487256810 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.607+0000 7fe745200640 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bdb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.607+0000 7fe745200640 1 -- 172.21.15.82:0/3487256810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc9a00 msgr2=0x562d76bd52e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.607+0000 7fe745200640 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc9a00 0x562d76bd52e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.607+0000 7fe745200640 1 -- 172.21.15.82:0/3487256810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc2b30 msgr2=0x562d76bc5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.607+0000 7fe745200640 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc2b30 0x562d76bc5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.607+0000 7fe745200640 1 -- 172.21.15.82:0/3487256810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d769037d0 con 0x562d76bc3ea0 2024-04-26T20:27:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.608+0000 7fe745200640 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bdb900 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x562d76bc03e0 tx=0x7fe73001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15993fca29f167d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.629+0000 7fe735600640 1 -- 172.21.15.82:0/3487256810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73000fde0 con 0x562d76bc3ea0 2024-04-26T20:27:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.629+0000 7fe735600640 1 -- 172.21.15.82:0/3487256810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe730035020 con 0x562d76bc3ea0 2024-04-26T20:27:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.629+0000 7fe735600640 1 -- 172.21.15.82:0/3487256810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730031440 con 0x562d76bc3ea0 2024-04-26T20:27:56.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.672+0000 7fe74a9f8740 1 -- 172.21.15.82:0/3487256810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 msgr2=0x562d76bdb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.672+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bdb900 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x562d76bc03e0 tx=0x7fe73001e000 comp rx=0 tx=0).stop 2024-04-26T20:27:56.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.709+0000 7fe74a9f8740 1 -- 172.21.15.82:0/3487256810 shutdown_connections 2024-04-26T20:27:56.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.709+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc2b30 0x562d76bc5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.709+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc9a00 0x562d76bd52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.709+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/3487256810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc3ea0 0x562d76bdb900 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.709+0000 7fe74a9f8740 1 -- 172.21.15.82:0/3487256810 >> 172.21.15.82:0/3487256810 conn(0x562d76bbf510 msgr2=0x562d76bc2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.753+0000 7fe74a9f8740 1 -- 172.21.15.82:0/3487256810 shutdown_connections 2024-04-26T20:27:56.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.761+0000 7fe74a9f8740 1 -- 172.21.15.82:0/3487256810 wait complete. 2024-04-26T20:27:56.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.761+0000 7fe74a9f8740 1 -- start start 2024-04-26T20:27:56.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.761+0000 7fe74a9f8740 1 Processor -- start 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc2b30 0x562d76bd28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bd2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7401b30a0 con 0x562d76bc2b30 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7401b2910 con 0x562d76bc9a00 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe7401afb50 con 0x562d76bc3ea0 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.784+0000 7fe74a9f8740 10 client.0 _ll_register_callbacks cb 0x7fe72c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.788+0000 7fe73fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bd2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.788+0000 7fe73fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bd2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34042/0 (socket says 172.21.15.82:34042) 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.788+0000 7fe73fe00640 1 -- 172.21.15.82:0/2641529019 learned_addr learned my addr 172.21.15.82:0/2641529019 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.788+0000 7fe745c00640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.790+0000 7fe745200640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc2b30 0x562d76bd28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.791+0000 7fe745200640 1 -- 172.21.15.82:0/2641529019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 msgr2=0x562d76bd2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.791+0000 7fe745200640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bd2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.791+0000 7fe745200640 1 -- 172.21.15.82:0/2641529019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 msgr2=0x562d76bd3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.791+0000 7fe745200640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.791+0000 7fe745200640 1 -- 172.21.15.82:0/2641529019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d76ace2a0 con 0x562d76bc2b30 2024-04-26T20:27:56.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.792+0000 7fe745200640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc2b30 0x562d76bd28e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x562d76bc93f0 tx=0x7fe73000ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d789629f9b318e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:56.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.793+0000 7fe72aa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:56.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.793+0000 7fe72aa00640 1 -- 172.21.15.82:0/2641529019 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300188b0 con 0x562d76bc2b30 2024-04-26T20:27:56.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.793+0000 7fe72aa00640 1 -- 172.21.15.82:0/2641529019 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe730018a50 con 0x562d76bc2b30 2024-04-26T20:27:56.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.793+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe730035020 con 0x562d76bc2b30 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.794+0000 7fe72aa00640 1 -- 172.21.15.82:0/2641529019 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe730018c50 con 0x562d76bc2b30 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.794+0000 7fe74a9f8740 10 client.16659 fetch_fsmap learned FSMap version 37 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.794+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562d76bd5440 con 0x562d76bc2b30 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.795+0000 7fe72aa00640 1 -- 172.21.15.82:0/2641529019 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe730035020 con 0x562d76bc2b30 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.796+0000 7fe72aa00640 1 -- 172.21.15.82:0/2641529019 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fe730005020 con 0x562d76bc2b30 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe74a9f8740 10 client.16659 fetch_fsmap finished waiting for FSMap version 37 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe74a9f8740 10 client.16659 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe74a9f8740 20 client.16659 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76c40430 0x562d76c42850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe74a9f8740 4 client.16659 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d76b2f6f0 con 0x562d76c40430 2024-04-26T20:27:56.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.797+0000 7fe73fe00640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76c40430 0x562d76c42850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:56.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.798+0000 7fe73fe00640 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76c40430 0x562d76c42850 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30e16eeffcef96d0 server_cookie=d6f536ed9e00d622 in_seq=0 out_seq=0 2024-04-26T20:27:56.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.800+0000 7fe72aa00640 10 client.16659 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:27:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.808+0000 7fe72aa00640 1 -- 172.21.15.82:0/2641529019 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d76b2f6f0 con 0x562d76c40430 2024-04-26T20:27:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.808+0000 7fe72aa00640 10 client.16659 handle_command_reply: tid=0 2024-04-26T20:27:56.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.811+0000 7fe74a9f8740 1 client.16659 shutdown 2024-04-26T20:27:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc2b30 msgr2=0x562d76bd28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc2b30 0x562d76bd28e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x562d76bc93f0 tx=0x7fe73000ff20 comp rx=0 tx=0).stop 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 shutdown_connections 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x562d76c40430 0x562d76c42850 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d76bc9a00 0x562d76bd3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d76bc3ea0 0x562d76bd2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 --2- 172.21.15.82:0/2641529019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d76bc2b30 0x562d76bd28e0 secure :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0x562d76bc93f0 tx=0x7fe73000ff20 comp rx=0 tx=0).stop 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 >> 172.21.15.82:0/2641529019 conn(0x562d76bbf510 msgr2=0x562d76bbde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.820+0000 7fe72aa00640 0 client.16659 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:27:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.822+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 shutdown_connections 2024-04-26T20:27:56.838 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:27:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.828+0000 7fe74a9f8740 1 -- 172.21.15.82:0/2641529019 wait complete. 2024-04-26T20:27:56.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.836+0000 7fe74a9f8740 20 client.16659 trim_cache size 0 max 16384 2024-04-26T20:27:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7240a3e40 msgr2=0x7fe7240a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7240a3e40 0x7fe7240a6300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe73000a560 tx=0x7fe7300046c0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 msgr2=0x7fe74019f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74019f6b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00d770 tx=0x7fe72c00dc30 comp rx=0 tx=0).stop 2024-04-26T20:27:56.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 shutdown_connections 2024-04-26T20:27:56.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe7240a3e40 0x7fe7240a6300 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe73000a560 tx=0x7fe7300046c0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe74010ec70 0x7fe7401a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe74010c2a0 0x7fe74019f6b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 --2- 172.21.15.82:0/3357194414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe740109930 0x7fe74019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.887+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 >> 172.21.15.82:0/3357194414 conn(0x7fe74006f7c0 msgr2=0x7fe74010cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:56.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.892+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 shutdown_connections 2024-04-26T20:27:56.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:56.893+0000 7fe747c00640 1 -- 172.21.15.82:0/3357194414 wait complete. 2024-04-26T20:27:57.080 INFO:tasks.workunit.client.0.smithi082.stdout: 213 466680 707 313225 851 138773 1195 2024-04-26T20:27:57.114 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:27:57.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:57 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:57.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:57 smithi082 ceph-mon[28105]: pgmap v566: 129 pgs: 129 active+clean; 747 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.5 MiB/s wr, 1.21k op/s 2024-04-26T20:27:57.570 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:57 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:57.570 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:57 smithi139 ceph-mon[32999]: pgmap v566: 129 pgs: 129 active+clean; 747 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.5 MiB/s wr, 1.21k op/s 2024-04-26T20:27:57.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:57 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:27:57.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:57 smithi135 ceph-mon[32816]: pgmap v566: 129 pgs: 129 active+clean; 747 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.5 MiB/s wr, 1.21k op/s 2024-04-26T20:27:58.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.896+0000 7fa40c600640 1 -- 172.21.15.82:0/3372509397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 msgr2=0x7fa40410bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:58.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.898+0000 7fa40c600640 1 --2- 172.21.15.82:0/3372509397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40410bd60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009860 tx=0x7fa3f802a380 comp rx=0 tx=0).stop 2024-04-26T20:27:58.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.900+0000 7fa40c600640 1 -- 172.21.15.82:0/3372509397 shutdown_connections 2024-04-26T20:27:58.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.900+0000 7fa40c600640 1 --2- 172.21.15.82:0/3372509397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40410ec70 0x7fa40410f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.900+0000 7fa40c600640 1 --2- 172.21.15.82:0/3372509397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410c2a0 0x7fa40410e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.900+0000 7fa40c600640 1 --2- 172.21.15.82:0/3372509397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40410bd60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.900+0000 7fa40c600640 1 -- 172.21.15.82:0/3372509397 >> 172.21.15.82:0/3372509397 conn(0x7fa40406f7c0 msgr2=0x7fa404071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:58.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.900+0000 7fa40c600640 1 -- 172.21.15.82:0/3372509397 shutdown_connections 2024-04-26T20:27:58.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.901+0000 7fa40c600640 1 -- 172.21.15.82:0/3372509397 wait complete. 2024-04-26T20:27:58.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.910+0000 7fa40c600640 1 Processor -- start 2024-04-26T20:27:58.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.910+0000 7fa40c600640 1 -- start start 2024-04-26T20:27:58.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.914+0000 7fa40c600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.922+0000 7fa409c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa409c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40419f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53296/0 (socket says 172.21.15.82:53296) 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa409c00640 1 -- 172.21.15.82:0/3180680227 learned_addr learned my addr 172.21.15.82:0/3180680227 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40410c2a0 0x7fa40419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410ec70 0x7fa4041a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa404112af0 con 0x7fa404109930 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa404112970 con 0x7fa40410c2a0 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa404112c70 con 0x7fa40410ec70 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.923+0000 7fa409200640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40410c2a0 0x7fa40419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.924+0000 7fa40a600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410ec70 0x7fa4041a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.925+0000 7fa40a600640 1 -- 172.21.15.82:0/3180680227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40410c2a0 msgr2=0x7fa40419f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.925+0000 7fa40a600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40410c2a0 0x7fa40419f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.925+0000 7fa40a600640 1 -- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 msgr2=0x7fa40419f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.925+0000 7fa40a600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40419f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.925+0000 7fa40a600640 1 -- 172.21.15.82:0/3180680227 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4041a6c80 con 0x7fa40410ec70 2024-04-26T20:27:58.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.926+0000 7fa409c00640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:27:58.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.927+0000 7fa40a600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410ec70 0x7fa4041a6610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00ca00 tx=0x7fa3fc00ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:58.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.947+0000 7fa402000640 1 -- 172.21.15.82:0/3180680227 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc004d20 con 0x7fa40410ec70 2024-04-26T20:27:58.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.947+0000 7fa402000640 1 -- 172.21.15.82:0/3180680227 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3fc005020 con 0x7fa40410ec70 2024-04-26T20:27:58.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.947+0000 7fa402000640 1 -- 172.21.15.82:0/3180680227 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0316a0 con 0x7fa40410ec70 2024-04-26T20:27:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.971+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa404074bc0 con 0x7fa40410ec70 2024-04-26T20:27:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.971+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa404075090 con 0x7fa40410ec70 2024-04-26T20:27:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.983+0000 7fa40f430740 1 Processor -- start 2024-04-26T20:27:58.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.984+0000 7fa402000640 1 -- 172.21.15.82:0/3180680227 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa3fc007ad0 con 0x7fa40410ec70 2024-04-26T20:27:58.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.986+0000 7fa402000640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3ec0a3dc0 0x7fa3ec0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.987+0000 7fa409200640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3ec0a3dc0 0x7fa3ec0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:58.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.988+0000 7fa409200640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3ec0a3dc0 0x7fa3ec0a6280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4041a0570 tx=0x7fa3f001a270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 -- start start 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 0x556c2ec8f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2ec94390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ec96e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c2ebf2c70 con 0x556c2ec8f890 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c2ebab980 con 0x556c2ec8eea0 2024-04-26T20:27:58.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.989+0000 7fa40f430740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556c2ebeec30 con 0x556c2ec94a00 2024-04-26T20:27:58.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.990+0000 7fa409200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2ec94390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.991+0000 7fa409200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2ec94390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53298/0 (socket says 172.21.15.82:53298) 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.991+0000 7fa409200640 1 -- 172.21.15.82:0/1568090454 learned_addr learned my addr 172.21.15.82:0/1568090454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.992+0000 7fa409200640 1 -- 172.21.15.82:0/1568090454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 msgr2=0x556c2ec96e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.992+0000 7fa409200640 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ec96e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.992+0000 7fa409200640 1 -- 172.21.15.82:0/1568090454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 msgr2=0x556c2ec8f2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.992+0000 7fa409200640 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 0x556c2ec8f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.992+0000 7fa409200640 1 -- 172.21.15.82:0/1568090454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2eb837b0 con 0x556c2ec8f890 2024-04-26T20:27:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.993+0000 7fa409200640 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2ec94390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa3f001a6a0 tx=0x7fa3f0025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be87785be5c2af38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.995+0000 7fa3f6a00640 1 -- 172.21.15.82:0/1568090454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0037630 con 0x556c2ec8f890 2024-04-26T20:27:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.996+0000 7fa3f6a00640 1 -- 172.21.15.82:0/1568090454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f002d8a0 con 0x556c2ec8f890 2024-04-26T20:27:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.996+0000 7fa3f6a00640 1 -- 172.21.15.82:0/1568090454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0037630 con 0x556c2ec8f890 2024-04-26T20:27:58.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:58.997+0000 7fa402000640 1 -- 172.21.15.82:0/3180680227 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa3fc0bccc0 con 0x7fa40410ec70 2024-04-26T20:27:59.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 -- 172.21.15.82:0/1568090454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 msgr2=0x556c2ec94390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:59.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2ec94390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa3f001a6a0 tx=0x7fa3f0025000 comp rx=0 tx=0).stop 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 -- 172.21.15.82:0/1568090454 shutdown_connections 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ec96e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2ec94390 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 --2- 172.21.15.82:0/1568090454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 0x556c2ec8f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 -- 172.21.15.82:0/1568090454 >> 172.21.15.82:0/1568090454 conn(0x556c2ec8a510 msgr2=0x556c2ec8a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 -- 172.21.15.82:0/1568090454 shutdown_connections 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.001+0000 7fa40f430740 1 -- 172.21.15.82:0/1568090454 wait complete. 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.002+0000 7fa40f430740 1 -- start start 2024-04-26T20:27:59.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.002+0000 7fa40f430740 1 Processor -- start 2024-04-26T20:27:59.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.005+0000 7fa40f430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec8eea0 0x556c2ec98dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.005+0000 7fa40f430740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec99300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.006+0000 7fa409c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec8eea0 0x556c2ec98dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.006+0000 7fa409c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec8eea0 0x556c2ec98dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:34076/0 (socket says 172.21.15.82:34076) 2024-04-26T20:27:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.006+0000 7fa409c00640 1 -- 172.21.15.82:0/3084621201 learned_addr learned my addr 172.21.15.82:0/3084621201 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.007+0000 7fa409200640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec99300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.007+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec94a00 0x556c2eca0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.008+0000 7fa40a600640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec94a00 0x556c2eca0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.009+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c2ebf1f80 con 0x556c2ec94a00 2024-04-26T20:27:59.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.009+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c2eb9f260 con 0x556c2ec8f890 2024-04-26T20:27:59.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.009+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556c2ebf72a0 con 0x556c2ec8eea0 2024-04-26T20:27:59.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.010+0000 7fa40f430740 10 client.0 _ll_register_callbacks cb 0x556c2ebe9960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:59.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.012+0000 7fa409200640 1 -- 172.21.15.82:0/3084621201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec8eea0 msgr2=0x556c2ec98dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:59.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.012+0000 7fa409200640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec8eea0 0x556c2ec98dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.012+0000 7fa409200640 1 -- 172.21.15.82:0/3084621201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec94a00 msgr2=0x556c2eca0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:59.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.017+0000 7fa409200640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec94a00 0x556c2eca0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.017+0000 7fa409200640 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2eb811c0 con 0x556c2ec8f890 2024-04-26T20:27:59.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.017+0000 7fa40a600640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec94a00 0x556c2eca0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:27:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.047+0000 7fa409200640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec99300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3f001aa00 tx=0x7fa3f002d500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=324fa155ca945bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:59.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.047+0000 7fa3eb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:27:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.063+0000 7fa3eb400640 1 -- 172.21.15.82:0/3084621201 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f003c040 con 0x556c2ec8f890 2024-04-26T20:27:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.063+0000 7fa3eb400640 1 -- 172.21.15.82:0/3084621201 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa3f0037430 con 0x556c2ec8f890 2024-04-26T20:27:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.064+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f002d8a0 con 0x556c2ec8f890 2024-04-26T20:27:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.065+0000 7fa3eb400640 1 -- 172.21.15.82:0/3084621201 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa3f0037630 con 0x556c2ec8f890 2024-04-26T20:27:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.065+0000 7fa40f430740 10 client.26738 fetch_fsmap learned FSMap version 37 2024-04-26T20:27:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.065+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556c2e9043f0 con 0x556c2ec8f890 2024-04-26T20:27:59.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.065+0000 7fa3eb400640 1 -- 172.21.15.82:0/3084621201 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0005040 con 0x556c2ec8f890 2024-04-26T20:27:59.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.066+0000 7fa3eb400640 1 -- 172.21.15.82:0/3084621201 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fa3f003f070 con 0x556c2ec8f890 2024-04-26T20:27:59.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.066+0000 7fa40f430740 10 client.26738 fetch_fsmap finished waiting for FSMap version 37 2024-04-26T20:27:59.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.066+0000 7fa40f430740 10 client.26738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:59.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.066+0000 7fa40f430740 20 client.26738 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:59.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.067+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2eca4550 0x556c2eca6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.067+0000 7fa40f430740 4 client.26738 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:27:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.067+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa3f002d8a0 con 0x556c2eca4550 2024-04-26T20:27:59.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.067+0000 7fa409c00640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2eca4550 0x556c2eca6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.068+0000 7fa409c00640 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2eca4550 0x556c2eca6940 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b550b9e238776a26 server_cookie=f01ee53fb8418b4b in_seq=0 out_seq=0 2024-04-26T20:27:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.068+0000 7fa3eb400640 10 client.26738 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.069+0000 7fa3eb400640 1 -- 172.21.15.82:0/3084621201 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7fa3f002d8a0 con 0x556c2eca4550 2024-04-26T20:27:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.070+0000 7fa3eb400640 10 client.26738 handle_command_reply: tid=0 2024-04-26T20:27:59.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.070+0000 7fa40f430740 1 client.26738 shutdown 2024-04-26T20:27:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.071+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 msgr2=0x556c2ec99300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:59.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.071+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec99300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3f001aa00 tx=0x7fa3f002d500 comp rx=0 tx=0).stop 2024-04-26T20:27:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 shutdown_connections 2024-04-26T20:27:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2eca4550 0x556c2eca6940 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec94a00 0x556c2eca0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec99300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 --2- 172.21.15.82:0/3084621201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec8eea0 0x556c2ec98dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 >> 172.21.15.82:0/3084621201 conn(0x556c2ec8a510 msgr2=0x556c2ec89690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa3eb400640 0 client.26738 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 shutdown_connections 2024-04-26T20:27:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.072+0000 7fa40f430740 1 -- 172.21.15.82:0/3084621201 wait complete. 2024-04-26T20:27:59.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.073+0000 7fa40f430740 20 client.26738 trim_cache size 0 max 16384 2024-04-26T20:27:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.156+0000 7fa40f430740 1 Processor -- start 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 -- start start 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 0x556c2ec89e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2eca0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ec8d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa40407f590 con 0x556c2ec8f890 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4040811c0 con 0x556c2ec8eea0 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.157+0000 7fa40f430740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa40407fc60 con 0x556c2ec94a00 2024-04-26T20:27:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2eca0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2eca0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53304/0 (socket says 172.21.15.82:53304) 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 -- 172.21.15.82:0/781622815 learned_addr learned my addr 172.21.15.82:0/781622815 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 -- 172.21.15.82:0/781622815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 msgr2=0x556c2ec8d3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ec8d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 -- 172.21.15.82:0/781622815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 msgr2=0x556c2ec89e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 0x556c2ec89e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.158+0000 7fa409200640 1 -- 172.21.15.82:0/781622815 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2e9ce7d0 con 0x556c2ec8f890 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.159+0000 7fa409200640 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2eca0300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0037b30 tx=0x7fa3f0037ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a8aa197bcde96b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.160+0000 7fa3f6000640 1 -- 172.21.15.82:0/781622815 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0051070 con 0x556c2ec8f890 2024-04-26T20:27:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.160+0000 7fa3f6000640 1 -- 172.21.15.82:0/781622815 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0037430 con 0x556c2ec8f890 2024-04-26T20:27:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.160+0000 7fa3f6000640 1 -- 172.21.15.82:0/781622815 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0004420 con 0x556c2ec8f890 2024-04-26T20:27:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.161+0000 7fa40f430740 1 -- 172.21.15.82:0/781622815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 msgr2=0x556c2eca0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.161+0000 7fa40f430740 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2eca0300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0037b30 tx=0x7fa3f0037ef0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 -- 172.21.15.82:0/781622815 shutdown_connections 2024-04-26T20:27:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ec8d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8f890 0x556c2eca0300 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 --2- 172.21.15.82:0/781622815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8eea0 0x556c2ec89e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 -- 172.21.15.82:0/781622815 >> 172.21.15.82:0/781622815 conn(0x556c2ec8a510 msgr2=0x556c2ec983b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:59.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 -- 172.21.15.82:0/781622815 shutdown_connections 2024-04-26T20:27:59.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.163+0000 7fa40f430740 1 -- 172.21.15.82:0/781622815 wait complete. 2024-04-26T20:27:59.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.167+0000 7fa40f430740 1 -- start start 2024-04-26T20:27:59.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.167+0000 7fa40f430740 1 Processor -- start 2024-04-26T20:27:59.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 0x556c2ec9d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec9d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ed08a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa404080ac0 con 0x556c2ec8eea0 2024-04-26T20:27:59.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa404080330 con 0x556c2ec8f890 2024-04-26T20:27:59.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa40407d580 con 0x556c2ec94a00 2024-04-26T20:27:59.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.168+0000 7fa40f430740 10 client.0 _ll_register_callbacks cb 0x7fa3f001aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:27:59.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.169+0000 7fa409c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 0x556c2ec9d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.169+0000 7fa409c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 0x556c2ec9d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53310/0 (socket says 172.21.15.82:53310) 2024-04-26T20:27:59.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.169+0000 7fa409c00640 1 -- 172.21.15.82:0/3594515256 learned_addr learned my addr 172.21.15.82:0/3594515256 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:27:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.170+0000 7fa40a600640 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ed08a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.170+0000 7fa409c00640 1 -- 172.21.15.82:0/3594515256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 msgr2=0x556c2ed08a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:27:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.170+0000 7fa409c00640 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ed08a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.170+0000 7fa409c00640 1 -- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 msgr2=0x556c2ec9d6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:27:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.170+0000 7fa409c00640 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec9d6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.170+0000 7fa409c00640 1 -- 172.21.15.82:0/3594515256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2eb992a0 con 0x556c2ec8eea0 2024-04-26T20:27:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.171+0000 7fa409c00640 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 0x556c2ec9d160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x556c2eca7140 tx=0x7fa3f80303b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e8baab84cd7529 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:27:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.172+0000 7fa3eb400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:27:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.172+0000 7fa3eb400640 1 -- 172.21.15.82:0/3594515256 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8045030 con 0x556c2ec8eea0 2024-04-26T20:27:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.172+0000 7fa3eb400640 1 -- 172.21.15.82:0/3594515256 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa3f8030890 con 0x556c2ec8eea0 2024-04-26T20:27:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.172+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f0037430 con 0x556c2ec8eea0 2024-04-26T20:27:59.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.174+0000 7fa3eb400640 1 -- 172.21.15.82:0/3594515256 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa3f8037040 con 0x556c2ec8eea0 2024-04-26T20:27:59.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.174+0000 7fa40f430740 10 client.16677 fetch_fsmap learned FSMap version 37 2024-04-26T20:27:59.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.174+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556c2ed0a020 con 0x556c2ec8eea0 2024-04-26T20:27:59.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.174+0000 7fa3eb400640 1 -- 172.21.15.82:0/3594515256 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0037430 con 0x556c2ec8eea0 2024-04-26T20:27:59.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.175+0000 7fa3eb400640 1 -- 172.21.15.82:0/3594515256 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fa3f80046c0 con 0x556c2ec8eea0 2024-04-26T20:27:59.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa40f430740 10 client.16677 fetch_fsmap finished waiting for FSMap version 37 2024-04-26T20:27:59.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa40f430740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:27:59.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa40f430740 20 client.16677 populate_metadata read hostname 'smithi082' 2024-04-26T20:27:59.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa40f430740 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2ed0a980 0x556c2ed0cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:27:59.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa40f430740 4 client.16677 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:27:59.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c2ec98bb0 con 0x556c2ed0a980 2024-04-26T20:27:59.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.179+0000 7fa409200640 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2ed0a980 0x556c2ed0cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:27:59.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.180+0000 7fa409200640 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2ed0a980 0x556c2ed0cda0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed8d10f9daa6f94 server_cookie=85fd6fd9eb813800 in_seq=0 out_seq=0 2024-04-26T20:27:59.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.180+0000 7fa3eb400640 10 client.16677 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:59.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.180+0000 7fa3eb400640 1 -- 172.21.15.82:0/3594515256 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c2ec98bb0 con 0x556c2ed0a980 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.180+0000 7fa3eb400640 10 client.16677 handle_command_reply: tid=0 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.180+0000 7fa40f430740 1 client.16677 shutdown 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 msgr2=0x556c2ec9d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 0x556c2ec9d160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x556c2eca7140 tx=0x7fa3f80303b0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 shutdown_connections 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556c2ed0a980 0x556c2ed0cda0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c2ec94a00 0x556c2ed08a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2ec8f890 0x556c2ec9d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 --2- 172.21.15.82:0/3594515256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c2ec8eea0 0x556c2ec9d160 secure :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0x556c2eca7140 tx=0x7fa3f80303b0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.181+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 >> 172.21.15.82:0/3594515256 conn(0x556c2ec8a510 msgr2=0x556c2ec8d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.182+0000 7fa3eb400640 0 client.16677 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.182+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 shutdown_connections 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.182+0000 7fa40f430740 1 -- 172.21.15.82:0/3594515256 wait complete. 2024-04-26T20:27:59.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.182+0000 7fa40f430740 20 client.16677 trim_cache size 0 max 16384 2024-04-26T20:27:59.183 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:27:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.207+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3ec0a3dc0 msgr2=0x7fa3ec0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.207+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3ec0a3dc0 0x7fa3ec0a6280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4041a0570 tx=0x7fa3f001a270 comp rx=0 tx=0).stop 2024-04-26T20:27:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.207+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410ec70 msgr2=0x7fa4041a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:27:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.207+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410ec70 0x7fa4041a6610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00ca00 tx=0x7fa3fc00ce00 comp rx=0 tx=0).stop 2024-04-26T20:27:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 shutdown_connections 2024-04-26T20:27:59.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3ec0a3dc0 0x7fa3ec0a6280 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa40410ec70 0x7fa4041a6610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40410c2a0 0x7fa40419f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 --2- 172.21.15.82:0/3180680227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa404109930 0x7fa40419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:27:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 >> 172.21.15.82:0/3180680227 conn(0x7fa40406f7c0 msgr2=0x7fa40410a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:27:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 shutdown_connections 2024-04-26T20:27:59.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:27:59.208+0000 7fa40c600640 1 -- 172.21.15.82:0/3180680227 wait complete. 2024-04-26T20:28:00.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:27:59 smithi135 ceph-mon[32816]: pgmap v567: 129 pgs: 129 active+clean; 745 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.4 MiB/s wr, 1.22k op/s 2024-04-26T20:28:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:27:59 smithi082 ceph-mon[28105]: pgmap v567: 129 pgs: 129 active+clean; 745 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.4 MiB/s wr, 1.22k op/s 2024-04-26T20:28:00.279 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-26T20:28:00.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:28:00.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-26T20:28:00.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:27:59 smithi139 ceph-mon[32999]: pgmap v567: 129 pgs: 129 active+clean; 745 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.4 MiB/s wr, 1.22k op/s 2024-04-26T20:28:02.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:01 smithi135 ceph-mon[32816]: pgmap v568: 129 pgs: 129 active+clean; 746 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 1.10k op/s 2024-04-26T20:28:02.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:01 smithi082 ceph-mon[28105]: pgmap v568: 129 pgs: 129 active+clean; 746 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 1.10k op/s 2024-04-26T20:28:02.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:01 smithi139 ceph-mon[32999]: pgmap v568: 129 pgs: 129 active+clean; 746 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 1.10k op/s 2024-04-26T20:28:03.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.045+0000 7f2e29600640 1 -- 172.21.15.82:0/3271952181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e24073d70 msgr2=0x7f2e24074190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:03.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.045+0000 7f2e29600640 1 --2- 172.21.15.82:0/3271952181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e24073d70 0x7f2e24074190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009900 tx=0x7f2e1002a440 comp rx=0 tx=0).stop 2024-04-26T20:28:03.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.057+0000 7f2e29600640 1 -- 172.21.15.82:0/3271952181 shutdown_connections 2024-04-26T20:28:03.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.059+0000 7f2e29600640 1 --2- 172.21.15.82:0/3271952181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2410a9b0 0x7f2e2410f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.059+0000 7f2e29600640 1 --2- 172.21.15.82:0/3271952181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 0x7f2e2410a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.059+0000 7f2e29600640 1 --2- 172.21.15.82:0/3271952181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e24073d70 0x7f2e24074190 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.059+0000 7f2e29600640 1 -- 172.21.15.82:0/3271952181 >> 172.21.15.82:0/3271952181 conn(0x7f2e2406f840 msgr2=0x7f2e24071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:03.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.067+0000 7f2e29600640 1 -- 172.21.15.82:0/3271952181 shutdown_connections 2024-04-26T20:28:03.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.070+0000 7f2e29600640 1 -- 172.21.15.82:0/3271952181 wait complete. 2024-04-26T20:28:03.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.099+0000 7f2e29600640 1 Processor -- start 2024-04-26T20:28:03.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.115+0000 7f2e29600640 1 -- start start 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.135+0000 7f2e29600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e24073d70 0x7f2e24116050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.135+0000 7f2e29600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 0x7f2e24116590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.141+0000 7f2e23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 0x7f2e24116590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.141+0000 7f2e23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 0x7f2e24116590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39838/0 (socket says 172.21.15.82:39838) 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.148+0000 7f2e29600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 0x7f2e241b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.148+0000 7f2e28c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 0x7f2e241b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.148+0000 7f2e28c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 0x7f2e241b7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51266/0 (socket says 172.21.15.82:51266) 2024-04-26T20:28:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.149+0000 7f2e29600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2411d1c0 con 0x7f2e24073d70 2024-04-26T20:28:03.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.149+0000 7f2e29600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2411d040 con 0x7f2e2410a010 2024-04-26T20:28:03.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.149+0000 7f2e29600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2411d340 con 0x7f2e2410a9b0 2024-04-26T20:28:03.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.149+0000 7f2e23400640 1 -- 172.21.15.82:0/3574337736 learned_addr learned my addr 172.21.15.82:0/3574337736 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.151+0000 7f2e23e00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e24073d70 0x7f2e24116050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.152+0000 7f2e23e00640 1 -- 172.21.15.82:0/3574337736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 msgr2=0x7f2e241b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.152+0000 7f2e23e00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 0x7f2e241b7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.152+0000 7f2e23e00640 1 -- 172.21.15.82:0/3574337736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 msgr2=0x7f2e24116590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.152+0000 7f2e23e00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 0x7f2e24116590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.152+0000 7f2e23e00640 1 -- 172.21.15.82:0/3574337736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e241b7dd0 con 0x7f2e24073d70 2024-04-26T20:28:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.156+0000 7f2e28c00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 0x7f2e241b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T20:28:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.158+0000 7f2e23e00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e24073d70 0x7f2e24116050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009850 tx=0x7f2e10004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.178+0000 7f2e20c00640 1 -- 172.21.15.82:0/3574337736 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10040030 con 0x7f2e24073d70 2024-04-26T20:28:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.178+0000 7f2e20c00640 1 -- 172.21.15.82:0/3574337736 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e100050f0 con 0x7f2e24073d70 2024-04-26T20:28:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.178+0000 7f2e20c00640 1 -- 172.21.15.82:0/3574337736 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1003c980 con 0x7f2e24073d70 2024-04-26T20:28:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:02 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:02 smithi082 ceph-mon[28105]: pgmap v569: 129 pgs: 129 active+clean; 750 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 1.03k op/s 2024-04-26T20:28:03.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.185+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e241b7fa0 con 0x7f2e24073d70 2024-04-26T20:28:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.185+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e241b8350 con 0x7f2e24073d70 2024-04-26T20:28:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.284+0000 7f2e2da0d740 1 Processor -- start 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 -- start start 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc631ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6321f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc6324a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562bc6281980 con 0x562bc631d460 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562bc621e220 con 0x562bc63225d0 2024-04-26T20:28:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.299+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562bc627d940 con 0x562bc631ca70 2024-04-26T20:28:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.303+0000 7f2e23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc6324a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.303+0000 7f2e28c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc631ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.303+0000 7f2e23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc6324a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39846/0 (socket says 172.21.15.82:39846) 2024-04-26T20:28:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.303+0000 7f2e23400640 1 -- 172.21.15.82:0/1807139748 learned_addr learned my addr 172.21.15.82:0/1807139748 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.303+0000 7f2e20c00640 1 -- 172.21.15.82:0/3574337736 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2e10043030 con 0x7f2e24073d70 2024-04-26T20:28:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.315+0000 7f2e23e00640 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6321f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.316+0000 7f2e23400640 1 -- 172.21.15.82:0/1807139748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 msgr2=0x562bc631ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:03.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.316+0000 7f2e23400640 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc631ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.316+0000 7f2e23400640 1 -- 172.21.15.82:0/1807139748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 msgr2=0x562bc6321f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:03.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.316+0000 7f2e23400640 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6321f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.316+0000 7f2e23400640 1 -- 172.21.15.82:0/1807139748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc605b7e0 con 0x562bc63225d0 2024-04-26T20:28:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.318+0000 7f2e23400640 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc6324a60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c010370 tx=0x7f2e1c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6304aa96064bf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:03.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:02 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:03.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:02 smithi139 ceph-mon[32999]: pgmap v569: 129 pgs: 129 active+clean; 750 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 1.03k op/s 2024-04-26T20:28:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.326+0000 7f2e20c00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2e080a3e40 0x7f2e080a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.326+0000 7f2e20c00640 1 -- 172.21.15.82:0/3574337736 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2e100f13c0 con 0x7f2e24073d70 2024-04-26T20:28:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.333+0000 7f2e19200640 1 -- 172.21.15.82:0/1807139748 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c016070 con 0x562bc63225d0 2024-04-26T20:28:03.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.333+0000 7f2e19200640 1 -- 172.21.15.82:0/1807139748 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e1c012bc0 con 0x562bc63225d0 2024-04-26T20:28:03.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.333+0000 7f2e19200640 1 -- 172.21.15.82:0/1807139748 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c011c70 con 0x562bc63225d0 2024-04-26T20:28:03.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.339+0000 7f2e28c00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2e080a3e40 0x7f2e080a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.345+0000 7f2e28c00640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2e080a3e40 0x7f2e080a6300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x562bc631dcc0 tx=0x7f2e1400b340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:03.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:02 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:03.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:02 smithi135 ceph-mon[32816]: pgmap v569: 129 pgs: 129 active+clean; 750 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 1.03k op/s 2024-04-26T20:28:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.366+0000 7f2e2da0d740 1 -- 172.21.15.82:0/1807139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 msgr2=0x562bc6324a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.366+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc6324a60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c010370 tx=0x7f2e1c010830 comp rx=0 tx=0).stop 2024-04-26T20:28:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.403+0000 7f2e2da0d740 1 -- 172.21.15.82:0/1807139748 shutdown_connections 2024-04-26T20:28:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.404+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc6324a60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.404+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6321f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.404+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/1807139748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc631ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.404+0000 7f2e2da0d740 1 -- 172.21.15.82:0/1807139748 >> 172.21.15.82:0/1807139748 conn(0x562bc63180e0 msgr2=0x562bc63184e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.457+0000 7f2e2da0d740 1 -- 172.21.15.82:0/1807139748 shutdown_connections 2024-04-26T20:28:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.457+0000 7f2e2da0d740 1 -- 172.21.15.82:0/1807139748 wait complete. 2024-04-26T20:28:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.457+0000 7f2e2da0d740 1 -- start start 2024-04-26T20:28:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.458+0000 7f2e2da0d740 1 Processor -- start 2024-04-26T20:28:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.458+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc6326f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.458+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6327470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.462+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.465+0000 7f2e23e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc6326f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.465+0000 7f2e23e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc6326f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51296/0 (socket says 172.21.15.82:51296) 2024-04-26T20:28:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.465+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562bc6325580 con 0x562bc631d460 2024-04-26T20:28:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.465+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562bc6209170 con 0x562bc63225d0 2024-04-26T20:28:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.465+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562bc6325700 con 0x562bc631ca70 2024-04-26T20:28:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.465+0000 7f2e2da0d740 10 client.0 _ll_register_callbacks cb 0x562bc6278770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e28c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23400640 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6327470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23e00640 1 -- 172.21.15.82:0/11508842 learned_addr learned my addr 172.21.15.82:0/11508842 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23400640 1 -- 172.21.15.82:0/11508842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 msgr2=0x562bc6326f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23400640 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc6326f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23400640 1 -- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 msgr2=0x562bc632e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23400640 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.466+0000 7f2e23400640 1 -- 172.21.15.82:0/11508842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc60bbf70 con 0x562bc631d460 2024-04-26T20:28:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.467+0000 7f2e23400640 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6327470 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0094c0 tx=0x7f2e1c013fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aa558957027f8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.469+0000 7f2e0d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:03.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.488+0000 7f2e0d600640 1 -- 172.21.15.82:0/11508842 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c029060 con 0x562bc631d460 2024-04-26T20:28:03.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.488+0000 7f2e0d600640 1 -- 172.21.15.82:0/11508842 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2e1c004c40 con 0x562bc631d460 2024-04-26T20:28:03.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.506+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e1c012bc0 con 0x562bc631d460 2024-04-26T20:28:03.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.509+0000 7f2e0d600640 1 -- 172.21.15.82:0/11508842 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2e1c016040 con 0x562bc631d460 2024-04-26T20:28:03.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.529+0000 7f2e2da0d740 10 client.16683 fetch_fsmap learned FSMap version 38 2024-04-26T20:28:03.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.529+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562bc5f53170 con 0x562bc631d460 2024-04-26T20:28:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e0d600640 1 -- 172.21.15.82:0/11508842 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e1c012bc0 con 0x562bc631d460 2024-04-26T20:28:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e0d600640 1 -- 172.21.15.82:0/11508842 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f2e1c023030 con 0x562bc631d460 2024-04-26T20:28:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e2da0d740 10 client.16683 fetch_fsmap finished waiting for FSMap version 38 2024-04-26T20:28:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e2da0d740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e2da0d740 20 client.16683 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63326c0 0x562bc6334ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e2da0d740 4 client.16683 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:28:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.553+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bc628f590 con 0x562bc63326c0 2024-04-26T20:28:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.570+0000 7f2e23e00640 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63326c0 0x562bc6334ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.575+0000 7f2e23e00640 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63326c0 0x562bc6334ab0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a6cfc73c8b166d3 server_cookie=bc725380f9c9f4c7 in_seq=0 out_seq=0 2024-04-26T20:28:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.575+0000 7f2e0d600640 10 client.16683 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.583+0000 7f2e0d600640 1 -- 172.21.15.82:0/11508842 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562bc628f590 con 0x562bc63326c0 2024-04-26T20:28:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.583+0000 7f2e0d600640 10 client.16683 handle_command_reply: tid=0 2024-04-26T20:28:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.583+0000 7f2e2da0d740 1 client.16683 shutdown 2024-04-26T20:28:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.584+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 msgr2=0x562bc6327470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.584+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6327470 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0094c0 tx=0x7f2e1c013fb0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.586+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 shutdown_connections 2024-04-26T20:28:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.586+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63326c0 0x562bc6334ab0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.586+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.586+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631d460 0x562bc6327470 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.586+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/11508842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631ca70 0x562bc6326f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:03.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.586+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 >> 172.21.15.82:0/11508842 conn(0x562bc63180e0 msgr2=0x562bc63172e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:03.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.599+0000 7f2e0d600640 0 client.16683 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.624+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 shutdown_connections 2024-04-26T20:28:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.626+0000 7f2e2da0d740 1 -- 172.21.15.82:0/11508842 wait complete. 2024-04-26T20:28:03.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:03.634+0000 7f2e2da0d740 20 client.16683 trim_cache size 0 max 16384 2024-04-26T20:28:04.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.536+0000 7f2e2da0d740 1 Processor -- start 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 -- start start 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc6326930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc631d460 0x562bc632e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc63225d0 0x562bc6316a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241c28d0 con 0x562bc631ca70 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241c4560 con 0x562bc631d460 2024-04-26T20:28:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.580+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241c2fa0 con 0x562bc63225d0 2024-04-26T20:28:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.590+0000 7f2e28c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc63225d0 0x562bc6316a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.590+0000 7f2e28c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc63225d0 0x562bc6316a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51300/0 (socket says 172.21.15.82:51300) 2024-04-26T20:28:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.590+0000 7f2e28c00640 1 -- 172.21.15.82:0/2779524506 learned_addr learned my addr 172.21.15.82:0/2779524506 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.590+0000 7f2e23400640 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc631d460 0x562bc632e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.593+0000 7f2e23400640 1 -- 172.21.15.82:0/2779524506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc63225d0 msgr2=0x562bc6316a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.593+0000 7f2e23400640 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc63225d0 0x562bc6316a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.593+0000 7f2e23400640 1 -- 172.21.15.82:0/2779524506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 msgr2=0x562bc6326930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.593+0000 7f2e23400640 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc6326930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.593+0000 7f2e23400640 1 -- 172.21.15.82:0/2779524506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc6334db0 con 0x562bc631d460 2024-04-26T20:28:04.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.597+0000 7f2e23400640 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc631d460 0x562bc632e470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c015040 tx=0x7f2e1c005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=239dac977ae61220 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.614+0000 7f2e0fe00640 1 -- 172.21.15.82:0/2779524506 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c029040 con 0x562bc631d460 2024-04-26T20:28:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.614+0000 7f2e0fe00640 1 -- 172.21.15.82:0/2779524506 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e1c003e20 con 0x562bc631d460 2024-04-26T20:28:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.614+0000 7f2e0fe00640 1 -- 172.21.15.82:0/2779524506 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c011910 con 0x562bc631d460 2024-04-26T20:28:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.639+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2779524506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc631d460 msgr2=0x562bc632e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.639+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc631d460 0x562bc632e470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c015040 tx=0x7f2e1c005f10 comp rx=0 tx=0).stop 2024-04-26T20:28:04.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2779524506 shutdown_connections 2024-04-26T20:28:04.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc63225d0 0x562bc6316a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc631d460 0x562bc632e470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2779524506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc6326930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2779524506 >> 172.21.15.82:0/2779524506 conn(0x562bc63180e0 msgr2=0x562bc6326220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:04.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2779524506 shutdown_connections 2024-04-26T20:28:04.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.658+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2779524506 wait complete. 2024-04-26T20:28:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.659+0000 7f2e2da0d740 1 -- start start 2024-04-26T20:28:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.659+0000 7f2e2da0d740 1 Processor -- start 2024-04-26T20:28:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.669+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc632bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.669+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631d460 0x562bc632c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.669+0000 7f2e2da0d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e23e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc632bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e23e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc632bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35610/0 (socket says 172.21.15.82:35610) 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e23400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631d460 0x562bc632c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e23400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631d460 0x562bc632c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51302/0 (socket says 172.21.15.82:51302) 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241c3e00 con 0x562bc631ca70 2024-04-26T20:28:04.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241c3670 con 0x562bc63225d0 2024-04-26T20:28:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e2da0d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241c08b0 con 0x562bc631d460 2024-04-26T20:28:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.670+0000 7f2e2da0d740 10 client.0 _ll_register_callbacks cb 0x7f2e14005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:04.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e23e00640 1 -- 172.21.15.82:0/2945249423 learned_addr learned my addr 172.21.15.82:0/2945249423 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e28c00640 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e23e00640 1 -- 172.21.15.82:0/2945249423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631d460 msgr2=0x562bc632c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e23e00640 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631d460 0x562bc632c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e23e00640 1 -- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 msgr2=0x562bc632d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e23e00640 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.671+0000 7f2e23e00640 1 -- 172.21.15.82:0/2945249423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc632d650 con 0x562bc631ca70 2024-04-26T20:28:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.672+0000 7f2e23e00640 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc632bb10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006010 tx=0x7f2e1002a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892e1e5340db953f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.690+0000 7f2e0d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.690+0000 7f2e0d600640 1 -- 172.21.15.82:0/2945249423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e100c15c0 con 0x562bc631ca70 2024-04-26T20:28:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.690+0000 7f2e0d600640 1 -- 172.21.15.82:0/2945249423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2e10039da0 con 0x562bc631ca70 2024-04-26T20:28:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.711+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e1c003e20 con 0x562bc631ca70 2024-04-26T20:28:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.717+0000 7f2e0d600640 1 -- 172.21.15.82:0/2945249423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2e100c5df0 con 0x562bc631ca70 2024-04-26T20:28:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.718+0000 7f2e2da0d740 10 client.16686 fetch_fsmap learned FSMap version 38 2024-04-26T20:28:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.718+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562bc6398b90 con 0x562bc631ca70 2024-04-26T20:28:04.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.722+0000 7f2e0d600640 1 -- 172.21.15.82:0/2945249423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e1c003e20 con 0x562bc631ca70 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.723+0000 7f2e0d600640 1 -- 172.21.15.82:0/2945249423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 38) ==== 8390+0+0 (secure 0 0 0) 0x7f2e1004d060 con 0x562bc631ca70 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.724+0000 7f2e2da0d740 10 client.16686 fetch_fsmap finished waiting for FSMap version 38 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.724+0000 7f2e2da0d740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.724+0000 7f2e2da0d740 20 client.16686 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.724+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63993e0 0x562bc639b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.724+0000 7f2e2da0d740 4 client.16686 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-26T20:28:04.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.724+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562bc6289400 con 0x562bc63993e0 2024-04-26T20:28:04.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.727+0000 7f2e23400640 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63993e0 0x562bc639b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:04.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.728+0000 7f2e23400640 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63993e0 0x562bc639b800 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9881a2306bae6bd server_cookie=2f7d504cda515145 in_seq=0 out_seq=0 2024-04-26T20:28:04.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.748+0000 7f2e0d600640 10 client.16686 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:04.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.748+0000 7f2e0d600640 1 -- 172.21.15.82:0/2945249423 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562bc6289400 con 0x562bc63993e0 2024-04-26T20:28:04.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.748+0000 7f2e0d600640 10 client.16686 handle_command_reply: tid=0 2024-04-26T20:28:04.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.752+0000 7f2e2da0d740 1 client.16686 shutdown 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.796+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 msgr2=0x562bc632bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.796+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc632bb10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006010 tx=0x7f2e1002a940 comp rx=0 tx=0).stop 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 shutdown_connections 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562bc63993e0 0x562bc639b800 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562bc63225d0 0x562bc632d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562bc631d460 0x562bc632c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e2da0d740 1 --2- 172.21.15.82:0/2945249423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562bc631ca70 0x562bc632bb10 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006010 tx=0x7f2e1002a940 comp rx=0 tx=0).stop 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 >> 172.21.15.82:0/2945249423 conn(0x562bc63180e0 msgr2=0x562bc631b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:04.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.799+0000 7f2e0d600640 0 client.16686 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:04.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.806+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 shutdown_connections 2024-04-26T20:28:04.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.810+0000 7f2e2da0d740 1 -- 172.21.15.82:0/2945249423 wait complete. 2024-04-26T20:28:04.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.819+0000 7f2e2da0d740 20 client.16686 trim_cache size 0 max 16384 2024-04-26T20:28:04.832 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:28:04.832 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-04-26T20:28:04.832 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "41c13c1b-3ac6-4900-8aae-7000533ba6e3", 2024-04-26T20:28:04.832 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-04-26T20:28:04.832 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:28:04.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.833+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2e080a3e40 msgr2=0x7f2e080a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:04.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.833+0000 7f2e29600640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2e080a3e40 0x7f2e080a6300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x562bc631dcc0 tx=0x7f2e1400b340 comp rx=0 tx=0).stop 2024-04-26T20:28:04.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.834+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e24073d70 msgr2=0x7f2e24116050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:04.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.834+0000 7f2e29600640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e24073d70 0x7f2e24116050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009850 tx=0x7f2e10004580 comp rx=0 tx=0).stop 2024-04-26T20:28:04.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.835+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 shutdown_connections 2024-04-26T20:28:04.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.842+0000 7f2e29600640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f2e080a3e40 0x7f2e080a6300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.845+0000 7f2e29600640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e2410a9b0 0x7f2e241b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.847+0000 7f2e29600640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e2410a010 0x7f2e24116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.849+0000 7f2e29600640 1 --2- 172.21.15.82:0/3574337736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e24073d70 0x7f2e24116050 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:04.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.856+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 >> 172.21.15.82:0/3574337736 conn(0x7f2e2406f840 msgr2=0x7f2e24070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:04.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.876+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 shutdown_connections 2024-04-26T20:28:04.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:04.878+0000 7f2e29600640 1 -- 172.21.15.82:0/3574337736 wait complete. 2024-04-26T20:28:05.159 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:04 smithi139 ceph-mon[32999]: pgmap v570: 129 pgs: 129 active+clean; 766 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.6 MiB/s wr, 606 op/s 2024-04-26T20:28:05.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:04 smithi082 ceph-mon[28105]: pgmap v570: 129 pgs: 129 active+clean; 766 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.6 MiB/s wr, 606 op/s 2024-04-26T20:28:05.235 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:04 smithi135 ceph-mon[32816]: pgmap v570: 129 pgs: 129 active+clean; 766 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.6 MiB/s wr, 606 op/s 2024-04-26T20:28:05.235 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:28:05.120+0000 7fd34598e700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002851 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/ auth{1=1,2=1,3=1,4=1} fragtree_t(*^3) v116975 ap=2 f(v4 m2024-04-26T20:27:40.517500+0000 147=147+0) n(v6 rc2024-04-26T20:27:40.517500+0000 b3706409 148=147+1) (inest sync->mix g=1,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@63} | dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirtyrstat=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5577fd3eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x20000002851:[<0x10000000971/blog-71 v105497>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[]","memoryvalue":"(2)0x20000002851:[<0x10000000971/blog-71 v116975>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1502>,<0x100000005e2/tmp v95>,<0x100000001fb/client.0 v95>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v98>,<0x10000000001/sv_1 v122>,<0x10000000000/qa v111>,<0x1/volumes v108>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:27:40.517500+0000 143=143+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:27:40.517500+0000 b3706409 148=147+1)","memory_value.dirstat":"f(v4 m2024-04-26T20:27:40.517500+0000 147=147+0)","memory_value.rstat":"n(v6 rc2024-04-26T20:27:40.517500+0000 b3706409 148=147+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-04-26T20:28:05.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:28:05.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:28:05.571 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.158+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c3c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-59.xml auth{0=1} v768 ap=1 s=15629 n(v0 rc2024-04-26T20:26:08.676294+0000 b15629 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564239e3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c3c:[<0x20000002bd2/article-59.xml v214>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c3c:[<0x20000002bd2/article-59.xml v768>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.571 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.159+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c6d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-18.xml auth{0=1} v686 ap=1 s=30705 n(v0 rc2024-04-26T20:26:09.019287+0000 b30705 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a3eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c6d:[<0x20000002bd2/article-18.xml v460>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c6d:[<0x20000002bd2/article-18.xml v686>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.571 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.159+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c11 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-74.xml auth{0=1} v806 ap=1 s=4126 n(v0 rc2024-04-26T20:26:08.525297+0000 b4126 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423ab92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c11:[<0x20000002bd2/article-74.xml v124>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c11:[<0x20000002bd2/article-74.xml v806>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.572 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.160+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ee [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-5.xml auth{0=1} v880 ap=1 s=6846 n(v0 rc2024-04-26T20:26:40.235677+0000 b6846 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a3ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009ee:[<0x20000002bd2/comment-5.xml v868>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009ee:[<0x20000002bd2/comment-5.xml v880>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.572 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.162+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c4b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-51.xml auth{0=1} v752 ap=1 s=14106 n(v0 rc2024-04-26T20:26:08.779292+0000 b14106 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a408c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c4b:[<0x20000002bd2/article-51.xml v262>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c4b:[<0x20000002bd2/article-51.xml v752>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.572 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.162+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bda [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-92.xml auth{0=1} v836 ap=1 s=25196 n(v0 rc2024-04-26T20:26:08.334300+0000 b25196 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423ab92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bda:[<0x20000002bd2/article-92.xml v16>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bda:[<0x20000002bd2/article-92.xml v836>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.572 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.162+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c86 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-4.jpg auth{0=1} v644 ap=1 s=12934 n(v0 rc2024-04-26T20:26:09.132285+0000 b12934 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a407080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c86:[<0x20000002bd2/picture-4.jpg v610>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c86:[<0x20000002bd2/picture-4.jpg v644>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.573 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.164+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c88 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-2.jpg auth{0=1} v636 ap=1 s=27611 n(v0 rc2024-04-26T20:26:09.145285+0000 b27611 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a406b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c88:[<0x20000002bd2/picture-2.jpg v622>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c88:[<0x20000002bd2/picture-2.jpg v636>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.573 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.164+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c1c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-70.xml auth{0=1} v798 ap=1 s=7657 n(v0 rc2024-04-26T20:26:08.558296+0000 b7657 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a406000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c1c:[<0x20000002bd2/article-70.xml v148>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c1c:[<0x20000002bd2/article-70.xml v798>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.573 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.165+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c64 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-27.xml auth{0=1} v704 ap=1 s=10702 n(v0 rc2024-04-26T20:26:08.973288+0000 b10702 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a407b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c64:[<0x20000002bd2/article-27.xml v406>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c64:[<0x20000002bd2/article-27.xml v704>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.573 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.165+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c6b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-20.xml auth{0=1} v690 ap=1 s=13309 n(v0 rc2024-04-26T20:26:09.009287+0000 b13309 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a44c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c6b:[<0x20000002bd2/article-20.xml v448>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c6b:[<0x20000002bd2/article-20.xml v690>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.165+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bf5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-83.xml auth{0=1} v818 ap=1 s=2470 n(v0 rc2024-04-26T20:26:08.435298+0000 b2470 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a44b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bf5:[<0x20000002bd2/article-83.xml v70>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bf5:[<0x20000002bd2/article-83.xml v818>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.166+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c37 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-61.xml auth{0=1} v774 ap=1 s=20625 n(v0 rc2024-04-26T20:26:08.640294+0000 b20625 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a44b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c37:[<0x20000002bd2/article-61.xml v202>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c37:[<0x20000002bd2/article-61.xml v774>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.167+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c56 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-41.xml auth{0=1} v732 ap=1 s=11932 n(v0 rc2024-04-26T20:26:08.879290+0000 b11932 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a44ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c56:[<0x20000002bd2/article-41.xml v322>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c56:[<0x20000002bd2/article-41.xml v732>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.167+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c52 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-45.xml auth{0=1} v740 ap=1 s=11511 n(v0 rc2024-04-26T20:26:08.845290+0000 b11511 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a44a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c52:[<0x20000002bd2/article-45.xml v298>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c52:[<0x20000002bd2/article-45.xml v740>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.167+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c1f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-69.xml auth{0=1} v796 ap=1 s=23242 n(v0 rc2024-04-26T20:26:08.568296+0000 b23242 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a44a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c1f:[<0x20000002bd2/article-69.xml v154>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c1f:[<0x20000002bd2/article-69.xml v796>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.167+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c83 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-7.jpg auth{0=1} v656 ap=1 s=17810 n(v0 rc2024-04-26T20:26:09.115285+0000 b17810 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a449b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c83:[<0x20000002bd2/picture-7.jpg v592>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c83:[<0x20000002bd2/picture-7.jpg v656>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.167+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c81 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-9.jpg auth{0=1} v664 ap=1 s=31614 n(v0 rc2024-04-26T20:26:09.104285+0000 b31614 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a449080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c81:[<0x20000002bd2/picture-9.jpg v580>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c81:[<0x20000002bd2/picture-9.jpg v664>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.574 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.168+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-11.xml auth{0=1} v878 ap=1 s=5079 n(v0 rc2024-04-26T20:26:40.184678+0000 b5079 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a448b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e8:[<0x20000002bd2/comment-11.xml v849>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e8:[<0x20000002bd2/comment-11.xml v878>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.168+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009dd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-20.xml auth{0=1} v876 ap=1 s=6677 n(v0 rc2024-04-26T20:26:40.049681+0000 b6677 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a448000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009dd:[<0x20000002bd2/comment-20.xml v847>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009dd:[<0x20000002bd2/comment-20.xml v876>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.169+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bfe [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-80.xml auth{0=1} v814 ap=1 s=30178 n(v0 rc2024-04-26T20:26:08.462298+0000 b30178 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238aa7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bfe:[<0x20000002bd2/article-80.xml v88>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bfe:[<0x20000002bd2/article-80.xml v814>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.171+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c89 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-1.jpg auth{0=1} v632 ap=1 s=45572 n(v0 rc2024-04-26T20:26:09.153284+0000 b45572 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238aa8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c89:[<0x20000002bd2/picture-1.jpg v628>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c89:[<0x20000002bd2/picture-1.jpg v632>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.172+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c60 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-31.xml auth{0=1} v712 ap=1 s=18557 n(v0 rc2024-04-26T20:26:08.953288+0000 b18557 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a449600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c60:[<0x20000002bd2/article-31.xml v382>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c60:[<0x20000002bd2/article-31.xml v712>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.172+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c80 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-10.jpg auth{0=1} v668 ap=1 s=61078 n(v0 rc2024-04-26T20:26:09.099285+0000 b61078 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238aa8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c80:[<0x20000002bd2/picture-10.jpg v574>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c80:[<0x20000002bd2/picture-10.jpg v668>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.174+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-16.xml auth{0=1} v873 ap=1 s=7281 n(v0 rc2024-04-26T20:26:40.097680+0000 b7281 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238aa8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e2:[<0x20000002bd2/comment-16.xml v861>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e2:[<0x20000002bd2/comment-16.xml v873>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.575 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.175+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c53 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-44.xml auth{0=1} v738 ap=1 s=18971 n(v0 rc2024-04-26T20:26:08.852290+0000 b18971 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238aa9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c53:[<0x20000002bd2/article-44.xml v304>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c53:[<0x20000002bd2/article-44.xml v738>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.576 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.175+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c76 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-9.xml auth{0=1} v666 ap=1 s=28278 n(v0 rc2024-04-26T20:26:09.055286+0000 b28278 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238aa9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c76:[<0x20000002bd2/article-9.xml v514>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c76:[<0x20000002bd2/article-9.xml v666>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.576 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.176+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c84 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-6.jpg auth{0=1} v652 ap=1 s=8439 n(v0 rc2024-04-26T20:26:09.120285+0000 b8439 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423834e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c84:[<0x20000002bd2/picture-6.jpg v598>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c84:[<0x20000002bd2/picture-6.jpg v652>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.576 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.177+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c34 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-62.xml auth{0=1} v776 ap=1 s=2325 n(v0 rc2024-04-26T20:26:08.631295+0000 b2325 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423834eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c34:[<0x20000002bd2/article-62.xml v196>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c34:[<0x20000002bd2/article-62.xml v776>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.576 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.177+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bf0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-85.xml auth{0=1} v822 ap=1 s=12676 n(v0 rc2024-04-26T20:26:08.420299+0000 b12676 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423834f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bf0:[<0x20000002bd2/article-85.xml v58>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bf0:[<0x20000002bd2/article-85.xml v822>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.576 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.177+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002be7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-88.xml auth{0=1} v828 ap=1 s=8603 n(v0 rc2024-04-26T20:26:08.384299+0000 b8603 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423834fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002be7:[<0x20000002bd2/article-88.xml v40>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002be7:[<0x20000002bd2/article-88.xml v828>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.576 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.178+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c7c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-3.xml auth{0=1} v642 ap=1 s=19566 n(v0 rc2024-04-26T20:26:09.078286+0000 b19566 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238350680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c7c:[<0x20000002bd2/article-3.xml v550>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c7c:[<0x20000002bd2/article-3.xml v642>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.179+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c43 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-55.xml auth{0=1} v760 ap=1 s=14201 n(v0 rc2024-04-26T20:26:08.727293+0000 b14201 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238585700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c43:[<0x20000002bd2/article-55.xml v238>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c43:[<0x20000002bd2/article-55.xml v760>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.179+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c67 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-24.xml auth{0=1} v698 ap=1 s=7941 n(v0 rc2024-04-26T20:26:08.991288+0000 b7941 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423834f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c67:[<0x20000002bd2/article-24.xml v424>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c67:[<0x20000002bd2/article-24.xml v698>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.217+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c77 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-8.xml auth{0=1} v662 ap=1 s=13641 n(v0 rc2024-04-26T20:26:09.059286+0000 b13641 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c77:[<0x20000002bd2/article-8.xml v520>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c77:[<0x20000002bd2/article-8.xml v662>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.217+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c78 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-7.xml auth{0=1} v658 ap=1 s=13907 n(v0 rc2024-04-26T20:26:09.062286+0000 b13907 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238350c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c78:[<0x20000002bd2/article-7.xml v526>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c78:[<0x20000002bd2/article-7.xml v658>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.218+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c22 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-68.xml auth{0=1} v790 ap=1 s=25575 n(v0 rc2024-04-26T20:26:08.578296+0000 b25575 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385ed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c22:[<0x20000002bd2/article-68.xml v160>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c22:[<0x20000002bd2/article-68.xml v790>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.219+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c25 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-67.xml auth{0=1} v794 ap=1 s=24569 n(v0 rc2024-04-26T20:26:08.587295+0000 b24569 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238350100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c25:[<0x20000002bd2/article-67.xml v166>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c25:[<0x20000002bd2/article-67.xml v794>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.219+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c2a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-65.xml auth{0=1} v782 ap=1 s=10752 n(v0 rc2024-04-26T20:26:08.601295+0000 b10752 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423834e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c2a:[<0x20000002bd2/article-65.xml v178>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c2a:[<0x20000002bd2/article-65.xml v782>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.219+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c0b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-76.xml auth{0=1} v810 ap=1 s=1174 n(v0 rc2024-04-26T20:26:08.507297+0000 b1174 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c0b:[<0x20000002bd2/article-76.xml v112>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c0b:[<0x20000002bd2/article-76.xml v810>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.219+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c82 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-8.jpg auth{0=1} v660 ap=1 s=42195 n(v0 rc2024-04-26T20:26:09.109285+0000 b42195 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238591700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c82:[<0x20000002bd2/picture-8.jpg v586>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c82:[<0x20000002bd2/picture-8.jpg v660>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.221+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c5f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-32.xml auth{0=1} v714 ap=1 s=25560 n(v0 rc2024-04-26T20:26:08.946288+0000 b25560 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423860c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c5f:[<0x20000002bd2/article-32.xml v376>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c5f:[<0x20000002bd2/article-32.xml v714>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.577 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.223+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c6a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-21.xml auth{0=1} v692 ap=1 s=2807 n(v0 rc2024-04-26T20:26:09.005287+0000 b2807 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c6a:[<0x20000002bd2/article-21.xml v442>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c6a:[<0x20000002bd2/article-21.xml v692>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.224+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bd4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-94.xml auth{0=1} v840 ap=1 s=16271 n(v0 rc2024-04-26T20:26:08.312301+0000 b16271 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bd4:[<0x20000002bd2/article-94.xml v4>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bd4:[<0x20000002bd2/article-94.xml v840>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.224+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c72 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-13.xml auth{0=1} v676 ap=1 s=27974 n(v0 rc2024-04-26T20:26:09.040287+0000 b27974 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423859cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c72:[<0x20000002bd2/article-13.xml v490>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c72:[<0x20000002bd2/article-13.xml v676>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.224+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ef [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-4.xml auth{0=1} v871 ap=1 s=2856 n(v0 rc2024-04-26T20:26:40.247677+0000 b2856 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423859c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009ef:[<0x20000002bd2/comment-4.xml v867>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009ef:[<0x20000002bd2/comment-4.xml v871>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.224+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c61 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-30.xml auth{0=1} v710 ap=1 s=21074 n(v0 rc2024-04-26T20:26:08.958288+0000 b21074 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c61:[<0x20000002bd2/article-30.xml v388>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c61:[<0x20000002bd2/article-30.xml v710>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.225+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c4d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-50.xml auth{0=1} v750 ap=1 s=15435 n(v0 rc2024-04-26T20:26:08.795291+0000 b15435 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c4d:[<0x20000002bd2/article-50.xml v268>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c4d:[<0x20000002bd2/article-50.xml v750>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.226+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c7d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-2.xml auth{0=1} v638 ap=1 s=2217 n(v0 rc2024-04-26T20:26:09.083286+0000 b2217 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385e2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c7d:[<0x20000002bd2/article-2.xml v556>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c7d:[<0x20000002bd2/article-2.xml v638>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.578 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.226+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-14.xml auth{0=1} v873 ap=1 s=5549 n(v0 rc2024-04-26T20:26:40.134679+0000 b5549 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e5:[<0x20000002bd2/comment-14.xml v853>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e5:[<0x20000002bd2/comment-14.xml v873>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.581 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.226+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c79 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-6.xml auth{0=1} v654 ap=1 s=26046 n(v0 rc2024-04-26T20:26:09.066286+0000 b26046 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642385fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c79:[<0x20000002bd2/article-6.xml v532>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c79:[<0x20000002bd2/article-6.xml v654>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.581 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.228+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002be1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-90.xml auth{0=1} v832 ap=1 s=23778 n(v0 rc2024-04-26T20:26:08.359300+0000 b23778 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423835e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002be1:[<0x20000002bd2/article-90.xml v28>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002be1:[<0x20000002bd2/article-90.xml v832>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.581 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.229+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009de [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-19.xml auth{0=1} v875 ap=1 s=4634 n(v0 rc2024-04-26T20:26:40.065680+0000 b4634 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642383b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009de:[<0x20000002bd2/comment-19.xml v851>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009de:[<0x20000002bd2/comment-19.xml v875>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.581 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.231+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c41 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-56.xml auth{0=1} v762 ap=1 s=21055 n(v0 rc2024-04-26T20:26:08.710293+0000 b21055 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423ab93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c41:[<0x20000002bd2/article-56.xml v232>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c41:[<0x20000002bd2/article-56.xml v762>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.581 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.232+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-2.xml auth{0=1} v877 ap=1 s=4988 n(v0 rc2024-04-26T20:26:40.286676+0000 b4988 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009f1:[<0x20000002bd2/comment-2.xml v871>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009f1:[<0x20000002bd2/comment-2.xml v877>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.233+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009db [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-22.xml auth{0=1} v881 ap=1 s=9629 n(v0 rc2024-04-26T20:26:35.968760+0000 b9629 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009db:[<0x20000002bd2/comment-22.xml v844>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009db:[<0x20000002bd2/comment-22.xml v881>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.233+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c54 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-43.xml auth{0=1} v736 ap=1 s=14723 n(v0 rc2024-04-26T20:26:08.859290+0000 b14723 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c54:[<0x20000002bd2/article-43.xml v310>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c54:[<0x20000002bd2/article-43.xml v736>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.234+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c5e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-33.xml auth{0=1} v716 ap=1 s=5771 n(v0 rc2024-04-26T20:26:08.938289+0000 b5771 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c5e:[<0x20000002bd2/article-33.xml v370>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c5e:[<0x20000002bd2/article-33.xml v716>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.234+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c85 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-5.jpg auth{0=1} v648 ap=1 s=40041 n(v0 rc2024-04-26T20:26:09.125285+0000 b40041 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c85:[<0x20000002bd2/picture-5.jpg v604>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c85:[<0x20000002bd2/picture-5.jpg v648>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.234+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c40 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-57.xml auth{0=1} v764 ap=1 s=30063 n(v0 rc2024-04-26T20:26:08.694293+0000 b30063 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c40:[<0x20000002bd2/article-57.xml v226>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c40:[<0x20000002bd2/article-57.xml v764>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.235+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c01 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-79.xml auth{0=1} v812 ap=1 s=27026 n(v0 rc2024-04-26T20:26:08.471298+0000 b27026 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c01:[<0x20000002bd2/article-79.xml v94>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c01:[<0x20000002bd2/article-79.xml v812>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.235+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ec [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-7.xml auth{0=1} v879 ap=1 s=8665 n(v0 rc2024-04-26T20:26:40.223677+0000 b8665 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009ec:[<0x20000002bd2/comment-7.xml v864>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009ec:[<0x20000002bd2/comment-7.xml v879>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.235+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c3e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-58.xml auth{0=1} v766 ap=1 s=15686 n(v0 rc2024-04-26T20:26:08.688294+0000 b15686 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c3e:[<0x20000002bd2/article-58.xml v220>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c3e:[<0x20000002bd2/article-58.xml v766>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.236+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c47 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-53.xml auth{0=1} v756 ap=1 s=1925 n(v0 rc2024-04-26T20:26:08.752292+0000 b1925 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af26000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c47:[<0x20000002bd2/article-53.xml v250>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c47:[<0x20000002bd2/article-53.xml v756>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.236+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-17.xml auth{0=1} v875 ap=1 s=6910 n(v0 rc2024-04-26T20:26:40.090680+0000 b6910 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af26580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e0:[<0x20000002bd2/comment-17.xml v848>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e0:[<0x20000002bd2/comment-17.xml v875>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.582 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.237+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-15.xml auth{0=1} v885 ap=1 s=4708 n(v0 rc2024-04-26T20:26:40.123679+0000 b4708 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e3:[<0x20000002bd2/comment-15.xml v850>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e3:[<0x20000002bd2/comment-15.xml v885>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.238+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c63 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-28.xml auth{0=1} v706 ap=1 s=18912 n(v0 rc2024-04-26T20:26:08.967288+0000 b18912 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af26b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c63:[<0x20000002bd2/article-28.xml v400>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c63:[<0x20000002bd2/article-28.xml v706>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.238+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-9.xml auth{0=1} v883 ap=1 s=4063 n(v0 rc2024-04-26T20:26:40.201678+0000 b4063 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af27080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009ea:[<0x20000002bd2/comment-9.xml v856>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009ea:[<0x20000002bd2/comment-9.xml v883>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.239+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c49 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-52.xml auth{0=1} v754 ap=1 s=7633 n(v0 rc2024-04-26T20:26:08.765292+0000 b7633 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af27600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c49:[<0x20000002bd2/article-52.xml v256>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c49:[<0x20000002bd2/article-52.xml v754>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.239+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-10.xml auth{0=1} v867 ap=1 s=4986 n(v0 rc2024-04-26T20:26:40.196678+0000 b4986 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e9:[<0x20000002bd2/comment-10.xml v851>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e9:[<0x20000002bd2/comment-10.xml v867>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.239+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c87 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-3.jpg auth{0=1} v640 ap=1 s=24031 n(v0 rc2024-04-26T20:26:09.138285+0000 b24031 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c87:[<0x20000002bd2/picture-3.jpg v616>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c87:[<0x20000002bd2/picture-3.jpg v640>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.241+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-6.xml auth{0=1} v869 ap=1 s=2092 n(v0 rc2024-04-26T20:26:40.227677+0000 b2092 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009ed:[<0x20000002bd2/comment-6.xml v863>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009ed:[<0x20000002bd2/comment-6.xml v869>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.241+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c7f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-11.jpg auth{0=1} v770 ap=1 s=51985 n(v0 rc2024-04-26T20:26:09.093286+0000 b51985 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c7f:[<0x20000002bd2/picture-11.jpg v568>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c7f:[<0x20000002bd2/picture-11.jpg v770>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.242+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c5d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-34.xml auth{0=1} v718 ap=1 s=25691 n(v0 rc2024-04-26T20:26:08.933289+0000 b25691 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c5d:[<0x20000002bd2/article-34.xml v364>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c5d:[<0x20000002bd2/article-34.xml v718>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.243+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c7a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-5.xml auth{0=1} v650 ap=1 s=27482 n(v0 rc2024-04-26T20:26:09.070286+0000 b27482 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c7a:[<0x20000002bd2/article-5.xml v538>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c7a:[<0x20000002bd2/article-5.xml v650>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.243+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bfb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-81.xml auth{0=1} v786 ap=1 s=12745 n(v0 rc2024-04-26T20:26:08.454298+0000 b12745 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bfb:[<0x20000002bd2/article-81.xml v82>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bfb:[<0x20000002bd2/article-81.xml v786>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.243+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c04 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-78.xml auth{0=1} v792 ap=1 s=28028 n(v0 rc2024-04-26T20:26:08.483298+0000 b28028 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a97f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c04:[<0x20000002bd2/article-78.xml v100>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c04:[<0x20000002bd2/article-78.xml v792>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.244+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c62 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-29.xml auth{0=1} v708 ap=1 s=26520 n(v0 rc2024-04-26T20:26:08.963288+0000 b26520 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af38000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c62:[<0x20000002bd2/article-29.xml v394>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c62:[<0x20000002bd2/article-29.xml v708>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.583 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.244+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c4e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-49.xml auth{0=1} v748 ap=1 s=3635 n(v0 rc2024-04-26T20:26:08.801291+0000 b3635 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af39080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c4e:[<0x20000002bd2/article-49.xml v274>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c4e:[<0x20000002bd2/article-49.xml v748>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.244+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c69 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-22.xml auth{0=1} v694 ap=1 s=25783 n(v0 rc2024-04-26T20:26:09.002287+0000 b25783 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af38b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c69:[<0x20000002bd2/article-22.xml v436>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c69:[<0x20000002bd2/article-22.xml v694>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.245+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c71 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-14.xml auth{0=1} v678 ap=1 s=15975 n(v0 rc2024-04-26T20:26:09.035287+0000 b15975 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af39b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c71:[<0x20000002bd2/article-14.xml v484>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c71:[<0x20000002bd2/article-14.xml v678>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.245+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c3a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-60.xml auth{0=1} v772 ap=1 s=3072 n(v0 rc2024-04-26T20:26:08.649294+0000 b3072 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af38580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c3a:[<0x20000002bd2/article-60.xml v208>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c3a:[<0x20000002bd2/article-60.xml v772>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.245+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c51 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-46.xml auth{0=1} v742 ap=1 s=12072 n(v0 rc2024-04-26T20:26:08.837291+0000 b12072 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c51:[<0x20000002bd2/article-46.xml v292>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c51:[<0x20000002bd2/article-46.xml v742>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.245+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bde [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-91.xml auth{0=1} v834 ap=1 s=9074 n(v0 rc2024-04-26T20:26:08.349300+0000 b9074 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bde:[<0x20000002bd2/article-91.xml v22>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bde:[<0x20000002bd2/article-91.xml v834>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.246+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c50 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-47.xml auth{0=1} v744 ap=1 s=8872 n(v0 rc2024-04-26T20:26:08.829291+0000 b8872 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c50:[<0x20000002bd2/article-47.xml v286>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c50:[<0x20000002bd2/article-47.xml v744>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.246+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c19 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-71.xml auth{0=1} v800 ap=1 s=23551 n(v0 rc2024-04-26T20:26:08.549296+0000 b23551 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c19:[<0x20000002bd2/article-71.xml v142>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c19:[<0x20000002bd2/article-71.xml v800>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.248+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c74 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-11.xml auth{0=1} v672 ap=1 s=12355 n(v0 rc2024-04-26T20:26:09.048286+0000 b12355 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c74:[<0x20000002bd2/article-11.xml v502>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c74:[<0x20000002bd2/article-11.xml v672>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.248+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c6f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-16.xml auth{0=1} v682 ap=1 s=14865 n(v0 rc2024-04-26T20:26:09.027287+0000 b14865 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c6f:[<0x20000002bd2/article-16.xml v472>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c6f:[<0x20000002bd2/article-16.xml v682>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.249+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bf2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-84.xml auth{0=1} v820 ap=1 s=5950 n(v0 rc2024-04-26T20:26:08.428299+0000 b5950 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bf2:[<0x20000002bd2/article-84.xml v64>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bf2:[<0x20000002bd2/article-84.xml v820>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.584 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.249+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009eb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-8.xml auth{0=1} v871 ap=1 s=5577 n(v0 rc2024-04-26T20:26:40.211678+0000 b5577 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af39600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009eb:[<0x20000002bd2/comment-8.xml v859>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009eb:[<0x20000002bd2/comment-8.xml v871>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.249+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c45 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-54.xml auth{0=1} v758 ap=1 s=24922 n(v0 rc2024-04-26T20:26:08.743292+0000 b24922 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c45:[<0x20000002bd2/article-54.xml v244>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c45:[<0x20000002bd2/article-54.xml v758>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.249+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c65 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-26.xml auth{0=1} v702 ap=1 s=9297 n(v0 rc2024-04-26T20:26:08.979288+0000 b9297 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c65:[<0x20000002bd2/article-26.xml v412>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c65:[<0x20000002bd2/article-26.xml v702>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.249+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bd7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-93.xml auth{0=1} v838 ap=1 s=30895 n(v0 rc2024-04-26T20:26:08.321301+0000 b30895 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bd7:[<0x20000002bd2/article-93.xml v10>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bd7:[<0x20000002bd2/article-93.xml v838>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.250+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c7b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-4.xml auth{0=1} v646 ap=1 s=16801 n(v0 rc2024-04-26T20:26:09.074286+0000 b16801 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c7b:[<0x20000002bd2/article-4.xml v544>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c7b:[<0x20000002bd2/article-4.xml v646>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.250+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c66 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-25.xml auth{0=1} v700 ap=1 s=1230 n(v0 rc2024-04-26T20:26:08.985288+0000 b1230 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c66:[<0x20000002bd2/article-25.xml v418>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c66:[<0x20000002bd2/article-25.xml v700>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.252+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c17 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-72.xml auth{0=1} v802 ap=1 s=32126 n(v0 rc2024-04-26T20:26:08.542296+0000 b32126 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c17:[<0x20000002bd2/article-72.xml v136>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c17:[<0x20000002bd2/article-72.xml v802>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.252+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c5c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-35.xml auth{0=1} v720 ap=1 s=24985 n(v0 rc2024-04-26T20:26:08.927289+0000 b24985 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c5c:[<0x20000002bd2/article-35.xml v358>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c5c:[<0x20000002bd2/article-35.xml v720>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.252+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c75 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-10.xml auth{0=1} v670 ap=1 s=19202 n(v0 rc2024-04-26T20:26:09.051286+0000 b19202 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c75:[<0x20000002bd2/article-10.xml v508>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c75:[<0x20000002bd2/article-10.xml v670>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.585 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.253+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c4f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-48.xml auth{0=1} v746 ap=1 s=28549 n(v0 rc2024-04-26T20:26:08.822291+0000 b28549 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c4f:[<0x20000002bd2/article-48.xml v280>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c4f:[<0x20000002bd2/article-48.xml v746>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.254+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c57 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-40.xml auth{0=1} v730 ap=1 s=7509 n(v0 rc2024-04-26T20:26:08.888290+0000 b7509 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c57:[<0x20000002bd2/article-40.xml v328>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c57:[<0x20000002bd2/article-40.xml v730>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.255+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bf8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-82.xml auth{0=1} v816 ap=1 s=12666 n(v0 rc2024-04-26T20:26:08.444298+0000 b12666 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bf8:[<0x20000002bd2/article-82.xml v76>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bf8:[<0x20000002bd2/article-82.xml v816>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.255+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c59 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-38.xml auth{0=1} v726 ap=1 s=12639 n(v0 rc2024-04-26T20:26:08.906289+0000 b12639 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af3f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c59:[<0x20000002bd2/article-38.xml v340>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c59:[<0x20000002bd2/article-38.xml v726>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.256+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c70 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-15.xml auth{0=1} v680 ap=1 s=26216 n(v0 rc2024-04-26T20:26:09.031287+0000 b26216 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c70:[<0x20000002bd2/article-15.xml v478>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c70:[<0x20000002bd2/article-15.xml v680>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.256+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c6c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-19.xml auth{0=1} v688 ap=1 s=6579 n(v0 rc2024-04-26T20:26:09.013287+0000 b6579 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c6c:[<0x20000002bd2/article-19.xml v454>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c6c:[<0x20000002bd2/article-19.xml v688>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.257+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c55 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-42.xml auth{0=1} v734 ap=1 s=26612 n(v0 rc2024-04-26T20:26:08.871290+0000 b26612 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c55:[<0x20000002bd2/article-42.xml v316>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c55:[<0x20000002bd2/article-42.xml v734>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.258+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c2e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-64.xml auth{0=1} v780 ap=1 s=30706 n(v0 rc2024-04-26T20:26:08.613295+0000 b30706 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c2e:[<0x20000002bd2/article-64.xml v184>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c2e:[<0x20000002bd2/article-64.xml v780>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.258+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-86.xml auth{0=1} v824 ap=1 s=6057 n(v0 rc2024-04-26T20:26:08.411299+0000 b6057 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bed:[<0x20000002bd2/article-86.xml v52>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bed:[<0x20000002bd2/article-86.xml v824>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.259+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-1.xml auth{0=1} v879 ap=1 s=3975 n(v0 rc2024-04-26T20:26:40.291676+0000 b3975 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af4c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009f2:[<0x20000002bd2/comment-1.xml v875>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009f2:[<0x20000002bd2/comment-1.xml v879>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.259+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-13.xml auth{0=1} v882 ap=1 s=9054 n(v0 rc2024-04-26T20:26:40.157679+0000 b9054 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e6:[<0x20000002bd2/comment-13.xml v866>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e6:[<0x20000002bd2/comment-13.xml v882>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.586 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.259+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009dc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-21.xml auth{0=1} v884 ap=1 s=2346 n(v0 rc2024-04-26T20:26:35.994760+0000 b2346 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009dc:[<0x20000002bd2/comment-21.xml v844>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009dc:[<0x20000002bd2/comment-21.xml v884>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.260+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c0e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-75.xml auth{0=1} v808 ap=1 s=32520 n(v0 rc2024-04-26T20:26:08.515297+0000 b32520 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c0e:[<0x20000002bd2/article-75.xml v118>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c0e:[<0x20000002bd2/article-75.xml v808>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.260+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002be4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-89.xml auth{0=1} v830 ap=1 s=12184 n(v0 rc2024-04-26T20:26:08.373300+0000 b12184 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002be4:[<0x20000002bd2/article-89.xml v34>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002be4:[<0x20000002bd2/article-89.xml v830>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.260+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002bea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-87.xml auth{0=1} v826 ap=1 s=18979 n(v0 rc2024-04-26T20:26:08.400299+0000 b18979 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af57600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002bea:[<0x20000002bd2/article-87.xml v46>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002bea:[<0x20000002bd2/article-87.xml v826>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.260+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c14 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-73.xml auth{0=1} v804 ap=1 s=11149 n(v0 rc2024-04-26T20:26:08.532297+0000 b11149 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c14:[<0x20000002bd2/article-73.xml v130>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c14:[<0x20000002bd2/article-73.xml v804>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.261+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c5a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-37.xml auth{0=1} v724 ap=1 s=16958 n(v0 rc2024-04-26T20:26:08.914289+0000 b16958 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c5a:[<0x20000002bd2/article-37.xml v346>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c5a:[<0x20000002bd2/article-37.xml v724>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.261+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c58 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-39.xml auth{0=1} v728 ap=1 s=29549 n(v0 rc2024-04-26T20:26:08.897289+0000 b29549 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c58:[<0x20000002bd2/article-39.xml v334>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c58:[<0x20000002bd2/article-39.xml v728>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.261+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c73 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-12.xml auth{0=1} v674 ap=1 s=5586 n(v0 rc2024-04-26T20:26:09.043287+0000 b5586 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af60580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c73:[<0x20000002bd2/article-12.xml v496>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c73:[<0x20000002bd2/article-12.xml v674>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.261+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c5b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-36.xml auth{0=1} v722 ap=1 s=23403 n(v0 rc2024-04-26T20:26:08.921289+0000 b23403 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af60000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c5b:[<0x20000002bd2/article-36.xml v352>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c5b:[<0x20000002bd2/article-36.xml v722>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.588 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.261+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c7e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-1.xml auth{0=1} v634 ap=1 s=2846 n(v0 rc2024-04-26T20:26:09.088286+0000 b2846 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af60b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c7e:[<0x20000002bd2/article-1.xml v562>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c7e:[<0x20000002bd2/article-1.xml v634>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.262+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c07 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-77.xml auth{0=1} v788 ap=1 s=7521 n(v0 rc2024-04-26T20:26:08.492297+0000 b7521 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c07:[<0x20000002bd2/article-77.xml v106>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c07:[<0x20000002bd2/article-77.xml v788>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.262+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-12.xml auth{0=1} v880 ap=1 s=2244 n(v0 rc2024-04-26T20:26:40.170678+0000 b2244 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009e7:[<0x20000002bd2/comment-12.xml v870>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009e7:[<0x20000002bd2/comment-12.xml v880>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.263+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c68 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-23.xml auth{0=1} v696 ap=1 s=9740 n(v0 rc2024-04-26T20:26:08.995288+0000 b9740 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af62c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c68:[<0x20000002bd2/article-23.xml v430>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c68:[<0x20000002bd2/article-23.xml v696>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.264+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c6e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-17.xml auth{0=1} v684 ap=1 s=29147 n(v0 rc2024-04-26T20:26:09.023287+0000 b29147 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af63180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c6e:[<0x20000002bd2/article-17.xml v466>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c6e:[<0x20000002bd2/article-17.xml v684>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.266+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c31 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-63.xml auth{0=1} v778 ap=1 s=29367 n(v0 rc2024-04-26T20:26:08.621295+0000 b29367 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c31:[<0x20000002bd2/article-63.xml v190>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c31:[<0x20000002bd2/article-63.xml v778>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.267+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009df [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-18.xml auth{0=1} v888 ap=1 s=4819 n(v0 rc2024-04-26T20:26:40.080680+0000 b4819 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af61600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009df:[<0x20000002bd2/comment-18.xml v856>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009df:[<0x20000002bd2/comment-18.xml v888>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.267+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-3.xml auth{0=1} v886 ap=1 s=9813 n(v0 rc2024-04-26T20:26:40.256677+0000 b9813 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af61080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009f0:[<0x20000002bd2/comment-3.xml v872>,<0x10000000971/blog-79 v102299>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009f0:[<0x20000002bd2/comment-3.xml v886>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.589 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.272+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002c28 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-66.xml auth{0=1} v784 ap=1 s=19510 n(v0 rc2024-04-26T20:26:08.596295+0000 b19510 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af61b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002c28:[<0x20000002bd2/article-66.xml v172>,<0x10000000971/blog-79 v82058>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x20000002c28:[<0x20000002bd2/article-66.xml v784>,<0x10000000971/blog-79 v105739>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.618 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:28:05.234+0000 7fd34598e700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019c3 [...2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38/ auth{1=1,2=1,3=1,4=1} v109032 ap=2 f(v4 m2024-04-26T20:26:52.216443+0000 34=34+0) n(v7 rc2024-04-26T20:26:52.216443+0000 b1064749 35=34+1) (inest sync->mix g=1,2,3,4) caps={25436=pAsLsXsFs/pAsLsXsFsx@1} | lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5577fe178000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x200000019c3:[<0x10000000971/blog-38 v109032>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[]","memoryvalue":"(2)0x200000019c3:[<0x10000000971/blog-38 v109032>,<0x100000007e0/blogtest_in v1842>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1502>,<0x100000005e2/tmp v95>,<0x100000001fb/client.0 v95>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v98>,<0x10000000001/sv_1 v122>,<0x10000000000/qa v111>,<0x1/volumes v108>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-26T20:26:07.771311+0000 32=32+0)","ondisk_value.rstat":"n(v0 rc2024-04-26T20:26:52.216443+0000 b1064749 35=34+1)","memory_value.dirstat":"f(v4 m2024-04-26T20:26:52.216443+0000 34=34+0)","memory_value.rstat":"n(v7 rc2024-04-26T20:26:52.216443+0000 b1064749 35=34+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-04-26T20:28:05.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.781+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003198 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-56.xml auth{0=1} v904 ap=1 s=2561 n(v0 rc2024-04-26T20:26:18.921094+0000 b2561 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d4ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003198:[<0x20000002e19/comment-56.xml v514>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003198:[<0x20000002e19/comment-56.xml v904>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.781+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e8b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg auth{0=1} v886 ap=1 s=43620 n(v0 rc2024-04-26T20:26:12.507219+0000 b43620 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e8b:[<0x20000002e19/picture-18.jpg v340>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e8b:[<0x20000002e19/picture-18.jpg v886>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.782+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-92.xml auth v912 ap=1 s=6418 n(v0 rc2024-04-26T20:26:35.518769+0000 b6418 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8d4ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009d9:[<0x20000002e19/article-92.xml v908>,<0x10000000971/blog-83 v102295>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009d9:[<0x20000002e19/article-92.xml v912>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.784+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000322f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-5.xml auth{0=1} v896 ap=1 s=9252 n(v0 rc2024-04-26T20:26:19.952073+0000 b9252 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000322f:[<0x20000002e19/comment-5.xml v820>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000322f:[<0x20000002e19/comment-5.xml v896>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.856 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.603+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002369 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml auth{0=1} v759 ap=1 s=15178 n(v0 rc2024-04-26T20:25:43.564784+0000 b15178 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423aef8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002369:[<0x2000000233e/article-59.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002369:[<0x2000000233e/article-59.xml v759>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.856 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.603+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002440 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg auth{0=1} v791 ap=1 s=60580 n(v0 rc2024-04-26T20:25:44.218772+0000 b60580 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423aef9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002440:[<0x2000000233e/picture-13.jpg v791>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002440:[<0x2000000233e/picture-13.jpg v791>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.784+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e89 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg auth{0=1} v890 ap=1 s=17724 n(v0 rc2024-04-26T20:26:12.503219+0000 b17724 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e89:[<0x20000002e19/picture-19.jpg v334>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e89:[<0x20000002e19/picture-19.jpg v890>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.785+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e95 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg auth{0=1} v882 ap=1 s=58087 n(v0 rc2024-04-26T20:26:12.525219+0000 b58087 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d4aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e95:[<0x20000002e19/picture-13.jpg v370>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e95:[<0x20000002e19/picture-13.jpg v882>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.785+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-29.xml auth{0=1} v902 ap=1 s=4393 n(v0 rc2024-04-26T20:26:19.511082+0000 b4393 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ea:[<0x20000002e19/comment-29.xml v676>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ea:[<0x20000002e19/comment-29.xml v902>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.857 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.603+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-56.xml auth{0=1} v907 ap=1 s=7011 n(v0 rc2024-04-26T20:26:43.445614+0000 b7011 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423aef9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009fc:[<0x2000000233e/comment-56.xml v808>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009fc:[<0x2000000233e/comment-56.xml v907>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.857 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.603+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002346 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-74.xml auth{0=1} v767 ap=1 s=19135 n(v0 rc2024-04-26T20:25:43.416787+0000 b19135 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002346:[<0x2000000233e/article-74.xml v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002346:[<0x2000000233e/article-74.xml v767>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.857 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.604+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023b5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml auth{0=1} v769 ap=1 s=2442 n(v0 rc2024-04-26T20:25:43.826779+0000 b2442 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023b5:[<0x2000000233e/article-18.xml v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023b5:[<0x2000000233e/article-18.xml v769>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.604+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a17 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-29.xml auth{0=1} v905 ap=1 s=7487 n(v0 rc2024-04-26T20:26:43.745609+0000 b7487 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a17:[<0x2000000233e/comment-29.xml v847>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a17:[<0x2000000233e/comment-29.xml v905>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.605+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023a3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml auth{0=1} v773 ap=1 s=15081 n(v0 rc2024-04-26T20:25:43.765780+0000 b15081 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023a3:[<0x2000000233e/article-27.xml v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023a3:[<0x2000000233e/article-27.xml v773>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.785+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e2d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml auth{0=1} v888 ap=1 s=19116 n(v0 rc2024-04-26T20:26:12.340222+0000 b19116 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e2d:[<0x20000002e19/article-18.xml v58>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e2d:[<0x20000002e19/article-18.xml v888>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.787+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg auth{0=1} v876 ap=1 s=27433 n(v0 rc2024-04-26T20:26:12.592217+0000 b27433 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002ea7:[<0x20000002e19/picture-4.jpg v424>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002ea7:[<0x20000002e19/picture-4.jpg v876>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.787+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e1b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-27.xml auth{0=1} v894 ap=1 s=19352 n(v0 rc2024-04-26T20:26:12.276223+0000 b19352 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e1b:[<0x20000002e19/article-27.xml v4>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e1b:[<0x20000002e19/article-27.xml v894>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.789+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e69 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg auth v906 ap=1 s=46577 n(v0 rc2024-04-26T20:26:12.446220+0000 b46577 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8d5ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e69:[<0x20000002e19/picture-35.jpg v238>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e69:[<0x20000002e19/picture-35.jpg v906>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.790+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eab [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg auth{0=1} v874 ap=1 s=39709 n(v0 rc2024-04-26T20:26:12.625217+0000 b39709 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002eab:[<0x20000002e19/picture-2.jpg v436>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002eab:[<0x20000002e19/picture-2.jpg v874>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.790+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e29 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml auth{0=1} v892 ap=1 s=23718 n(v0 rc2024-04-26T20:26:12.332222+0000 b23718 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e29:[<0x20000002e19/article-20.xml v46>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e29:[<0x20000002e19/article-20.xml v892>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.790+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e93 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg auth{0=1} v884 ap=1 s=25282 n(v0 rc2024-04-26T20:26:12.520219+0000 b25282 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d5cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e93:[<0x20000002e19/picture-14.jpg v364>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e93:[<0x20000002e19/picture-14.jpg v884>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.605+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002436 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg auth{0=1} v795 ap=1 s=42866 n(v0 rc2024-04-26T20:25:44.189772+0000 b42866 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af0e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002436:[<0x2000000233e/picture-18.jpg v795>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002436:[<0x2000000233e/picture-18.jpg v795>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.606+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002452 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg auth{0=1} v785 ap=1 s=20202 n(v0 rc2024-04-26T20:25:44.270771+0000 b20202 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002452:[<0x2000000233e/picture-4.jpg v785>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002452:[<0x2000000233e/picture-4.jpg v785>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.606+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023f6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg auth{0=1} v777 ap=1 s=34233 n(v0 rc2024-04-26T20:25:44.012776+0000 b34233 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023f6:[<0x2000000233e/picture-35.jpg v777>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023f6:[<0x2000000233e/picture-35.jpg v777>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.606+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002456 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg auth{0=1} v783 ap=1 s=42428 n(v0 rc2024-04-26T20:25:44.294770+0000 b42428 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002456:[<0x2000000233e/picture-2.jpg v783>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002456:[<0x2000000233e/picture-2.jpg v783>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.859 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.607+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023b1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml auth{0=1} v771 ap=1 s=11484 n(v0 rc2024-04-26T20:25:43.812780+0000 b11484 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023b1:[<0x2000000233e/article-20.xml v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023b1:[<0x2000000233e/article-20.xml v771>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.607+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000234f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml auth{0=1} v765 ap=1 s=31917 n(v0 rc2024-04-26T20:25:43.452787+0000 b31917 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af14000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000234f:[<0x2000000233e/article-70.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000234f:[<0x2000000233e/article-70.xml v765>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.607+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-5.xml auth{0=1} v912 ap=1 s=4488 n(v0 rc2024-04-26T20:26:55.654376+0000 b4488 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af0f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b6c:[<0x2000000233e/comment-5.xml v894>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b6c:[<0x2000000233e/comment-5.xml v912>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.793+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg auth{0=1} v878 ap=1 s=59270 n(v0 rc2024-04-26T20:26:12.548218+0000 b59270 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90624000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002ea1:[<0x20000002e19/picture-7.jpg v406>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002ea1:[<0x20000002e19/picture-7.jpg v878>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.793+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e9d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg auth{0=1} v880 ap=1 s=40214 n(v0 rc2024-04-26T20:26:12.540218+0000 b40214 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90624b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e9d:[<0x20000002e19/picture-9.jpg v394>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e9d:[<0x20000002e19/picture-9.jpg v880>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.793+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000321d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-11.xml auth{0=1} v898 ap=1 s=4863 n(v0 rc2024-04-26T20:26:19.831076+0000 b4863 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90625080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000321d:[<0x20000002e19/comment-11.xml v784>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000321d:[<0x20000002e19/comment-11.xml v898>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.794+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003205 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-20.xml auth{0=1} v900 ap=1 s=2792 n(v0 rc2024-04-26T20:26:19.672079+0000 b2792 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90625600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003205:[<0x20000002e19/comment-20.xml v730>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003205:[<0x20000002e19/comment-20.xml v900>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.794+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e9b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg auth{0=1} v887 ap=1 s=16058 n(v0 rc2024-04-26T20:26:12.536218+0000 b16058 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90df9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e9b:[<0x20000002e19/picture-10.jpg v388>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e9b:[<0x20000002e19/picture-10.jpg v887>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.795+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ead [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg auth{0=1,1=1} v852 ap=1 s=16528 n(v0 rc2024-04-26T20:26:12.640216+0000 b16528 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90df9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002ead:[<0x20000002e19/picture-1.jpg v852>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002ead:[<0x20000002e19/picture-1.jpg v852>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.796+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000320f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-16.xml auth{0=1} v899 ap=1 s=5905 n(v0 rc2024-04-26T20:26:19.738078+0000 b5905 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90dfa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000320f:[<0x20000002e19/comment-16.xml v754>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000320f:[<0x20000002e19/comment-16.xml v899>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.861 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.608+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002434 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg auth{0=1} v797 ap=1 s=20581 n(v0 rc2024-04-26T20:25:44.185772+0000 b20581 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af0f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002434:[<0x2000000233e/picture-19.jpg v797>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002434:[<0x2000000233e/picture-19.jpg v797>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.861 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.608+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000243e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg auth{0=1} v793 ap=1 s=18499 n(v0 rc2024-04-26T20:25:44.212772+0000 b18499 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000243e:[<0x2000000233e/picture-14.jpg v793>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000243e:[<0x2000000233e/picture-14.jpg v793>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.861 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.608+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002364 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml auth{0=1} v761 ap=1 s=30154 n(v0 rc2024-04-26T20:25:43.545785+0000 b30154 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002364:[<0x2000000233e/article-61.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002364:[<0x2000000233e/article-61.xml v761>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.608+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000237f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml auth{0=1} v781 ap=1 s=8971 n(v0 rc2024-04-26T20:25:43.649783+0000 b8971 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000237f:[<0x2000000233e/article-45.xml v781>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000237f:[<0x2000000233e/article-45.xml v781>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.609+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002351 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml auth{0=1} v763 ap=1 s=29007 n(v0 rc2024-04-26T20:25:43.462786+0000 b29007 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af16100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002351:[<0x2000000233e/article-69.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002351:[<0x2000000233e/article-69.xml v763>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.609+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002374 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml auth{0=1} v757 ap=1 s=21595 n(v0 rc2024-04-26T20:25:43.611784+0000 b21595 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af0fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002374:[<0x2000000233e/article-51.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002374:[<0x2000000233e/article-51.xml v757>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.610+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002448 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg auth{0=1} v789 ap=1 s=14948 n(v0 rc2024-04-26T20:25:44.241771+0000 b14948 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002448:[<0x2000000233e/picture-9.jpg v789>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002448:[<0x2000000233e/picture-9.jpg v789>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.610+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000239a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml auth{0=1} v775 ap=1 s=14879 n(v0 rc2024-04-26T20:25:43.738781+0000 b14879 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af16c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000239a:[<0x2000000233e/article-31.xml v775>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000239a:[<0x2000000233e/article-31.xml v775>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.610+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a20 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-20.xml auth{0=1} v903 ap=1 s=2065 n(v0 rc2024-04-26T20:26:43.841607+0000 b2065 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a20:[<0x2000000233e/comment-20.xml v863>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a20:[<0x2000000233e/comment-20.xml v903>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.862 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.796+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg auth{0=1} v881 ap=1 s=35047 n(v0 rc2024-04-26T20:26:12.554218+0000 b35047 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90dfac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002ea3:[<0x20000002e19/picture-6.jpg v412>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002ea3:[<0x20000002e19/picture-6.jpg v881>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.798+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-31.xml auth v925 ap=1 s=16798 n(v0 rc2024-04-26T20:27:39.822513+0000 b16798 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fc90624580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000153f:[<0x20000002e19/article-31.xml v921>,<0x10000000971/blog-83 v111282>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000153f:[<0x20000002e19/article-31.xml v925>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.798+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031d1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-37.xml auth{0=1} v909 ap=1 s=3828 n(v0 rc2024-04-26T20:26:19.260087+0000 b3828 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90df9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031d1:[<0x20000002e19/comment-37.xml v628>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031d1:[<0x20000002e19/comment-37.xml v909>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.798+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000319b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-55.xml auth{0=1} v917 ap=1 s=3402 n(v0 rc2024-04-26T20:26:18.939093+0000 b3402 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90dfb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000319b:[<0x20000002e19/comment-55.xml v520>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000319b:[<0x20000002e19/comment-55.xml v917>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.798+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003192 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-58.xml auth{0=1} v919 ap=1 s=7623 n(v0 rc2024-04-26T20:26:18.900094+0000 b7623 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90dfb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003192:[<0x20000002e19/comment-58.xml v502>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003192:[<0x20000002e19/comment-58.xml v919>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.799+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031d9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-34.xml auth{0=1} v907 ap=1 s=5005 n(v0 rc2024-04-26T20:26:19.370085+0000 b5005 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90104580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031d9:[<0x20000002e19/comment-34.xml v646>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031d9:[<0x20000002e19/comment-34.xml v907>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.799+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031f6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-25.xml auth{0=1} v905 ap=1 s=7454 n(v0 rc2024-04-26T20:26:19.580081+0000 b7454 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90104b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031f6:[<0x20000002e19/comment-25.xml v700>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031f6:[<0x20000002e19/comment-25.xml v905>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.864 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.611+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-37.xml auth{0=1} v907 ap=1 s=4566 n(v0 rc2024-04-26T20:26:43.678610+0000 b4566 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238351180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a0f:[<0x2000000233e/comment-37.xml v829>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a0f:[<0x2000000233e/comment-37.xml v907>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.864 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.612+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a29 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-11.xml auth{0=1} v901 ap=1 s=8734 n(v0 rc2024-04-26T20:26:43.950605+0000 b8734 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a29:[<0x2000000233e/comment-11.xml v865>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a29:[<0x2000000233e/comment-11.xml v901>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.864 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.612+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002387 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml auth{0=1} v779 ap=1 s=28462 n(v0 rc2024-04-26T20:25:43.678782+0000 b28462 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002387:[<0x2000000233e/article-41.xml v779>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002387:[<0x2000000233e/article-41.xml v779>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.800+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e21 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-24.xml auth{0=1} v893 ap=1 s=5759 n(v0 rc2024-04-26T20:26:12.311223+0000 b5759 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90104000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e21:[<0x20000002e19/article-24.xml v22>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e21:[<0x20000002e19/article-24.xml v893>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.800+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e8d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg auth{0=1} v889 ap=1 s=27887 n(v0 rc2024-04-26T20:26:12.510219+0000 b27887 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90106100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e8d:[<0x20000002e19/picture-17.jpg v346>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e8d:[<0x20000002e19/picture-17.jpg v889>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.800+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e4b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml auth{0=1} v879 ap=1 s=15253 n(v0 rc2024-04-26T20:26:12.395221+0000 b15253 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90106680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e4b:[<0x20000002e19/article-3.xml v148>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e4b:[<0x20000002e19/article-3.xml v879>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.865 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.613+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002446 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-10.jpg auth{0=1} v783 ap=1 s=55851 n(v0 rc2024-04-26T20:25:44.235771+0000 b55851 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x564238351700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002446:[<0x2000000233e/picture-10.jpg v783>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002446:[<0x2000000233e/picture-10.jpg v783>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.865 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.615+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002458 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-1.jpg auth{0=1,1=1} v754 ap=1 s=43514 n(v0 rc2024-04-26T20:25:44.301770+0000 b43514 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002458:[<0x2000000233e/picture-1.jpg v754>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002458:[<0x2000000233e/picture-1.jpg v754>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.866 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.801+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e65 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg auth v915 ap=1 s=16378 n(v0 rc2024-04-26T20:26:12.439220+0000 b16378 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90105b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e65:[<0x20000002e19/picture-37.jpg v226>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e65:[<0x20000002e19/picture-37.jpg v915>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.866 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.802+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e7f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg auth{0=1} v891 ap=1 s=23882 n(v0 rc2024-04-26T20:26:12.482219+0000 b23882 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90106c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e7f:[<0x20000002e19/picture-24.jpg v304>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e7f:[<0x20000002e19/picture-24.jpg v891>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.615+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a24 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-16.xml auth{0=1} v897 ap=1 s=6918 n(v0 rc2024-04-26T20:26:43.885606+0000 b6918 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a24:[<0x2000000233e/comment-16.xml v877>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a24:[<0x2000000233e/comment-16.xml v897>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.616+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023c7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-9.xml auth{0=1} v781 ap=1 s=12770 n(v0 rc2024-04-26T20:25:43.890778+0000 b12770 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023c7:[<0x2000000233e/article-9.xml v781>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023c7:[<0x2000000233e/article-9.xml v781>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.616+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002381 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-44.xml auth{0=1} v773 ap=1 s=14985 n(v0 rc2024-04-26T20:25:43.655783+0000 b14985 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002381:[<0x2000000233e/article-44.xml v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002381:[<0x2000000233e/article-44.xml v773>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.616+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000244e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-6.jpg auth{0=1} v777 ap=1 s=31246 n(v0 rc2024-04-26T20:25:44.258771+0000 b31246 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000244e:[<0x2000000233e/picture-6.jpg v777>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000244e:[<0x2000000233e/picture-6.jpg v777>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.617+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023a9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-24.xml auth{0=1} v763 ap=1 s=28494 n(v0 rc2024-04-26T20:25:43.784780+0000 b28494 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023a9:[<0x2000000233e/article-24.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023a9:[<0x2000000233e/article-24.xml v763>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.618+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000244c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg auth{0=1} v787 ap=1 s=30370 n(v0 rc2024-04-26T20:25:44.253771+0000 b30370 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000244c:[<0x2000000233e/picture-7.jpg v787>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000244c:[<0x2000000233e/picture-7.jpg v787>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.619+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002362 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-62.xml auth{0=1} v757 ap=1 s=17185 n(v0 rc2024-04-26T20:25:43.531785+0000 b17185 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002362:[<0x2000000233e/article-62.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002362:[<0x2000000233e/article-62.xml v757>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.619+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000235b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-65.xml auth{0=1} v759 ap=1 s=3313 n(v0 rc2024-04-26T20:25:43.500786+0000 b3313 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000235b:[<0x2000000233e/article-65.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000235b:[<0x2000000233e/article-65.xml v759>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.867 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.619+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002413 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-28.jpg auth{0=1} v789 ap=1 s=31105 n(v0 rc2024-04-26T20:25:44.092774+0000 b31105 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002413:[<0x2000000233e/picture-28.jpg v789>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002413:[<0x2000000233e/picture-28.jpg v789>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.620+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-41.xml auth{0=1} v909 ap=1 s=6596 n(v0 rc2024-04-26T20:26:43.631611+0000 b6596 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a0b:[<0x2000000233e/comment-41.xml v823>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a0b:[<0x2000000233e/comment-41.xml v909>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.620+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-25.xml auth{0=1} v903 ap=1 s=2310 n(v0 rc2024-04-26T20:26:43.779608+0000 b2310 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a1b:[<0x2000000233e/comment-25.xml v851>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a1b:[<0x2000000233e/comment-25.xml v903>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.622+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023f1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-37.jpg auth{0=1} v767 ap=1 s=65467 n(v0 rc2024-04-26T20:25:43.990776+0000 b65467 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023f1:[<0x2000000233e/picture-37.jpg v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023f1:[<0x2000000233e/picture-37.jpg v767>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.803+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e3f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml auth{0=1} v885 ap=1 s=4750 n(v0 rc2024-04-26T20:26:12.374221+0000 b4750 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90dfa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e3f:[<0x20000002e19/article-9.xml v112>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e3f:[<0x20000002e19/article-9.xml v885>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.804+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e5b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg auth v897 ap=1 s=64781 n(v0 rc2024-04-26T20:26:12.422221+0000 b64781 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90b32000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e5b:[<0x20000002e19/picture-42.jpg v196>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e5b:[<0x20000002e19/picture-42.jpg v897>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.805+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e43 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml auth{0=1} v883 ap=1 s=29813 n(v0 rc2024-04-26T20:26:12.381221+0000 b29813 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90107700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e43:[<0x20000002e19/article-7.xml v124>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e43:[<0x20000002e19/article-7.xml v883>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.806+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031fc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-23.xml auth{0=1} v901 ap=1 s=2550 n(v0 rc2024-04-26T20:26:19.610080+0000 b2550 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031fc:[<0x20000002e19/comment-23.xml v712>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031fc:[<0x20000002e19/comment-23.xml v901>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.807+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031f9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-24.xml auth{0=1} v903 ap=1 s=3859 n(v0 rc2024-04-26T20:26:19.599080+0000 b3859 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b33080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031f9:[<0x20000002e19/comment-24.xml v706>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031f9:[<0x20000002e19/comment-24.xml v903>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.808+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg auth v913 ap=1 s=10609 n(v0 rc2024-04-26T20:26:12.453220+0000 b10609 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90107180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e6d:[<0x20000002e19/picture-33.jpg v250>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e6d:[<0x20000002e19/picture-33.jpg v913>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.808+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e7d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg auth{0=1} v887 ap=1 s=56835 n(v0 rc2024-04-26T20:26:12.478219+0000 b56835 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90496680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e7d:[<0x20000002e19/picture-25.jpg v298>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e7d:[<0x20000002e19/picture-25.jpg v887>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.810+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031b3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-47.xml auth{0=1} v903 ap=1 s=8419 n(v0 rc2024-04-26T20:26:19.061091+0000 b8419 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90497180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031b3:[<0x20000002e19/comment-47.xml v568>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031b3:[<0x20000002e19/comment-47.xml v903>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.811+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e77 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg auth{0=1} v895 ap=1 s=29878 n(v0 rc2024-04-26T20:26:12.469220+0000 b29878 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90105080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e77:[<0x20000002e19/picture-28.jpg v280>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e77:[<0x20000002e19/picture-28.jpg v895>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.812+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031c6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-41.xml auth{0=1} v911 ap=1 s=6453 n(v0 rc2024-04-26T20:26:19.182088+0000 b6453 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90105600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031c6:[<0x20000002e19/comment-41.xml v604>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031c6:[<0x20000002e19/comment-41.xml v911>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.869 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.623+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a12 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-34.xml auth{0=1} v905 ap=1 s=8824 n(v0 rc2024-04-26T20:26:43.708609+0000 b8824 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a12:[<0x2000000233e/comment-34.xml v837>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a12:[<0x2000000233e/comment-34.xml v905>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.870 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.623+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-55.xml auth{0=1} v911 ap=1 s=7498 n(v0 rc2024-04-26T20:26:43.470614+0000 b7498 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a8d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009fd:[<0x2000000233e/comment-55.xml v809>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009fd:[<0x2000000233e/comment-55.xml v911>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.870 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.624+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002356 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-67.xml auth{0=1} v761 ap=1 s=13780 n(v0 rc2024-04-26T20:25:43.481786+0000 b13780 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002356:[<0x2000000233e/article-67.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002356:[<0x2000000233e/article-67.xml v761>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.812+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e41 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml auth{0=1} v881 ap=1 s=14283 n(v0 rc2024-04-26T20:26:12.377221+0000 b14283 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90496c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e41:[<0x20000002e19/article-8.xml v118>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e41:[<0x20000002e19/article-8.xml v881>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.813+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e61 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg auth v921 ap=1 s=40054 n(v0 rc2024-04-26T20:26:12.433220+0000 b40054 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90b32580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e61:[<0x20000002e19/picture-39.jpg v214>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e61:[<0x20000002e19/picture-39.jpg v921>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.814+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031b6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-46.xml auth{0=1} v901 ap=1 s=3498 n(v0 rc2024-04-26T20:26:19.090090+0000 b3498 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90497700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031b6:[<0x20000002e19/comment-46.xml v574>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031b6:[<0x20000002e19/comment-46.xml v901>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.814+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e71 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg auth v909 ap=1 s=47980 n(v0 rc2024-04-26T20:26:12.460220+0000 b47980 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc904ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e71:[<0x20000002e19/picture-31.jpg v262>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e71:[<0x20000002e19/picture-31.jpg v909>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.815+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e7b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg auth{0=1} v889 ap=1 s=12741 n(v0 rc2024-04-26T20:26:12.475220+0000 b12741 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e7b:[<0x20000002e19/picture-26.jpg v292>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e7b:[<0x20000002e19/picture-26.jpg v889>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.625+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002438 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-17.jpg auth{0=1} v785 ap=1 s=60973 n(v0 rc2024-04-26T20:25:44.193772+0000 b60973 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002438:[<0x2000000233e/picture-17.jpg v785>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002438:[<0x2000000233e/picture-17.jpg v785>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.626+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023d3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-3.xml auth{0=1} v775 ap=1 s=5844 n(v0 rc2024-04-26T20:25:43.928777+0000 b5844 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023d3:[<0x2000000233e/article-3.xml v775>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023d3:[<0x2000000233e/article-3.xml v775>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.627+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002424 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-24.jpg auth{0=1} v787 ap=1 s=43937 n(v0 rc2024-04-26T20:25:44.138773+0000 b43937 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002424:[<0x2000000233e/picture-24.jpg v787>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002424:[<0x2000000233e/picture-24.jpg v787>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.627+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023cb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-7.xml auth{0=1} v779 ap=1 s=7933 n(v0 rc2024-04-26T20:25:43.902778+0000 b7933 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023cb:[<0x2000000233e/article-7.xml v779>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023cb:[<0x2000000233e/article-7.xml v779>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.628+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023ed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-39.jpg auth{0=1} v769 ap=1 s=9097 n(v0 rc2024-04-26T20:25:43.983776+0000 b9097 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423aef6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023ed:[<0x2000000233e/picture-39.jpg v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023ed:[<0x2000000233e/picture-39.jpg v769>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.871 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.628+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-23.xml auth{0=1} v899 ap=1 s=9585 n(v0 rc2024-04-26T20:26:43.799607+0000 b9585 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423aef6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a1d:[<0x2000000233e/comment-23.xml v857>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a1d:[<0x2000000233e/comment-23.xml v899>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.629+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023e7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-42.jpg auth{0=1} v771 ap=1 s=15222 n(v0 rc2024-04-26T20:25:43.972776+0000 b15222 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023e7:[<0x2000000233e/picture-42.jpg v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023e7:[<0x2000000233e/picture-42.jpg v771>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.630+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023ff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-33.jpg auth{0=1} v765 ap=1 s=22526 n(v0 rc2024-04-26T20:25:44.043775+0000 b22526 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423a9dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023ff:[<0x2000000233e/picture-33.jpg v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023ff:[<0x2000000233e/picture-33.jpg v765>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.631+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000236e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-55.xml auth{0=1} v759 ap=1 s=29211 n(v0 rc2024-04-26T20:25:43.587784+0000 b29211 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b106580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000236e:[<0x2000000233e/article-55.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000236e:[<0x2000000233e/article-55.xml v759>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.815+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e27 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml auth{0=1} v885 ap=1 s=1408 n(v0 rc2024-04-26T20:26:12.327222+0000 b1408 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e27:[<0x20000002e19/article-21.xml v40>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e27:[<0x20000002e19/article-21.xml v885>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.815+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031d3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-36.xml auth{0=1} v899 ap=1 s=4465 n(v0 rc2024-04-26T20:26:19.321086+0000 b4465 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031d3:[<0x20000002e19/comment-36.xml v634>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031d3:[<0x20000002e19/comment-36.xml v899>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.815+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e37 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml auth{0=1} v883 ap=1 s=1037 n(v0 rc2024-04-26T20:26:12.361222+0000 b1037 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e37:[<0x20000002e19/article-13.xml v88>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e37:[<0x20000002e19/article-13.xml v883>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.815+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003181 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-64.xml auth{0=1} v905 ap=1 s=6834 n(v0 rc2024-04-26T20:26:18.834095+0000 b6834 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003181:[<0x20000002e19/comment-64.xml v466>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003181:[<0x20000002e19/comment-64.xml v905>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.816+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003232 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml auth{0=1} v893 ap=1 s=2991 n(v0 rc2024-04-26T20:26:19.969073+0000 b2991 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003232:[<0x20000002e19/comment-4.xml v826>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003232:[<0x20000002e19/comment-4.xml v893>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.816+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e9f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg auth{0=1} v879 ap=1 s=10907 n(v0 rc2024-04-26T20:26:12.543218+0000 b10907 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e9f:[<0x20000002e19/picture-8.jpg v400>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e9f:[<0x20000002e19/picture-8.jpg v879>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.816+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003215 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-14.xml auth{0=1} v895 ap=1 s=5613 n(v0 rc2024-04-26T20:26:19.772077+0000 b5613 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003215:[<0x20000002e19/comment-14.xml v766>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003215:[<0x20000002e19/comment-14.xml v895>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.816+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e45 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml auth{0=1} v877 ap=1 s=25656 n(v0 rc2024-04-26T20:26:12.384221+0000 b25656 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e45:[<0x20000002e19/article-6.xml v130>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e45:[<0x20000002e19/article-6.xml v877>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.817+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000317a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-67.xml auth{0=1} v907 ap=1 s=4284 n(v0 rc2024-04-26T20:26:18.805096+0000 b4284 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90df8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000317a:[<0x20000002e19/comment-67.xml v448>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000317a:[<0x20000002e19/comment-67.xml v907>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.817+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e75 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg auth v891 ap=1 s=36067 n(v0 rc2024-04-26T20:26:12.466220+0000 b36067 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90df8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e75:[<0x20000002e19/picture-29.jpg v274>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e75:[<0x20000002e19/picture-29.jpg v891>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.632+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002421 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-25.jpg auth{0=1} v787 ap=1 s=19493 n(v0 rc2024-04-26T20:25:44.127773+0000 b19493 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b106b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002421:[<0x2000000233e/picture-25.jpg v787>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002421:[<0x2000000233e/picture-25.jpg v787>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.632+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-24.xml auth{0=1} v901 ap=1 s=7291 n(v0 rc2024-04-26T20:26:43.786608+0000 b7291 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423aef6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a1c:[<0x2000000233e/comment-24.xml v855>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a1c:[<0x2000000233e/comment-24.xml v901>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.873 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.633+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023c9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-8.xml auth{0=1} v785 ap=1 s=26518 n(v0 rc2024-04-26T20:25:43.896778+0000 b26518 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b107600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023c9:[<0x2000000233e/article-8.xml v785>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023c9:[<0x2000000233e/article-8.xml v785>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.633+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a05 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-47.xml auth{0=1} v910 ap=1 s=4245 n(v0 rc2024-04-26T20:26:43.562612+0000 b4245 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b107b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a05:[<0x2000000233e/comment-47.xml v810>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a05:[<0x2000000233e/comment-47.xml v910>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.634+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002354 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-68.xml auth{0=1} v763 ap=1 s=31661 n(v0 rc2024-04-26T20:25:43.471786+0000 b31661 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b108c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002354:[<0x2000000233e/article-68.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002354:[<0x2000000233e/article-68.xml v763>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.634+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002407 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-31.jpg auth{0=1} v773 ap=1 s=20822 n(v0 rc2024-04-26T20:25:44.064775+0000 b20822 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b108680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002407:[<0x2000000233e/picture-31.jpg v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002407:[<0x2000000233e/picture-31.jpg v773>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.634+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000233f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-76.xml auth{0=1} v765 ap=1 s=15726 n(v0 rc2024-04-26T20:25:43.394788+0000 b15726 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b109700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000233f:[<0x2000000233e/article-76.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000233f:[<0x2000000233e/article-76.xml v765>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1859>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.635+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000244a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-8.jpg auth{0=1} v783 ap=1 s=25708 n(v0 rc2024-04-26T20:25:44.247771+0000 b25708 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b116000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000244a:[<0x2000000233e/picture-8.jpg v783>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000244a:[<0x2000000233e/picture-8.jpg v783>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.635+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002398 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-32.xml auth{0=1} v775 ap=1 s=32695 n(v0 rc2024-04-26T20:25:43.733781+0000 b32695 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b117080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002398:[<0x2000000233e/article-32.xml v775>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002398:[<0x2000000233e/article-32.xml v775>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.636+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000241c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-26.jpg auth{0=1} v789 ap=1 s=37875 n(v0 rc2024-04-26T20:25:44.111774+0000 b37875 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b116580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000241c:[<0x2000000233e/picture-26.jpg v789>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000241c:[<0x2000000233e/picture-26.jpg v789>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.817+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e4d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml auth{0=1} v875 ap=1 s=25194 n(v0 rc2024-04-26T20:26:12.398221+0000 b25194 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e4d:[<0x20000002e19/article-2.xml v154>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e4d:[<0x20000002e19/article-2.xml v875>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.817+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003236 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml auth{0=1} v881 ap=1 s=5088 n(v0 rc2024-04-26T20:26:20.002072+0000 b5088 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90488000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003236:[<0x20000002e19/comment-2.xml v838>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003236:[<0x20000002e19/comment-2.xml v881>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.817+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-22.xml auth{0=1} v891 ap=1 s=2548 n(v0 rc2024-04-26T20:26:19.626080+0000 b2548 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eecb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ff:[<0x20000002e19/comment-22.xml v718>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ff:[<0x20000002e19/comment-22.xml v891>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.818+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031bd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-44.xml auth{0=1} v895 ap=1 s=2552 n(v0 rc2024-04-26T20:26:19.130089+0000 b2552 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90488580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031bd:[<0x20000002e19/comment-44.xml v586>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031bd:[<0x20000002e19/comment-44.xml v895>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.819+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031f0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-27.xml auth{0=1} v879 ap=1 s=7250 n(v0 rc2024-04-26T20:26:19.544081+0000 b7250 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90489080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031f0:[<0x20000002e19/comment-27.xml v688>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031f0:[<0x20000002e19/comment-27.xml v879>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.819+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031a6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-52.xml auth{0=1} v873 ap=1 s=9515 n(v0 rc2024-04-26T20:26:18.984092+0000 b9515 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90489600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031a6:[<0x20000002e19/comment-52.xml v538>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031a6:[<0x20000002e19/comment-52.xml v873>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.820+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000317d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-66.xml auth{0=1} v875 ap=1 s=6351 n(v0 rc2024-04-26T20:26:18.820096+0000 b6351 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90489b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000317d:[<0x20000002e19/comment-66.xml v454>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000317d:[<0x20000002e19/comment-66.xml v875>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.820+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003206 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-19.xml auth{0=1} v897 ap=1 s=6759 n(v0 rc2024-04-26T20:26:19.681079+0000 b6759 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90df8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003206:[<0x20000002e19/comment-19.xml v736>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003206:[<0x20000002e19/comment-19.xml v897>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.821+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003229 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-7.xml auth{0=1} v883 ap=1 s=4605 n(v0 rc2024-04-26T20:26:19.915074+0000 b4605 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9048a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003229:[<0x20000002e19/comment-7.xml v808>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003229:[<0x20000002e19/comment-7.xml v883>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.637+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023af [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-21.xml auth{0=1} v769 ap=1 s=1783 n(v0 rc2024-04-26T20:25:43.805780+0000 b1783 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b117600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023af:[<0x2000000233e/article-21.xml v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023af:[<0x2000000233e/article-21.xml v769>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.638+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000239c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-30.xml auth{0=1} v771 ap=1 s=17921 n(v0 rc2024-04-26T20:25:43.744781+0000 b17921 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b117b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000239c:[<0x2000000233e/article-30.xml v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000239c:[<0x2000000233e/article-30.xml v771>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.639+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a10 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-36.xml auth{0=1} v906 ap=1 s=5717 n(v0 rc2024-04-26T20:26:43.685610+0000 b5717 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b118100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a10:[<0x2000000233e/comment-36.xml v832>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a10:[<0x2000000233e/comment-36.xml v906>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.640+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023bf [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-13.xml auth{0=1} v767 ap=1 s=3766 n(v0 rc2024-04-26T20:25:43.860779+0000 b3766 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b118680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023bf:[<0x2000000233e/article-13.xml v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023bf:[<0x2000000233e/article-13.xml v767>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.643+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023d9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-49.jpg auth{0=1} v777 ap=1 s=26333 n(v0 rc2024-04-26T20:25:43.947777+0000 b26333 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b109180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023d9:[<0x2000000233e/picture-49.jpg v777>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023d9:[<0x2000000233e/picture-49.jpg v777>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.643+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a06 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-46.xml auth{0=1} v908 ap=1 s=6659 n(v0 rc2024-04-26T20:26:43.584612+0000 b6659 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b108100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a06:[<0x2000000233e/comment-46.xml v812>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a06:[<0x2000000233e/comment-46.xml v908>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.644+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-4.xml auth{0=1} v915 ap=1 s=2384 n(v0 rc2024-04-26T20:26:55.660376+0000 b2384 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b119180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b6d:[<0x2000000233e/comment-4.xml v897>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b6d:[<0x2000000233e/comment-4.xml v915>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.876 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.821+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000320c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-17.xml auth{0=1} v889 ap=1 s=5330 n(v0 rc2024-04-26T20:26:19.711078+0000 b5330 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9048b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000320c:[<0x20000002e19/comment-17.xml v748>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000320c:[<0x20000002e19/comment-17.xml v889>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.821+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003212 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-15.xml auth{0=1} v887 ap=1 s=6637 n(v0 rc2024-04-26T20:26:19.756077+0000 b6637 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9048a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003212:[<0x20000002e19/comment-15.xml v760>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003212:[<0x20000002e19/comment-15.xml v887>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.822+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg auth{0=1} v871 ap=1 s=34612 n(v0 rc2024-04-26T20:26:12.578218+0000 b34612 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90488b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002ea5:[<0x20000002e19/picture-5.jpg v418>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002ea5:[<0x20000002e19/picture-5.jpg v871>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.822+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031c0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-43.xml auth{0=1} v893 ap=1 s=8574 n(v0 rc2024-04-26T20:26:19.144089+0000 b8574 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9048ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031c0:[<0x20000002e19/comment-43.xml v592>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031c0:[<0x20000002e19/comment-43.xml v893>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.824+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ba [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-45.xml auth{0=1} v897 ap=1 s=3787 n(v0 rc2024-04-26T20:26:19.108090+0000 b3787 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90008000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ba:[<0x20000002e19/comment-45.xml v580>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ba:[<0x20000002e19/comment-45.xml v897>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.825+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003224 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-9.xml auth{0=1} v885 ap=1 s=9614 n(v0 rc2024-04-26T20:26:19.869075+0000 b9614 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9048b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003224:[<0x20000002e19/comment-9.xml v796>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003224:[<0x20000002e19/comment-9.xml v885>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.827+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e53 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg auth v877 ap=1 s=63017 n(v0 rc2024-04-26T20:26:12.409221+0000 b63017 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90008580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e53:[<0x20000002e19/picture-46.jpg v172>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e53:[<0x20000002e19/picture-46.jpg v877>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.644+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002376 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-50.xml auth{0=1} v757 ap=1 s=7635 n(v0 rc2024-04-26T20:25:43.617783+0000 b7635 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b119700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002376:[<0x2000000233e/article-50.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002376:[<0x2000000233e/article-50.xml v757>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.877 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.645+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023cd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-6.xml auth{0=1} v781 ap=1 s=5786 n(v0 rc2024-04-26T20:25:43.909778+0000 b5786 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b120000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023cd:[<0x2000000233e/article-6.xml v781>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023cd:[<0x2000000233e/article-6.xml v781>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.827+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003220 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-10.xml auth{0=1} v885 ap=1 s=4879 n(v0 rc2024-04-26T20:26:19.851075+0000 b4879 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90008b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003220:[<0x20000002e19/comment-10.xml v790>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003220:[<0x20000002e19/comment-10.xml v885>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.828+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg auth{0=1} v871 ap=1 s=48786 n(v0 rc2024-04-26T20:26:12.605217+0000 b48786 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90009080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002ea9:[<0x20000002e19/picture-3.jpg v430>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002ea9:[<0x20000002e19/picture-3.jpg v871>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.829+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031a2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-53.xml auth{0=1} v893 ap=1 s=6943 n(v0 rc2024-04-26T20:26:18.974093+0000 b6943 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90009600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031a2:[<0x20000002e19/comment-53.xml v532>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031a2:[<0x20000002e19/comment-53.xml v893>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.878 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.645+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a26 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-14.xml auth{0=1} v902 ap=1 s=4311 n(v0 rc2024-04-26T20:26:43.900605+0000 b4311 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b120b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a26:[<0x2000000233e/comment-14.xml v869>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a26:[<0x2000000233e/comment-14.xml v902>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.878 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.645+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023d5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-2.xml auth{0=1} v779 ap=1 s=13487 n(v0 rc2024-04-26T20:25:43.935777+0000 b13487 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b120580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023d5:[<0x2000000233e/article-2.xml v779>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023d5:[<0x2000000233e/article-2.xml v779>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.879 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.646+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a21 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-19.xml auth{0=1} v904 ap=1 s=3970 n(v0 rc2024-04-26T20:26:43.847607+0000 b3970 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b121600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a21:[<0x2000000233e/comment-19.xml v867>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a21:[<0x2000000233e/comment-19.xml v904>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.830+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000322c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-6.xml auth{0=1} v883 ap=1 s=5226 n(v0 rc2024-04-26T20:26:19.930074+0000 b5226 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90009b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000322c:[<0x20000002e19/comment-6.xml v814>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000322c:[<0x20000002e19/comment-6.xml v883>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.830+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e99 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg auth{0=1} v875 ap=1 s=37673 n(v0 rc2024-04-26T20:26:12.532218+0000 b37673 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9000a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e99:[<0x20000002e19/picture-11.jpg v382>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e99:[<0x20000002e19/picture-11.jpg v875>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.646+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000236d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-56.xml auth{0=1} v761 ap=1 s=23339 n(v0 rc2024-04-26T20:25:43.580784+0000 b23339 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b121b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000236d:[<0x2000000233e/article-56.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000236d:[<0x2000000233e/article-56.xml v761>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.647+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-22.xml auth{0=1} v911 ap=1 s=7556 n(v0 rc2024-04-26T20:26:43.806607+0000 b7556 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a1e:[<0x2000000233e/comment-22.xml v859>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a1e:[<0x2000000233e/comment-22.xml v911>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.647+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000240f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-29.jpg auth{0=1} v791 ap=1 s=58368 n(v0 rc2024-04-26T20:25:44.083774+0000 b58368 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b121080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000240f:[<0x2000000233e/picture-29.jpg v791>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000240f:[<0x2000000233e/picture-29.jpg v791>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.647+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a08 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-44.xml auth{0=1} v917 ap=1 s=2831 n(v0 rc2024-04-26T20:26:43.596611+0000 b2831 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a08:[<0x2000000233e/comment-44.xml v819>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a08:[<0x2000000233e/comment-44.xml v917>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.647+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002383 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-43.xml auth{0=1} v769 ap=1 s=16089 n(v0 rc2024-04-26T20:25:43.663782+0000 b16089 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002383:[<0x2000000233e/article-43.xml v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002383:[<0x2000000233e/article-43.xml v769>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.647+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002396 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-33.xml auth{0=1} v767 ap=1 s=25684 n(v0 rc2024-04-26T20:25:43.727781+0000 b25684 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002396:[<0x2000000233e/article-33.xml v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002396:[<0x2000000233e/article-33.xml v767>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.648+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002450 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-5.jpg auth{0=1} v773 ap=1 s=47364 n(v0 rc2024-04-26T20:25:44.264771+0000 b47364 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002450:[<0x2000000233e/picture-5.jpg v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002450:[<0x2000000233e/picture-5.jpg v773>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.648+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000236c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-57.xml auth{0=1} v761 ap=1 s=6261 n(v0 rc2024-04-26T20:25:43.576784+0000 b6261 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000236c:[<0x2000000233e/article-57.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000236c:[<0x2000000233e/article-57.xml v761>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.880 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.649+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-2.xml auth{0=1} v926 ap=1 s=2700 n(v0 rc2024-04-26T20:26:55.699375+0000 b2700 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b6f:[<0x2000000233e/comment-2.xml v900>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b6f:[<0x2000000233e/comment-2.xml v926>,<0x10000000971/blog-61 v120410>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.652+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a00 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-52.xml auth{0=1} v903 ap=1 s=6174 n(v0 rc2024-04-26T20:26:43.510613+0000 b6174 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a00:[<0x2000000233e/comment-52.xml v815>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a00:[<0x2000000233e/comment-52.xml v903>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.652+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-7.xml auth{0=1} v927 ap=1 s=5917 n(v0 rc2024-04-26T20:26:55.644376+0000 b5917 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b6a:[<0x2000000233e/comment-7.xml v893>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b6a:[<0x2000000233e/comment-7.xml v927>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.652+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a19 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-27.xml auth{0=1} v913 ap=1 s=9653 n(v0 rc2024-04-26T20:26:43.759608+0000 b9653 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a19:[<0x2000000233e/comment-27.xml v843>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a19:[<0x2000000233e/comment-27.xml v913>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.830+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e47 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml auth{0=1} v873 ap=1 s=15704 n(v0 rc2024-04-26T20:26:12.388221+0000 b15704 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9000a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e47:[<0x20000002e19/article-5.xml v136>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e47:[<0x20000002e19/article-5.xml v873>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.830+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031d6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-35.xml auth{0=1} v889 ap=1 s=9875 n(v0 rc2024-04-26T20:26:19.346085+0000 b9875 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9000ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031d6:[<0x20000002e19/comment-35.xml v640>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031d6:[<0x20000002e19/comment-35.xml v889>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.830+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-28.xml auth{0=1} v887 ap=1 s=7563 n(v0 rc2024-04-26T20:26:19.530082+0000 b7563 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9000b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ed:[<0x20000002e19/comment-28.xml v682>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ed:[<0x20000002e19/comment-28.xml v887>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.831+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003187 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-61.xml auth{0=1} v881 ap=1 s=9142 n(v0 rc2024-04-26T20:26:18.857095+0000 b9142 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90880580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003187:[<0x20000002e19/comment-61.xml v484>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003187:[<0x20000002e19/comment-61.xml v881>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.831+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003195 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-57.xml auth{0=1} v895 ap=1 s=3691 n(v0 rc2024-04-26T20:26:18.909094+0000 b3691 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9000b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003195:[<0x20000002e19/comment-57.xml v508>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003195:[<0x20000002e19/comment-57.xml v895>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.831+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003226 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-8.xml auth{0=1} v879 ap=1 s=10006 n(v0 rc2024-04-26T20:26:19.895075+0000 b10006 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90881600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003226:[<0x20000002e19/comment-8.xml v802>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003226:[<0x20000002e19/comment-8.xml v879>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.831+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e5f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg auth v897 ap=1 s=51366 n(v0 rc2024-04-26T20:26:12.430220+0000 b51366 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90880000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e5f:[<0x20000002e19/picture-40.jpg v208>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e5f:[<0x20000002e19/picture-40.jpg v897>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.832+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e81 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg auth{0=1} v893 ap=1 s=46178 n(v0 rc2024-04-26T20:26:12.486219+0000 b46178 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e81:[<0x20000002e19/picture-23.jpg v310>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e81:[<0x20000002e19/picture-23.jpg v893>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.833+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e35 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml auth{0=1} v885 ap=1 s=5979 n(v0 rc2024-04-26T20:26:12.357222+0000 b5979 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e35:[<0x20000002e19/article-14.xml v82>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e35:[<0x20000002e19/article-14.xml v885>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.833+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e55 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg auth v913 ap=1 s=15630 n(v0 rc2024-04-26T20:26:12.412221+0000 b15630 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8f88d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e55:[<0x20000002e19/picture-45.jpg v178>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e55:[<0x20000002e19/picture-45.jpg v913>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.653+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a25 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-15.xml auth{0=1} v907 ap=1 s=5994 n(v0 rc2024-04-26T20:26:43.892606+0000 b5994 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a25:[<0x2000000233e/comment-15.xml v866>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a25:[<0x2000000233e/comment-15.xml v907>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.653+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000236a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-58.xml auth{0=1} v763 ap=1 s=3482 n(v0 rc2024-04-26T20:25:43.569784+0000 b3482 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000236a:[<0x2000000233e/article-58.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000236a:[<0x2000000233e/article-58.xml v763>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.654+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002371 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-53.xml auth{0=1} v759 ap=1 s=20091 n(v0 rc2024-04-26T20:25:43.596784+0000 b20091 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002371:[<0x2000000233e/article-53.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002371:[<0x2000000233e/article-53.xml v759>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.656+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a09 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-43.xml auth{0=1} v915 ap=1 s=6882 n(v0 rc2024-04-26T20:26:43.609611+0000 b6882 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a09:[<0x2000000233e/comment-43.xml v821>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a09:[<0x2000000233e/comment-43.xml v915>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.656+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a23 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-17.xml auth{0=1} v909 ap=1 s=4182 n(v0 rc2024-04-26T20:26:43.874606+0000 b4182 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a23:[<0x2000000233e/comment-17.xml v864>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a23:[<0x2000000233e/comment-17.xml v909>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.656+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023a0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-28.xml auth{0=1} v765 ap=1 s=6179 n(v0 rc2024-04-26T20:25:43.756781+0000 b6179 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023a0:[<0x2000000233e/article-28.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023a0:[<0x2000000233e/article-28.xml v765>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.883 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.656+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a2b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-9.xml auth{0=1} v905 ap=1 s=8068 n(v0 rc2024-04-26T20:26:43.972604+0000 b8068 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a2b:[<0x2000000233e/comment-9.xml v872>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a2b:[<0x2000000233e/comment-9.xml v905>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.656+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002372 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-52.xml auth{0=1} v757 ap=1 s=14015 n(v0 rc2024-04-26T20:25:43.607784+0000 b14015 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002372:[<0x2000000233e/article-52.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002372:[<0x2000000233e/article-52.xml v757>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.657+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a07 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-45.xml auth{0=1} v919 ap=1 s=4657 n(v0 rc2024-04-26T20:26:43.591612+0000 b4657 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a07:[<0x2000000233e/comment-45.xml v817>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a07:[<0x2000000233e/comment-45.xml v919>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.834+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e83 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg auth{0=1} v891 ap=1 s=41223 n(v0 rc2024-04-26T20:26:12.491219+0000 b41223 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90221080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e83:[<0x20000002e19/picture-22.jpg v316>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e83:[<0x20000002e19/picture-22.jpg v891>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.835+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e25 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-22.xml auth{0=1} v877 ap=1 s=15707 n(v0 rc2024-04-26T20:26:12.322223+0000 b15707 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90880b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e25:[<0x20000002e19/article-22.xml v34>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e25:[<0x20000002e19/article-22.xml v877>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.836+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ce [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-38.xml auth{0=1} v891 ap=1 s=6865 n(v0 rc2024-04-26T20:26:19.241087+0000 b6865 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90881080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ce:[<0x20000002e19/comment-38.xml v622>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ce:[<0x20000002e19/comment-38.xml v891>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.836+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e3b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml auth{0=1} v881 ap=1 s=20672 n(v0 rc2024-04-26T20:26:12.367222+0000 b20672 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90221600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e3b:[<0x20000002e19/article-11.xml v100>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e3b:[<0x20000002e19/article-11.xml v881>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.839+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e31 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml auth{0=1} v889 ap=1 s=5468 n(v0 rc2024-04-26T20:26:12.349222+0000 b5468 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90222100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e31:[<0x20000002e19/article-16.xml v70>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e31:[<0x20000002e19/article-16.xml v889>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.839+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e5d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg auth v915 ap=1 s=60460 n(v0 rc2024-04-26T20:26:12.426220+0000 b60460 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90220580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e5d:[<0x20000002e19/picture-41.jpg v202>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e5d:[<0x20000002e19/picture-41.jpg v915>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.839+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003185 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-62.xml auth{0=1} v911 ap=1 s=4191 n(v0 rc2024-04-26T20:26:18.850095+0000 b4191 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90220b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003185:[<0x20000002e19/comment-62.xml v478>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003185:[<0x20000002e19/comment-62.xml v911>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.841+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000318f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-59.xml auth{0=1} v909 ap=1 s=4335 n(v0 rc2024-04-26T20:26:18.888094+0000 b4335 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90221b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000318f:[<0x20000002e19/comment-59.xml v496>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000318f:[<0x20000002e19/comment-59.xml v909>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.841+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e91 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg auth{0=1} v887 ap=1 s=18454 n(v0 rc2024-04-26T20:26:12.517219+0000 b18454 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90222c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e91:[<0x20000002e19/picture-15.jpg v358>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e91:[<0x20000002e19/picture-15.jpg v887>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.842+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e1d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-26.xml auth{0=1} v897 ap=1 s=22539 n(v0 rc2024-04-26T20:26:12.297223+0000 b22539 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90222680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e1d:[<0x20000002e19/article-26.xml v10>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e1d:[<0x20000002e19/article-26.xml v897>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.885 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.657+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a2a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-10.xml auth{0=1} v896 ap=1 s=7576 n(v0 rc2024-04-26T20:26:43.962604+0000 b7576 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af68580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a2a:[<0x2000000233e/comment-10.xml v866>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a2a:[<0x2000000233e/comment-10.xml v896>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.885 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.657+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023df [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-46.jpg auth{0=1} v771 ap=1 s=38260 n(v0 rc2024-04-26T20:25:43.957777+0000 b38260 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023df:[<0x2000000233e/picture-46.jpg v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023df:[<0x2000000233e/picture-46.jpg v771>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.885 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.658+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002454 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg auth{0=1} v769 ap=1 s=61419 n(v0 rc2024-04-26T20:25:44.287770+0000 b61419 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af68b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002454:[<0x2000000233e/picture-3.jpg v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002454:[<0x2000000233e/picture-3.jpg v769>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.843+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e51 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg auth v901 ap=1 s=61102 n(v0 rc2024-04-26T20:26:12.406221+0000 b61102 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90223180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e51:[<0x20000002e19/picture-47.jpg v166>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e51:[<0x20000002e19/picture-47.jpg v901>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.844+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e97 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg auth{0=1} v883 ap=1 s=42692 n(v0 rc2024-04-26T20:26:12.528218+0000 b42692 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e6f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e97:[<0x20000002e19/picture-12.jpg v376>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e97:[<0x20000002e19/picture-12.jpg v883>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.846+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ab [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-50.xml auth{0=1} v907 ap=1 s=2959 n(v0 rc2024-04-26T20:26:19.014092+0000 b2959 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e6f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ab:[<0x20000002e19/comment-50.xml v550>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ab:[<0x20000002e19/comment-50.xml v907>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.846+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e57 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg auth v899 ap=1 s=60679 n(v0 rc2024-04-26T20:26:12.416221+0000 b60679 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8e6f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e57:[<0x20000002e19/picture-44.jpg v184>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e57:[<0x20000002e19/picture-44.jpg v899>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.886 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.658+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-6.xml auth{0=1} v915 ap=1 s=4478 n(v0 rc2024-04-26T20:26:55.650376+0000 b4478 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af69600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b6b:[<0x2000000233e/comment-6.xml v893>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b6b:[<0x2000000233e/comment-6.xml v915>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.886 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.658+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023cf [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml auth{0=1} v771 ap=1 s=23468 n(v0 rc2024-04-26T20:25:43.916778+0000 b23468 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af6a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023cf:[<0x2000000233e/article-5.xml v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023cf:[<0x2000000233e/article-5.xml v771>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.846+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e49 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml auth{0=1} v877 ap=1 s=18410 n(v0 rc2024-04-26T20:26:12.392221+0000 b18410 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e6f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e49:[<0x20000002e19/article-4.xml v142>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e49:[<0x20000002e19/article-4.xml v877>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.850+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e1f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-25.xml auth{0=1} v895 ap=1 s=6851 n(v0 rc2024-04-26T20:26:12.304223+0000 b6851 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e6f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e1f:[<0x20000002e19/article-25.xml v16>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e1f:[<0x20000002e19/article-25.xml v895>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.850+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031e2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-31.xml auth{0=1} v903 ap=1 s=3894 n(v0 rc2024-04-26T20:26:19.456083+0000 b3894 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e6f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031e2:[<0x20000002e19/comment-31.xml v664>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031e2:[<0x20000002e19/comment-31.xml v903>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.887 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.659+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002394 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml auth{0=1} v765 ap=1 s=24510 n(v0 rc2024-04-26T20:25:43.722781+0000 b24510 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af6a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002394:[<0x2000000233e/article-34.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002394:[<0x2000000233e/article-34.xml v765>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.887 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.659+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a11 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-35.xml auth{0=1} v900 ap=1 s=8587 n(v0 rc2024-04-26T20:26:43.694610+0000 b8587 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af6ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a11:[<0x2000000233e/comment-35.xml v832>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a11:[<0x2000000233e/comment-35.xml v900>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.887 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.659+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-53.xml auth{0=1} v904 ap=1 s=8056 n(v0 rc2024-04-26T20:26:43.496613+0000 b8056 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af69080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009ff:[<0x2000000233e/comment-53.xml v812>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009ff:[<0x2000000233e/comment-53.xml v904>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.661+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a18 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-28.xml auth{0=1} v898 ap=1 s=5553 n(v0 rc2024-04-26T20:26:43.751608+0000 b5553 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af6b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a18:[<0x2000000233e/comment-28.xml v840>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a18:[<0x2000000233e/comment-28.xml v898>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.661+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002444 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg auth{0=1} v773 ap=1 s=23500 n(v0 rc2024-04-26T20:25:44.229771+0000 b23500 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af69b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002444:[<0x2000000233e/picture-11.jpg v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002444:[<0x2000000233e/picture-11.jpg v773>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.852+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000318a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-60.xml auth{0=1} v888 ap=1 s=7429 n(v0 rc2024-04-26T20:26:18.880094+0000 b7429 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000318a:[<0x20000002e19/comment-60.xml v490>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000318a:[<0x20000002e19/comment-60.xml v888>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.852+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e3d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml auth{0=1} v879 ap=1 s=12867 n(v0 rc2024-04-26T20:26:12.371222+0000 b12867 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90223700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e3d:[<0x20000002e19/article-10.xml v106>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e3d:[<0x20000002e19/article-10.xml v879>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.661+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023eb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg auth{0=1} v767 ap=1 s=28367 n(v0 rc2024-04-26T20:25:43.980776+0000 b28367 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af74b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023eb:[<0x2000000233e/picture-40.jpg v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023eb:[<0x2000000233e/picture-40.jpg v767>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.661+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000239e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml auth{0=1} v763 ap=1 s=3191 n(v0 rc2024-04-26T20:25:43.750781+0000 b3191 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af74000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000239e:[<0x2000000233e/article-29.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000239e:[<0x2000000233e/article-29.xml v763>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.854+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031b0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-48.xml auth{0=1} v905 ap=1 s=4269 n(v0 rc2024-04-26T20:26:19.050091+0000 b4269 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e6f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031b0:[<0x20000002e19/comment-48.xml v562>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031b0:[<0x20000002e19/comment-48.xml v905>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.854+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e73 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg auth v886 ap=1 s=11620 n(v0 rc2024-04-26T20:26:12.463220+0000 b11620 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8fe79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e73:[<0x20000002e19/picture-30.jpg v268>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e73:[<0x20000002e19/picture-30.jpg v886>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.856+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e33 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml auth{0=1} v874 ap=1 s=7043 n(v0 rc2024-04-26T20:26:12.353222+0000 b7043 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e33:[<0x20000002e19/article-15.xml v76>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e33:[<0x20000002e19/article-15.xml v874>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.889 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.662+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002367 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml auth{0=1} v759 ap=1 s=11160 n(v0 rc2024-04-26T20:25:43.552785+0000 b11160 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af74580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002367:[<0x2000000233e/article-60.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002367:[<0x2000000233e/article-60.xml v759>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.890 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.662+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023ad [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml auth{0=1} v761 ap=1 s=14610 n(v0 rc2024-04-26T20:25:43.797780+0000 b14610 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af75600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023ad:[<0x2000000233e/article-22.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023ad:[<0x2000000233e/article-22.xml v761>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.890 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.662+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-38.xml auth{0=1} v902 ap=1 s=2180 n(v0 rc2024-04-26T20:26:43.668610+0000 b2180 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af75b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a0e:[<0x2000000233e/comment-38.xml v826>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a0e:[<0x2000000233e/comment-38.xml v902>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.890 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.662+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002378 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml auth{0=1} v757 ap=1 s=24978 n(v0 rc2024-04-26T20:25:43.623783+0000 b24978 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af76100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002378:[<0x2000000233e/article-49.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002378:[<0x2000000233e/article-49.xml v757>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.890 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.663+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b69 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-8.xml auth{0=1} v916 ap=1 s=7643 n(v0 rc2024-04-26T20:26:55.601377+0000 b7643 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af76680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b69:[<0x2000000233e/comment-8.xml v886>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b69:[<0x2000000233e/comment-8.xml v916>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.856+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003237 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml auth{1=1} v854 ap=1 s=3186 n(v0 rc2024-04-26T20:26:20.014072+0000 b3186 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003237:[<0x20000002e19/comment-1.xml v854>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003237:[<0x20000002e19/comment-1.xml v854>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.859+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031c8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-40.xml auth{0=1} v882 ap=1 s=7025 n(v0 rc2024-04-26T20:26:19.197088+0000 b7025 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031c8:[<0x20000002e19/comment-40.xml v610>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031c8:[<0x20000002e19/comment-40.xml v882>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.891 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.663+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023bd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml auth{0=1} v763 ap=1 s=26443 n(v0 rc2024-04-26T20:25:43.853779+0000 b26443 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023bd:[<0x2000000233e/article-14.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023bd:[<0x2000000233e/article-14.xml v763>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.891 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.664+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002428 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg auth{0=1} v797 ap=1 s=30407 n(v0 rc2024-04-26T20:25:44.151773+0000 b30407 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002428:[<0x2000000233e/picture-23.jpg v797>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002428:[<0x2000000233e/picture-23.jpg v797>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.891 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.669+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023e1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg auth{0=1} v777 ap=1 s=16816 n(v0 rc2024-04-26T20:25:43.961777+0000 b16816 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023e1:[<0x2000000233e/picture-45.jpg v777>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023e1:[<0x2000000233e/picture-45.jpg v777>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.859+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031dc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-33.xml auth{0=1} v890 ap=1 s=8007 n(v0 rc2024-04-26T20:26:19.400084+0000 b8007 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031dc:[<0x20000002e19/comment-33.xml v652>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031dc:[<0x20000002e19/comment-33.xml v890>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.859+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e85 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg auth{0=1} v878 ap=1 s=63193 n(v0 rc2024-04-26T20:26:12.495219+0000 b63193 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e85:[<0x20000002e19/picture-21.jpg v322>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e85:[<0x20000002e19/picture-21.jpg v878>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.859+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031cb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-39.xml auth{0=1} v894 ap=1 s=4167 n(v0 rc2024-04-26T20:26:19.216088+0000 b4167 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031cb:[<0x20000002e19/comment-39.xml v616>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031cb:[<0x20000002e19/comment-39.xml v894>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.892 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.669+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023e9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg auth{0=1} v773 ap=1 s=48957 n(v0 rc2024-04-26T20:25:43.976776+0000 b48957 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023e9:[<0x2000000233e/picture-41.jpg v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023e9:[<0x2000000233e/picture-41.jpg v773>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.892 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.674+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000237d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml auth{0=1} v779 ap=1 s=12098 n(v0 rc2024-04-26T20:25:43.642783+0000 b12098 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000237d:[<0x2000000233e/article-46.xml v779>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000237d:[<0x2000000233e/article-46.xml v779>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.892 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.860+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e67 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg auth v900 ap=1 s=36407 n(v0 rc2024-04-26T20:26:12.443220+0000 b36407 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8fe7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e67:[<0x20000002e19/picture-36.jpg v232>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e67:[<0x20000002e19/picture-36.jpg v900>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.892 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.860+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e59 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg auth v884 ap=1 s=36010 n(v0 rc2024-04-26T20:26:12.419221+0000 b36010 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90200000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e59:[<0x20000002e19/picture-43.jpg v190>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e59:[<0x20000002e19/picture-43.jpg v884>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.893 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.674+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000237b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml auth{0=1} v783 ap=1 s=7710 n(v0 rc2024-04-26T20:25:43.636783+0000 b7710 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000237b:[<0x2000000233e/article-47.xml v783>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000237b:[<0x2000000233e/article-47.xml v783>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.893 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.675+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000234d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml auth{0=1} v761 ap=1 s=15289 n(v0 rc2024-04-26T20:25:43.440787+0000 b15289 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000234d:[<0x2000000233e/article-71.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000234d:[<0x2000000233e/article-71.xml v761>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.893 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.675+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000242b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg auth{0=1} v795 ap=1 s=37807 n(v0 rc2024-04-26T20:25:44.163773+0000 b37807 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000242b:[<0x2000000233e/picture-22.jpg v795>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000242b:[<0x2000000233e/picture-22.jpg v795>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.893 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.675+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023c3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml auth{0=1} v789 ap=1 s=2533 n(v0 rc2024-04-26T20:25:43.875778+0000 b2533 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023c3:[<0x2000000233e/article-11.xml v789>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023c3:[<0x2000000233e/article-11.xml v789>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.893 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.676+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023b9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml auth{0=1} v765 ap=1 s=16748 n(v0 rc2024-04-26T20:25:43.840779+0000 b16748 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023b9:[<0x2000000233e/article-16.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023b9:[<0x2000000233e/article-16.xml v765>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.894 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.860+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e2b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml auth{0=1} v872 ap=1 s=18458 n(v0 rc2024-04-26T20:26:12.336222+0000 b18458 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90200580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e2b:[<0x20000002e19/article-19.xml v52>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e2b:[<0x20000002e19/article-19.xml v872>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.894 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.860+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031df [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-32.xml auth{0=1} v892 ap=1 s=7752 n(v0 rc2024-04-26T20:26:19.425084+0000 b7752 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90201080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031df:[<0x20000002e19/comment-32.xml v658>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031df:[<0x20000002e19/comment-32.xml v892>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.894 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.676+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000236f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml auth{0=1} v759 ap=1 s=32022 n(v0 rc2024-04-26T20:25:43.591784+0000 b32022 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000236f:[<0x2000000233e/article-54.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000236f:[<0x2000000233e/article-54.xml v759>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.894 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.677+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023a5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml auth{0=1} v769 ap=1 s=17968 n(v0 rc2024-04-26T20:25:43.773780+0000 b17968 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023a5:[<0x2000000233e/article-26.xml v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023a5:[<0x2000000233e/article-26.xml v769>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.895 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.862+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e63 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg auth v880 ap=1 s=54985 n(v0 rc2024-04-26T20:26:12.436220+0000 b54985 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90202100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e63:[<0x20000002e19/picture-38.jpg v220>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e63:[<0x20000002e19/picture-38.jpg v880>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.895 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.862+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000319f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-54.xml auth{0=1} v896 ap=1 s=7944 n(v0 rc2024-04-26T20:26:18.960093+0000 b7944 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90201b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000319f:[<0x20000002e19/comment-54.xml v526>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000319f:[<0x20000002e19/comment-54.xml v896>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.895 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.864+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003184 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-63.xml auth{0=1} v898 ap=1 s=8926 n(v0 rc2024-04-26T20:26:18.844095+0000 b8926 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90201600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003184:[<0x20000002e19/comment-63.xml v472>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003184:[<0x20000002e19/comment-63.xml v898>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.898 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.677+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000243c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg auth{0=1} v793 ap=1 s=19915 n(v0 rc2024-04-26T20:25:44.202772+0000 b19915 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000243c:[<0x2000000233e/picture-15.jpg v793>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000243c:[<0x2000000233e/picture-15.jpg v793>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.898 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.677+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023dd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg auth{0=1} v781 ap=1 s=64523 n(v0 rc2024-04-26T20:25:43.953777+0000 b64523 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023dd:[<0x2000000233e/picture-47.jpg v781>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023dd:[<0x2000000233e/picture-47.jpg v781>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.898 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.678+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002442 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg auth{0=1} v791 ap=1 s=8743 n(v0 rc2024-04-26T20:25:44.223772+0000 b8743 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002442:[<0x2000000233e/picture-12.jpg v791>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002442:[<0x2000000233e/picture-12.jpg v791>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.898 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.678+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023c5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml auth{0=1} v787 ap=1 s=4275 n(v0 rc2024-04-26T20:25:43.883778+0000 b4275 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afcf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023c5:[<0x2000000233e/article-10.xml v787>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023c5:[<0x2000000233e/article-10.xml v787>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.678+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023e3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg auth{0=1} v775 ap=1 s=39479 n(v0 rc2024-04-26T20:25:43.964777+0000 b39479 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afda580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023e3:[<0x2000000233e/picture-44.jpg v775>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023e3:[<0x2000000233e/picture-44.jpg v775>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.678+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a02 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-50.xml auth{0=1} v861 ap=1 s=3282 n(v0 rc2024-04-26T20:26:43.532613+0000 b3282 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a02:[<0x2000000233e/comment-50.xml v807>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a02:[<0x2000000233e/comment-50.xml v861>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.678+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023d1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml auth{0=1} v785 ap=1 s=14696 n(v0 rc2024-04-26T20:25:43.922777+0000 b14696 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023d1:[<0x2000000233e/article-4.xml v785>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023d1:[<0x2000000233e/article-4.xml v785>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.679+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml auth{0=1} v924 ap=1 s=9735 n(v0 rc2024-04-26T20:27:07.721140+0000 b9735 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000bd6:[<0x2000000233e/article-48.xml v924>,<0x10000000971/blog-61 v108261>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000bd6:[<0x2000000233e/article-48.xml v924>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.679+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023a7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml auth{0=1} v767 ap=1 s=16385 n(v0 rc2024-04-26T20:25:43.778780+0000 b16385 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023a7:[<0x2000000233e/article-25.xml v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023a7:[<0x2000000233e/article-25.xml v767>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.679+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a04 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-48.xml auth{0=1} v859 ap=1 s=3499 n(v0 rc2024-04-26T20:26:43.553612+0000 b3499 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a04:[<0x2000000233e/comment-48.xml v809>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a04:[<0x2000000233e/comment-48.xml v859>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.680+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a15 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-31.xml auth{0=1} v857 ap=1 s=3343 n(v0 rc2024-04-26T20:26:43.727609+0000 b3343 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a15:[<0x2000000233e/comment-31.xml v841>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a15:[<0x2000000233e/comment-31.xml v857>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.680+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000242e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-21.jpg auth{0=1} v779 ap=1 s=34176 n(v0 rc2024-04-26T20:25:44.170773+0000 b34176 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afa4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000242e:[<0x2000000233e/picture-21.jpg v779>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000242e:[<0x2000000233e/picture-21.jpg v779>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.681+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000238d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml auth{0=1} v771 ap=1 s=32688 n(v0 rc2024-04-26T20:25:43.700782+0000 b32688 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afdc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000238d:[<0x2000000233e/article-38.xml v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000238d:[<0x2000000233e/article-38.xml v771>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.682+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000234b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-72.xml auth{0=1} v757 ap=1 s=28971 n(v0 rc2024-04-26T20:25:43.434787+0000 b28971 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afa3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000234b:[<0x2000000233e/article-72.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000234b:[<0x2000000233e/article-72.xml v757>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.682+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b70 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-1.xml auth{0=1} v922 ap=1 s=4769 n(v0 rc2024-04-26T20:26:55.703375+0000 b4769 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afa5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b70:[<0x2000000233e/comment-1.xml v902>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b70:[<0x2000000233e/comment-1.xml v922>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.899 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.682+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002392 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-35.xml auth{0=1} v765 ap=1 s=31768 n(v0 rc2024-04-26T20:25:43.716781+0000 b31768 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afa4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002392:[<0x2000000233e/article-35.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002392:[<0x2000000233e/article-35.xml v765>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.682+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002389 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-40.xml auth{0=1} v771 ap=1 s=5334 n(v0 rc2024-04-26T20:25:43.683782+0000 b5334 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002389:[<0x2000000233e/article-40.xml v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002389:[<0x2000000233e/article-40.xml v771>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.683+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000240c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-30.jpg auth{0=1} v763 ap=1 s=11317 n(v0 rc2024-04-26T20:25:44.072774+0000 b11317 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000240c:[<0x2000000233e/picture-30.jpg v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000240c:[<0x2000000233e/picture-30.jpg v763>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.683+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023bb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-15.xml auth{0=1} v759 ap=1 s=32135 n(v0 rc2024-04-26T20:25:43.847779+0000 b32135 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023bb:[<0x2000000233e/article-15.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023bb:[<0x2000000233e/article-15.xml v759>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.683+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-40.xml auth{0=1} v913 ap=1 s=8081 n(v0 rc2024-04-26T20:26:43.643611+0000 b8081 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a0c:[<0x2000000233e/comment-40.xml v824>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a0c:[<0x2000000233e/comment-40.xml v913>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.683+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a13 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-33.xml auth{0=1} v909 ap=1 s=7340 n(v0 rc2024-04-26T20:26:43.712609+0000 b7340 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a13:[<0x2000000233e/comment-33.xml v836>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a13:[<0x2000000233e/comment-33.xml v909>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.684+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-39.xml auth{0=1} v911 ap=1 s=4573 n(v0 rc2024-04-26T20:26:43.660610+0000 b4573 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a0d:[<0x2000000233e/comment-39.xml v828>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a0d:[<0x2000000233e/comment-39.xml v911>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.684+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023b3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-19.xml auth{0=1} v761 ap=1 s=9306 n(v0 rc2024-04-26T20:25:43.819779+0000 b9306 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023b3:[<0x2000000233e/article-19.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023b3:[<0x2000000233e/article-19.xml v761>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.684+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023f3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-36.jpg auth{0=1} v767 ap=1 s=17967 n(v0 rc2024-04-26T20:25:43.995776+0000 b17967 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023f3:[<0x2000000233e/picture-36.jpg v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023f3:[<0x2000000233e/picture-36.jpg v767>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.684+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023e5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-43.jpg auth{0=1} v775 ap=1 s=19148 n(v0 rc2024-04-26T20:25:43.968777+0000 b19148 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023e5:[<0x2000000233e/picture-43.jpg v775>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023e5:[<0x2000000233e/picture-43.jpg v775>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.685+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002432 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-20.jpg auth{0=1} v777 ap=1 s=43071 n(v0 rc2024-04-26T20:25:44.181772+0000 b43071 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002432:[<0x2000000233e/picture-20.jpg v777>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002432:[<0x2000000233e/picture-20.jpg v777>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1871>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.686+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a14 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-32.xml auth{0=1} v907 ap=1 s=5140 n(v0 rc2024-04-26T20:26:43.722609+0000 b5140 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afb5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a14:[<0x2000000233e/comment-32.xml v838>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a14:[<0x2000000233e/comment-32.xml v907>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.686+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fe [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-54.xml auth{0=1} v915 ap=1 s=4318 n(v0 rc2024-04-26T20:26:43.484614+0000 b4318 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009fe:[<0x2000000233e/comment-54.xml v803>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009fe:[<0x2000000233e/comment-54.xml v915>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.900 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.687+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000235d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-64.xml auth{0=1} v759 ap=1 s=17909 n(v0 rc2024-04-26T20:25:43.508786+0000 b17909 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b05e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000235d:[<0x2000000233e/article-64.xml v759>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000235d:[<0x2000000233e/article-64.xml v759>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.687+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a27 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-13.xml auth{0=1} v909 ap=1 s=5691 n(v0 rc2024-04-26T20:26:43.915605+0000 b5691 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b05e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a27:[<0x2000000233e/comment-13.xml v882>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a27:[<0x2000000233e/comment-13.xml v909>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.688+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-21.xml auth{0=1} v913 ap=1 s=7096 n(v0 rc2024-04-26T20:26:43.832607+0000 b7096 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b05eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a1f:[<0x2000000233e/comment-21.xml v860>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a1f:[<0x2000000233e/comment-21.xml v913>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.688+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-26.xml auth{0=1} v915 ap=1 s=6045 n(v0 rc2024-04-26T20:26:43.767608+0000 b6045 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b05f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a1a:[<0x2000000233e/comment-26.xml v850>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a1a:[<0x2000000233e/comment-26.xml v915>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.688+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002342 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-75.xml auth{0=1} v765 ap=1 s=24223 n(v0 rc2024-04-26T20:25:43.406788+0000 b24223 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b05f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002342:[<0x2000000233e/article-75.xml v765>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002342:[<0x2000000233e/article-75.xml v765>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.688+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002417 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-27.jpg auth{0=1} v789 ap=1 s=44195 n(v0 rc2024-04-26T20:25:44.101774+0000 b44195 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b060100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002417:[<0x2000000233e/picture-27.jpg v789>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002417:[<0x2000000233e/picture-27.jpg v789>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.689+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002385 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-42.xml auth{0=1} v773 ap=1 s=11879 n(v0 rc2024-04-26T20:25:43.672782+0000 b11879 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002385:[<0x2000000233e/article-42.xml v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002385:[<0x2000000233e/article-42.xml v773>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.689+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000238b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-39.xml auth{0=1} v781 ap=1 s=3634 n(v0 rc2024-04-26T20:25:43.690782+0000 b3634 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b060c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000238b:[<0x2000000233e/article-39.xml v781>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000238b:[<0x2000000233e/article-39.xml v781>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.690+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002390 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-36.xml auth{0=1} v777 ap=1 s=6766 n(v0 rc2024-04-26T20:25:43.711782+0000 b6766 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b061180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002390:[<0x2000000233e/article-36.xml v777>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002390:[<0x2000000233e/article-36.xml v777>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.690+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023ef [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-38.jpg auth{0=1} v769 ap=1 s=10418 n(v0 rc2024-04-26T20:25:43.986776+0000 b10418 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afbb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023ef:[<0x2000000233e/picture-38.jpg v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023ef:[<0x2000000233e/picture-38.jpg v769>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.690+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023c1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-12.xml auth{0=1} v767 ap=1 s=24924 n(v0 rc2024-04-26T20:25:43.867778+0000 b24924 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b061700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023c1:[<0x2000000233e/article-12.xml v767>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023c1:[<0x2000000233e/article-12.xml v767>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.691+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000238f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-37.xml auth{0=1} v779 ap=1 s=30209 n(v0 rc2024-04-26T20:25:43.706782+0000 b30209 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b05fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000238f:[<0x2000000233e/article-37.xml v779>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000238f:[<0x2000000233e/article-37.xml v779>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.691+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002349 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-73.xml auth{0=1} v763 ap=1 s=12583 n(v0 rc2024-04-26T20:25:43.427787+0000 b12583 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b060680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002349:[<0x2000000233e/article-73.xml v763>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002349:[<0x2000000233e/article-73.xml v763>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.901 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.691+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a16 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-30.xml auth{0=1} v917 ap=1 s=5157 n(v0 rc2024-04-26T20:26:43.742609+0000 b5157 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b06e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a16:[<0x2000000233e/comment-30.xml v844>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a16:[<0x2000000233e/comment-30.xml v917>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.691+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023fb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-34.jpg auth{0=1} v775 ap=1 s=54772 n(v0 rc2024-04-26T20:25:44.030775+0000 b54772 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b06eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023fb:[<0x2000000233e/picture-34.jpg v775>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023fb:[<0x2000000233e/picture-34.jpg v775>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.691+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023d7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-1.xml auth{0=1} v785 ap=1 s=9351 n(v0 rc2024-04-26T20:25:43.941777+0000 b9351 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b06e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023d7:[<0x2000000233e/article-1.xml v785>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023d7:[<0x2000000233e/article-1.xml v785>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.692+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-3.xml auth{0=1} v928 ap=1 s=7936 n(v0 rc2024-04-26T20:26:55.691375+0000 b7936 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b06f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000b6e:[<0x2000000233e/comment-3.xml v898>,<0x10000000971/blog-61 v103705>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000b6e:[<0x2000000233e/comment-3.xml v928>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.692+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002359 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-66.xml auth{0=1} v761 ap=1 s=11941 n(v0 rc2024-04-26T20:25:43.490786+0000 b11941 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b06fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002359:[<0x2000000233e/article-66.xml v761>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002359:[<0x2000000233e/article-66.xml v761>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.693+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000243a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-16.jpg auth{0=1} v787 ap=1 s=53799 n(v0 rc2024-04-26T20:25:44.197772+0000 b53799 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b070100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000243a:[<0x2000000233e/picture-16.jpg v787>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x2000000243a:[<0x2000000233e/picture-16.jpg v787>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.693+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a22 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-18.xml auth{0=1} v911 ap=1 s=3473 n(v0 rc2024-04-26T20:26:43.867606+0000 b3473 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b06f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a22:[<0x2000000233e/comment-18.xml v872>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a22:[<0x2000000233e/comment-18.xml v911>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.693+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a28 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-12.xml auth{0=1} v907 ap=1 s=5339 n(v0 rc2024-04-26T20:26:43.933605+0000 b5339 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b070680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a28:[<0x2000000233e/comment-12.xml v886>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a28:[<0x2000000233e/comment-12.xml v907>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.693+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a03 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-49.xml auth{0=1} v921 ap=1 s=3560 n(v0 rc2024-04-26T20:26:43.544612+0000 b3560 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b070c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a03:[<0x2000000233e/comment-49.xml v810>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a03:[<0x2000000233e/comment-49.xml v921>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.694+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023ab [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-23.xml auth{0=1} v771 ap=1 s=23773 n(v0 rc2024-04-26T20:25:43.791780+0000 b23773 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b07a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023ab:[<0x2000000233e/article-23.xml v771>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023ab:[<0x2000000233e/article-23.xml v771>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.695+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-42.xml auth{0=1} v919 ap=1 s=2497 n(v0 rc2024-04-26T20:26:43.619611+0000 b2497 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b071180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a0a:[<0x2000000233e/comment-42.xml v820>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a0a:[<0x2000000233e/comment-42.xml v919>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.695+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002360 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-63.xml auth{0=1} v757 ap=1 s=18836 n(v0 rc2024-04-26T20:25:43.520785+0000 b18836 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b07b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002360:[<0x2000000233e/article-63.xml v757>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002360:[<0x2000000233e/article-63.xml v757>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.902 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.696+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023db [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-48.jpg auth{0=1} v783 ap=1 s=14864 n(v0 rc2024-04-26T20:25:43.950777+0000 b14864 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b07b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023db:[<0x2000000233e/picture-48.jpg v783>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023db:[<0x2000000233e/picture-48.jpg v783>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.903 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.696+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002403 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-32.jpg auth{0=1} v773 ap=1 s=35066 n(v0 rc2024-04-26T20:25:44.053775+0000 b35066 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b07ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002403:[<0x2000000233e/picture-32.jpg v773>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x20000002403:[<0x2000000233e/picture-32.jpg v773>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.903 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.697+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x200000023b7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-17.xml auth{0=1} v769 ap=1 s=3525 n(v0 rc2024-04-26T20:25:43.832779+0000 b3525 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b07a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000023b7:[<0x2000000233e/article-17.xml v769>,<0x10000000971/blog-61 v70832>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x200000023b7:[<0x2000000233e/article-17.xml v769>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:05.903 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.697+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a01 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-51.xml auth{0=1} v923 ap=1 s=4293 n(v0 rc2024-04-26T20:26:43.523613+0000 b4293 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b07bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a01:[<0x2000000233e/comment-51.xml v806>,<0x10000000971/blog-61 v73448>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x10000000a01:[<0x2000000233e/comment-51.xml v923>,<0x10000000971/blog-61 v120412>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.111 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.875+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031f3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-26.xml auth{0=1} v902 ap=1 s=7607 n(v0 rc2024-04-26T20:26:19.567081+0000 b7607 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90882680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031f3:[<0x20000002e19/comment-26.xml v694>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031f3:[<0x20000002e19/comment-26.xml v902>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.111 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.877+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e79 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg auth{0=1} v886 ap=1 s=63672 n(v0 rc2024-04-26T20:26:12.472220+0000 b63672 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90882c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e79:[<0x20000002e19/picture-27.jpg v286>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e79:[<0x20000002e19/picture-27.jpg v886>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub queued for path: / 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:28:06.112 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: scrub summary: active paths [/] 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002851 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71) see mds.b log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c3c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c4b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bda (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-92.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.113 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c86 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.114 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.114 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.114 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c64 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.114 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.114 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bf5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-83.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.114 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.115 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.917+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b3c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-13.jpg auth{0=1} v653 ap=1 s=55296 n(v0 rc2024-04-26T20:25:28.446080+0000 b55296 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b08cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b3c:[<0x20000001a85/picture-13.jpg v520>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b3c:[<0x20000001a85/picture-13.jpg v653>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.115 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.917+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012aa [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-56.xml auth{0=1} v784 ap=1 s=9744 n(v0 rc2024-04-26T20:27:35.861591+0000 b9744 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b08d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012aa:[<0x20000001a85/comment-56.xml v784>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012aa:[<0x20000001a85/comment-56.xml v784>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.115 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.879+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003202 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-21.xml auth{0=1} v900 ap=1 s=2612 n(v0 rc2024-04-26T20:26:19.645079+0000 b2612 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90882100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003202:[<0x20000002e19/comment-21.xml v724>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003202:[<0x20000002e19/comment-21.xml v900>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.115 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.880+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e87 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg auth{0=1} v876 ap=1 s=11302 n(v0 rc2024-04-26T20:26:12.500219+0000 b11302 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90200b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e87:[<0x20000002e19/picture-20.jpg v328>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e87:[<0x20000002e19/picture-20.jpg v876>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.116 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.917+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-5.xml auth{0=1} v786 ap=1 s=8204 n(v0 rc2024-04-26T20:27:36.573577+0000 b8204 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b098580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000131d:[<0x20000001a85/comment-5.xml v786>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000131d:[<0x20000001a85/comment-5.xml v786>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.116 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.917+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b30 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-18.jpg auth{0=1} v657 ap=1 s=33880 n(v0 rc2024-04-26T20:25:28.414080+0000 b33880 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b08d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b30:[<0x20000001a85/picture-18.jpg v490>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b30:[<0x20000001a85/picture-18.jpg v657>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c56 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c52 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.116 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c83 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c81 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009dd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bfe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-80.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c60 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c80 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.117 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c76 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.118 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c84 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.118 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c34 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.118 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.880+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003218 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-13.xml auth{0=1} v896 ap=1 s=5105 n(v0 rc2024-04-26T20:26:19.793077+0000 b5105 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90881b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003218:[<0x20000002e19/comment-13.xml v772>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003218:[<0x20000002e19/comment-13.xml v896>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.118 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.880+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e39 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml auth{0=1} v878 ap=1 s=2468 n(v0 rc2024-04-26T20:26:12.364222+0000 b2468 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90883180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e39:[<0x20000002e19/article-12.xml v94>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e39:[<0x20000002e19/article-12.xml v878>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.118 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.880+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e4f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml auth{0=1} v876 ap=1 s=28133 n(v0 rc2024-04-26T20:26:12.402221+0000 b28133 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90883700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e4f:[<0x20000002e19/article-1.xml v160>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e4f:[<0x20000002e19/article-1.xml v876>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.119 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.881+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg auth v888 ap=1 s=32094 n(v0 rc2024-04-26T20:26:12.450220+0000 b32094 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8f888580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e6b:[<0x20000002e19/picture-34.jpg v244>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e6b:[<0x20000002e19/picture-34.jpg v888>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.119 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.881+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031e5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-30.xml auth{0=1} v904 ap=1 s=4487 n(v0 rc2024-04-26T20:26:19.495082+0000 b4487 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f888000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031e5:[<0x20000002e19/comment-30.xml v670>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031e5:[<0x20000002e19/comment-30.xml v904>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.119 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.918+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b2d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-19.jpg auth{0=1} v659 ap=1 s=31229 n(v0 rc2024-04-26T20:25:28.408081+0000 b31229 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b098b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b2d:[<0x20000001a85/picture-19.jpg v484>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b2d:[<0x20000001a85/picture-19.jpg v659>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.119 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.918+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b4e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-4.jpg auth{0=1} v649 ap=1 s=20508 n(v0 rc2024-04-26T20:25:28.480079+0000 b20508 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b099b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b4e:[<0x20000001a85/picture-4.jpg v574>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b4e:[<0x20000001a85/picture-4.jpg v649>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.119 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.919+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b08 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-35.jpg auth{0=1} v643 ap=1 s=63251 n(v0 rc2024-04-26T20:25:28.306083+0000 b63251 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b08:[<0x20000001a85/picture-35.jpg v388>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b08:[<0x20000001a85/picture-35.jpg v643>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bf0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-85.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002be7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-88.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c7c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c43 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c77 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.120 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c78 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c2a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-76.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c82 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c6a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bd4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-94.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.121 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c72 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.122 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.122 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.881+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003234 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml auth{0=1} v892 ap=1 s=10055 n(v0 rc2024-04-26T20:26:19.984073+0000 b10055 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f888b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003234:[<0x20000002e19/comment-3.xml v832>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003234:[<0x20000002e19/comment-3.xml v892>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.122 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.881+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003209 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-18.xml auth{0=1} v898 ap=1 s=2525 n(v0 rc2024-04-26T20:26:19.688079+0000 b2525 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f889080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000003209:[<0x20000002e19/comment-18.xml v742>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000003209:[<0x20000002e19/comment-18.xml v898>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.122 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.882+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e8f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg auth{0=1} v880 ap=1 s=45972 n(v0 rc2024-04-26T20:26:12.513219+0000 b45972 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f889600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e8f:[<0x20000002e19/picture-16.jpg v352>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e8f:[<0x20000002e19/picture-16.jpg v880>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.123 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.919+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b52 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-2.jpg auth{0=1} v647 ap=1 s=19151 n(v0 rc2024-04-26T20:25:28.488079+0000 b19151 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b52:[<0x20000001a85/picture-2.jpg v586>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b52:[<0x20000001a85/picture-2.jpg v647>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.123 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.919+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001abd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-20.xml auth{0=1} v634 ap=1 s=15055 n(v0 rc2024-04-26T20:25:28.153086+0000 b15055 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001abd:[<0x20000001a85/article-20.xml v160>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001abd:[<0x20000001a85/article-20.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.123 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.882+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000317f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-65.xml auth{0=1} v912 ap=1 s=2425 n(v0 rc2024-04-26T20:26:18.825095+0000 b2425 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000317f:[<0x20000002e19/comment-65.xml v460>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000317f:[<0x20000002e19/comment-65.xml v912>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.885+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000321b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-12.xml auth{0=1} v894 ap=1 s=2411 n(v0 rc2024-04-26T20:26:19.819076+0000 b2411 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f889b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000321b:[<0x20000002e19/comment-12.xml v778>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x2000000321b:[<0x20000002e19/comment-12.xml v894>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.885+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031ad [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-49.xml auth{0=1} v908 ap=1 s=8177 n(v0 rc2024-04-26T20:26:19.028091+0000 b8177 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031ad:[<0x20000002e19/comment-49.xml v556>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031ad:[<0x20000002e19/comment-49.xml v908>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.887+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031a8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-51.xml auth{0=1} v910 ap=1 s=9047 n(v0 rc2024-04-26T20:26:18.998092+0000 b9047 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031a8:[<0x20000002e19/comment-51.xml v544>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031a8:[<0x20000002e19/comment-51.xml v910>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c4d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c7d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.124 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c79 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002be1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-90.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c54 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c5e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.125 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c85 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.126 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38) see mds.b log and `damage ls` output for details 2024-04-26T20:28:06.126 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c40 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.126 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-79.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.126 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.920+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a37 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-83.xml auth v670 ap=1 s=11254 n(v0 rc2024-04-26T20:26:49.197502+0000 b11254 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x56423b09b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000a37:[<0x20000001a85/article-83.xml v666>,<0x10000000971/blog-41 v104627>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x10000000a37:[<0x20000001a85/article-83.xml v670>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.126 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.920+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b3a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-14.jpg auth{0=1} v655 ap=1 s=31385 n(v0 rc2024-04-26T20:25:28.442080+0000 b31385 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b3a:[<0x20000001a85/picture-14.jpg v514>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b3a:[<0x20000001a85/picture-14.jpg v655>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.126 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.921+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ef [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-29.xml auth{0=1} v792 ap=1 s=4644 n(v0 rc2024-04-26T20:27:36.295582+0000 b4644 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b099080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012ef:[<0x20000001a85/comment-29.xml v792>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012ef:[<0x20000001a85/comment-29.xml v792>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.127 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.888+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg auth v890 ap=1 s=41117 n(v0 rc2024-04-26T20:26:12.457220+0000 b41117 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8fe78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e6f:[<0x20000002e19/picture-32.jpg v256>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e6f:[<0x20000002e19/picture-32.jpg v890>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.127 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.888+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000031c3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-42.xml auth{0=1} v906 ap=1 s=6931 n(v0 rc2024-04-26T20:26:19.160089+0000 b6931 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000031c3:[<0x20000002e19/comment-42.xml v598>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x200000031c3:[<0x20000002e19/comment-42.xml v906>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.127 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.890+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e23 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-23.xml auth{0=1} v884 ap=1 s=22201 n(v0 rc2024-04-26T20:26:12.317223+0000 b22201 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e23:[<0x20000002e19/article-23.xml v28>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e23:[<0x20000002e19/article-23.xml v884>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.127 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:05.890+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e2f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml auth{0=1} v882 ap=1 s=27612 n(v0 rc2024-04-26T20:26:12.344222+0000 b27612 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000002e2f:[<0x20000002e19/article-17.xml v64>,<0x10000000971/blog-83 v92514>,<0x100000007e0/blogtest_in v1008>,<0x100000007d9/src v1697>,<0x100000005e3/blogbench-1.0 v1478>,<0x100000005e2/tmp v73>,<0x100000001fb/client.0 v73>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v89>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x20000002e2f:[<0x20000002e19/article-17.xml v882>,<0x10000000971/blog-83 v112377>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.128 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.922+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a90 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-41.xml auth{0=1} v640 ap=1 s=17373 n(v0 rc2024-04-26T20:25:27.990089+0000 b17373 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a90:[<0x20000001a85/article-41.xml v34>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a90:[<0x20000001a85/article-41.xml v640>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.128 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.923+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a88 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-45.xml auth{0=1} v630 ap=1 s=8172 n(v0 rc2024-04-26T20:25:27.954089+0000 b8172 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a88:[<0x20000001a85/article-45.xml v10>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a88:[<0x20000001a85/article-45.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.128 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009ec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.129 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c49 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c7f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c7a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bfb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-81.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-78.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c62 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.130 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c4e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c3a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c51 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bde (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-91.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c74 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bf2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-84.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.131 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c45 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bd7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-93.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c7b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c66 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c5c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c75 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c4f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.132 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bf8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-82.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c6c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c2e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-86.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.133 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002be4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-89.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002bea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-87.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c5a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c58 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c7e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-77.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.134 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c68 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.135 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c6e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.135 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.135 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.135 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.135 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002c28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.143 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.923+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ac1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-18.xml auth{0=1} v632 ap=1 s=13683 n(v0 rc2024-04-26T20:25:28.165085+0000 b13683 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b098000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ac1:[<0x20000001a85/article-18.xml v172>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ac1:[<0x20000001a85/article-18.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.143 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.924+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b48 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-7.jpg auth{0=1} v645 ap=1 s=62267 n(v0 rc2024-04-26T20:25:28.467079+0000 b62267 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b48:[<0x20000001a85/picture-7.jpg v556>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b48:[<0x20000001a85/picture-7.jpg v645>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.143 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.924+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000978 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-61.jpg auth v663 ap=1 s=62807 n(v0 rc2024-04-26T20:25:34.370964+0000 b62807 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x56423b09cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000978:[<0x20000001a85/picture-61.jpg v602>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x10000000978:[<0x20000001a85/picture-61.jpg v663>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.924+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-31.xml auth{0=1} v638 ap=1 s=15797 n(v0 rc2024-04-26T20:25:28.067087+0000 b15797 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa4:[<0x20000001a85/article-31.xml v94>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa4:[<0x20000001a85/article-31.xml v638>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.924+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aac [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-27.xml auth{0=1} v636 ap=1 s=26091 n(v0 rc2024-04-26T20:25:28.097087+0000 b26091 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b099600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aac:[<0x20000001a85/article-27.xml v118>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aac:[<0x20000001a85/article-27.xml v636>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.925+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b44 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-9.jpg auth{0=1} v651 ap=1 s=44155 n(v0 rc2024-04-26T20:25:28.459080+0000 b44155 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b44:[<0x20000001a85/picture-9.jpg v544>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b44:[<0x20000001a85/picture-9.jpg v651>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.925+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-11.xml auth{0=1} v788 ap=1 s=2091 n(v0 rc2024-04-26T20:27:36.523578+0000 b2091 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000130b:[<0x20000001a85/comment-11.xml v788>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000130b:[<0x20000001a85/comment-11.xml v788>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.925+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-20.xml auth{0=1} v790 ap=1 s=10234 n(v0 rc2024-04-26T20:27:36.419580+0000 b10234 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012fb:[<0x20000001a85/comment-20.xml v790>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012fb:[<0x20000001a85/comment-20.xml v790>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.925+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-37.xml auth{0=1} v783 ap=1 s=6288 n(v0 rc2024-04-26T20:27:36.188584+0000 b6288 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012e2:[<0x20000001a85/comment-37.xml v783>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012e2:[<0x20000001a85/comment-37.xml v783>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.926+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001288 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-71.xml auth{0=1} v791 ap=1 s=7480 n(v0 rc2024-04-26T20:27:35.639595+0000 b7480 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001288:[<0x20000001a85/comment-71.xml v791>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001288:[<0x20000001a85/comment-71.xml v791>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.926+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b42 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-10.jpg auth{0=1} v655 ap=1 s=35046 n(v0 rc2024-04-26T20:25:28.456080+0000 b35046 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b42:[<0x20000001a85/picture-10.jpg v538>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b42:[<0x20000001a85/picture-10.jpg v655>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.144 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.926+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b54 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-1.jpg auth{0=1,1=1} v598 ap=1 s=8816 n(v0 rc2024-04-26T20:25:28.492079+0000 b8816 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b54:[<0x20000001a85/picture-1.jpg v598>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b54:[<0x20000001a85/picture-1.jpg v598>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.927+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ad3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-9.xml auth{0=1} v632 ap=1 s=10761 n(v0 rc2024-04-26T20:25:28.206085+0000 b10761 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ad3:[<0x20000001a85/article-9.xml v226>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ad3:[<0x20000001a85/article-9.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.927+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001300 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-16.xml auth{0=1} v795 ap=1 s=9598 n(v0 rc2024-04-26T20:27:36.454579+0000 b9598 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001300:[<0x20000001a85/comment-16.xml v795>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001300:[<0x20000001a85/comment-16.xml v795>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.928+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b4a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-6.jpg auth{0=1} v653 ap=1 s=38274 n(v0 rc2024-04-26T20:25:28.472079+0000 b38274 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b4a:[<0x20000001a85/picture-6.jpg v562>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b4a:[<0x20000001a85/picture-6.jpg v653>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.928+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ad [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-55.xml auth{0=1} v787 ap=1 s=6414 n(v0 rc2024-04-26T20:27:35.882590+0000 b6414 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012ad:[<0x20000001a85/comment-55.xml v787>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012ad:[<0x20000001a85/comment-55.xml v787>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.928+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-58.xml auth{0=1} v789 ap=1 s=3700 n(v0 rc2024-04-26T20:27:35.832591+0000 b3700 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012a5:[<0x20000001a85/comment-58.xml v789>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012a5:[<0x20000001a85/comment-58.xml v789>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.928+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a8b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-44.xml auth{0=1} v630 ap=1 s=28080 n(v0 rc2024-04-26T20:25:27.970089+0000 b28080 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0cb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a8b:[<0x20000001a85/article-44.xml v16>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a8b:[<0x20000001a85/article-44.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.928+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ab4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-24.xml auth{0=1} v634 ap=1 s=27940 n(v0 rc2024-04-26T20:25:28.123086+0000 b27940 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ab4:[<0x20000001a85/article-24.xml v136>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ab4:[<0x20000001a85/article-24.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.929+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-25.xml auth{0=1} v801 ap=1 s=10098 n(v0 rc2024-04-26T20:27:36.333581+0000 b10098 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f4:[<0x20000001a85/comment-25.xml v801>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f4:[<0x20000001a85/comment-25.xml v801>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.929+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-41.xml auth{0=1} v785 ap=1 s=9457 n(v0 rc2024-04-26T20:27:36.124586+0000 b9457 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012d7:[<0x20000001a85/comment-41.xml v785>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012d7:[<0x20000001a85/comment-41.xml v785>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.145 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.929+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001273 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-75.xml auth{0=1} v793 ap=1 s=7769 n(v0 rc2024-04-26T20:27:35.597596+0000 b7769 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001273:[<0x20000001a85/comment-75.xml v793>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001273:[<0x20000001a85/comment-75.xml v793>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.929+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b04 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-37.jpg auth{0=1} v643 ap=1 s=20110 n(v0 rc2024-04-26T20:25:28.300083+0000 b20110 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b04:[<0x20000001a85/picture-37.jpg v376>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b04:[<0x20000001a85/picture-37.jpg v643>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.930+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ade [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-3.xml auth{0=1} v651 ap=1 s=27841 n(v0 rc2024-04-26T20:25:28.233084+0000 b27841 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0da000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ade:[<0x20000001a85/article-3.xml v262>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ade:[<0x20000001a85/article-3.xml v651>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.930+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-34.xml auth{0=1} v781 ap=1 s=2821 n(v0 rc2024-04-26T20:27:36.227584+0000 b2821 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012e9:[<0x20000001a85/comment-34.xml v781>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012e9:[<0x20000001a85/comment-34.xml v781>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.930+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b33 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-17.jpg auth{0=1} v657 ap=1 s=43458 n(v0 rc2024-04-26T20:25:28.424080+0000 b43458 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b33:[<0x20000001a85/picture-17.jpg v496>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b33:[<0x20000001a85/picture-17.jpg v657>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.931+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b0c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-33.jpg auth{0=1} v641 ap=1 s=64705 n(v0 rc2024-04-26T20:25:28.316082+0000 b64705 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0dab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b0c:[<0x20000001a85/picture-33.jpg v400>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b0c:[<0x20000001a85/picture-33.jpg v641>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.931+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ad6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-7.xml auth{0=1} v649 ap=1 s=3866 n(v0 rc2024-04-26T20:25:28.216084+0000 b3866 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ad6:[<0x20000001a85/article-7.xml v238>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ad6:[<0x20000001a85/article-7.xml v649>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.932+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-23.xml auth{0=1} v797 ap=1 s=2282 n(v0 rc2024-04-26T20:27:36.357581+0000 b2282 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0dc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f7:[<0x20000001a85/comment-23.xml v797>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f7:[<0x20000001a85/comment-23.xml v797>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.146 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.932+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b00 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-39.jpg auth{0=1} v645 ap=1 s=57701 n(v0 rc2024-04-26T20:25:28.294083+0000 b57701 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0dbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b00:[<0x20000001a85/picture-39.jpg v364>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b00:[<0x20000001a85/picture-39.jpg v645>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.933+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-24.xml auth{0=1} v799 ap=1 s=3244 n(v0 rc2024-04-26T20:27:36.348581+0000 b3244 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f6:[<0x20000001a85/comment-24.xml v799>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f6:[<0x20000001a85/comment-24.xml v799>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.934+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b16 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-28.jpg auth{0=1} v639 ap=1 s=58255 n(v0 rc2024-04-26T20:25:28.342082+0000 b58255 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b16:[<0x20000001a85/picture-28.jpg v430>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b16:[<0x20000001a85/picture-28.jpg v639>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.934+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b1e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-24.jpg auth{0=1} v637 ap=1 s=11348 n(v0 rc2024-04-26T20:25:28.366081+0000 b11348 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b1e:[<0x20000001a85/picture-24.jpg v454>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b1e:[<0x20000001a85/picture-24.jpg v637>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.938+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001afa [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-42.jpg auth{0=1} v647 ap=1 s=36892 n(v0 rc2024-04-26T20:25:28.283083+0000 b36892 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0db600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001afa:[<0x20000001a85/picture-42.jpg v346>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001afa:[<0x20000001a85/picture-42.jpg v647>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.969+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-10.xml auth{0=1} v786 ap=1 s=7138 n(v0 rc2024-04-26T20:27:36.531578+0000 b7138 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b049b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000130d:[<0x20000001a85/comment-10.xml v786>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000130d:[<0x20000001a85/comment-10.xml v786>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.969+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b50 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-3.jpg auth{0=1} v641 ap=1 s=34963 n(v0 rc2024-04-26T20:25:28.484079+0000 b34963 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b04a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b50:[<0x20000001a85/picture-3.jpg v580>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b50:[<0x20000001a85/picture-3.jpg v641>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.969+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-6.xml auth{0=1} v788 ap=1 s=8086 n(v0 rc2024-04-26T20:27:36.562577+0000 b8086 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b04ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000131b:[<0x20000001a85/comment-6.xml v788>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000131b:[<0x20000001a85/comment-6.xml v788>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.969+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-53.xml auth{0=1} v778 ap=1 s=5901 n(v0 rc2024-04-26T20:27:35.906590+0000 b5901 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b04a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012b3:[<0x20000001a85/comment-53.xml v778>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012b3:[<0x20000001a85/comment-53.xml v778>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.970+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ada [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-5.xml auth{0=1} v639 ap=1 s=12696 n(v0 rc2024-04-26T20:25:28.224084+0000 b12696 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b04b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ada:[<0x20000001a85/article-5.xml v250>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ada:[<0x20000001a85/article-5.xml v639>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.970+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a9e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-34.xml auth{0=1} v634 ap=1 s=7002 n(v0 rc2024-04-26T20:25:28.041088+0000 b7002 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b054000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a9e:[<0x20000001a85/article-34.xml v76>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a9e:[<0x20000001a85/article-34.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.147 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.971+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-29.xml auth{0=1} v630 ap=1 s=2432 n(v0 rc2024-04-26T20:25:28.083087+0000 b2432 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b055600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa8:[<0x20000001a85/article-29.xml v106>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa8:[<0x20000001a85/article-29.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.971+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-57.xml auth{0=1} v780 ap=1 s=2097 n(v0 rc2024-04-26T20:27:35.844591+0000 b2097 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b055080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012a8:[<0x20000001a85/comment-57.xml v780>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012a8:[<0x20000001a85/comment-57.xml v780>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.971+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-35.xml auth{0=1} v774 ap=1 s=4813 n(v0 rc2024-04-26T20:27:36.221584+0000 b4813 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b054580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012e8:[<0x20000001a85/comment-35.xml v774>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012e8:[<0x20000001a85/comment-35.xml v774>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.971+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001afe [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-40.jpg auth{0=1} v637 ap=1 s=60238 n(v0 rc2024-04-26T20:25:28.291083+0000 b60238 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b055b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001afe:[<0x20000001a85/picture-40.jpg v358>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001afe:[<0x20000001a85/picture-40.jpg v637>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.972+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-28.xml auth{0=1} v792 ap=1 s=3946 n(v0 rc2024-04-26T20:27:36.304582+0000 b3946 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b054b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f0:[<0x20000001a85/comment-28.xml v792>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f0:[<0x20000001a85/comment-28.xml v792>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.972+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ab8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-22.xml auth{0=1} v632 ap=1 s=14020 n(v0 rc2024-04-26T20:25:28.137086+0000 b14020 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b056680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ab8:[<0x20000001a85/article-22.xml v148>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ab8:[<0x20000001a85/article-22.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.972+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012df [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-38.xml auth{0=1} v776 ap=1 s=6393 n(v0 rc2024-04-26T20:27:36.173585+0000 b6393 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b056c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012df:[<0x20000001a85/comment-38.xml v776>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012df:[<0x20000001a85/comment-38.xml v776>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.973+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-68.xml auth{0=1} v784 ap=1 s=7282 n(v0 rc2024-04-26T20:27:35.699594+0000 b7282 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b057180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000128f:[<0x20000001a85/comment-68.xml v784>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000128f:[<0x20000001a85/comment-68.xml v784>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.148 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.974+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001313 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-8.xml auth{0=1} v790 ap=1 s=4279 n(v0 rc2024-04-26T20:27:36.547577+0000 b4279 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b057700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001313:[<0x20000001a85/comment-8.xml v790>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001313:[<0x20000001a85/comment-8.xml v790>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.974+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b20 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-23.jpg auth{0=1} v651 ap=1 s=38615 n(v0 rc2024-04-26T20:25:28.375081+0000 b38615 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0dd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b20:[<0x20000001a85/picture-23.jpg v460>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b20:[<0x20000001a85/picture-23.jpg v651>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.974+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001af4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-45.jpg auth{0=1} v653 ap=1 s=59353 n(v0 rc2024-04-26T20:25:28.274083+0000 b59353 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001af4:[<0x20000001a85/picture-45.jpg v328>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001af4:[<0x20000001a85/picture-45.jpg v653>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.974+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001afc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-41.jpg auth{0=1} v655 ap=1 s=8916 n(v0 rc2024-04-26T20:25:28.286083+0000 b8916 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001afc:[<0x20000001a85/picture-41.jpg v352>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001afc:[<0x20000001a85/picture-41.jpg v655>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.975+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-61.xml auth{0=1} v782 ap=1 s=9336 n(v0 rc2024-04-26T20:27:35.788592+0000 b9336 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b056100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000129e:[<0x20000001a85/comment-61.xml v782>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000129e:[<0x20000001a85/comment-61.xml v782>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.975+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a86 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-46.xml auth{0=1} v630 ap=1 s=7362 n(v0 rc2024-04-26T20:25:27.948090+0000 b7362 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a86:[<0x20000001a85/article-46.xml v4>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a86:[<0x20000001a85/article-46.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.975+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-62.xml auth{0=1} v755 ap=1 s=7455 n(v0 rc2024-04-26T20:27:35.780592+0000 b7455 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000129c:[<0x20000001a85/comment-62.xml v755>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000129c:[<0x20000001a85/comment-62.xml v755>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.976+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ac9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-14.xml auth{0=1} v636 ap=1 s=22380 n(v0 rc2024-04-26T20:25:28.179085+0000 b22380 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ac9:[<0x20000001a85/article-14.xml v196>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ac9:[<0x20000001a85/article-14.xml v636>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.149 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.976+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001acf [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-11.xml auth{0=1} v634 ap=1 s=30876 n(v0 rc2024-04-26T20:25:28.193085+0000 b30876 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001acf:[<0x20000001a85/article-11.xml v214>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001acf:[<0x20000001a85/article-11.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.976+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b22 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-22.jpg auth{0=1} v649 ap=1 s=52740 n(v0 rc2024-04-26T20:25:28.380081+0000 b52740 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b22:[<0x20000001a85/picture-22.jpg v466>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b22:[<0x20000001a85/picture-22.jpg v649>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.977+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-59.xml auth{0=1} v753 ap=1 s=8063 n(v0 rc2024-04-26T20:27:35.813592+0000 b8063 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012a1:[<0x20000001a85/comment-59.xml v753>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012a1:[<0x20000001a85/comment-59.xml v753>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.977+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ac5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-16.xml auth{0=1} v638 ap=1 s=17350 n(v0 rc2024-04-26T20:25:28.172085+0000 b17350 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ac5:[<0x20000001a85/article-16.xml v184>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ac5:[<0x20000001a85/article-16.xml v638>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.977+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001177 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-54.xml auth v759 ap=1 s=23972 n(v0 rc2024-04-26T20:27:34.654614+0000 b23972 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x56423b0f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001177:[<0x20000001a85/article-54.xml v759>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001177:[<0x20000001a85/article-54.xml v759>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.977+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000985 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-71.xml auth v666 ap=1 s=5803 n(v0 rc2024-04-26T20:25:36.407924+0000 b5803 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x56423b0f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000985:[<0x20000001a85/article-71.xml v626>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x10000000985:[<0x20000001a85/article-71.xml v666>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.978+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aae [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-26.xml auth{0=1} v642 ap=1 s=14375 n(v0 rc2024-04-26T20:25:28.110086+0000 b14375 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aae:[<0x20000001a85/article-26.xml v124>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aae:[<0x20000001a85/article-26.xml v642>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.978+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b3e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-12.jpg auth{0=1} v659 ap=1 s=18074 n(v0 rc2024-04-26T20:25:28.449080+0000 b18074 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b3e:[<0x20000001a85/picture-12.jpg v526>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b3e:[<0x20000001a85/picture-12.jpg v659>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.978+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000984 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-44.jpg auth{0=1} v663 ap=1 s=27132 n(v0 rc2024-04-26T20:25:36.387925+0000 b27132 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000984:[<0x20000001a85/picture-44.jpg v619>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x10000000984:[<0x20000001a85/picture-44.jpg v663>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.150 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.979+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b38 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-15.jpg auth{0=1} v661 ap=1 s=40319 n(v0 rc2024-04-26T20:25:28.436080+0000 b40319 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b38:[<0x20000001a85/picture-15.jpg v508>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b38:[<0x20000001a85/picture-15.jpg v661>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.979+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001af0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-47.jpg auth{0=1} v647 ap=1 s=24563 n(v0 rc2024-04-26T20:25:28.269083+0000 b24563 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001af0:[<0x20000001a85/picture-47.jpg v316>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001af0:[<0x20000001a85/picture-47.jpg v647>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.980+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-50.xml auth{0=1} v751 ap=1 s=8800 n(v0 rc2024-04-26T20:27:35.947589+0000 b8800 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012bc:[<0x20000001a85/comment-50.xml v751>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012bc:[<0x20000001a85/comment-50.xml v751>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.982+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ab2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-25.xml auth{0=1} v640 ap=1 s=22379 n(v0 rc2024-04-26T20:25:28.116086+0000 b22379 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ab2:[<0x20000001a85/article-25.xml v130>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ab2:[<0x20000001a85/article-25.xml v640>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.982+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ad1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-10.xml auth{0=1} v632 ap=1 s=29548 n(v0 rc2024-04-26T20:25:28.200085+0000 b29548 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ad1:[<0x20000001a85/article-10.xml v220>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ad1:[<0x20000001a85/article-10.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.982+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a96 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-38.xml auth{0=1} v644 ap=1 s=10902 n(v0 rc2024-04-26T20:25:28.013088+0000 b10902 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a96:[<0x20000001a85/article-38.xml v52>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a96:[<0x20000001a85/article-38.xml v644>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.983+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a9c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-35.xml auth{0=1} v636 ap=1 s=4817 n(v0 rc2024-04-26T20:25:28.035088+0000 b4817 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a9c:[<0x20000001a85/article-35.xml v70>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a9c:[<0x20000001a85/article-35.xml v636>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.983+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-31.xml auth{0=1} v757 ap=1 s=5970 n(v0 rc2024-04-26T20:27:36.272583+0000 b5970 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012ed:[<0x20000001a85/comment-31.xml v757>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012ed:[<0x20000001a85/comment-31.xml v757>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.983+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-48.xml auth{0=1} v749 ap=1 s=8947 n(v0 rc2024-04-26T20:27:35.966589+0000 b8947 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012c0:[<0x20000001a85/comment-48.xml v749>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012c0:[<0x20000001a85/comment-48.xml v749>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.984+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-60.xml auth{0=1} v797 ap=1 s=9803 n(v0 rc2024-04-26T20:27:35.800592+0000 b9803 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b000000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000129f:[<0x20000001a85/comment-60.xml v797>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000129f:[<0x20000001a85/comment-60.xml v797>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.985+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-73.xml auth{0=1} v801 ap=1 s=7435 n(v0 rc2024-04-26T20:27:35.619595+0000 b7435 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000127a:[<0x20000001a85/comment-73.xml v801>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000127a:[<0x20000001a85/comment-73.xml v801>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.985+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a92 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-40.xml auth{0=1} v634 ap=1 s=17627 n(v0 rc2024-04-26T20:25:27.996089+0000 b17627 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b000b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a92:[<0x20000001a85/article-40.xml v40>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a92:[<0x20000001a85/article-40.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.151 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.985+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b12 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-30.jpg auth{0=1} v639 ap=1 s=53820 n(v0 rc2024-04-26T20:25:28.330082+0000 b53820 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b001080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b12:[<0x20000001a85/picture-30.jpg v418>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b12:[<0x20000001a85/picture-30.jpg v639>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.986+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ac7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-15.xml auth{0=1} v630 ap=1 s=32077 n(v0 rc2024-04-26T20:25:28.176085+0000 b32077 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b001600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ac7:[<0x20000001a85/article-15.xml v190>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ac7:[<0x20000001a85/article-15.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.986+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b24 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-21.jpg auth{0=1} v649 ap=1 s=36590 n(v0 rc2024-04-26T20:25:28.391081+0000 b36590 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423afecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b24:[<0x20000001a85/picture-21.jpg v472>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b24:[<0x20000001a85/picture-21.jpg v649>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.987+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-1.xml auth{0=1} v803 ap=1 s=6490 n(v0 rc2024-04-26T20:27:36.613576+0000 b6490 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b000580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000132b:[<0x20000001a85/comment-1.xml v803>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000132b:[<0x20000001a85/comment-1.xml v803>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.987+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-40.xml auth{0=1} v793 ap=1 s=7937 n(v0 rc2024-04-26T20:27:36.134585+0000 b7937 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b001b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012d9:[<0x20000001a85/comment-40.xml v793>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012d9:[<0x20000001a85/comment-40.xml v793>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.987+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b06 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-36.jpg auth{0=1} v641 ap=1 s=20529 n(v0 rc2024-04-26T20:25:28.303083+0000 b20529 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b002c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b06:[<0x20000001a85/picture-36.jpg v382>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b06:[<0x20000001a85/picture-36.jpg v641>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.988+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001abf [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-19.xml auth{0=1} v632 ap=1 s=9359 n(v0 rc2024-04-26T20:25:28.155086+0000 b9359 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b003700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001abf:[<0x20000001a85/article-19.xml v166>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001abf:[<0x20000001a85/article-19.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.988+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012de [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-39.xml auth{0=1} v791 ap=1 s=7159 n(v0 rc2024-04-26T20:27:36.151585+0000 b7159 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b002680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012de:[<0x20000001a85/comment-39.xml v791>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012de:[<0x20000001a85/comment-39.xml v791>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.989+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001af8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-43.jpg auth{0=1} v645 ap=1 s=19434 n(v0 rc2024-04-26T20:25:28.280083+0000 b19434 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b003180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001af8:[<0x20000001a85/picture-43.jpg v340>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001af8:[<0x20000001a85/picture-43.jpg v645>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.989+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-63.xml auth{0=1} v799 ap=1 s=8318 n(v0 rc2024-04-26T20:27:35.747593+0000 b8318 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000129b:[<0x20000001a85/comment-63.xml v799>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000129b:[<0x20000001a85/comment-63.xml v799>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.993+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b28 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-20.jpg auth{0=1} v647 ap=1 s=47733 n(v0 rc2024-04-26T20:25:28.400081+0000 b47733 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b28:[<0x20000001a85/picture-20.jpg v478>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b28:[<0x20000001a85/picture-20.jpg v647>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.993+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001adc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-4.xml auth{0=1} v657 ap=1 s=21365 n(v0 rc2024-04-26T20:25:28.229084+0000 b21365 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001adc:[<0x20000001a85/article-4.xml v256>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001adc:[<0x20000001a85/article-4.xml v657>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.152 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.994+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-33.xml auth{0=1} v789 ap=1 s=3000 n(v0 rc2024-04-26T20:27:36.237583+0000 b3000 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b002100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012ea:[<0x20000001a85/comment-33.xml v789>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012ea:[<0x20000001a85/comment-33.xml v789>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.994+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000979 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-42.xml auth{0=1} v651 ap=1 s=29149 n(v0 rc2024-04-26T20:25:34.378964+0000 b29149 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000979:[<0x20000001a85/article-42.xml v610>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x10000000979:[<0x20000001a85/article-42.xml v651>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.995+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b02 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-38.jpg auth{0=1} v643 ap=1 s=13714 n(v0 rc2024-04-26T20:25:28.297083+0000 b13714 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b02:[<0x20000001a85/picture-38.jpg v370>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b02:[<0x20000001a85/picture-38.jpg v643>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.995+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b1c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-25.jpg auth{0=1} v643 ap=1 s=65240 n(v0 rc2024-04-26T20:25:28.361081+0000 b65240 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af76c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b1c:[<0x20000001a85/picture-25.jpg v448>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b1c:[<0x20000001a85/picture-25.jpg v643>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.995+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ad5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-8.xml auth{0=1} v630 ap=1 s=22849 n(v0 rc2024-04-26T20:25:28.213084+0000 b22849 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af77180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ad5:[<0x20000001a85/article-8.xml v232>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ad5:[<0x20000001a85/article-8.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.995+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-47.xml auth{0=1} v783 ap=1 s=10082 n(v0 rc2024-04-26T20:27:35.979588+0000 b10082 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af77700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012c2:[<0x20000001a85/comment-47.xml v783>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012c2:[<0x20000001a85/comment-47.xml v783>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.995+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-46.xml auth{0=1} v781 ap=1 s=9997 n(v0 rc2024-04-26T20:27:35.999588+0000 b9997 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af86000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012c4:[<0x20000001a85/comment-46.xml v781>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012c4:[<0x20000001a85/comment-46.xml v781>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.995+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b10 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-31.jpg auth{0=1} v649 ap=1 s=59300 n(v0 rc2024-04-26T20:25:28.325082+0000 b59300 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b10:[<0x20000001a85/picture-31.jpg v412>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b10:[<0x20000001a85/picture-31.jpg v649>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.996+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-70.xml auth{0=1} v791 ap=1 s=8483 n(v0 rc2024-04-26T20:27:35.657595+0000 b8483 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af86b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000128a:[<0x20000001a85/comment-70.xml v791>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000128a:[<0x20000001a85/comment-70.xml v791>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.996+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012eb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-32.xml auth{0=1} v787 ap=1 s=2297 n(v0 rc2024-04-26T20:27:36.256583+0000 b2297 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012eb:[<0x20000001a85/comment-32.xml v787>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012eb:[<0x20000001a85/comment-32.xml v787>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.996+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-54.xml auth{0=1} v795 ap=1 s=7567 n(v0 rc2024-04-26T20:27:35.893590+0000 b7567 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012b1:[<0x20000001a85/comment-54.xml v795>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012b1:[<0x20000001a85/comment-54.xml v795>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.153 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.996+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aec [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-49.jpg auth v651 ap=1 s=11476 n(v0 rc2024-04-26T20:25:28.262083+0000 b11476 1=1+0) | authpin=1 scrubqueue=0 0x56423a331700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aec:[<0x20000001a85/picture-49.jpg v304>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aec:[<0x20000001a85/picture-49.jpg v651>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.997+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b46 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-8.jpg auth{0=1} v655 ap=1 s=60310 n(v0 rc2024-04-26T20:25:28.463080+0000 b60310 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b46:[<0x20000001a85/picture-8.jpg v550>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b46:[<0x20000001a85/picture-8.jpg v655>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.997+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-32.xml auth{0=1} v638 ap=1 s=12988 n(v0 rc2024-04-26T20:25:28.061087+0000 b12988 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa2:[<0x20000001a85/article-32.xml v88>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa2:[<0x20000001a85/article-32.xml v638>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.997+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aba [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-21.xml auth{0=1} v634 ap=1 s=24983 n(v0 rc2024-04-26T20:25:28.148086+0000 b24983 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af88680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aba:[<0x20000001a85/article-21.xml v154>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aba:[<0x20000001a85/article-21.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.997+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-69.xml auth{0=1} v789 ap=1 s=9711 n(v0 rc2024-04-26T20:27:35.690594+0000 b9711 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af88100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000128b:[<0x20000001a85/comment-69.xml v789>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000128b:[<0x20000001a85/comment-69.xml v789>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.998+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-36.xml auth{0=1} v779 ap=1 s=6883 n(v0 rc2024-04-26T20:27:36.206584+0000 b6883 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af89700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012e5:[<0x20000001a85/comment-36.xml v779>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012e5:[<0x20000001a85/comment-36.xml v779>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.998+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001297 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-64.xml auth{0=1} v785 ap=1 s=8696 n(v0 rc2024-04-26T20:27:35.726593+0000 b8696 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001297:[<0x20000001a85/comment-64.xml v785>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001297:[<0x20000001a85/comment-64.xml v785>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.999+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001281 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-72.xml auth{0=1} v793 ap=1 s=9453 n(v0 rc2024-04-26T20:27:35.636595+0000 b9453 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001281:[<0x20000001a85/comment-72.xml v793>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001281:[<0x20000001a85/comment-72.xml v793>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:05.999+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b1a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-26.jpg auth{0=1} v645 ap=1 s=15368 n(v0 rc2024-04-26T20:25:28.356082+0000 b15368 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af87600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b1a:[<0x20000001a85/picture-26.jpg v442>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b1a:[<0x20000001a85/picture-26.jpg v645>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.000+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001acb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-13.xml auth{0=1} v632 ap=1 s=16345 n(v0 rc2024-04-26T20:25:28.183085+0000 b16345 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001acb:[<0x20000001a85/article-13.xml v202>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001acb:[<0x20000001a85/article-13.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.154 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.055+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ae0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-2.xml auth{0=1} v641 ap=1 s=30559 n(v0 rc2024-04-26T20:25:28.237084+0000 b30559 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ae0:[<0x20000001a85/article-2.xml v268>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ae0:[<0x20000001a85/article-2.xml v641>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.060+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001322 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-4.xml auth{0=1} v797 ap=1 s=6125 n(v0 rc2024-04-26T20:27:36.582577+0000 b6125 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af93080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001322:[<0x20000001a85/comment-4.xml v797>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001322:[<0x20000001a85/comment-4.xml v797>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.061+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-30.xml auth{0=1} v636 ap=1 s=21489 n(v0 rc2024-04-26T20:25:28.072087+0000 b21489 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af88c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa6:[<0x20000001a85/article-30.xml v100>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa6:[<0x20000001a85/article-30.xml v636>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.061+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001274 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-74.xml auth{0=1} v795 ap=1 s=6968 n(v0 rc2024-04-26T20:27:35.604596+0000 b6968 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af89180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001274:[<0x20000001a85/comment-74.xml v795>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001274:[<0x20000001a85/comment-74.xml v795>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.062+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ad8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-6.xml auth{0=1} v653 ap=1 s=17094 n(v0 rc2024-04-26T20:25:28.220084+0000 b17094 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af93600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ad8:[<0x20000001a85/article-6.xml v244>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ad8:[<0x20000001a85/article-6.xml v653>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.062+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001291 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-67.xml auth{0=1} v787 ap=1 s=8574 n(v0 rc2024-04-26T20:27:35.705594+0000 b8574 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af94680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001291:[<0x20000001a85/comment-67.xml v787>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001291:[<0x20000001a85/comment-67.xml v787>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.062+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b14 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-29.jpg auth{0=1} v647 ap=1 s=13276 n(v0 rc2024-04-26T20:25:28.337082+0000 b13276 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af94c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b14:[<0x20000001a85/picture-29.jpg v424>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b14:[<0x20000001a85/picture-29.jpg v647>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.063+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001305 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-14.xml auth{0=1} v799 ap=1 s=3936 n(v0 rc2024-04-26T20:27:36.502578+0000 b3936 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af94100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001305:[<0x20000001a85/comment-14.xml v799>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001305:[<0x20000001a85/comment-14.xml v799>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.068+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-19.xml auth{0=1} v801 ap=1 s=4512 n(v0 rc2024-04-26T20:27:36.425580+0000 b4512 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423af95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012fd:[<0x20000001a85/comment-19.xml v801>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012fd:[<0x20000001a85/comment-19.xml v801>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.155 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.109+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-22.xml auth{0=1} v803 ap=1 s=2079 n(v0 rc2024-04-26T20:27:36.371581+0000 b2079 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f8:[<0x20000001a85/comment-22.xml v803>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f8:[<0x20000001a85/comment-22.xml v803>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.110+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001328 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-2.xml auth{0=1} v793 ap=1 s=2094 n(v0 rc2024-04-26T20:27:36.604576+0000 b2094 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001328:[<0x20000001a85/comment-2.xml v793>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001328:[<0x20000001a85/comment-2.xml v793>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.110+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012cb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-44.xml auth{0=1} v785 ap=1 s=6273 n(v0 rc2024-04-26T20:27:36.057587+0000 b6273 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b09f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012cb:[<0x20000001a85/comment-44.xml v785>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012cb:[<0x20000001a85/comment-44.xml v785>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.111+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-33.xml auth{0=1} v634 ap=1 s=15596 n(v0 rc2024-04-26T20:25:28.045088+0000 b15596 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa0:[<0x20000001a85/article-33.xml v82>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa0:[<0x20000001a85/article-33.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.112+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a8d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-43.xml auth{0=1} v630 ap=1 s=19063 n(v0 rc2024-04-26T20:25:27.980089+0000 b19063 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a8d:[<0x20000001a85/article-43.xml v22>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a8d:[<0x20000001a85/article-43.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.114+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b4c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-5.jpg auth{0=1} v641 ap=1 s=50143 n(v0 rc2024-04-26T20:25:28.476079+0000 b50143 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b4c:[<0x20000001a85/picture-5.jpg v568>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b4c:[<0x20000001a85/picture-5.jpg v641>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.115+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-50.jpg auth v639 ap=1 s=10395 n(v0 rc2024-04-26T20:25:28.256084+0000 b10395 1=1+0) | authpin=1 scrubqueue=0 0x5642383d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aea:[<0x20000001a85/picture-50.jpg v298>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aea:[<0x20000001a85/picture-50.jpg v639>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.115+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-27.xml auth{0=1} v805 ap=1 s=2548 n(v0 rc2024-04-26T20:27:36.310582+0000 b2548 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f2:[<0x20000001a85/comment-27.xml v805>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f2:[<0x20000001a85/comment-27.xml v805>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.156 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.116+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-52.xml auth{0=1} v789 ap=1 s=3515 n(v0 rc2024-04-26T20:27:35.921589+0000 b3515 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012b6:[<0x20000001a85/comment-52.xml v789>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012b6:[<0x20000001a85/comment-52.xml v789>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.157 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.116+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001293 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-66.xml auth{0=1} v791 ap=1 s=7972 n(v0 rc2024-04-26T20:27:35.715593+0000 b7972 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001293:[<0x20000001a85/comment-66.xml v791>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001293:[<0x20000001a85/comment-66.xml v791>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.157 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.117+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001317 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-7.xml auth{0=1} v795 ap=1 s=7494 n(v0 rc2024-04-26T20:27:36.556577+0000 b7494 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001317:[<0x20000001a85/comment-7.xml v795>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001317:[<0x20000001a85/comment-7.xml v795>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.157 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.117+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001303 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-15.xml auth{0=1} v799 ap=1 s=3708 n(v0 rc2024-04-26T20:27:36.495578+0000 b3708 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001303:[<0x20000001a85/comment-15.xml v799>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001303:[<0x20000001a85/comment-15.xml v799>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.157 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.119+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-43.xml auth{0=1} v783 ap=1 s=9069 n(v0 rc2024-04-26T20:27:36.098586+0000 b9069 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012d0:[<0x20000001a85/comment-43.xml v783>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012d0:[<0x20000001a85/comment-43.xml v783>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.157 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.119+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-17.xml auth{0=1} v801 ap=1 s=8985 n(v0 rc2024-04-26T20:27:36.441579+0000 b8985 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012ff:[<0x20000001a85/comment-17.xml v801>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012ff:[<0x20000001a85/comment-17.xml v801>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.157 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.119+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aaa [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-28.xml auth{0=1} v632 ap=1 s=20415 n(v0 rc2024-04-26T20:25:28.089087+0000 b20415 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aaa:[<0x20000001a85/article-28.xml v112>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aaa:[<0x20000001a85/article-28.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.158 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.120+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001310 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-9.xml auth{0=1} v797 ap=1 s=2074 n(v0 rc2024-04-26T20:27:36.538577+0000 b2074 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001310:[<0x20000001a85/comment-9.xml v797>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001310:[<0x20000001a85/comment-9.xml v797>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.158 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.123+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ae8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-51.jpg auth v645 ap=1 s=18451 n(v0 rc2024-04-26T20:25:28.252084+0000 b18451 1=1+0) | authpin=1 scrubqueue=0 0x56423835f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ae8:[<0x20000001a85/picture-51.jpg v292>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ae8:[<0x20000001a85/picture-51.jpg v645>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.158 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.123+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001af2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-46.jpg auth{0=1} v637 ap=1 s=55740 n(v0 rc2024-04-26T20:25:28.271083+0000 b55740 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001af2:[<0x20000001a85/picture-46.jpg v322>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001af2:[<0x20000001a85/picture-46.jpg v637>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.158 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.124+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-45.xml auth{0=1} v787 ap=1 s=5203 n(v0 rc2024-04-26T20:27:36.026587+0000 b5203 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b0aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012c7:[<0x20000001a85/comment-45.xml v787>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012c7:[<0x20000001a85/comment-45.xml v787>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub queued for path: / 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:28:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: scrub summary: active paths [/] 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002851 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71) see mds.b log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c3c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c4b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bda (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-92.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c86 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c64 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bf5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-83.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c56 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c52 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c83 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c81 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009dd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bfe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-80.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c60 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c80 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c76 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c84 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c34 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bf0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-85.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002be7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-88.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c7c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c43 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c77 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c78 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c2a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-76.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c82 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c6a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bd4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-94.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c72 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c4d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c7d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c79 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002be1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-90.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c54 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c5e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c85 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38) see mds.b log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c40 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-79.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009ec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c49 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c7f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c7a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bfb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-81.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-78.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c62 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c4e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c3a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c51 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bde (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-91.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c74 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.209 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bf2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-84.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c45 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bd7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-93.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c7b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c66 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c5c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c75 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c4f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bf8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-82.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c6c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c2e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-86.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.212 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.213 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.234 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002be4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-89.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.234 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002bea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-87.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.234 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c5a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c58 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c7e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-77.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c68 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c6e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:05 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002c28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.368 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.186+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001307 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-13.xml auth{0=1} v800 ap=1 s=4334 n(v0 rc2024-04-26T20:27:36.509578+0000 b4334 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001307:[<0x20000001a85/comment-13.xml v800>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001307:[<0x20000001a85/comment-13.xml v800>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.368 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.186+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-26.xml auth{0=1} v806 ap=1 s=2071 n(v0 rc2024-04-26T20:27:36.323582+0000 b2071 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012f3:[<0x20000001a85/comment-26.xml v806>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012f3:[<0x20000001a85/comment-26.xml v806>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.368 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.186+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fa [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-21.xml auth{0=1} v804 ap=1 s=4089 n(v0 rc2024-04-26T20:27:36.382580+0000 b4089 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b00f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012fa:[<0x20000001a85/comment-21.xml v804>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012fa:[<0x20000001a85/comment-21.xml v804>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.369 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.187+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-64.xml auth v810 ap=1 s=25207 n(v0 rc2024-04-26T20:27:34.616615+0000 b25207 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x56423b00e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000116a:[<0x20000001a85/article-64.xml v810>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x1000000116a:[<0x20000001a85/article-64.xml v810>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.369 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.188+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b18 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-27.jpg auth{0=1} v643 ap=1 s=11653 n(v0 rc2024-04-26T20:25:28.350082+0000 b11653 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b016580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b18:[<0x20000001a85/picture-27.jpg v436>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b18:[<0x20000001a85/picture-27.jpg v643>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.369 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.188+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a98 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-37.xml auth{0=1} v632 ap=1 s=4957 n(v0 rc2024-04-26T20:25:28.019088+0000 b4957 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b016000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a98:[<0x20000001a85/article-37.xml v58>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a98:[<0x20000001a85/article-37.xml v632>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.369 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.188+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a94 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-39.xml auth{0=1} v640 ap=1 s=9897 n(v0 rc2024-04-26T20:25:28.008088+0000 b9897 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b016b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a94:[<0x20000001a85/article-39.xml v46>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a94:[<0x20000001a85/article-39.xml v640>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.369 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.188+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a9a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-36.xml auth{0=1} v638 ap=1 s=28320 n(v0 rc2024-04-26T20:25:28.025088+0000 b28320 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b017080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a9a:[<0x20000001a85/article-36.xml v64>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a9a:[<0x20000001a85/article-36.xml v638>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.370 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.189+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001acd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-12.xml auth{0=1} v630 ap=1 s=21194 n(v0 rc2024-04-26T20:25:28.188085+0000 b21194 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b017600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001acd:[<0x20000001a85/article-12.xml v208>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001acd:[<0x20000001a85/article-12.xml v630>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.370 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.189+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ee [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-30.xml auth{0=1} v808 ap=1 s=4212 n(v0 rc2024-04-26T20:27:36.283582+0000 b4212 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b018100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012ee:[<0x20000001a85/comment-30.xml v808>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012ee:[<0x20000001a85/comment-30.xml v808>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.370 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.189+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ae2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-1.xml auth{0=1} v653 ap=1 s=32175 n(v0 rc2024-04-26T20:25:28.240084+0000 b32175 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b017b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ae2:[<0x20000001a85/article-1.xml v274>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ae2:[<0x20000001a85/article-1.xml v653>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.370 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.189+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ae4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-53.jpg auth v649 ap=1 s=61287 n(v0 rc2024-04-26T20:25:28.244084+0000 b61287 1=1+0) | authpin=1 scrubqueue=0 0x564239f28580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ae4:[<0x20000001a85/picture-53.jpg v280>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ae4:[<0x20000001a85/picture-53.jpg v649>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.371 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.190+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001325 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-3.xml auth{0=1} v796 ap=1 s=7785 n(v0 rc2024-04-26T20:27:36.600576+0000 b7785 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b018c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001325:[<0x20000001a85/comment-3.xml v796>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001325:[<0x20000001a85/comment-3.xml v796>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.371 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.190+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b0a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-34.jpg auth{0=1} v647 ap=1 s=24036 n(v0 rc2024-04-26T20:25:28.310082+0000 b24036 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b018680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b0a:[<0x20000001a85/picture-34.jpg v394>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b0a:[<0x20000001a85/picture-34.jpg v647>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.371 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.190+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fe [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-18.xml auth{0=1} v802 ap=1 s=6330 n(v0 rc2024-04-26T20:27:36.434579+0000 b6330 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b019180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012fe:[<0x20000001a85/comment-18.xml v802>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012fe:[<0x20000001a85/comment-18.xml v802>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.371 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.191+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001157 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-66.xml auth v812 ap=1 s=21161 n(v0 rc2024-04-26T20:27:34.543616+0000 b21161 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x56423b019700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001157:[<0x20000001a85/article-66.xml v812>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001157:[<0x20000001a85/article-66.xml v812>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.371 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.191+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001308 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-12.xml auth{0=1} v798 ap=1 s=5216 n(v0 rc2024-04-26T20:27:36.517578+0000 b5216 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b020580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001308:[<0x20000001a85/comment-12.xml v798>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001308:[<0x20000001a85/comment-12.xml v798>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.372 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.191+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b36 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-16.jpg auth{0=1} v655 ap=1 s=64697 n(v0 rc2024-04-26T20:25:28.431080+0000 b64697 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b020000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b36:[<0x20000001a85/picture-16.jpg v502>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b36:[<0x20000001a85/picture-16.jpg v655>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.372 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.191+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ae6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-52.jpg auth v657 ap=1 s=58628 n(v0 rc2024-04-26T20:25:28.248084+0000 b58628 1=1+0) | authpin=1 scrubqueue=0 0x564239f29080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ae6:[<0x20000001a85/picture-52.jpg v286>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ae6:[<0x20000001a85/picture-52.jpg v657>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.372 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.191+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012be [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-49.xml auth{0=1} v790 ap=1 s=3507 n(v0 rc2024-04-26T20:27:35.956589+0000 b3507 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b020b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012be:[<0x20000001a85/comment-49.xml v790>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012be:[<0x20000001a85/comment-49.xml v790>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.372 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.192+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-42.xml auth{0=1} v788 ap=1 s=4752 n(v0 rc2024-04-26T20:27:36.106586+0000 b4752 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b021080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012d4:[<0x20000001a85/comment-42.xml v788>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012d4:[<0x20000001a85/comment-42.xml v788>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.372 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.192+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ac3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-17.xml auth{0=1} v634 ap=1 s=13463 n(v0 rc2024-04-26T20:25:28.168085+0000 b13463 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b022100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ac3:[<0x20000001a85/article-17.xml v178>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ac3:[<0x20000001a85/article-17.xml v634>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.373 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.192+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b0e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-32.jpg auth{0=1} v645 ap=1 s=27014 n(v0 rc2024-04-26T20:25:28.319082+0000 b27014 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b022680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001b0e:[<0x20000001a85/picture-32.jpg v406>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001b0e:[<0x20000001a85/picture-32.jpg v645>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.373 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.192+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aee [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-48.jpg auth v651 ap=1 s=13324 n(v0 rc2024-04-26T20:25:28.266083+0000 b13324 1=1+0) | authpin=1 scrubqueue=0 0x56423aef0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aee:[<0x20000001a85/picture-48.jpg v310>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aee:[<0x20000001a85/picture-48.jpg v651>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.373 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.198+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001295 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-65.xml auth{0=1} v794 ap=1 s=3714 n(v0 rc2024-04-26T20:27:35.721593+0000 b3714 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b021600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001295:[<0x20000001a85/comment-65.xml v794>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001295:[<0x20000001a85/comment-65.xml v794>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.373 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.198+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ab6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-23.xml auth{0=1} v636 ap=1 s=28536 n(v0 rc2024-04-26T20:25:28.130086+0000 b28536 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b021b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001ab6:[<0x20000001a85/article-23.xml v142>,<0x10000000971/blog-41 v48687>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001ab6:[<0x20000001a85/article-23.xml v636>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.373 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:28:06.200+0000 7fb667aec700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-51.xml auth{0=1} v792 ap=1 s=4302 n(v0 rc2024-04-26T20:27:35.930589+0000 b4302 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x56423b022c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000012b9:[<0x20000001a85/comment-51.xml v792>,<0x10000000971/blog-41 v114968>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000012b9:[<0x20000001a85/comment-51.xml v792>,<0x10000000971/blog-41 v118278>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub queued for path: / 2024-04-26T20:28:06.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:06.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:28:06.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:28:06.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:28:06.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:28:06.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: scrub summary: active paths [/] 2024-04-26T20:28:06.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002851 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71) see mds.b log and `damage ls` output for details 2024-04-26T20:28:06.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c3c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c4b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bda (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-92.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c86 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c64 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bf5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-83.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c56 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c52 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c83 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c81 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009dd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bfe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-80.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c60 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c80 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c76 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c84 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c34 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bf0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-85.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002be7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-88.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c7c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c43 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c77 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c78 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c2a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-76.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c82 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c6a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bd4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-94.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c72 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c4d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c7d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c79 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002be1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-90.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c54 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c5e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c85 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-38) see mds.b log and `damage ls` output for details 2024-04-26T20:28:06.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c40 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-79.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009ec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c49 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c7f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c7a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bfb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-81.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-78.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c62 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c4e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c3a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c51 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bde (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-91.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c74 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bf2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-84.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c45 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bd7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-93.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c7b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c66 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c5c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c75 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c4f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bf8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-82.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c6c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c2e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-86.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002be4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-89.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002bea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-87.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c5a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c58 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c7e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-77.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c68 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c6e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:05 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002c28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:06.846 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.363+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000145e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-59.xml auth{0=1} v866 ap=1 s=14445 n(v0 rc2024-04-26T20:25:16.801307+0000 b14445 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90625b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000145e:[<0x2000000142a/article-59.xml v866>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000145e:[<0x2000000142a/article-59.xml v866>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.847 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.364+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001440 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-74.xml auth{0=1} v872 ap=1 s=9622 n(v0 rc2024-04-26T20:25:16.719309+0000 b9622 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90627180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001440:[<0x2000000142a/article-74.xml v872>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001440:[<0x2000000142a/article-74.xml v872>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.847 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.364+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001529 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-18.jpg auth{0=1} v870 ap=1 s=54393 n(v0 rc2024-04-26T20:25:17.210299+0000 b54393 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90626c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001529:[<0x2000000142a/picture-18.jpg v870>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001529:[<0x2000000142a/picture-18.jpg v870>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.847 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.365+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001533 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-13.jpg auth{0=1} v868 ap=1 s=63458 n(v0 rc2024-04-26T20:25:17.259298+0000 b63458 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90626100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001533:[<0x2000000142a/picture-13.jpg v868>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001533:[<0x2000000142a/picture-13.jpg v868>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.847 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.365+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001527 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-19.jpg auth{0=1} v874 ap=1 s=22424 n(v0 rc2024-04-26T20:25:17.199300+0000 b22424 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f524580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001527:[<0x2000000142a/picture-19.jpg v874>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001527:[<0x2000000142a/picture-19.jpg v874>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.847 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.366+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-5.xml auth{0=1} v1446 ap=1 s=6321 n(v0 rc2024-04-26T20:27:23.910824+0000 b6321 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f524000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f3e:[<0x2000000142a/comment-5.xml v1435>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f3e:[<0x2000000142a/comment-5.xml v1446>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.848 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.366+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000146e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-51.xml auth{0=1} v876 ap=1 s=17891 n(v0 rc2024-04-26T20:25:16.836307+0000 b17891 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f524b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000146e:[<0x2000000142a/article-51.xml v876>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000146e:[<0x2000000142a/article-51.xml v876>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.848 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.367+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-56.xml auth{0=1} v1457 ap=1 s=6357 n(v0 rc2024-04-26T20:27:23.400834+0000 b6357 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90626680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000efb:[<0x2000000142a/comment-56.xml v1345>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000efb:[<0x2000000142a/comment-56.xml v1457>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.848 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.367+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014b0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-18.xml auth{0=1} v1142 ap=1 s=18092 n(v0 rc2024-04-26T20:25:16.960304+0000 b18092 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90627700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014b0:[<0x2000000142a/article-18.xml v1142>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014b0:[<0x2000000142a/article-18.xml v1142>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.848 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.367+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f16 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-29.xml auth{0=1} v1444 ap=1 s=5119 n(v0 rc2024-04-26T20:27:23.642829+0000 b5119 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f525080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f16:[<0x2000000142a/comment-29.xml v1396>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f16:[<0x2000000142a/comment-29.xml v1444>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.848 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.367+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001507 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg auth{0=1} v882 ap=1 s=33362 n(v0 rc2024-04-26T20:25:17.103301+0000 b33362 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f526100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001507:[<0x2000000142a/picture-35.jpg v882>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001507:[<0x2000000142a/picture-35.jpg v882>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.849 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.368+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001549 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-2.jpg auth{0=1} v1157 ap=1 s=39327 n(v0 rc2024-04-26T20:25:17.414295+0000 b39327 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f526680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001549:[<0x2000000142a/picture-2.jpg v856>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001549:[<0x2000000142a/picture-2.jpg v1157>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.849 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.368+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001545 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-4.jpg auth{0=1} v880 ap=1 s=31778 n(v0 rc2024-04-26T20:25:17.379296+0000 b31778 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f525b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001545:[<0x2000000142a/picture-4.jpg v880>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001545:[<0x2000000142a/picture-4.jpg v880>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.849 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.368+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000149e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-27.xml auth{0=1} v878 ap=1 s=27150 n(v0 rc2024-04-26T20:25:16.930305+0000 b27150 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f525600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000149e:[<0x2000000142a/article-27.xml v878>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000149e:[<0x2000000142a/article-27.xml v878>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.849 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.368+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ac [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-20.xml auth{0=1} v886 ap=1 s=23321 n(v0 rc2024-04-26T20:25:16.954304+0000 b23321 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f527180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ac:[<0x2000000142a/article-20.xml v886>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ac:[<0x2000000142a/article-20.xml v886>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.849 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.369+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001531 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-14.jpg auth{0=1} v888 ap=1 s=16278 n(v0 rc2024-04-26T20:25:17.247299+0000 b16278 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f527700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001531:[<0x2000000142a/picture-14.jpg v888>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001531:[<0x2000000142a/picture-14.jpg v888>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.850 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.369+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000142e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-83.xml auth{0=1} v1134 ap=1 s=8458 n(v0 rc2024-04-26T20:25:16.672310+0000 b8458 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eec8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000142e:[<0x2000000142a/article-83.xml v1134>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000142e:[<0x2000000142a/article-83.xml v1134>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.850 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.369+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001448 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-70.xml auth{0=1} v884 ap=1 s=32662 n(v0 rc2024-04-26T20:25:16.742309+0000 b32662 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f526c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001448:[<0x2000000142a/article-70.xml v884>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001448:[<0x2000000142a/article-70.xml v884>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.850 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.370+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000145a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-61.xml auth{0=1} v890 ap=1 s=1528 n(v0 rc2024-04-26T20:25:16.792308+0000 b1528 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eec8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000145a:[<0x2000000142a/article-61.xml v890>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000145a:[<0x2000000142a/article-61.xml v890>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.850 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.370+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001482 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-41.xml auth{0=1} v892 ap=1 s=19619 n(v0 rc2024-04-26T20:25:16.875306+0000 b19619 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eec8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001482:[<0x2000000142a/article-41.xml v892>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001482:[<0x2000000142a/article-41.xml v892>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.850 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.370+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000147a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-45.xml auth{0=1} v894 ap=1 s=21350 n(v0 rc2024-04-26T20:25:16.860306+0000 b21350 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eec9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000147a:[<0x2000000142a/article-45.xml v894>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000147a:[<0x2000000142a/article-45.xml v894>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.851 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.370+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000153f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-7.jpg auth{0=1} v898 ap=1 s=16664 n(v0 rc2024-04-26T20:25:17.345297+0000 b16664 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eec9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000153f:[<0x2000000142a/picture-7.jpg v898>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000153f:[<0x2000000142a/picture-7.jpg v898>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.851 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.371+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000144a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-69.xml auth{0=1} v896 ap=1 s=27483 n(v0 rc2024-04-26T20:25:16.746308+0000 b27483 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eec9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000144a:[<0x2000000142a/article-69.xml v896>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000144a:[<0x2000000142a/article-69.xml v896>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.851 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.371+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001496 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-31.xml auth{0=1} v900 ap=1 s=22697 n(v0 rc2024-04-26T20:25:16.916305+0000 b22697 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eeca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001496:[<0x2000000142a/article-31.xml v900>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001496:[<0x2000000142a/article-31.xml v900>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.851 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.371+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-11.xml auth{0=1} v1455 ap=1 s=6131 n(v0 rc2024-04-26T20:27:23.832825+0000 b6131 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eecac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f2e:[<0x2000000142a/comment-11.xml v1415>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f2e:[<0x2000000142a/comment-11.xml v1455>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.851 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.372+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-20.xml auth{0=1} v1456 ap=1 s=4998 n(v0 rc2024-04-26T20:27:23.704828+0000 b4998 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eecb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f1f:[<0x2000000142a/comment-20.xml v1412>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f1f:[<0x2000000142a/comment-20.xml v1456>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.852 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.372+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000153b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-9.jpg auth{0=1} v902 ap=1 s=30082 n(v0 rc2024-04-26T20:25:17.317297+0000 b30082 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8eeca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000153b:[<0x2000000142a/picture-9.jpg v902>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000153b:[<0x2000000142a/picture-9.jpg v902>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.852 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.372+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-37.xml auth{0=1} v1469 ap=1 s=7738 n(v0 rc2024-04-26T20:27:23.570830+0000 b7738 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f552c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f0e:[<0x2000000142a/comment-37.xml v1370>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f0e:[<0x2000000142a/comment-37.xml v1469>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.852 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.372+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000154b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-1.jpg auth{1=1} v1155 ap=1 s=42481 n(v0 rc2024-04-26T20:25:17.432295+0000 b42481 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000154b:[<0x2000000142a/picture-1.jpg v1132>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000154b:[<0x2000000142a/picture-1.jpg v1155>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.852 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.373+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f23 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-16.xml auth{0=1} v1470 ap=1 s=5606 n(v0 rc2024-04-26T20:27:23.756827+0000 b5606 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f23:[<0x2000000142a/comment-16.xml v1427>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f23:[<0x2000000142a/comment-16.xml v1470>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.852 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.373+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001434 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-80.xml auth{0=1} v904 ap=1 s=23820 n(v0 rc2024-04-26T20:25:16.686310+0000 b23820 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f552680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001434:[<0x2000000142a/article-80.xml v904>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001434:[<0x2000000142a/article-80.xml v904>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.853 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.373+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014c2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-9.xml auth{0=1} v908 ap=1 s=15463 n(v0 rc2024-04-26T20:25:16.989304+0000 b15463 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014c2:[<0x2000000142a/article-9.xml v908>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014c2:[<0x2000000142a/article-9.xml v908>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.853 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.374+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000147c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-44.xml auth{0=1} v910 ap=1 s=30588 n(v0 rc2024-04-26T20:25:16.864306+0000 b30588 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000147c:[<0x2000000142a/article-44.xml v910>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000147c:[<0x2000000142a/article-44.xml v910>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.853 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.374+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001541 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-6.jpg auth{0=1} v912 ap=1 s=61365 n(v0 rc2024-04-26T20:25:17.357297+0000 b61365 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001541:[<0x2000000142a/picture-6.jpg v912>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001541:[<0x2000000142a/picture-6.jpg v912>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.853 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.374+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-58.xml auth{0=1} v1467 ap=1 s=9382 n(v0 rc2024-04-26T20:27:23.382834+0000 b9382 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef9:[<0x2000000142a/comment-58.xml v1341>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef9:[<0x2000000142a/comment-58.xml v1467>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.853 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.375+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001452 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-65.xml auth{0=1} v914 ap=1 s=23811 n(v0 rc2024-04-26T20:25:16.771308+0000 b23811 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001452:[<0x2000000142a/article-65.xml v914>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001452:[<0x2000000142a/article-65.xml v914>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.854 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.375+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001458 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-62.xml auth{0=1} v916 ap=1 s=24341 n(v0 rc2024-04-26T20:25:16.787308+0000 b24341 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001458:[<0x2000000142a/article-62.xml v916>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001458:[<0x2000000142a/article-62.xml v916>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.854 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.375+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001539 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-10.jpg auth{0=1} v906 ap=1 s=43906 n(v0 rc2024-04-26T20:25:17.301298+0000 b43906 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f553700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001539:[<0x2000000142a/picture-10.jpg v906>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001539:[<0x2000000142a/picture-10.jpg v906>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.854 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.375+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-71.xml auth{0=1} v1474 ap=1 s=4616 n(v0 rc2024-04-26T20:27:23.271836+0000 b4616 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f553180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ee3:[<0x2000000142a/comment-71.xml v1322>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ee3:[<0x2000000142a/comment-71.xml v1474>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.854 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.375+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-55.xml auth{0=1} v1471 ap=1 s=5515 n(v0 rc2024-04-26T20:27:23.404834+0000 b5515 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000efc:[<0x2000000142a/comment-55.xml v1348>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000efc:[<0x2000000142a/comment-55.xml v1471>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.854 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.376+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f11 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-34.xml auth{0=1} v1448 ap=1 s=4468 n(v0 rc2024-04-26T20:27:23.588830+0000 b4468 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f11:[<0x2000000142a/comment-34.xml v1379>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f11:[<0x2000000142a/comment-34.xml v1448>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.855 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.376+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-25.xml auth{0=1} v1468 ap=1 s=3767 n(v0 rc2024-04-26T20:27:23.670828+0000 b3767 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f1a:[<0x2000000142a/comment-25.xml v1397>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f1a:[<0x2000000142a/comment-25.xml v1468>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.855 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.376+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-41.xml auth{0=1} v1446 ap=1 s=7748 n(v0 rc2024-04-26T20:27:23.537831+0000 b7748 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f0a:[<0x2000000142a/comment-41.xml v1363>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f0a:[<0x2000000142a/comment-41.xml v1446>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.855 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.377+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001515 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg auth{0=1} v920 ap=1 s=51752 n(v0 rc2024-04-26T20:25:17.128301+0000 b51752 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001515:[<0x2000000142a/picture-28.jpg v920>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001515:[<0x2000000142a/picture-28.jpg v920>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.855 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.377+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001503 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg auth{0=1} v924 ap=1 s=58787 n(v0 rc2024-04-26T20:25:17.095302+0000 b58787 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001503:[<0x2000000142a/picture-37.jpg v924>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001503:[<0x2000000142a/picture-37.jpg v924>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.855 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.378+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000152b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-17.jpg auth{0=1} v926 ap=1 s=36561 n(v0 rc2024-04-26T20:25:17.220299+0000 b36561 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000152b:[<0x2000000142a/picture-17.jpg v926>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000152b:[<0x2000000142a/picture-17.jpg v926>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.378+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ce [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-3.xml auth{0=1} v928 ap=1 s=14091 n(v0 rc2024-04-26T20:25:17.008303+0000 b14091 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ce:[<0x2000000142a/article-3.xml v928>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ce:[<0x2000000142a/article-3.xml v928>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.378+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-75.xml auth{0=1} v1444 ap=1 s=7098 n(v0 rc2024-04-26T20:27:23.231837+0000 b7098 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ed8:[<0x2000000142a/comment-75.xml v1318>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ed8:[<0x2000000142a/comment-75.xml v1444>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.378+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000151d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg auth{0=1} v930 ap=1 s=49655 n(v0 rc2024-04-26T20:25:17.148301+0000 b49655 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000151d:[<0x2000000142a/picture-24.jpg v930>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000151d:[<0x2000000142a/picture-24.jpg v930>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.379+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000150b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg auth{0=1} v932 ap=1 s=52186 n(v0 rc2024-04-26T20:25:17.110301+0000 b52186 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000150b:[<0x2000000142a/picture-33.jpg v932>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000150b:[<0x2000000142a/picture-33.jpg v932>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.856 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.379+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014da [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg auth{0=1} v934 ap=1 s=51926 n(v0 rc2024-04-26T20:25:17.026303+0000 b51926 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014da:[<0x2000000142a/picture-57.jpg v934>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014da:[<0x2000000142a/picture-57.jpg v934>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.379+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014f9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg auth{0=1} v938 ap=1 s=31281 n(v0 rc2024-04-26T20:25:17.077302+0000 b31281 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc900ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014f9:[<0x2000000142a/picture-42.jpg v938>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014f9:[<0x2000000142a/picture-42.jpg v938>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.380+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014c6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-7.xml auth{0=1} v936 ap=1 s=14892 n(v0 rc2024-04-26T20:25:16.995304+0000 b14892 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc900ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014c6:[<0x2000000142a/article-7.xml v936>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014c6:[<0x2000000142a/article-7.xml v936>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.380+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-24.xml auth{0=1} v1473 ap=1 s=8883 n(v0 rc2024-04-26T20:27:23.674828+0000 b8883 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc900eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f1b:[<0x2000000142a/comment-24.xml v1401>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f1b:[<0x2000000142a/comment-24.xml v1473>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.381+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001466 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-55.xml auth{0=1} v942 ap=1 s=26917 n(v0 rc2024-04-26T20:25:16.819307+0000 b26917 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001466:[<0x2000000142a/article-55.xml v942>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001466:[<0x2000000142a/article-55.xml v942>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.857 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.382+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014a4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-24.xml auth{0=1} v918 ap=1 s=17306 n(v0 rc2024-04-26T20:25:16.940305+0000 b17306 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f65f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014a4:[<0x2000000142a/article-24.xml v918>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014a4:[<0x2000000142a/article-24.xml v918>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.382+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000983 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-67.xml auth{0=1} v1175 ap=1 s=29319 n(v0 rc2024-04-26T20:25:35.948933+0000 b29319 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000983:[<0x2000000142a/article-67.xml v1170>,<0x10000000971/blog-25 v51623>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x10000000983:[<0x2000000142a/article-67.xml v1175>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.382+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000151b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg auth{0=1} v944 ap=1 s=13978 n(v0 rc2024-04-26T20:25:17.139301+0000 b13978 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000151b:[<0x2000000142a/picture-25.jpg v944>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000151b:[<0x2000000142a/picture-25.jpg v944>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.382+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014c4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-8.xml auth{0=1} v946 ap=1 s=8071 n(v0 rc2024-04-26T20:25:16.992304+0000 b8071 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014c4:[<0x2000000142a/article-8.xml v946>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014c4:[<0x2000000142a/article-8.xml v946>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.383+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f04 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-47.xml auth{0=1} v1468 ap=1 s=4599 n(v0 rc2024-04-26T20:27:23.487832+0000 b4599 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f04:[<0x2000000142a/comment-47.xml v1351>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f04:[<0x2000000142a/comment-47.xml v1468>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.858 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.383+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-95.xml auth v1172 ap=1 s=26814 n(v0 rc2024-04-26T20:25:35.537941+0000 b26814 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc904b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000097e:[<0x2000000142a/article-95.xml v1165>,<0x10000000971/blog-25 v51623>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x1000000097e:[<0x2000000142a/article-95.xml v1172>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.383+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f05 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-46.xml auth{0=1} v1472 ap=1 s=2876 n(v0 rc2024-04-26T20:27:23.496832+0000 b2876 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f05:[<0x2000000142a/comment-46.xml v1354>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f05:[<0x2000000142a/comment-46.xml v1472>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.384+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000144c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-68.xml auth{0=1} v950 ap=1 s=13973 n(v0 rc2024-04-26T20:25:16.753308+0000 b13973 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000144c:[<0x2000000142a/article-68.xml v950>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000144c:[<0x2000000142a/article-68.xml v950>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.384+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg auth{0=1} v940 ap=1 s=37823 n(v0 rc2024-04-26T20:25:17.087302+0000 b37823 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc900eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ff:[<0x2000000142a/picture-39.jpg v940>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ff:[<0x2000000142a/picture-39.jpg v940>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.384+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-70.xml auth{0=1} v1475 ap=1 s=5293 n(v0 rc2024-04-26T20:27:23.283836+0000 b5293 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ee5:[<0x2000000142a/comment-70.xml v1322>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ee5:[<0x2000000142a/comment-70.xml v1475>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.859 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.385+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg auth{0=1} v952 ap=1 s=58138 n(v0 rc2024-04-26T20:25:17.053302+0000 b58138 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ea:[<0x2000000142a/picture-49.jpg v952>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ea:[<0x2000000142a/picture-49.jpg v952>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.385+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000143c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-76.xml auth{0=1} v954 ap=1 s=9107 n(v0 rc2024-04-26T20:25:16.704309+0000 b9107 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000143c:[<0x2000000142a/article-76.xml v954>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000143c:[<0x2000000142a/article-76.xml v954>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.385+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000153d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-8.jpg auth{0=1} v956 ap=1 s=18054 n(v0 rc2024-04-26T20:25:17.332297+0000 b18054 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000153d:[<0x2000000142a/picture-8.jpg v956>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000153d:[<0x2000000142a/picture-8.jpg v956>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.386+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-23.xml auth{0=1} v1472 ap=1 s=6211 n(v0 rc2024-04-26T20:27:23.687828+0000 b6211 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc900eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f1c:[<0x2000000142a/comment-23.xml v1404>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f1c:[<0x2000000142a/comment-23.xml v1472>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.386+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000150f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg auth{0=1} v948 ap=1 s=8972 n(v0 rc2024-04-26T20:25:17.117301+0000 b8972 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000150f:[<0x2000000142a/picture-31.jpg v948>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000150f:[<0x2000000142a/picture-31.jpg v948>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.860 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.386+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014aa [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-21.xml auth{0=1} v962 ap=1 s=5782 n(v0 rc2024-04-26T20:25:16.950304+0000 b5782 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014aa:[<0x2000000142a/article-21.xml v962>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014aa:[<0x2000000142a/article-21.xml v962>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.387+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001519 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg auth{0=1} v958 ap=1 s=54699 n(v0 rc2024-04-26T20:25:17.134301+0000 b54699 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001519:[<0x2000000142a/picture-26.jpg v958>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001519:[<0x2000000142a/picture-26.jpg v958>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.387+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001498 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-30.xml auth{0=1} v964 ap=1 s=29559 n(v0 rc2024-04-26T20:25:16.919305+0000 b29559 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001498:[<0x2000000142a/article-30.xml v964>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001498:[<0x2000000142a/article-30.xml v964>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.387+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eda [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-74.xml auth{0=1} v1440 ap=1 s=5036 n(v0 rc2024-04-26T20:27:23.236837+0000 b5036 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000eda:[<0x2000000142a/comment-74.xml v1318>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000eda:[<0x2000000142a/comment-74.xml v1440>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.388+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001494 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-32.xml auth{0=1} v960 ap=1 s=18145 n(v0 rc2024-04-26T20:25:16.911305+0000 b18145 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001494:[<0x2000000142a/article-32.xml v960>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001494:[<0x2000000142a/article-32.xml v960>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.861 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.388+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-69.xml auth{0=1} v1474 ap=1 s=8435 n(v0 rc2024-04-26T20:27:23.292836+0000 b8435 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ae5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ee7:[<0x2000000142a/comment-69.xml v1325>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ee7:[<0x2000000142a/comment-69.xml v1474>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.862 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.388+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-36.xml auth{0=1} v1466 ap=1 s=9713 n(v0 rc2024-04-26T20:27:23.573830+0000 b9713 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f0f:[<0x2000000142a/comment-36.xml v1374>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f0f:[<0x2000000142a/comment-36.xml v1466>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.862 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.389+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-72.xml auth{0=1} v1469 ap=1 s=4412 n(v0 rc2024-04-26T20:27:23.255836+0000 b4412 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ee0:[<0x2000000142a/comment-72.xml v1320>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ee0:[<0x2000000142a/comment-72.xml v1469>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.862 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.389+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ba [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-13.xml auth{0=1} v966 ap=1 s=30197 n(v0 rc2024-04-26T20:25:16.977304+0000 b30197 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ba:[<0x2000000142a/article-13.xml v966>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ba:[<0x2000000142a/article-13.xml v966>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.862 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.389+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-64.xml auth{0=1} v1465 ap=1 s=7190 n(v0 rc2024-04-26T20:27:23.334835+0000 b7190 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef0:[<0x2000000142a/comment-64.xml v1330>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef0:[<0x2000000142a/comment-64.xml v1465>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.862 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.390+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-4.xml auth{0=1} v1470 ap=1 s=9657 n(v0 rc2024-04-26T20:27:23.919824+0000 b9657 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f3f:[<0x2000000142a/comment-4.xml v1435>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f3f:[<0x2000000142a/comment-4.xml v1470>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.391+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014c8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-6.xml auth{0=1} v970 ap=1 s=6451 n(v0 rc2024-04-26T20:25:16.998304+0000 b6451 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014c8:[<0x2000000142a/article-6.xml v970>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014c8:[<0x2000000142a/article-6.xml v970>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.391+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014d0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-2.xml auth{0=1} v972 ap=1 s=15409 n(v0 rc2024-04-26T20:25:17.011303+0000 b15409 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014d0:[<0x2000000142a/article-2.xml v972>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014d0:[<0x2000000142a/article-2.xml v972>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.392+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001470 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-50.xml auth{0=1} v968 ap=1 s=11913 n(v0 rc2024-04-26T20:25:16.840307+0000 b11913 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001470:[<0x2000000142a/article-50.xml v968>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001470:[<0x2000000142a/article-50.xml v968>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.392+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f25 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-14.xml auth{0=1} v1467 ap=1 s=8641 n(v0 rc2024-04-26T20:27:23.767826+0000 b8641 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8e8fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f25:[<0x2000000142a/comment-14.xml v1419>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f25:[<0x2000000142a/comment-14.xml v1467>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.863 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.393+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014e0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg auth{0=1} v974 ap=1 s=52090 n(v0 rc2024-04-26T20:25:17.036303+0000 b52090 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ff4c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014e0:[<0x2000000142a/picture-54.jpg v974>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014e0:[<0x2000000142a/picture-54.jpg v974>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.864 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.393+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-90.xml auth v1284 ap=1 s=1870 n(v0 rc2024-04-26T20:26:34.981780+0000 b1870 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc8ff4cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000009d5:[<0x2000000142a/article-90.xml v1177>,<0x10000000971/blog-25 v102485>,<0x100000007e0/blogtest_in v1172>,<0x100000007d9/src v1701>,<0x100000005e3/blogbench-1.0 v1482>,<0x100000005e2/tmp v77>,<0x100000001fb/client.0 v77>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v93>,<0x1/volumes v90>]//[3]","memoryvalue":"(4)0x100000009d5:[<0x2000000142a/article-90.xml v1284>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.864 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.393+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f20 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-19.xml auth{0=1} v1471 ap=1 s=3353 n(v0 rc2024-04-26T20:27:23.718827+0000 b3353 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ff4d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f20:[<0x2000000142a/comment-19.xml v1416>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f20:[<0x2000000142a/comment-19.xml v1471>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.864 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.395+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001464 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-56.xml auth{0=1} v976 ap=1 s=29218 n(v0 rc2024-04-26T20:25:16.816307+0000 b29218 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ff4db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001464:[<0x2000000142a/article-56.xml v976>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001464:[<0x2000000142a/article-56.xml v976>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.864 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.396+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-67.xml auth{0=1} v1473 ap=1 s=4327 n(v0 rc2024-04-26T20:27:23.317835+0000 b4327 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ff4c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000eed:[<0x2000000142a/comment-67.xml v1327>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000eed:[<0x2000000142a/comment-67.xml v1473>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.864 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.397+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f41 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-2.xml auth{0=1} v1446 ap=1 s=3989 n(v0 rc2024-04-26T20:27:23.940823+0000 b3989 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90982b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f41:[<0x2000000142a/comment-2.xml v1439>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f41:[<0x2000000142a/comment-2.xml v1446>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.398+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-22.xml auth{0=1} v1477 ap=1 s=3339 n(v0 rc2024-04-26T20:27:23.691828+0000 b3339 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90982580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f1d:[<0x2000000142a/comment-22.xml v1405>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f1d:[<0x2000000142a/comment-22.xml v1477>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.398+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001513 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg auth{0=1} v1148 ap=1 s=26258 n(v0 rc2024-04-26T20:25:17.124301+0000 b26258 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ff4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001513:[<0x2000000142a/picture-29.jpg v1148>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001513:[<0x2000000142a/picture-29.jpg v1148>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.398+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f07 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-44.xml auth{0=1} v1448 ap=1 s=9117 n(v0 rc2024-04-26T20:27:23.507832+0000 b9117 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90983080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f07:[<0x2000000142a/comment-44.xml v1362>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f07:[<0x2000000142a/comment-44.xml v1448>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.398+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001492 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-33.xml auth{0=1} v980 ap=1 s=13166 n(v0 rc2024-04-26T20:25:16.908305+0000 b13166 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90983b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001492:[<0x2000000142a/article-33.xml v980>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001492:[<0x2000000142a/article-33.xml v980>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.865 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.400+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000147e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-43.xml auth{0=1} v978 ap=1 s=26425 n(v0 rc2024-04-26T20:25:16.867306+0000 b26425 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90983600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000147e:[<0x2000000142a/article-43.xml v978>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000147e:[<0x2000000142a/article-43.xml v978>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.866 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.400+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001543 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-5.jpg auth{0=1} v982 ap=1 s=47343 n(v0 rc2024-04-26T20:25:17.368296+0000 b47343 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90984100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001543:[<0x2000000142a/picture-5.jpg v982>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001543:[<0x2000000142a/picture-5.jpg v982>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.866 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.401+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f18 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-27.xml auth{0=1} v1472 ap=1 s=6603 n(v0 rc2024-04-26T20:27:23.655829+0000 b6603 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90984680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f18:[<0x2000000142a/comment-27.xml v1389>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f18:[<0x2000000142a/comment-27.xml v1472>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.866 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.401+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014e8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg auth{0=1} v984 ap=1 s=9239 n(v0 rc2024-04-26T20:25:17.049303+0000 b9239 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90984c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014e8:[<0x2000000142a/picture-50.jpg v984>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014e8:[<0x2000000142a/picture-50.jpg v984>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.866 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.401+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-76.xml auth{0=1} v1444 ap=1 s=8181 n(v0 rc2024-04-26T20:27:23.219837+0000 b8181 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90985180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ed6:[<0x2000000142a/comment-76.xml v1315>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ed6:[<0x2000000142a/comment-76.xml v1444>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.867 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.403+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014d8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg auth{0=1} v986 ap=1 s=29123 n(v0 rc2024-04-26T20:25:17.023303+0000 b29123 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90985700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014d8:[<0x2000000142a/picture-58.jpg v986>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014d8:[<0x2000000142a/picture-58.jpg v986>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.867 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.403+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eee [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-66.xml auth{0=1} v1473 ap=1 s=5557 n(v0 rc2024-04-26T20:27:23.323835+0000 b5557 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000eee:[<0x2000000142a/comment-66.xml v1319>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000eee:[<0x2000000142a/comment-66.xml v1473>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.867 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.403+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f39 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-7.xml auth{0=1} v1474 ap=1 s=9189 n(v0 rc2024-04-26T20:27:23.879824+0000 b9189 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f39:[<0x2000000142a/comment-7.xml v1431>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f39:[<0x2000000142a/comment-7.xml v1474>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.867 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.405+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-52.xml auth{0=1} v1480 ap=1 s=6745 n(v0 rc2024-04-26T20:27:23.452833+0000 b6745 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000eff:[<0x2000000142a/comment-52.xml v1356>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000eff:[<0x2000000142a/comment-52.xml v1480>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.867 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.406+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001436 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-79.xml auth{0=1} v988 ap=1 s=21079 n(v0 rc2024-04-26T20:25:16.691310+0000 b21079 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001436:[<0x2000000142a/article-79.xml v988>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001436:[<0x2000000142a/article-79.xml v988>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.406+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f24 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-15.xml auth{0=1} v1471 ap=1 s=8934 n(v0 rc2024-04-26T20:27:23.762827+0000 b8934 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f24:[<0x2000000142a/comment-15.xml v1415>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f24:[<0x2000000142a/comment-15.xml v1471>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.406+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001460 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-58.xml auth{0=1} v990 ap=1 s=23644 n(v0 rc2024-04-26T20:25:16.808307+0000 b23644 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001460:[<0x2000000142a/article-58.xml v990>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001460:[<0x2000000142a/article-58.xml v990>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.407+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001462 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-57.xml auth{0=1} v1140 ap=1 s=29480 n(v0 rc2024-04-26T20:25:16.812307+0000 b29480 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001462:[<0x2000000142a/article-57.xml v1140>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001462:[<0x2000000142a/article-57.xml v1140>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.407+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000146a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-53.xml auth{0=1} v992 ap=1 s=16961 n(v0 rc2024-04-26T20:25:16.827307+0000 b16961 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000146a:[<0x2000000142a/article-53.xml v992>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000146a:[<0x2000000142a/article-53.xml v992>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.868 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.410+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000146c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-52.xml auth{0=1} v996 ap=1 s=30915 n(v0 rc2024-04-26T20:25:16.832307+0000 b30915 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000146c:[<0x2000000142a/article-52.xml v996>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000146c:[<0x2000000142a/article-52.xml v996>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.411+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-28.xml auth{0=1} v1173 ap=1 s=30504 n(v0 rc2024-04-26T20:25:53.040599+0000 b30504 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000098b:[<0x2000000142a/article-28.xml v1167>,<0x10000000971/blog-25 v58631>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x1000000098b:[<0x2000000142a/article-28.xml v1173>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.413+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f33 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-9.xml auth{0=1} v1475 ap=1 s=7163 n(v0 rc2024-04-26T20:27:23.852825+0000 b7163 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f33:[<0x2000000142a/comment-9.xml v1422>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f33:[<0x2000000142a/comment-9.xml v1475>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.413+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f08 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-43.xml auth{0=1} v1478 ap=1 s=9735 n(v0 rc2024-04-26T20:27:23.513831+0000 b9735 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f08:[<0x2000000142a/comment-43.xml v1365>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f08:[<0x2000000142a/comment-43.xml v1478>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.413+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014e6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg auth{0=1} v998 ap=1 s=41207 n(v0 rc2024-04-26T20:25:17.046303+0000 b41207 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014e6:[<0x2000000142a/picture-51.jpg v998>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014e6:[<0x2000000142a/picture-51.jpg v998>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.869 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.414+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f22 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-17.xml auth{0=1} v1476 ap=1 s=3863 n(v0 rc2024-04-26T20:27:23.737827+0000 b3863 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc901b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f22:[<0x2000000142a/comment-17.xml v1412>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f22:[<0x2000000142a/comment-17.xml v1476>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.414+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f06 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-45.xml auth{0=1} v1479 ap=1 s=8051 n(v0 rc2024-04-26T20:27:23.501832+0000 b8051 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f06:[<0x2000000142a/comment-45.xml v1359>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f06:[<0x2000000142a/comment-45.xml v1479>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.414+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014f0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg auth{0=1} v1000 ap=1 s=13414 n(v0 rc2024-04-26T20:25:17.063302+0000 b13414 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc904b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014f0:[<0x2000000142a/picture-46.jpg v1000>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014f0:[<0x2000000142a/picture-46.jpg v1000>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.416+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001547 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-3.jpg auth{0=1} v1002 ap=1 s=9486 n(v0 rc2024-04-26T20:25:17.396296+0000 b9486 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001547:[<0x2000000142a/picture-3.jpg v1002>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001547:[<0x2000000142a/picture-3.jpg v1002>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.870 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.417+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efe [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-53.xml auth{0=1} v1465 ap=1 s=3755 n(v0 rc2024-04-26T20:27:23.417833+0000 b3755 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000efe:[<0x2000000142a/comment-53.xml v1352>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000efe:[<0x2000000142a/comment-53.xml v1465>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.871 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.419+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-6.xml auth{0=1} v1462 ap=1 s=3163 n(v0 rc2024-04-26T20:27:23.885824+0000 b3163 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f3b:[<0x2000000142a/comment-6.xml v1428>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f3b:[<0x2000000142a/comment-6.xml v1462>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.871 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.419+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-81.xml auth{0=1} v1435 ap=1 s=6485 n(v0 rc2024-04-26T20:27:23.169838+0000 b6485 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc900ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ec8:[<0x2000000142a/comment-81.xml v1302>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ec8:[<0x2000000142a/comment-81.xml v1435>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.871 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.419+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f31 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-10.xml auth{0=1} v1464 ap=1 s=9389 n(v0 rc2024-04-26T20:27:23.843825+0000 b9389 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f31:[<0x2000000142a/comment-10.xml v1412>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f31:[<0x2000000142a/comment-10.xml v1464>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.871 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.419+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001537 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-11.jpg auth{0=1} v1004 ap=1 s=10894 n(v0 rc2024-04-26T20:25:17.285298+0000 b10894 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001537:[<0x2000000142a/picture-11.jpg v1004>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001537:[<0x2000000142a/picture-11.jpg v1004>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.871 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.421+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ca [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-5.xml auth{0=1} v1006 ap=1 s=5642 n(v0 rc2024-04-26T20:25:17.001303+0000 b5642 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ca:[<0x2000000142a/article-5.xml v1006>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ca:[<0x2000000142a/article-5.xml v1006>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.421+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f17 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-28.xml auth{0=1} v1437 ap=1 s=9767 n(v0 rc2024-04-26T20:27:23.646829+0000 b9767 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f17:[<0x2000000142a/comment-28.xml v1385>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f17:[<0x2000000142a/comment-28.xml v1437>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.422+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f10 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-35.xml auth{0=1} v1458 ap=1 s=10006 n(v0 rc2024-04-26T20:27:23.583830+0000 b10006 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f10:[<0x2000000142a/comment-35.xml v1377>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f10:[<0x2000000142a/comment-35.xml v1458>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.422+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001490 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-34.xml auth{0=1} v1008 ap=1 s=12629 n(v0 rc2024-04-26T20:25:16.903305+0000 b12629 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001490:[<0x2000000142a/article-34.xml v1008>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001490:[<0x2000000142a/article-34.xml v1008>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.422+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efa [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-57.xml auth{0=1} v1459 ap=1 s=9299 n(v0 rc2024-04-26T20:27:23.394834+0000 b9299 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000efa:[<0x2000000142a/comment-57.xml v1340>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000efa:[<0x2000000142a/comment-57.xml v1459>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.424+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001438 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-78.xml auth{0=1} v1012 ap=1 s=26690 n(v0 rc2024-04-26T20:25:16.695309+0000 b26690 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d400580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001438:[<0x2000000142a/article-78.xml v1012>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001438:[<0x2000000142a/article-78.xml v1012>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.872 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.424+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001432 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-81.xml auth{0=1} v1010 ap=1 s=24860 n(v0 rc2024-04-26T20:25:16.681310+0000 b24860 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d400000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001432:[<0x2000000142a/article-81.xml v1010>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001432:[<0x2000000142a/article-81.xml v1010>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.425+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000149a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-29.xml auth{0=1} v1014 ap=1 s=26147 n(v0 rc2024-04-26T20:25:16.923305+0000 b26147 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d400b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000149a:[<0x2000000142a/article-29.xml v1014>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000149a:[<0x2000000142a/article-29.xml v1014>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.425+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014de [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg auth{0=1} v1144 ap=1 s=65315 n(v0 rc2024-04-26T20:25:17.033303+0000 b65315 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90b6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014de:[<0x2000000142a/picture-55.jpg v1144>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014de:[<0x2000000142a/picture-55.jpg v1144>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.426+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000145c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-60.xml auth{0=1} v1016 ap=1 s=1558 n(v0 rc2024-04-26T20:25:16.796307+0000 b1558 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d401080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000145c:[<0x2000000142a/article-60.xml v1016>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000145c:[<0x2000000142a/article-60.xml v1016>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.426+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-61.xml auth{0=1} v1461 ap=1 s=4110 n(v0 rc2024-04-26T20:27:23.367834+0000 b4110 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d401b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef6:[<0x2000000142a/comment-61.xml v1337>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef6:[<0x2000000142a/comment-61.xml v1461>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.873 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.427+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014a8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-22.xml auth{0=1} v1020 ap=1 s=19091 n(v0 rc2024-04-26T20:25:16.947305+0000 b19091 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d402100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014a8:[<0x2000000142a/article-22.xml v1020>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014a8:[<0x2000000142a/article-22.xml v1020>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.427+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014fd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg auth{0=1} v1018 ap=1 s=54731 n(v0 rc2024-04-26T20:25:17.083302+0000 b54731 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d401600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014fd:[<0x2000000142a/picture-40.jpg v1018>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014fd:[<0x2000000142a/picture-40.jpg v1018>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.427+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-38.xml auth{0=1} v1460 ap=1 s=7424 n(v0 rc2024-04-26T20:27:23.551831+0000 b7424 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d402680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f0d:[<0x2000000142a/comment-38.xml v1367>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f0d:[<0x2000000142a/comment-38.xml v1460>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.427+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001472 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-49.xml auth{0=1} v1022 ap=1 s=31068 n(v0 rc2024-04-26T20:25:16.844307+0000 b31068 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d403180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001472:[<0x2000000142a/article-49.xml v1022>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001472:[<0x2000000142a/article-49.xml v1022>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.427+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f37 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-8.xml auth{0=1} v1463 ap=1 s=6949 n(v0 rc2024-04-26T20:27:23.868825+0000 b6949 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d403700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f37:[<0x2000000142a/comment-8.xml v1421>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f37:[<0x2000000142a/comment-8.xml v1463>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.874 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.428+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ecb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-80.xml auth{0=1} v1433 ap=1 s=3242 n(v0 rc2024-04-26T20:27:23.188838+0000 b3242 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ecb:[<0x2000000142a/comment-80.xml v1307>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ecb:[<0x2000000142a/comment-80.xml v1433>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.428+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000151f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg auth{0=1} v1024 ap=1 s=41065 n(v0 rc2024-04-26T20:25:17.158300+0000 b41065 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fb33080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000151f:[<0x2000000142a/picture-23.jpg v1024>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000151f:[<0x2000000142a/picture-23.jpg v1024>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.428+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014f3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg auth{0=1} v1028 ap=1 s=8746 n(v0 rc2024-04-26T20:25:17.066302+0000 b8746 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ed5d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014f3:[<0x2000000142a/picture-45.jpg v1028>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014f3:[<0x2000000142a/picture-45.jpg v1028>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.428+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014b8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-14.xml auth{0=1} v1026 ap=1 s=6511 n(v0 rc2024-04-26T20:25:16.974304+0000 b6511 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fb32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014b8:[<0x2000000142a/article-14.xml v1026>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014b8:[<0x2000000142a/article-14.xml v1026>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.429+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-62.xml auth{0=1} v1418 ap=1 s=5678 n(v0 rc2024-04-26T20:27:23.353835+0000 b5678 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef2:[<0x2000000142a/comment-62.xml v1320>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef2:[<0x2000000142a/comment-62.xml v1418>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.875 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.429+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000142c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-84.xml auth{0=1} v1030 ap=1 s=12168 n(v0 rc2024-04-26T20:25:16.667310+0000 b12168 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000142c:[<0x2000000142a/article-84.xml v1030>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000142c:[<0x2000000142a/article-84.xml v1030>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.876 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.429+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014d4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg auth{0=1} v1032 ap=1 s=11716 n(v0 rc2024-04-26T20:25:17.017303+0000 b11716 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014d4:[<0x2000000142a/picture-60.jpg v1032>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014d4:[<0x2000000142a/picture-60.jpg v1032>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.876 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.430+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001478 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-46.xml auth{0=1} v1034 ap=1 s=9261 n(v0 rc2024-04-26T20:25:16.856306+0000 b9261 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ee72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001478:[<0x2000000142a/article-46.xml v1034>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001478:[<0x2000000142a/article-46.xml v1034>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.876 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.430+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001476 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-47.xml auth{0=1} v1036 ap=1 s=15861 n(v0 rc2024-04-26T20:25:16.852306+0000 b15861 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ee71080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001476:[<0x2000000142a/article-47.xml v1036>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001476:[<0x2000000142a/article-47.xml v1036>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.876 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.431+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001521 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg auth{0=1} v1040 ap=1 s=62010 n(v0 rc2024-04-26T20:25:17.168300+0000 b62010 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f96d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001521:[<0x2000000142a/picture-22.jpg v1040>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001521:[<0x2000000142a/picture-22.jpg v1040>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.876 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.431+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014be [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-11.xml auth{0=1} v1042 ap=1 s=27753 n(v0 rc2024-04-26T20:25:16.983304+0000 b27753 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f6a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014be:[<0x2000000142a/article-11.xml v1042>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014be:[<0x2000000142a/article-11.xml v1042>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.431+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-59.xml auth{0=1} v1407 ap=1 s=6671 n(v0 rc2024-04-26T20:27:23.378834+0000 b6671 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f69eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef8:[<0x2000000142a/comment-59.xml v1323>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef8:[<0x2000000142a/comment-59.xml v1407>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.431+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014b4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-16.xml auth{0=1} v1044 ap=1 s=7513 n(v0 rc2024-04-26T20:25:16.967304+0000 b7513 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f756680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014b4:[<0x2000000142a/article-16.xml v1044>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014b4:[<0x2000000142a/article-16.xml v1044>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.432+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001468 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-54.xml auth{0=1} v1046 ap=1 s=29762 n(v0 rc2024-04-26T20:25:16.823307+0000 b29762 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001468:[<0x2000000142a/article-54.xml v1046>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001468:[<0x2000000142a/article-54.xml v1046>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.432+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-68.xml auth{0=1} v1466 ap=1 s=4863 n(v0 rc2024-04-26T20:27:23.296836+0000 b4863 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8d402c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000eea:[<0x2000000142a/comment-68.xml v1323>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000eea:[<0x2000000142a/comment-68.xml v1466>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.877 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.432+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014fb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg auth{0=1} v1146 ap=1 s=27199 n(v0 rc2024-04-26T20:25:17.080302+0000 b27199 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90962100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014fb:[<0x2000000142a/picture-41.jpg v1146>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014fb:[<0x2000000142a/picture-41.jpg v1146>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.433+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001446 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-71.xml auth{0=1} v1038 ap=1 s=29160 n(v0 rc2024-04-26T20:25:16.734309+0000 b29160 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f96f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001446:[<0x2000000142a/article-71.xml v1038>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001446:[<0x2000000142a/article-71.xml v1038>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.433+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000152f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-15.jpg auth{0=1} v1050 ap=1 s=41876 n(v0 rc2024-04-26T20:25:17.240299+0000 b41876 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000152f:[<0x2000000142a/picture-15.jpg v1050>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000152f:[<0x2000000142a/picture-15.jpg v1050>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.434+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014dc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg auth{0=1} v1052 ap=1 s=17765 n(v0 rc2024-04-26T20:25:17.029303+0000 b17765 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014dc:[<0x2000000142a/picture-56.jpg v1052>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014dc:[<0x2000000142a/picture-56.jpg v1052>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.434+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014a0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-26.xml auth{0=1} v1048 ap=1 s=24164 n(v0 rc2024-04-26T20:25:16.933305+0000 b24164 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014a0:[<0x2000000142a/article-26.xml v1048>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014a0:[<0x2000000142a/article-26.xml v1048>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.878 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.435+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ee [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg auth{0=1} v1054 ap=1 s=47443 n(v0 rc2024-04-26T20:25:17.060302+0000 b47443 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ee:[<0x2000000142a/picture-47.jpg v1054>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ee:[<0x2000000142a/picture-47.jpg v1054>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.437+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014c0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-10.xml auth{0=1} v1056 ap=1 s=12523 n(v0 rc2024-04-26T20:25:16.986304+0000 b12523 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014c0:[<0x2000000142a/article-10.xml v1056>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014c0:[<0x2000000142a/article-10.xml v1056>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.437+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001535 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-12.jpg auth{0=1} v1058 ap=1 s=21906 n(v0 rc2024-04-26T20:25:17.272298+0000 b21906 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001535:[<0x2000000142a/picture-12.jpg v1058>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001535:[<0x2000000142a/picture-12.jpg v1058>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.438+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f01 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-50.xml auth{0=1} v1420 ap=1 s=4959 n(v0 rc2024-04-26T20:27:23.466832+0000 b4959 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f01:[<0x2000000142a/comment-50.xml v1347>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f01:[<0x2000000142a/comment-50.xml v1420>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.438+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-77.xml auth{0=1} v1405 ap=1 s=9540 n(v0 rc2024-04-26T20:27:23.213837+0000 b9540 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f754580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ed2:[<0x2000000142a/comment-77.xml v1314>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ed2:[<0x2000000142a/comment-77.xml v1405>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.879 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.438+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f03 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-48.xml auth{0=1} v1419 ap=1 s=4957 n(v0 rc2024-04-26T20:27:23.481832+0000 b4957 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f03:[<0x2000000142a/comment-48.xml v1350>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f03:[<0x2000000142a/comment-48.xml v1419>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.880 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.439+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014cc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-4.xml auth{0=1} v1064 ap=1 s=24024 n(v0 rc2024-04-26T20:25:17.004303+0000 b24024 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8ee4d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014cc:[<0x2000000142a/article-4.xml v1064>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014cc:[<0x2000000142a/article-4.xml v1064>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.880 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.439+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014f5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg auth{0=1} v1060 ap=1 s=25565 n(v0 rc2024-04-26T20:25:17.070302+0000 b25565 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014f5:[<0x2000000142a/picture-44.jpg v1060>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014f5:[<0x2000000142a/picture-44.jpg v1060>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.880 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.439+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014d6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg auth{0=1} v1068 ap=1 s=11663 n(v0 rc2024-04-26T20:25:17.020303+0000 b11663 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014d6:[<0x2000000142a/picture-59.jpg v1068>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014d6:[<0x2000000142a/picture-59.jpg v1068>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.880 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.440+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014a2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-25.xml auth{0=1} v1066 ap=1 s=31124 n(v0 rc2024-04-26T20:25:16.937305+0000 b31124 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014a2:[<0x2000000142a/article-25.xml v1066>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014a2:[<0x2000000142a/article-25.xml v1066>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.880 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.440+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001444 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-72.xml auth{0=1} v1072 ap=1 s=14176 n(v0 rc2024-04-26T20:25:16.727309+0000 b14176 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001444:[<0x2000000142a/article-72.xml v1072>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001444:[<0x2000000142a/article-72.xml v1072>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.440+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001474 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-48.xml auth{0=1} v1062 ap=1 s=20832 n(v0 rc2024-04-26T20:25:16.848306+0000 b20832 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f9dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001474:[<0x2000000142a/article-48.xml v1062>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001474:[<0x2000000142a/article-48.xml v1062>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.441+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000148e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-35.xml auth{0=1} v1076 ap=1 s=14837 n(v0 rc2024-04-26T20:25:16.899305+0000 b14837 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000148e:[<0x2000000142a/article-35.xml v1076>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000148e:[<0x2000000142a/article-35.xml v1076>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.441+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ede [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-73.xml auth{0=1} v1451 ap=1 s=2432 n(v0 rc2024-04-26T20:27:23.247837+0000 b2432 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ede:[<0x2000000142a/comment-73.xml v1316>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ede:[<0x2000000142a/comment-73.xml v1451>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.442+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-60.xml auth{0=1} v1477 ap=1 s=3395 n(v0 rc2024-04-26T20:27:23.373834+0000 b3395 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef7:[<0x2000000142a/comment-60.xml v1338>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef7:[<0x2000000142a/comment-60.xml v1477>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.881 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.442+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001488 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-38.xml auth{0=1} v1070 ap=1 s=17198 n(v0 rc2024-04-26T20:25:16.887306+0000 b17198 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001488:[<0x2000000142a/article-38.xml v1070>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001488:[<0x2000000142a/article-38.xml v1070>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.443+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001523 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg auth{0=1} v1074 ap=1 s=48112 n(v0 rc2024-04-26T20:25:17.178300+0000 b48112 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001523:[<0x2000000142a/picture-21.jpg v1074>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001523:[<0x2000000142a/picture-21.jpg v1074>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.444+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001484 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-40.xml auth{0=1} v1078 ap=1 s=26540 n(v0 rc2024-04-26T20:25:16.879306+0000 b26540 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001484:[<0x2000000142a/article-40.xml v1078>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001484:[<0x2000000142a/article-40.xml v1078>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.444+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f14 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-31.xml auth{0=1} v1421 ap=1 s=4873 n(v0 rc2024-04-26T20:27:23.610830+0000 b4873 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f88e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f14:[<0x2000000142a/comment-31.xml v1388>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f14:[<0x2000000142a/comment-31.xml v1421>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.444+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001511 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-30.jpg auth{0=1} v1080 ap=1 s=57962 n(v0 rc2024-04-26T20:25:17.121301+0000 b57962 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001511:[<0x2000000142a/picture-30.jpg v1080>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001511:[<0x2000000142a/picture-30.jpg v1080>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.882 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.445+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001430 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-82.xml auth{0=1} v1082 ap=1 s=20426 n(v0 rc2024-04-26T20:25:16.677310+0000 b20426 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001430:[<0x2000000142a/article-82.xml v1082>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001430:[<0x2000000142a/article-82.xml v1082>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.883 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.445+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f44 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-1.xml auth{0=1} v1479 ap=1 s=5305 n(v0 rc2024-04-26T20:27:23.951823+0000 b5305 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f44:[<0x2000000142a/comment-1.xml v1444>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f44:[<0x2000000142a/comment-1.xml v1479>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.883 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.446+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-78.xml auth{0=1} v1453 ap=1 s=8915 n(v0 rc2024-04-26T20:27:23.200838+0000 b8915 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc90ac2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ed1:[<0x2000000142a/comment-78.xml v1314>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ed1:[<0x2000000142a/comment-78.xml v1453>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.883 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.446+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ece [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-79.xml auth{0=1} v1455 ap=1 s=3868 n(v0 rc2024-04-26T20:27:23.194838+0000 b3868 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ece:[<0x2000000142a/comment-79.xml v1312>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ece:[<0x2000000142a/comment-79.xml v1455>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.883 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.446+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f12 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-33.xml auth{0=1} v1478 ap=1 s=5327 n(v0 rc2024-04-26T20:27:23.598830+0000 b5327 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f12:[<0x2000000142a/comment-33.xml v1381>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f12:[<0x2000000142a/comment-33.xml v1478>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.883 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.446+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-39.xml auth{0=1} v1476 ap=1 s=7247 n(v0 rc2024-04-26T20:27:23.548831+0000 b7247 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f0c:[<0x2000000142a/comment-39.xml v1373>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f0c:[<0x2000000142a/comment-39.xml v1476>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.447+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014b6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-15.xml auth{0=1} v1084 ap=1 s=30972 n(v0 rc2024-04-26T20:25:16.970304+0000 b30972 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014b6:[<0x2000000142a/article-15.xml v1084>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014b6:[<0x2000000142a/article-15.xml v1084>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.447+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-40.xml auth{0=1} v1480 ap=1 s=6983 n(v0 rc2024-04-26T20:27:23.542831+0000 b6983 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f0b:[<0x2000000142a/comment-40.xml v1369>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f0b:[<0x2000000142a/comment-40.xml v1480>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.447+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001505 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg auth{0=1} v1086 ap=1 s=53538 n(v0 rc2024-04-26T20:25:17.099302+0000 b53538 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001505:[<0x2000000142a/picture-36.jpg v1086>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001505:[<0x2000000142a/picture-36.jpg v1086>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.447+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ae [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-19.xml auth{0=1} v1090 ap=1 s=28906 n(v0 rc2024-04-26T20:25:16.957304+0000 b28906 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ae:[<0x2000000142a/article-19.xml v1090>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ae:[<0x2000000142a/article-19.xml v1090>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.884 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.448+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-82.xml auth{0=1} v1457 ap=1 s=2149 n(v0 rc2024-04-26T20:27:23.163838+0000 b2149 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f550580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ec4:[<0x2000000142a/comment-82.xml v1310>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ec4:[<0x2000000142a/comment-82.xml v1457>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.448+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f13 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-32.xml auth{0=1} v1481 ap=1 s=3627 n(v0 rc2024-04-26T20:27:23.604830+0000 b3627 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f550b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f13:[<0x2000000142a/comment-32.xml v1384>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f13:[<0x2000000142a/comment-32.xml v1481>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.449+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014f7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg auth{0=1} v1088 ap=1 s=15471 n(v0 rc2024-04-26T20:25:17.073302+0000 b15471 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fc7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014f7:[<0x2000000142a/picture-43.jpg v1088>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014f7:[<0x2000000142a/picture-43.jpg v1088>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.450+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001480 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-42.xml auth{0=1} v1094 ap=1 s=4897 n(v0 rc2024-04-26T20:25:16.871306+0000 b4897 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f551b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001480:[<0x2000000142a/article-42.xml v1094>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001480:[<0x2000000142a/article-42.xml v1094>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.450+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg auth{0=1} v1166 ap=1 s=30128 n(v0 rc2024-04-26T20:25:35.521942+0000 b30128 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f552100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000097d:[<0x2000000142a/picture-38.jpg v1161>,<0x10000000971/blog-25 v51623>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x1000000097d:[<0x2000000142a/picture-38.jpg v1166>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.885 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.451+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001454 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-64.xml auth{0=1} v1098 ap=1 s=30209 n(v0 rc2024-04-26T20:25:16.777308+0000 b30209 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001454:[<0x2000000142a/article-64.xml v1098>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001454:[<0x2000000142a/article-64.xml v1098>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.451+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f26 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-13.xml auth{0=1} v1474 ap=1 s=8322 n(v0 rc2024-04-26T20:27:23.780826+0000 b8322 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f26:[<0x2000000142a/comment-13.xml v1432>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f26:[<0x2000000142a/comment-13.xml v1474>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.451+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-21.xml auth{0=1} v1476 ap=1 s=8188 n(v0 rc2024-04-26T20:27:23.698828+0000 b8188 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f1e:[<0x2000000142a/comment-21.xml v1408>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f1e:[<0x2000000142a/comment-21.xml v1476>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.452+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f19 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-26.xml auth{0=1} v1477 ap=1 s=8485 n(v0 rc2024-04-26T20:27:23.659829+0000 b8485 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f19:[<0x2000000142a/comment-26.xml v1399>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f19:[<0x2000000142a/comment-26.xml v1477>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.452+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001153 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-86.xml auth v1485 ap=1 s=24797 n(v0 rc2024-04-26T20:27:34.513617+0000 b24797 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55fc90ac3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000001153:[<0x2000000142a/article-86.xml v1485>,<0x10000000971/blog-25 v112129>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x10000001153:[<0x2000000142a/article-86.xml v1485>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.886 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.453+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000143e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-75.xml auth{0=1} v1100 ap=1 s=32247 n(v0 rc2024-04-26T20:25:16.712309+0000 b32247 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000143e:[<0x2000000142a/article-75.xml v1100>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000143e:[<0x2000000142a/article-75.xml v1100>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.453+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000148a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-37.xml auth{0=1} v1102 ap=1 s=22301 n(v0 rc2024-04-26T20:25:16.891306+0000 b22301 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000148a:[<0x2000000142a/article-37.xml v1102>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000148a:[<0x2000000142a/article-37.xml v1102>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.454+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001442 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-73.xml auth{0=1} v1104 ap=1 s=22530 n(v0 rc2024-04-26T20:25:16.723309+0000 b22530 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001442:[<0x2000000142a/article-73.xml v1104>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001442:[<0x2000000142a/article-73.xml v1104>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.454+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001525 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-20.jpg auth{0=1} v1092 ap=1 s=12230 n(v0 rc2024-04-26T20:25:17.189300+0000 b12230 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f550000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001525:[<0x2000000142a/picture-20.jpg v1092>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001525:[<0x2000000142a/picture-20.jpg v1092>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.454+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001486 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-39.xml auth{0=1} v1106 ap=1 s=7312 n(v0 rc2024-04-26T20:25:16.883306+0000 b7312 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001486:[<0x2000000142a/article-39.xml v1106>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001486:[<0x2000000142a/article-39.xml v1106>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.887 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.455+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014bc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-12.xml auth{0=1} v1110 ap=1 s=3493 n(v0 rc2024-04-26T20:25:16.980304+0000 b3493 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014bc:[<0x2000000142a/article-12.xml v1110>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014bc:[<0x2000000142a/article-12.xml v1110>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.455+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014e4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg auth{0=1} v1112 ap=1 s=13344 n(v0 rc2024-04-26T20:25:17.043303+0000 b13344 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014e4:[<0x2000000142a/picture-52.jpg v1112>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014e4:[<0x2000000142a/picture-52.jpg v1112>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.457+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014d2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml auth{0=1} v1114 ap=1 s=15560 n(v0 rc2024-04-26T20:25:17.014303+0000 b15560 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014d2:[<0x2000000142a/article-1.xml v1114>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014d2:[<0x2000000142a/article-1.xml v1114>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.458+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001517 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg auth{0=1} v1150 ap=1 s=60406 n(v0 rc2024-04-26T20:25:17.131301+0000 b60406 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001517:[<0x2000000142a/picture-27.jpg v1150>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001517:[<0x2000000142a/picture-27.jpg v1150>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.458+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-63.xml auth{0=1} v1483 ap=1 s=5963 n(v0 rc2024-04-26T20:27:23.343835+0000 b5963 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f551080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000ef1:[<0x2000000142a/comment-63.xml v1333>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000ef1:[<0x2000000142a/comment-63.xml v1483>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.888 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.459+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001509 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg auth{0=1} v1116 ap=1 s=37596 n(v0 rc2024-04-26T20:25:17.106301+0000 b37596 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001509:[<0x2000000142a/picture-34.jpg v1116>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001509:[<0x2000000142a/picture-34.jpg v1116>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.459+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-54.xml auth{0=1} v1482 ap=1 s=6169 n(v0 rc2024-04-26T20:27:23.409833+0000 b6169 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8f551600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000efd:[<0x2000000142a/comment-54.xml v1343>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000efd:[<0x2000000142a/comment-54.xml v1482>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.459+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000148c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-36.xml auth{0=1} v1108 ap=1 s=12289 n(v0 rc2024-04-26T20:25:16.895306+0000 b12289 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc9018f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000148c:[<0x2000000142a/article-36.xml v1108>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000148c:[<0x2000000142a/article-36.xml v1108>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.460+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014e2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg auth{0=1} v1118 ap=1 s=35951 n(v0 rc2024-04-26T20:25:17.039303+0000 b35951 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014e2:[<0x2000000142a/picture-53.jpg v1118>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014e2:[<0x2000000142a/picture-53.jpg v1118>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.460+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f40 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-3.xml auth{0=1} v1449 ap=1 s=2403 n(v0 rc2024-04-26T20:27:23.926823+0000 b2403 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f40:[<0x2000000142a/comment-3.xml v1440>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f40:[<0x2000000142a/comment-3.xml v1449>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.889 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.460+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f15 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-30.xml auth{0=1} v1478 ap=1 s=3820 n(v0 rc2024-04-26T20:27:23.621829+0000 b3820 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f15:[<0x2000000142a/comment-30.xml v1392>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f15:[<0x2000000142a/comment-30.xml v1478>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.463+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000152d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-16.jpg auth{0=1} v1120 ap=1 s=50098 n(v0 rc2024-04-26T20:25:17.230299+0000 b50098 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000152d:[<0x2000000142a/picture-16.jpg v1120>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000152d:[<0x2000000142a/picture-16.jpg v1120>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.464+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000143a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml auth{0=1} v1122 ap=1 s=2025 n(v0 rc2024-04-26T20:25:16.699309+0000 b2025 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000143a:[<0x2000000142a/article-77.xml v1122>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000143a:[<0x2000000142a/article-77.xml v1122>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.464+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-12.xml auth{0=1} v1473 ap=1 s=9264 n(v0 rc2024-04-26T20:27:23.818825+0000 b9264 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe04000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f2b:[<0x2000000142a/comment-12.xml v1437>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f2b:[<0x2000000142a/comment-12.xml v1473>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.464+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f21 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-18.xml auth{0=1} v1475 ap=1 s=8224 n(v0 rc2024-04-26T20:27:23.726827+0000 b8224 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f21:[<0x2000000142a/comment-18.xml v1421>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f21:[<0x2000000142a/comment-18.xml v1475>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.890 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.465+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001450 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-66.xml auth{0=1} v1138 ap=1 s=6365 n(v0 rc2024-04-26T20:25:16.766308+0000 b6365 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fa7ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001450:[<0x2000000142a/article-66.xml v1138>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001450:[<0x2000000142a/article-66.xml v1138>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.467+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f02 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-49.xml auth{0=1} v1479 ap=1 s=7417 n(v0 rc2024-04-26T20:27:23.473832+0000 b7417 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe04580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f02:[<0x2000000142a/comment-49.xml v1349>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f02:[<0x2000000142a/comment-49.xml v1479>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.467+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f09 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-42.xml auth{0=1} v1472 ap=1 s=3699 n(v0 rc2024-04-26T20:27:23.529831+0000 b3699 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe04b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f09:[<0x2000000142a/comment-42.xml v1360>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f09:[<0x2000000142a/comment-42.xml v1472>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.467+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014a6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-23.xml auth{0=1} v1124 ap=1 s=10693 n(v0 rc2024-04-26T20:25:16.943305+0000 b10693 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe05600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014a6:[<0x2000000142a/article-23.xml v1124>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014a6:[<0x2000000142a/article-23.xml v1124>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.468+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eef [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-65.xml auth{0=1} v1481 ap=1 s=7367 n(v0 rc2024-04-26T20:27:23.331835+0000 b7367 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe05080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000eef:[<0x2000000142a/comment-65.xml v1329>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000eef:[<0x2000000142a/comment-65.xml v1481>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.891 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.468+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014b2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-17.xml auth{0=1} v1126 ap=1 s=1855 n(v0 rc2024-04-26T20:25:16.964304+0000 b1855 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe05b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014b2:[<0x2000000142a/article-17.xml v1126>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014b2:[<0x2000000142a/article-17.xml v1126>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.892 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.468+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f00 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-51.xml auth{0=1} v1480 ap=1 s=9624 n(v0 rc2024-04-26T20:27:23.459833+0000 b9624 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe07180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000f00:[<0x2000000142a/comment-51.xml v1344>,<0x10000000971/blog-25 v104402>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x10000000f00:[<0x2000000142a/comment-51.xml v1480>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.892 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.470+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000150d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg auth{0=1} v1128 ap=1 s=60518 n(v0 rc2024-04-26T20:25:17.114301+0000 b60518 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe06100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000150d:[<0x2000000142a/picture-32.jpg v1128>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000150d:[<0x2000000142a/picture-32.jpg v1128>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.892 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.472+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001456 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-63.xml auth{0=1} v1136 ap=1 s=32416 n(v0 rc2024-04-26T20:25:16.782308+0000 b32416 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe06680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001456:[<0x2000000142a/article-63.xml v1136>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000001456:[<0x2000000142a/article-63.xml v1136>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:06.892 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:28:06.474+0000 7f5ba3f61700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000014ec [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg auth{0=1} v1130 ap=1 s=37861 n(v0 rc2024-04-26T20:25:17.056302+0000 b37861 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55fc8fe06c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000014ec:[<0x2000000142a/picture-48.jpg v1130>,<0x10000000971/blog-25 v36251>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000014ec:[<0x2000000142a/picture-48.jpg v1130>,<0x10000000971/blog-25 v114740>,<0x100000007e0/blogtest_in v1873>,<0x100000007d9/src v1721>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v50>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:07.085 INFO:tasks.workunit.client.0.smithi082.stdout: 233 510838 902 343470 1011 160604 1397 2024-04-26T20:28:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002369 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002440 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009fc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002346 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023b5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023a3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002436 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002452 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002456 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000234f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b6c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002434 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000243e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002364 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000237f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002351 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002374 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002448 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000239a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002387 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002446 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002458 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023c7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002381 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000244e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023a9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000244c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002362 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000235b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002413 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002356 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002438 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023d3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002424 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000236e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002421 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023c9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002354 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002407 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000233f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-76.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000244a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002398 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000241c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023af (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000239c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023bf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002376 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023cd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a26 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023d5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000236d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000240f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002383 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002396 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002450 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000236c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b6a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000236a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002371 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002372 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a2a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002454 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023cf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002394 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002444 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000239e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002367 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002378 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023bd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002428 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023e1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000237d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000237b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000234d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000242b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000236f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023a5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000243c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023dd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002442 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023c5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023e3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023d1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000bd6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023a7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000242e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000238d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000234b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002392 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002389 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000240c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023bb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002432 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000235d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002342 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002417 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002385 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000238b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002390 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023c1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000238f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002349 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023d7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000b6e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002359 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000243a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023ab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002360 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023db (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002403 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000023b7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003198 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e8b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-92.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000322f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e95 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002ea7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002eab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e93 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002ea1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e9d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000321d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003205 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e9b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002ead (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000320f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002ea3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031d1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000319b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003192 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e8d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e4b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e7f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e3f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e43 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031fc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e7d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e77 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031c6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e7b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031d3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003181 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003232 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e9f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003215 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e45 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000317a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.343 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e75 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e4d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003236 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031bd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000317d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003206 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003229 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000320c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003212 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002ea5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.344 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003224 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003220 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002ea9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031a2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000322c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e99 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031d6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003187 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003195 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003226 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.345 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e81 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e35 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e83 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ce (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003185 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000318f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.346 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e91 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e51 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e97 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e49 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000318a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.347 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003237 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031c8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e85 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000319f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003184 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.348 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e79 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003202 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003218 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e39 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e4f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003234 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000003209 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e8f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000317f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000321b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.349 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000031c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000002e2f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b3c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012aa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b30 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b4e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b52 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.350 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001abd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000a37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-83.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b3a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a90 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ac1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b48 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aac (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b44 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.351 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b42 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b54 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ad3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b4a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012a5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a8b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ab4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012d7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001273 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.352 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ade (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ad6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001afa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.353 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ada (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a9e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001afe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ab8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000128f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.354 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001af4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001afc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000129e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a86 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000129c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ac9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001acf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012a1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ac5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001177 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.355 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b38 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001af0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ab2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ad1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a96 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a9c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.356 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000129f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000127a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a92 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ac7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001abf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001af8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000129b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.357 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001adc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ad5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012c2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000128a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.358 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b46 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000128b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001297 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001acb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ae0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001274 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.359 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ad8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001291 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a8d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b4c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.360 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012d0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aaa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ae8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001af2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012c7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.361 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a98 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a94 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a9a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001acd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ae2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ae4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.362 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b36 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ae6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012be (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012d4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ac3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001b0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001295 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001ab6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.363 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:06 smithi139 ceph-mon[32999]: pgmap v571: 129 pgs: 129 active+clean; 778 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 465 op/s 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002369 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002440 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009fc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002346 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023b5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023a3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002436 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002452 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002456 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000234f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b6c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002434 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000243e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002364 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000237f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002351 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002374 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002448 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000239a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002387 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002446 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002458 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023c7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002381 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000244e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023a9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000244c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002362 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000235b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002413 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002356 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002438 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023d3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002424 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000236e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002421 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023c9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002354 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002407 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000233f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-76.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000244a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002398 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000241c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023af (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000239c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023bf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002376 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023cd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a26 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023d5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000236d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000240f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002383 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002396 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002450 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000236c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b6a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000236a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002371 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002372 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a2a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002454 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023cf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002394 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002444 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000239e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002367 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002378 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023bd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002428 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023e1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000237d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000237b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000234d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000242b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000236f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023a5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000243c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023dd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002442 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023c5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023e3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023d1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000bd6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023a7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000242e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000238d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000234b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002392 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002389 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000240c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023bb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002432 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000235d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002342 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002417 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002385 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000238b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002390 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023c1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000238f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002349 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023d7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000b6e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002359 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000243a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023ab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002360 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023db (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002403 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000023b7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003198 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e8b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-92.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000322f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e95 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002ea7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002eab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e93 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002ea1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e9d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000321d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003205 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e9b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002ead (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000320f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002ea3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031d1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000319b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003192 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e8d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e4b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e7f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e3f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.389 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e43 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031fc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e7d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e77 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031c6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e7b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031d3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003181 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003232 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e9f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003215 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e45 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000317a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e75 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e4d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003236 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031bd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000317d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003206 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003229 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000320c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003212 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002ea5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003224 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003220 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002ea9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.392 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031a2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000322c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e99 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031d6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003187 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003195 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003226 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e81 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e35 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.393 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e83 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ce (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003185 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000318f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e91 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e51 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e97 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.394 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e49 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000318a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003237 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031c8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e85 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.395 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000319f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003184 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e79 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003202 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003218 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e39 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e4f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.396 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003234 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000003209 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e8f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000317f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000321b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000031c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000002e2f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b3c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.397 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012aa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b30 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b4e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b52 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001abd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000a37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-83.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b3a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a90 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.398 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ac1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b48 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aac (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b44 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b42 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b54 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ad3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.399 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b4a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012a5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a8b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ab4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012d7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001273 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ade (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ad6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.400 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001afa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ada (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a9e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.401 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001afe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ab8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000128f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001af4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001afc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000129e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a86 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000129c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ac9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.402 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001acf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012a1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ac5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001177 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b38 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001af0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ab2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ad1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a96 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a9c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000129f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000127a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a92 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ac7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001abf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001af8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000129b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001adc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ad5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012c2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.405 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000128a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b46 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000128b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001297 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001acb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ae0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001274 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ad8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001291 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.409 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.409 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a8d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.409 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b4c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.409 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012d0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aaa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ae8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001af2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.410 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012c7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a98 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a94 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a9a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001acd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ae2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ae4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.411 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b36 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ae6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012be (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012d4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.412 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ac3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001b0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001295 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001ab6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:06 smithi135 ceph-mon[32816]: pgmap v571: 129 pgs: 129 active+clean; 778 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 465 op/s 2024-04-26T20:28:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002369 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002440 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009fc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002346 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023b5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023a3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002436 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002452 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002456 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000234f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b6c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002434 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000243e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002364 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000237f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002351 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002374 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002448 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000239a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002387 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002446 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002458 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023c7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002381 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000244e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023a9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000244c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002362 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000235b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002413 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002356 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002438 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023d3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002424 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023e7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000236e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002421 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023c9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002354 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002407 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000233f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-76.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000244a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002398 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000241c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023af (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000239c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023bf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002376 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023cd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a26 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023d5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000236d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000240f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002383 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002396 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002450 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000236c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b6a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000236a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002371 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002372 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a2a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002454 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023cf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002394 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002444 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000239e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002367 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002378 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023bd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002428 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023e1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000237d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000237b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000234d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000242b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000236f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023a5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000243c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023dd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002442 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023c5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023e3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023d1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000bd6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023a7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000242e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000238d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000234b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002392 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002389 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000240c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023bb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002432 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000235d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002342 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002417 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002385 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000238b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002390 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023c1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000238f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002349 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023d7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000b6e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002359 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000243a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023ab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002360 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.475 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023db (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.475 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002403 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.475 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000023b7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.475 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003198 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e8b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-92.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000322f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e95 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002ea7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:06 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002eab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.484 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e93 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.484 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002ea1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.484 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e9d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000321d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003205 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e9b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002ead (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000320f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002ea3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031d1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000319b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003192 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e8d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e4b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e7f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e3f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e43 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031fc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.492 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e7d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e77 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031c6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e7b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031d3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003181 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003232 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e9f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003215 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e45 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000317a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e75 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e4d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003236 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031bd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000317d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003206 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003229 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000320c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003212 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002ea5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003224 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003220 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002ea9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031a2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000322c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e99 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031d6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003187 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003195 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003226 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e81 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e35 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e83 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ce (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003185 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000318f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e91 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e51 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e97 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ab (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e49 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000318a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003237 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031c8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.513 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e85 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000319f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003184 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e79 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003202 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003218 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e39 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e4f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.530 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.530 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003234 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.530 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000003209 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.530 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e8f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000317f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000321b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e6f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000031c3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000002e2f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b3c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012aa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-56.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b30 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b4e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b52 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001abd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000a37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-83.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b3a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a90 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ac1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b48 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aac (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b44 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-20.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b42 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b54 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ad3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b4a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-55.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012a5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-58.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a8b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ab4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012d7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-41.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001273 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-75.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ade (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ad6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-24.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001afa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-53.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ada (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-5.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a9e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-34.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-29.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-57.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001afe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ab8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012df (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000128f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-68.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001af4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001afc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000129e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-61.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a86 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000129c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-62.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ac9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001acf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-11.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012a1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-59.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ac5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-16.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001177 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-71.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b38 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001af0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-50.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ab2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-25.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ad1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-10.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a96 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-38.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a9c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-35.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-31.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-48.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000129f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-60.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000127a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-73.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a92 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ac7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-40.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001abf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001af8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000129b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-63.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b28 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001adc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ad5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-8.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012c2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-47.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-46.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000128a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-70.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-54.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b46 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-32.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000128b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-69.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012e5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001297 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-72.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001acb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ae0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-4.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001274 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-74.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ad8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-6.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001291 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-67.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-14.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-19.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-22.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-2.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012cb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-44.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-33.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a8d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b4c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-27.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-52.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-7.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-15.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012d0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-43.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aaa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-28.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-9.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ae8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001af2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012c7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-45.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-13.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-26.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-21.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-64.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a98 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-37.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a94 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-39.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a9a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-36.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001acd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-30.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ae2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-1.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ae4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-3.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-18.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-66.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-12.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b36 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ae6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012be (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-49.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012d4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-42.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ac3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-17.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001b0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001295 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-65.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001ab6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-23.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-51.xml) see mds.c log and `damage ls` output for details 2024-04-26T20:28:07.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: pgmap v571: 129 pgs: 129 active+clean; 778 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 465 op/s 2024-04-26T20:28:08.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000145e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001440 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-74.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001529 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001533 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001527 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000146e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000efb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001507 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001549 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001545 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000149e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ac (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001531 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000142e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-83.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001448 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-70.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000145a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001482 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000147a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000153f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000144a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-69.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001496 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f2e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000153b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000154b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001434 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-80.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014c2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000147c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001541 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001452 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001458 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001539 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ee3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-71.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000efc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001515 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001503 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000152b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ce (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ed8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-75.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000151d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000150b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014da (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014c6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001466 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014a4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000151b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-95.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000144c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-68.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ee5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-70.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000143c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-76.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000153d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000150f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014aa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001519 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001498 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000eda (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-74.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001494 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ee7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-69.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ee0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-72.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f3f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014c8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014d0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001470 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014e0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000009d5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-90.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001464 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000eed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001513 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001492 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000147e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001543 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-76.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014d8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000eee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.330 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f39 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000eff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001436 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-79.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001460 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001462 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000146a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000146c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000098b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014e6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001547 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ec8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-81.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001537 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ca (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001490 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000efa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001438 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-78.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.332 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001432 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-81.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000149a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000145c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001472 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ecb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-80.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000151f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014b8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.333 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000142c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-84.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014d4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001478 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001476 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001521 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014be (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014b4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001468 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000eea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-68.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001446 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-71.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.334 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000152f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001535 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.335 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ed2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-77.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014cc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014f5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014d6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014a2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001444 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-72.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001474 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000148e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ede (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-73.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.336 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001488 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001523 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001484 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001511 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001430 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-82.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-78.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-79.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:07 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.337 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001505 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ec4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-82.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001480 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001454 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.338 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000001153 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-86.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000143e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-75.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000148a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001442 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-73.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001525 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001486 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014e4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014d2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001517 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000ef1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001509 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.339 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000efd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000148c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f40 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000152d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000143a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001450 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.340 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014b2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x10000000f00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000150d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001456 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000014ec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:08.341 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000145e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001440 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-74.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001529 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001533 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001527 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000146e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000efb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001507 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001549 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001545 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000149e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ac (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001531 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000142e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-83.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001448 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-70.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000145a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001482 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000147a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000153f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000144a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-69.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001496 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f2e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000153b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000154b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001434 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-80.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014c2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000147c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001541 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001452 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:07 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001458 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001539 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ee3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-71.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000efc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001515 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001503 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000152b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ce (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ed8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-75.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000151d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000150b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014da (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014c6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001466 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014a4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000151b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-95.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000144c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-68.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ee5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-70.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000143c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-76.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000153d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000150f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014aa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001519 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001498 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000eda (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-74.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001494 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ee7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-69.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ee0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-72.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f3f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014c8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014d0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001470 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014e0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000009d5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-90.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001464 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000eed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001513 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001492 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000147e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001543 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-76.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014d8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000eee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f39 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000eff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001436 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-79.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001460 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001462 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000146a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000146c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000098b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014e6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001547 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ec8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-81.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001537 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ca (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001490 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000efa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001438 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-78.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001432 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-81.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000149a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000145c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001472 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ecb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-80.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000151f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014b8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000142c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-84.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014d4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001478 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001476 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001521 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014be (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014b4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001468 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000eea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-68.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001446 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-71.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000152f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001535 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ed2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-77.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014cc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014f5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014d6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014a2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001444 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-72.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001474 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000148e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ede (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-73.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001488 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001523 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001484 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001511 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001430 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-82.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-78.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-79.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001505 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ec4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-82.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001480 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001454 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000001153 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-86.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000143e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-75.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000148a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001442 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-73.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001525 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001486 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014e4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014d2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001517 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000ef1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001509 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000efd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000148c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f40 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000152d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000143a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001450 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014b2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x10000000f00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.387 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000150d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001456 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000014ec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:08.388 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:08.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000145e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001440 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-74.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001529 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001533 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001527 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f3e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000146e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000efb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f16 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001507 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001549 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001545 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:07 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000149e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ac (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001531 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000142e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-83.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001448 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-70.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000145a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001482 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000147a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000153f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000144a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-69.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001496 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f2e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-20.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000153b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f0e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000154b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001434 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-80.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014c2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000147c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001541 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001452 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001458 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001539 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ee3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-71.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000efc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f1a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f0a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-41.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001515 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001503 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000152b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ce (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ed8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-75.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000151d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000150b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014da (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014c6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001466 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-55.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014a4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-24.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000151b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f04 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-95.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000144c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-68.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ee5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-70.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000143c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-76.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000153d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f1c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000150f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014aa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001519 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001498 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000eda (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-74.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001494 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ee7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-69.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ee0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-72.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ba (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f3f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014c8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014d0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001470 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014e0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000009d5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-90.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f20 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001464 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-56.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000eed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-67.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f41 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-2.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001513 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-44.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001492 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000147e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001543 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f18 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-27.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-76.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014d8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000eee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f39 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-7.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000eff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001436 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-79.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f24 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001460 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-58.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001462 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000146a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000146c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-52.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000098b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-9.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f08 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-43.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014e6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f22 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f06 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-45.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014f0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001547 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-53.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-6.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ec8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-81.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001537 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ca (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-5.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-28.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f10 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001490 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-34.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000efa (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-57.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001438 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-78.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001432 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-81.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.604 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000149a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-29.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014de (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000145c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-61.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-22.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001472 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-8.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ecb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-80.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000151f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014b8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-14.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-62.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000142c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-84.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014d4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001478 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-46.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001476 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-47.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001521 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014be (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-11.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-59.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014b4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-16.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001468 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000eea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-68.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001446 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-71.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000152f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014dc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014c0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-10.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001535 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-50.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ed2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-77.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014cc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-4.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014f5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014d6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014a2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-25.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001444 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-72.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001474 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-48.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000148e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-35.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ede (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-73.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-60.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001488 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-38.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001523 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001484 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f14 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-31.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001511 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001430 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-82.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-78.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-79.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f12 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-33.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f0c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014b6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-15.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-40.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001505 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-19.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ec4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-82.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-32.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001480 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001454 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-64.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-13.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f1e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-21.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-26.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000001153 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-86.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000143e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-75.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000148a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-37.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001442 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-73.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001525 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001486 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-39.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014e4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014d2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001517 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000ef1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001509 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000efd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-54.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000148c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-36.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014e2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f40 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-3.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-30.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000152d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000143a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-12.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-18.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001450 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-66.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f02 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-49.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-42.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-23.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-65.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014b2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-17.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x10000000f00 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-51.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000150d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001456 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-63.xml) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000014ec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:08.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:09.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:09.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:08 smithi139 ceph-mon[32999]: pgmap v572: 129 pgs: 129 active+clean; 788 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 564 op/s 2024-04-26T20:28:09.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:09.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:08 smithi135 ceph-mon[32816]: pgmap v572: 129 pgs: 129 active+clean; 788 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 564 op/s 2024-04-26T20:28:09.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:09.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:08 smithi082 ceph-mon[28105]: pgmap v572: 129 pgs: 129 active+clean; 788 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 564 op/s 2024-04-26T20:28:11.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:10 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:28:10.821+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:11.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:10 smithi082 ceph-mon[28105]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:11.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:10 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:active 2024-04-26T20:28:11.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:10 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:10 smithi139 ceph-mon[32999]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:10 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:active 2024-04-26T20:28:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:10 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:10 smithi135 ceph-mon[32816]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:10 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] up:active 2024-04-26T20:28:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:10 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:12.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.039+0000 7fc9ba400640 1 -- 172.21.15.82:0/4200281046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b4109930 msgr2=0x7fc9b410bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.041+0000 7fc9ba400640 1 --2- 172.21.15.82:0/4200281046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b4109930 0x7fc9b410bd60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009860 tx=0x7fc99c02a360 comp rx=0 tx=0).stop 2024-04-26T20:28:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.041+0000 7fc9ba400640 1 -- 172.21.15.82:0/4200281046 shutdown_connections 2024-04-26T20:28:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.041+0000 7fc9ba400640 1 --2- 172.21.15.82:0/4200281046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410ec70 0x7fc9b410f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.041+0000 7fc9ba400640 1 --2- 172.21.15.82:0/4200281046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b410c2a0 0x7fc9b410e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.041+0000 7fc9ba400640 1 --2- 172.21.15.82:0/4200281046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b4109930 0x7fc9b410bd60 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009860 tx=0x7fc99c02a360 comp rx=0 tx=0).stop 2024-04-26T20:28:12.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.041+0000 7fc9ba400640 1 -- 172.21.15.82:0/4200281046 >> 172.21.15.82:0/4200281046 conn(0x7fc9b406f7c0 msgr2=0x7fc9b4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.053+0000 7f379ac00640 1 -- 172.21.15.82:0/3109825998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3794109fd0 msgr2=0x7f379410a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.053+0000 7f379ac00640 1 --2- 172.21.15.82:0/3109825998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3794109fd0 0x7f379410a430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3780009900 tx=0x7f378002a440 comp rx=0 tx=0).stop 2024-04-26T20:28:12.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.055+0000 7fc9ba400640 1 -- 172.21.15.82:0/4200281046 shutdown_connections 2024-04-26T20:28:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.055+0000 7fc9ba400640 1 -- 172.21.15.82:0/4200281046 wait complete. 2024-04-26T20:28:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.058+0000 7fc9ba400640 1 Processor -- start 2024-04-26T20:28:12.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.061+0000 7fc9ba400640 1 -- start start 2024-04-26T20:28:12.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.061+0000 7fc9ba400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410c2a0 0x7fc9b419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.064+0000 7fc9ba400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b410ec70 0x7fc9b419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.064+0000 7fc9b3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410c2a0 0x7fc9b419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.065+0000 7fc9b3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410c2a0 0x7fc9b419f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34652/0 (socket says 172.21.15.82:34652) 2024-04-26T20:28:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.065+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b410ec70 0x7fc9b419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.065+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b410ec70 0x7fc9b419f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33352/0 (socket says 172.21.15.82:33352) 2024-04-26T20:28:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.065+0000 7fc9b3400640 1 -- 172.21.15.82:0/2158773655 learned_addr learned my addr 172.21.15.82:0/2158773655 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.066+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b41a4940 0x7fc9b41a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.068+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b41a4940 0x7fc9b41a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.073+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4112aa0 con 0x7fc9b410c2a0 2024-04-26T20:28:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.073+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4112920 con 0x7fc9b410ec70 2024-04-26T20:28:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.073+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4112c20 con 0x7fc9b41a4940 2024-04-26T20:28:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.077+0000 7f379ac00640 1 -- 172.21.15.82:0/3109825998 shutdown_connections 2024-04-26T20:28:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.077+0000 7f379ac00640 1 --2- 172.21.15.82:0/3109825998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379410a970 0x7f379410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.077+0000 7f379ac00640 1 --2- 172.21.15.82:0/3109825998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3794109fd0 0x7f379410a430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.077+0000 7f379ac00640 1 --2- 172.21.15.82:0/3109825998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3794073d20 0x7f3794074140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.077+0000 7f379ac00640 1 -- 172.21.15.82:0/3109825998 >> 172.21.15.82:0/3109825998 conn(0x7f379406f7d0 msgr2=0x7f3794071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.079+0000 7f379ac00640 1 -- 172.21.15.82:0/3109825998 shutdown_connections 2024-04-26T20:28:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.079+0000 7f379ac00640 1 -- 172.21.15.82:0/3109825998 wait complete. 2024-04-26T20:28:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.081+0000 7f379ac00640 1 Processor -- start 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.076+0000 7fc9b3e00640 1 -- 172.21.15.82:0/2158773655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b410ec70 msgr2=0x7fc9b419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.076+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b410ec70 0x7fc9b419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.076+0000 7fc9b3e00640 1 -- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410c2a0 msgr2=0x7fc9b419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.076+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410c2a0 0x7fc9b419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.076+0000 7fc9b3e00640 1 -- 172.21.15.82:0/2158773655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b41a73a0 con 0x7fc9b41a4940 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.077+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b41a4940 0x7fc9b41a6d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005fd0 tx=0x7fc9ac01d380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.078+0000 7fc9abe00640 1 -- 172.21.15.82:0/2158773655 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac01ddc0 con 0x7fc9b41a4940 2024-04-26T20:28:12.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.078+0000 7fc9abe00640 1 -- 172.21.15.82:0/2158773655 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9ac003970 con 0x7fc9b41a4940 2024-04-26T20:28:12.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.078+0000 7fc9abe00640 1 -- 172.21.15.82:0/2158773655 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0044d0 con 0x7fc9b41a4940 2024-04-26T20:28:12.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.079+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b41a7690 con 0x7fc9b41a4940 2024-04-26T20:28:12.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.079+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b41a7b90 con 0x7fc9b41a4940 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.096+0000 7f379ac00640 1 -- start start 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.096+0000 7f379ac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3794073d20 0x7f379419f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.096+0000 7f379ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 0x7f379419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.096+0000 7f379ac00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f379410a970 0x7f37941a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.101+0000 7f3798c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f379410a970 0x7f37941a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.101+0000 7f3798c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f379410a970 0x7f37941a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58138/0 (socket says 172.21.15.82:58138) 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.102+0000 7f3793400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 0x7f379419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.102+0000 7f3793400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 0x7f379419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33362/0 (socket says 172.21.15.82:33362) 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.105+0000 7f379ac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3794112a80 con 0x7f3794073d20 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.105+0000 7f379ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3794112900 con 0x7f3794109fd0 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.105+0000 7f379ac00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3794112c00 con 0x7f379410a970 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.110+0000 7f3798c00640 1 -- 172.21.15.82:0/4128461709 learned_addr learned my addr 172.21.15.82:0/4128461709 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.111+0000 7f3793400640 1 -- 172.21.15.82:0/4128461709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f379410a970 msgr2=0x7f37941a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.111+0000 7f3793400640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f379410a970 0x7f37941a65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.111+0000 7f3793400640 1 -- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3794073d20 msgr2=0x7f379419f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.111+0000 7f3793400640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3794073d20 0x7f379419f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.112+0000 7f3793400640 1 -- 172.21.15.82:0/4128461709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37941a6c60 con 0x7f3794109fd0 2024-04-26T20:28:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.114+0000 7f3793400640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 0x7f379419f580 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3780009850 tx=0x7f3780004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.116+0000 7f3790c00640 1 -- 172.21.15.82:0/4128461709 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780062030 con 0x7f3794109fd0 2024-04-26T20:28:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.116+0000 7f3790c00640 1 -- 172.21.15.82:0/4128461709 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378005e900 con 0x7f3794109fd0 2024-04-26T20:28:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.116+0000 7f3790c00640 1 -- 172.21.15.82:0/4128461709 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780005180 con 0x7f3794109fd0 2024-04-26T20:28:12.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.114+0000 7fc9bd1fd740 1 Processor -- start 2024-04-26T20:28:12.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.117+0000 7fc9bd1fd740 1 -- start start 2024-04-26T20:28:12.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.119+0000 7fc9abe00640 1 -- 172.21.15.82:0/2158773655 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc9ac02e020 con 0x7fc9b41a4940 2024-04-26T20:28:12.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.122+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0079bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.122+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0079bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.122+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0079bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33368/0 (socket says 172.21.15.82:33368) 2024-04-26T20:28:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.124+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab007ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.124+0000 7fc9b2a00640 1 -- 172.21.15.82:0/2146221046 learned_addr learned my addr 172.21.15.82:0/2146221046 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.124+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 0x556ab0081780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.124+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556aaff8a030 con 0x556ab007a180 2024-04-26T20:28:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.124+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556aaffa57f0 con 0x556ab0079790 2024-04-26T20:28:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.124+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556aaff607e0 con 0x556ab007f2f0 2024-04-26T20:28:12.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.126+0000 7fc9b3400640 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab007ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.127+0000 7fc9b3400640 1 -- 172.21.15.82:0/2146221046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 msgr2=0x556ab0081780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.127+0000 7fc9b3400640 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 0x556ab0081780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.127+0000 7fc9b3400640 1 -- 172.21.15.82:0/2146221046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 msgr2=0x556ab0079bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.127+0000 7fc9b3400640 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0079bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.127+0000 7fc9b3400640 1 -- 172.21.15.82:0/2146221046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aaff6c050 con 0x556ab007a180 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.129+0000 7fc9abe00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9980a3e10 0x7fc9980a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.129+0000 7fc9abe00640 1 -- 172.21.15.82:0/2158773655 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc9ac0e11a0 con 0x7fc9b41a4940 2024-04-26T20:28:12.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.136+0000 7fc9b3400640 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab007ec80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc99c02a950 tx=0x7fc99c02cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea8e37689396f91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.134+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37941a6ef0 con 0x7f3794109fd0 2024-04-26T20:28:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.135+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37941a7300 con 0x7f3794109fd0 2024-04-26T20:28:12.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.142+0000 7fc9a8c00640 1 -- 172.21.15.82:0/2146221046 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c041070 con 0x556ab007a180 2024-04-26T20:28:12.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.142+0000 7fc9a8c00640 1 -- 172.21.15.82:0/2146221046 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c0054f0 con 0x556ab007a180 2024-04-26T20:28:12.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.146+0000 7fc9a8c00640 1 -- 172.21.15.82:0/2146221046 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c041070 con 0x556ab007a180 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.147+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 msgr2=0x556ab007ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.148+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab007ec80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc99c02a950 tx=0x7fc99c02cf30 comp rx=0 tx=0).stop 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.149+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 shutdown_connections 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.149+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 0x556ab0081780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.149+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab007ec80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.149+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2146221046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.149+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 >> 172.21.15.82:0/2146221046 conn(0x556ab0074db0 msgr2=0x556ab00751b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:12.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.150+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9980a3e10 0x7fc9980a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.151+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 shutdown_connections 2024-04-26T20:28:12.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.163+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9980a3e10 0x7fc9980a62d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x556ab007a9e0 tx=0x7fc9a400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.166+0000 7f3790c00640 1 -- 172.21.15.82:0/4128461709 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3780065030 con 0x7f3794109fd0 2024-04-26T20:28:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.174+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2146221046 wait complete. 2024-04-26T20:28:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.175+0000 7fc9bd1fd740 1 -- start start 2024-04-26T20:28:12.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.175+0000 7fc9bd1fd740 1 Processor -- start 2024-04-26T20:28:12.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.176+0000 7f3790c00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37780a3e40 0x7f37780a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.176+0000 7f3790c00640 1 -- 172.21.15.82:0/4128461709 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f3780113320 con 0x7f3794109fd0 2024-04-26T20:28:12.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.180+0000 7f3793e00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37780a3e40 0x7f37780a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.184+0000 7f379da4a740 1 Processor -- start 2024-04-26T20:28:12.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:11 smithi082 ceph-mon[28105]: pgmap v573: 129 pgs: 129 active+clean; 809 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 889 op/s 2024-04-26T20:28:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.189+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0083520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.189+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab0083a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.189+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 0x556ab008aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.189+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556aaffe2200 con 0x556ab007a180 2024-04-26T20:28:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.189+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556aaffdcee0 con 0x556ab0079790 2024-04-26T20:28:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.189+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556aaffe9e70 con 0x556ab007f2f0 2024-04-26T20:28:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.190+0000 7fc9bd1fd740 10 client.0 _ll_register_callbacks cb 0x556aaffd3270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:12.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.192+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab0083a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.193+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab0083a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34684/0 (socket says 172.21.15.82:34684) 2024-04-26T20:28:12.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.193+0000 7fc9b2a00640 1 -- 172.21.15.82:0/203012024 learned_addr learned my addr 172.21.15.82:0/203012024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.195+0000 7fc9b2a00640 1 -- 172.21.15.82:0/203012024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 msgr2=0x556ab008aaa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.195+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 0x556ab008aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.195+0000 7fc9b2a00640 1 -- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 msgr2=0x556ab0083520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.195+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0083520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.195+0000 7fc9b2a00640 1 -- 172.21.15.82:0/203012024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aafdb97d0 con 0x556ab007a180 2024-04-26T20:28:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.197+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab0083a60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc9a401f430 tx=0x7fc9a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75faaaa85fcb4f78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 -- start start 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ad9dc0 0x561482ada1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ada7b0 0x561482adf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482ae1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561482a3e380 con 0x561482ad9dc0 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5614829dac30 con 0x561482adf920 2024-04-26T20:28:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.202+0000 7f379da4a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561482a3a340 con 0x561482ada7b0 2024-04-26T20:28:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.206+0000 7f3798c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482ae1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.207+0000 7f3798c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482ae1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33374/0 (socket says 172.21.15.82:33374) 2024-04-26T20:28:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.207+0000 7f3798c00640 1 -- 172.21.15.82:0/386546891 learned_addr learned my addr 172.21.15.82:0/386546891 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.210+0000 7f3798c00640 1 -- 172.21.15.82:0/386546891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ada7b0 msgr2=0x561482adf2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.210+0000 7f3798c00640 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ada7b0 0x561482adf2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.210+0000 7f3798c00640 1 -- 172.21.15.82:0/386546891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ad9dc0 msgr2=0x561482ada1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.210+0000 7f3798c00640 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ad9dc0 0x561482ada1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.210+0000 7f3798c00640 1 -- 172.21.15.82:0/386546891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614829fc940 con 0x561482adf920 2024-04-26T20:28:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.213+0000 7f3798c00640 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482ae1db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f378c011460 tx=0x7f378c011920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a28eb3f7835a5ffa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.207+0000 7fc9a1600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.207+0000 7fc9a1600640 1 -- 172.21.15.82:0/203012024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a402c060 con 0x556ab007a180 2024-04-26T20:28:12.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.207+0000 7fc9a1600640 1 -- 172.21.15.82:0/203012024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc9a4017030 con 0x556ab007a180 2024-04-26T20:28:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.218+0000 7f3793e00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37780a3e40 0x7f37780a6300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x561482adb010 tx=0x7f3784005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.218+0000 7f3789200640 1 -- 172.21.15.82:0/386546891 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c012770 con 0x561482adf920 2024-04-26T20:28:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.219+0000 7f3789200640 1 -- 172.21.15.82:0/386546891 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378c012dc0 con 0x561482adf920 2024-04-26T20:28:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.219+0000 7f3789200640 1 -- 172.21.15.82:0/386546891 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c01ae60 con 0x561482adf920 2024-04-26T20:28:12.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.220+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc99c0054f0 con 0x556ab007a180 2024-04-26T20:28:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.229+0000 7f379da4a740 1 -- 172.21.15.82:0/386546891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 msgr2=0x561482ae1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.229+0000 7f379da4a740 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482ae1db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f378c011460 tx=0x7f378c011920 comp rx=0 tx=0).stop 2024-04-26T20:28:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.249+0000 7f379da4a740 1 -- 172.21.15.82:0/386546891 shutdown_connections 2024-04-26T20:28:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.249+0000 7f379da4a740 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482ae1db0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.249+0000 7f379da4a740 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ada7b0 0x561482adf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.249+0000 7f379da4a740 1 --2- 172.21.15.82:0/386546891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ad9dc0 0x561482ada1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.249+0000 7f379da4a740 1 -- 172.21.15.82:0/386546891 >> 172.21.15.82:0/386546891 conn(0x561482ad5430 msgr2=0x561482ad5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.255+0000 7f379da4a740 1 -- 172.21.15.82:0/386546891 shutdown_connections 2024-04-26T20:28:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.270+0000 7f379da4a740 1 -- 172.21.15.82:0/386546891 wait complete. 2024-04-26T20:28:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.271+0000 7f379da4a740 1 -- start start 2024-04-26T20:28:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.271+0000 7f379da4a740 1 Processor -- start 2024-04-26T20:28:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.274+0000 7fc9a1600640 1 -- 172.21.15.82:0/203012024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc9a401c600 con 0x556ab007a180 2024-04-26T20:28:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.285+0000 7fc9bd1fd740 10 client.16701 fetch_fsmap learned FSMap version 40 2024-04-26T20:28:12.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.285+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556aafcef3f0 con 0x556ab007a180 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.284+0000 7f379da4a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 0x561482ae4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.284+0000 7f379da4a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482ae45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.284+0000 7f379da4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.284+0000 7f379da4a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561482ae28d0 con 0x561482ada7b0 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.284+0000 7f379da4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5614829c5c60 con 0x561482adf920 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.284+0000 7f379da4a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561482ae2a50 con 0x561482ad9dc0 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.285+0000 7f379da4a740 10 client.0 _ll_register_callbacks cb 0x5614829f1e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.286+0000 7f3793e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 0x561482ae4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.286+0000 7f3793e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 0x561482ae4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58162/0 (socket says 172.21.15.82:58162) 2024-04-26T20:28:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.286+0000 7f3793e00640 1 -- 172.21.15.82:0/89997972 learned_addr learned my addr 172.21.15.82:0/89997972 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.286+0000 7f3793400640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482ae45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.286+0000 7f3798c00640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.287+0000 7f3793e00640 1 -- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 msgr2=0x561482aeb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.287+0000 7f3793e00640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.287+0000 7f3793e00640 1 -- 172.21.15.82:0/89997972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 msgr2=0x561482ae45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.287+0000 7f3793e00640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482ae45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.287+0000 7f3793e00640 1 -- 172.21.15.82:0/89997972 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614829d4510 con 0x561482ad9dc0 2024-04-26T20:28:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9a1600640 1 -- 172.21.15.82:0/203012024 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c0054f0 con 0x556ab007a180 2024-04-26T20:28:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9a1600640 1 -- 172.21.15.82:0/203012024 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7fc9a4027980 con 0x556ab007a180 2024-04-26T20:28:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9bd1fd740 10 client.16701 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T20:28:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9bd1fd740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9bd1fd740 20 client.16701 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab008f110 0x556ab00915d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9bd1fd740 4 client.16701 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:28:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.290+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aaffeb7e0 con 0x556ab008f110 2024-04-26T20:28:12.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.291+0000 7fc9b3400640 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab008f110 0x556ab00915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.294+0000 7f3793e00640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 0x561482ae4090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f378400a650 tx=0x7f37840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec25bc6d92584484 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.307+0000 7fc9b3400640 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab008f110 0x556ab00915d0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618d5f150a86e761 server_cookie=bed19b9ceb3b234e in_seq=0 out_seq=0 2024-04-26T20:28:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.307+0000 7fc9a1600640 10 client.16701 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.317+0000 7f377d600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:28:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.317+0000 7f377d600640 1 -- 172.21.15.82:0/89997972 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784022020 con 0x561482ad9dc0 2024-04-26T20:28:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.317+0000 7f377d600640 1 -- 172.21.15.82:0/89997972 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f378400eaf0 con 0x561482ad9dc0 2024-04-26T20:28:12.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.319+0000 7fc9a1600640 1 -- 172.21.15.82:0/203012024 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556aaffeb7e0 con 0x556ab008f110 2024-04-26T20:28:12.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.319+0000 7fc9a1600640 10 client.16701 handle_command_reply: tid=0 2024-04-26T20:28:12.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:11 smithi139 ceph-mon[32999]: pgmap v573: 129 pgs: 129 active+clean; 809 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 889 op/s 2024-04-26T20:28:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.323+0000 7fc9bd1fd740 1 client.16701 shutdown 2024-04-26T20:28:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.326+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378c012dc0 con 0x561482ad9dc0 2024-04-26T20:28:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.336+0000 7f377d600640 1 -- 172.21.15.82:0/89997972 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f378400ecf0 con 0x561482ad9dc0 2024-04-26T20:28:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.341+0000 7f379da4a740 10 client.26824 fetch_fsmap learned FSMap version 40 2024-04-26T20:28:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.341+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561482750210 con 0x561482ad9dc0 2024-04-26T20:28:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.342+0000 7f377d600640 1 -- 172.21.15.82:0/89997972 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378c012dc0 con 0x561482ad9dc0 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.342+0000 7f377d600640 1 -- 172.21.15.82:0/89997972 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7f37840263a0 con 0x561482ad9dc0 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.344+0000 7f379da4a740 10 client.26824 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.344+0000 7f379da4a740 10 client.26824 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.344+0000 7f379da4a740 20 client.26824 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.344+0000 7f379da4a740 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482aefc20 0x561482af20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.344+0000 7f379da4a740 4 client.26824 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:28:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.344+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561482a4bf90 con 0x561482aefc20 2024-04-26T20:28:12.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.344+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 msgr2=0x556ab0083a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.344+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab0083a60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc9a401f430 tx=0x7fc9a4004730 comp rx=0 tx=0).stop 2024-04-26T20:28:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.356+0000 7f3793400640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482aefc20 0x561482af20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.361+0000 7f3793400640 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482aefc20 0x561482af20a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e03d5b1a389fae server_cookie=84831d88660574c7 in_seq=0 out_seq=0 2024-04-26T20:28:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.362+0000 7f377d600640 10 client.26824 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.364+0000 7f377d600640 1 -- 172.21.15.82:0/89997972 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561482a4bf90 con 0x561482aefc20 2024-04-26T20:28:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.364+0000 7f377d600640 10 client.26824 handle_command_reply: tid=0 2024-04-26T20:28:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.365+0000 7f379da4a740 1 client.26824 shutdown 2024-04-26T20:28:12.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:11 smithi135 ceph-mon[32816]: pgmap v573: 129 pgs: 129 active+clean; 809 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 889 op/s 2024-04-26T20:28:12.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 shutdown_connections 2024-04-26T20:28:12.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab008f110 0x556ab00915d0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007f2f0 0x556ab008aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007a180 0x556ab0083a60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/203012024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0083520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 >> 172.21.15.82:0/203012024 conn(0x556ab0074db0 msgr2=0x556ab0074040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.370+0000 7fc9a1600640 0 client.16701 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.371+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 shutdown_connections 2024-04-26T20:28:12.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.378+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/203012024 wait complete. 2024-04-26T20:28:12.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.381+0000 7fc9bd1fd740 20 client.16701 trim_cache size 0 max 16384 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 msgr2=0x561482ae4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 0x561482ae4090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f378400a650 tx=0x7f37840046c0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 shutdown_connections 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482aefc20 0x561482af20a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482ae45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 --2- 172.21.15.82:0/89997972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482ad9dc0 0x561482ae4090 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f378400a650 tx=0x7f37840046c0 comp rx=0 tx=0).stop 2024-04-26T20:28:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 >> 172.21.15.82:0/89997972 conn(0x561482ad5430 msgr2=0x561482ad4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.390+0000 7f377d600640 0 client.26824 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.415+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 shutdown_connections 2024-04-26T20:28:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.428+0000 7f379da4a740 1 -- 172.21.15.82:0/89997972 wait complete. 2024-04-26T20:28:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:12.431+0000 7f379da4a740 20 client.26824 trim_cache size 0 max 16384 2024-04-26T20:28:12.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:12.968+0000 7fc9bd1fd740 1 Processor -- start 2024-04-26T20:28:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.038+0000 7f379da4a740 1 Processor -- start 2024-04-26T20:28:13.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.032+0000 7fc9bd1fd740 1 -- start start 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.033+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab0079790 0x556ab0073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.033+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 0x556ab008aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.033+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab0077e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.033+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9900118a0 con 0x556ab007f2f0 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.033+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9900102b0 con 0x556ab007a180 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.033+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc990010980 con 0x556ab0079790 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.036+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 0x556ab008aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.036+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 0x556ab008aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33392/0 (socket says 172.21.15.82:33392) 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.036+0000 7fc9b2a00640 1 -- 172.21.15.82:0/2631765506 learned_addr learned my addr 172.21.15.82:0/2631765506 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.036+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab0077e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.040+0000 7fc9b3400640 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab0079790 0x556ab0073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.040+0000 7fc9b2a00640 1 -- 172.21.15.82:0/2631765506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab0079790 msgr2=0x556ab0073ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.040+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab0079790 0x556ab0073ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.040+0000 7fc9b2a00640 1 -- 172.21.15.82:0/2631765506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 msgr2=0x556ab0077e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.040+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab0077e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.040+0000 7fc9b2a00640 1 -- 172.21.15.82:0/2631765506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aafcaf0f0 con 0x556ab007a180 2024-04-26T20:28:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.044+0000 7fc9b2a00640 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 0x556ab008aa60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9a401fcc0 tx=0x7fc9a4010630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef021a4daa150a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.057+0000 7fc9a3e00640 1 -- 172.21.15.82:0/2631765506 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4036080 con 0x556ab007a180 2024-04-26T20:28:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.057+0000 7fc9a3e00640 1 -- 172.21.15.82:0/2631765506 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a401c7a0 con 0x556ab007a180 2024-04-26T20:28:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.057+0000 7fc9a3e00640 1 -- 172.21.15.82:0/2631765506 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4027640 con 0x556ab007a180 2024-04-26T20:28:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.058+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2631765506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 msgr2=0x556ab008aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.058+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 0x556ab008aa60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9a401fcc0 tx=0x7fc9a4010630 comp rx=0 tx=0).stop 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.061+0000 7f379da4a740 1 -- start start 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.062+0000 7f379da4a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482adf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.062+0000 7f379da4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f379da4a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482adbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f379da4a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37941b18d0 con 0x561482ada7b0 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f379da4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37941b3590 con 0x561482adf920 2024-04-26T20:28:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f379da4a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f37941b1fa0 con 0x561482adba70 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f3793400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f3793400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33404/0 (socket says 172.21.15.82:33404) 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f3793400640 1 -- 172.21.15.82:0/206862045 learned_addr learned my addr 172.21.15.82:0/206862045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.063+0000 7f3798c00640 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482adbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.065+0000 7f3798c00640 1 -- 172.21.15.82:0/206862045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 msgr2=0x561482aeb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.065+0000 7f3798c00640 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.065+0000 7f3798c00640 1 -- 172.21.15.82:0/206862045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 msgr2=0x561482adf2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.065+0000 7f3798c00640 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482adf2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.065+0000 7f3798c00640 1 -- 172.21.15.82:0/206862045 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148281c620 con 0x561482adba70 2024-04-26T20:28:13.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.071+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2631765506 shutdown_connections 2024-04-26T20:28:13.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.071+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab0077e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.071+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab007a180 0x556ab008aa60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.071+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/2631765506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab0079790 0x556ab0073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.071+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2631765506 >> 172.21.15.82:0/2631765506 conn(0x556ab0074db0 msgr2=0x556ab00737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.081+0000 7f3798c00640 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482adbef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f378c009270 tx=0x7f378c009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e23db35d78a26bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.088+0000 7f377fe00640 1 -- 172.21.15.82:0/206862045 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c004dc0 con 0x561482adba70 2024-04-26T20:28:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.088+0000 7f377fe00640 1 -- 172.21.15.82:0/206862045 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378c012a20 con 0x561482adba70 2024-04-26T20:28:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.088+0000 7f377fe00640 1 -- 172.21.15.82:0/206862045 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c0055e0 con 0x561482adba70 2024-04-26T20:28:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.088+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2631765506 shutdown_connections 2024-04-26T20:28:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.088+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/2631765506 wait complete. 2024-04-26T20:28:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.088+0000 7fc9bd1fd740 1 -- start start 2024-04-26T20:28:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.088+0000 7fc9bd1fd740 1 Processor -- start 2024-04-26T20:28:13.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0087ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007a180 0x556ab00880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab00890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc99000dbc0 con 0x556ab007f2f0 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc990011110 con 0x556ab0079790 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc99000e230 con 0x556ab007a180 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.089+0000 7fc9bd1fd740 10 client.0 _ll_register_callbacks cb 0x7fc9a400bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.090+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007a180 0x556ab00880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.090+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007a180 0x556ab00880e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58194/0 (socket says 172.21.15.82:58194) 2024-04-26T20:28:13.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.090+0000 7fc9b2a00640 1 -- 172.21.15.82:0/3628213012 learned_addr learned my addr 172.21.15.82:0/3628213012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:13.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.092+0000 7fc9b3400640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0087ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.092+0000 7f379da4a740 1 -- 172.21.15.82:0/206862045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 msgr2=0x561482adbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.092+0000 7f379da4a740 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482adbef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f378c009270 tx=0x7f378c009d40 comp rx=0 tx=0).stop 2024-04-26T20:28:13.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.094+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab00890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.096+0000 7f379da4a740 1 -- 172.21.15.82:0/206862045 shutdown_connections 2024-04-26T20:28:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.095+0000 7fc9b3e00640 1 -- 172.21.15.82:0/3628213012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007a180 msgr2=0x556ab00880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.095+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007a180 0x556ab00880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.095+0000 7fc9b3e00640 1 -- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 msgr2=0x556ab0087ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.095+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0087ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.095+0000 7fc9b3e00640 1 -- 172.21.15.82:0/3628213012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aaffa5a30 con 0x556ab007f2f0 2024-04-26T20:28:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.097+0000 7f379da4a740 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482adbef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.097+0000 7f379da4a740 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482adf920 0x561482aeb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.112+0000 7f379da4a740 1 --2- 172.21.15.82:0/206862045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482ada7b0 0x561482adf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.112+0000 7f379da4a740 1 -- 172.21.15.82:0/206862045 >> 172.21.15.82:0/206862045 conn(0x561482ad5430 msgr2=0x561482ad5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.139+0000 7f379da4a740 1 -- 172.21.15.82:0/206862045 shutdown_connections 2024-04-26T20:28:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.140+0000 7f379da4a740 1 -- 172.21.15.82:0/206862045 wait complete. 2024-04-26T20:28:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.140+0000 7f379da4a740 1 -- start start 2024-04-26T20:28:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.140+0000 7f379da4a740 1 Processor -- start 2024-04-26T20:28:13.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.147+0000 7fc9b3e00640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab00890f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0de790 tx=0x7fc9ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf3f8018c723919 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:13.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.152+0000 7fc9a1600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:13.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.152+0000 7fc9a1600640 1 -- 172.21.15.82:0/3628213012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac02b050 con 0x556ab007f2f0 2024-04-26T20:28:13.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.157+0000 7fc9a1600640 1 -- 172.21.15.82:0/3628213012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc9ac004ab0 con 0x556ab007f2f0 2024-04-26T20:28:13.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.174+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a401c7a0 con 0x556ab007f2f0 2024-04-26T20:28:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482ada7b0 0x561482ae8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482ae8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482adf920 0x561482b54210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37941b2e00 con 0x561482adf920 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37941b2670 con 0x561482ada7b0 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f37941af8b0 con 0x561482adba70 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.170+0000 7f379da4a740 10 client.0 _ll_register_callbacks cb 0x7f378400a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.175+0000 7f3793400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482ae8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.175+0000 7f3793400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482ae8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58206/0 (socket says 172.21.15.82:58206) 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.175+0000 7f3793400640 1 -- 172.21.15.82:0/873044758 learned_addr learned my addr 172.21.15.82:0/873044758 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.175+0000 7f3793e00640 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482ada7b0 0x561482ae8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.176+0000 7f3793400640 1 -- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482ada7b0 msgr2=0x561482ae8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.176+0000 7f3793400640 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482ada7b0 0x561482ae8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.176+0000 7f3793400640 1 -- 172.21.15.82:0/873044758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482adf920 msgr2=0x561482b54210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.176+0000 7f3793400640 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482adf920 0x561482b54210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.176+0000 7f3793400640 1 -- 172.21.15.82:0/873044758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614829f8cb0 con 0x561482adba70 2024-04-26T20:28:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.178+0000 7f3793400640 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482ae8a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3780006010 tx=0x7f37800db4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9090bc9bda8e372 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:13.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.178+0000 7fc9a1600640 1 -- 172.21.15.82:0/3628213012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc9ac0c6260 con 0x556ab007f2f0 2024-04-26T20:28:13.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.182+0000 7fc9bd1fd740 10 client.16710 fetch_fsmap learned FSMap version 40 2024-04-26T20:28:13.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.182+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556ab008a890 con 0x556ab007f2f0 2024-04-26T20:28:13.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9a1600640 1 -- 172.21.15.82:0/3628213012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a401c7a0 con 0x556ab007f2f0 2024-04-26T20:28:13.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9a1600640 1 -- 172.21.15.82:0/3628213012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7fc9ac0ac4a0 con 0x556ab007f2f0 2024-04-26T20:28:13.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9bd1fd740 10 client.16710 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T20:28:13.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9bd1fd740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:13.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9bd1fd740 20 client.16710 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:13.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab00f5a00 0x556ab00f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9bd1fd740 4 client.16710 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:28:13.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.184+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556aaffe5650 con 0x556ab00f5a00 2024-04-26T20:28:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.197+0000 7f377d600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:28:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.197+0000 7f377d600640 1 -- 172.21.15.82:0/873044758 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37800fd060 con 0x561482adba70 2024-04-26T20:28:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.197+0000 7f377d600640 1 -- 172.21.15.82:0/873044758 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f37800dd470 con 0x561482adba70 2024-04-26T20:28:13.200 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:12 smithi082 ceph-mon[28105]: pgmap v574: 129 pgs: 129 active+clean; 858 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 1.27k op/s 2024-04-26T20:28:13.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.193+0000 7fc9b3400640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab00f5a00 0x556ab00f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.204+0000 7fc9b3400640 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab00f5a00 0x556ab00f7df0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61992970967c3860 server_cookie=fdd6c1c645406d64 in_seq=0 out_seq=0 2024-04-26T20:28:13.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.211+0000 7fc9a1600640 10 client.16710 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:13.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.220+0000 7fc9a1600640 1 -- 172.21.15.82:0/3628213012 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556aaffe5650 con 0x556ab00f5a00 2024-04-26T20:28:13.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.220+0000 7fc9a1600640 10 client.16710 handle_command_reply: tid=0 2024-04-26T20:28:13.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.220+0000 7fc9bd1fd740 1 client.16710 shutdown 2024-04-26T20:28:13.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.221+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 msgr2=0x556ab00890f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:13.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.221+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab00890f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0de790 tx=0x7fc9ac004730 comp rx=0 tx=0).stop 2024-04-26T20:28:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.219+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378c012a20 con 0x561482adba70 2024-04-26T20:28:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.224+0000 7f377d600640 1 -- 172.21.15.82:0/873044758 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f37800c2050 con 0x561482adba70 2024-04-26T20:28:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.228+0000 7f379da4a740 10 client.26836 fetch_fsmap learned FSMap version 40 2024-04-26T20:28:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.228+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561482b55910 con 0x561482adba70 2024-04-26T20:28:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.228+0000 7f377d600640 1 -- 172.21.15.82:0/873044758 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378c012a20 con 0x561482adba70 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f377d600640 1 -- 172.21.15.82:0/873044758 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 40) ==== 8394+0+0 (secure 0 0 0) 0x7f37800c5020 con 0x561482adba70 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f379da4a740 10 client.26836 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f379da4a740 10 client.26836 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f379da4a740 20 client.26836 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f379da4a740 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482b562e0 0x561482b58700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f379da4a740 4 client.26836 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.229+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561482a45e00 con 0x561482b562e0 2024-04-26T20:28:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.231+0000 7f3793e00640 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482b562e0 0x561482b58700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.227+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 shutdown_connections 2024-04-26T20:28:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.227+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556ab00f5a00 0x556ab00f7df0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.227+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ab007f2f0 0x556ab00890f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.228+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ab007a180 0x556ab00880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.228+0000 7fc9bd1fd740 1 --2- 172.21.15.82:0/3628213012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ab0079790 0x556ab0087ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.228+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 >> 172.21.15.82:0/3628213012 conn(0x556ab0074db0 msgr2=0x556ab007b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:13.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.237+0000 7fc9a1600640 0 client.16710 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:13.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.244+0000 7f3793e00640 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482b562e0 0x561482b58700 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b9d0dc859897df server_cookie=3de0a714d870cdd7 in_seq=0 out_seq=0 2024-04-26T20:28:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:13.252+0000 7f377d600640 10 client.26836 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:13.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.251+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 shutdown_connections 2024-04-26T20:28:13.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.264+0000 7fc9bd1fd740 1 -- 172.21.15.82:0/3628213012 wait complete. 2024-04-26T20:28:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.271+0000 7fc9bd1fd740 20 client.16710 trim_cache size 0 max 16384 2024-04-26T20:28:13.305 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: "41c13c1b-3ac6-4900-8aae-7000533ba6e3": { 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "41c13c1b-3ac6-4900-8aae-7000533ba6e3", 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:28:13.306 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:28:13.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:12 smithi139 ceph-mon[32999]: pgmap v574: 129 pgs: 129 active+clean; 858 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 1.27k op/s 2024-04-26T20:28:13.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.349+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9980a3e10 msgr2=0x7fc9980a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:13.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.349+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9980a3e10 0x7fc9980a62d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x556ab007a9e0 tx=0x7fc9a400b390 comp rx=0 tx=0).stop 2024-04-26T20:28:13.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.349+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b41a4940 msgr2=0x7fc9b41a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:13.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.349+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b41a4940 0x7fc9b41a6d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005fd0 tx=0x7fc9ac01d380 comp rx=0 tx=0).stop 2024-04-26T20:28:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.358+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 shutdown_connections 2024-04-26T20:28:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.358+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc9980a3e10 0x7fc9980a62d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.358+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9b41a4940 0x7fc9b41a6d30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.358+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9b410ec70 0x7fc9b419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.358+0000 7fc9ba400640 1 --2- 172.21.15.82:0/2158773655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b410c2a0 0x7fc9b419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.358+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 >> 172.21.15.82:0/2158773655 conn(0x7fc9b406f7c0 msgr2=0x7fc9b410a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:13.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:12 smithi135 ceph-mon[32816]: pgmap v574: 129 pgs: 129 active+clean; 858 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 1.27k op/s 2024-04-26T20:28:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.388+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 shutdown_connections 2024-04-26T20:28:13.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:13.389+0000 7fc9ba400640 1 -- 172.21.15.82:0/2158773655 wait complete. 2024-04-26T20:28:13.895 INFO:tasks.cephfs.filesystem:scrub status for tag:41c13c1b-3ac6-4900-8aae-7000533ba6e3 - {'path': '/', 'tag': '41c13c1b-3ac6-4900-8aae-7000533ba6e3', 'options': 'recursive,force'} 2024-04-26T20:28:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:14 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:active 2024-04-26T20:28:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:14 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:14 smithi139 ceph-mon[32999]: pgmap v575: 129 pgs: 129 active+clean; 870 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.34k op/s 2024-04-26T20:28:15.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:14 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:active 2024-04-26T20:28:15.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:14 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:15.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:14 smithi135 ceph-mon[32816]: pgmap v575: 129 pgs: 129 active+clean; 870 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.34k op/s 2024-04-26T20:28:15.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:14 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] up:active 2024-04-26T20:28:15.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:14 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:15.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:14 smithi082 ceph-mon[28105]: pgmap v575: 129 pgs: 129 active+clean; 870 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.34k op/s 2024-04-26T20:28:17.086 INFO:tasks.workunit.client.0.smithi082.stdout: 240 417806 328 287231 444 135708 854 2024-04-26T20:28:18.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:17 smithi082 ceph-mon[28105]: pgmap v576: 129 pgs: 129 active+clean; 894 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.56k op/s 2024-04-26T20:28:18.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:17 smithi139 ceph-mon[32999]: pgmap v576: 129 pgs: 129 active+clean; 894 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.56k op/s 2024-04-26T20:28:18.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:17 smithi135 ceph-mon[32816]: pgmap v576: 129 pgs: 129 active+clean; 894 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.56k op/s 2024-04-26T20:28:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.400+0000 7f377d600640 1 -- 172.21.15.82:0/873044758 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561482a45e00 con 0x561482b562e0 2024-04-26T20:28:18.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.400+0000 7f377d600640 10 client.26836 handle_command_reply: tid=0 2024-04-26T20:28:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.401+0000 7f379da4a740 1 client.26836 shutdown 2024-04-26T20:28:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.401+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 msgr2=0x561482ae8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.401+0000 7f379da4a740 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482ae8a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3780006010 tx=0x7f37800db4e0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 shutdown_connections 2024-04-26T20:28:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f379da4a740 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561482b562e0 0x561482b58700 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f379da4a740 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561482adf920 0x561482b54210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f379da4a740 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561482adba70 0x561482ae8a40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f379da4a740 1 --2- 172.21.15.82:0/873044758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561482ada7b0 0x561482ae8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 >> 172.21.15.82:0/873044758 conn(0x561482ad5430 msgr2=0x561482ad83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:28:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:28:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:28:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:28:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.402+0000 7f377d600640 0 client.26836 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.403+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 shutdown_connections 2024-04-26T20:28:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.403+0000 7f379da4a740 1 -- 172.21.15.82:0/873044758 wait complete. 2024-04-26T20:28:18.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.403+0000 7f379da4a740 20 client.26836 trim_cache size 0 max 16384 2024-04-26T20:28:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.404+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37780a3e40 msgr2=0x7f37780a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.404+0000 7f379ac00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37780a3e40 0x7f37780a6300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x561482adb010 tx=0x7f3784005850 comp rx=0 tx=0).stop 2024-04-26T20:28:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.404+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 msgr2=0x7f379419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.404+0000 7f379ac00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 0x7f379419f580 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3780009850 tx=0x7f3780004580 comp rx=0 tx=0).stop 2024-04-26T20:28:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 shutdown_connections 2024-04-26T20:28:18.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37780a3e40 0x7f37780a6300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f379410a970 0x7f37941a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3794109fd0 0x7f379419f580 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 --2- 172.21.15.82:0/4128461709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3794073d20 0x7f379419f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 >> 172.21.15.82:0/4128461709 conn(0x7f379406f7d0 msgr2=0x7f379410d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 shutdown_connections 2024-04-26T20:28:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:18.405+0000 7f379ac00640 1 -- 172.21.15.82:0/4128461709 wait complete. 2024-04-26T20:28:19.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:28:19.331+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:19 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:19 smithi082 ceph-mon[28105]: pgmap v577: 129 pgs: 129 active+clean; 900 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.62k op/s 2024-04-26T20:28:20.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:19 smithi082 ceph-mon[28105]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:20.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:19 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:20.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:19 smithi139 ceph-mon[32999]: pgmap v577: 129 pgs: 129 active+clean; 900 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.62k op/s 2024-04-26T20:28:20.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:19 smithi139 ceph-mon[32999]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:20.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:19 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:20.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:19 smithi135 ceph-mon[32816]: pgmap v577: 129 pgs: 129 active+clean; 900 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.62k op/s 2024-04-26T20:28:20.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:19 smithi135 ceph-mon[32816]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:20.680 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.303+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000359 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml auth v1571 ap=1 s=21302 n(v0 rc2024-04-26T20:24:48.310865+0000 b21302 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8611080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000359:[<0x20000000001/article-55.xml v1571>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000359:[<0x20000000001/article-55.xml v1571>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.680 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.304+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000601 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml auth v1813 ap=1 s=5908 n(v0 rc2024-04-26T20:24:52.178789+0000 b5908 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7adc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000601:[<0x20000000001/article-8.xml v1813>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000601:[<0x20000000001/article-8.xml v1813>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.306+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x40000000211 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg auth{0=1,3=1} v1945 ap=1 s=57922 n(v0 rc2024-04-26T20:25:14.326356+0000 b57922 1=1+0) caps={25436=pAsLsXsFscr/pFscr@27} mcw={3=Fscr} | request=0 lock=0 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x5642aaa86000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x40000000211:[<0x20000000001/picture-25.jpg v1945>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x40000000211:[<0x20000000001/picture-25.jpg v1945>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.311+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c33 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg auth v1886 ap=1 s=41772 n(v0 rc2024-04-26T20:25:02.284591+0000 b41772 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a81eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000c33:[<0x20000000001/picture-31.jpg v1886>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000c33:[<0x20000000001/picture-31.jpg v1886>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.313+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005d9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml auth v1683 ap=1 s=28602 n(v0 rc2024-04-26T20:24:52.049792+0000 b28602 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8525b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005d9:[<0x20000000001/article-68.xml v1683>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005d9:[<0x20000000001/article-68.xml v1683>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.313+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000009f1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg auth v1882 ap=1 s=8275 n(v0 rc2024-04-26T20:24:58.350668+0000 b8275 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a946f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000009f1:[<0x20000000001/picture-49.jpg v1882>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000009f1:[<0x20000000001/picture-49.jpg v1882>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.313+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x40000000496 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg auth{0=1,3=1} v2131 ap=1 s=37953 n(v0 rc2024-04-26T20:26:47.595533+0000 b37953 1=1+0) caps={25436=pAsLsXsFscr/pFscr@3} mcw={3=Fscr} | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a8c5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x40000000496:[<0x20000000001/picture-8.jpg v2131>,<0x10000000971/blog-1 v103034>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x40000000496:[<0x20000000001/picture-8.jpg v2131>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.318+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000921 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-76.xml auth v1880 ap=1 s=26714 n(v0 rc2024-04-26T20:24:56.512704+0000 b26714 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8710100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000921:[<0x20000000001/article-76.xml v1880>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000921:[<0x20000000001/article-76.xml v1880>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.318+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x300000001fe [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg auth{0=1,2=1} v1937 ap=1 s=34526 n(v0 rc2024-04-26T20:25:12.571390+0000 b34526 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9ea9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x300000001fe:[<0x20000000001/picture-26.jpg v1937>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x300000001fe:[<0x20000000001/picture-26.jpg v1937>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.319+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000049c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml auth v1573 ap=1 s=25789 n(v0 rc2024-04-26T20:24:50.011831+0000 b25789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a85b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000049c:[<0x20000000001/article-32.xml v1573>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000049c:[<0x20000000001/article-32.xml v1573>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.319+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000004f3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-83.xml auth v1579 ap=1 s=5566 n(v0 rc2024-04-26T20:24:50.506822+0000 b5566 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8148680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000004f3:[<0x20000000001/comment-83.xml v1579>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000004f3:[<0x20000000001/comment-83.xml v1579>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.681 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.319+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000503 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml auth v1577 ap=1 s=16789 n(v0 rc2024-04-26T20:24:50.598820+0000 b16789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7c62000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000503:[<0x20000000001/article-21.xml v1577>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000503:[<0x20000000001/article-21.xml v1577>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.323+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000ef2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-74.xml auth{0=1,2=1} v2170 ap=1 s=3030 n(v0 rc2024-04-26T20:27:47.944355+0000 b3030 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | request=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aaacc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x30000000ef2:[<0x20000000001/comment-74.xml v2170>,<0x10000000971/blog-1 v108512>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x30000000ef2:[<0x20000000001/comment-74.xml v2170>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.324+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000004a6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml auth v1589 ap=1 s=25961 n(v0 rc2024-04-26T20:24:50.072830+0000 b25961 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a85c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000004a6:[<0x20000000001/article-30.xml v1589>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000004a6:[<0x20000000001/article-30.xml v1589>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.326+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ba2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-36.xml auth v1888 ap=1 s=4548 n(v0 rc2024-04-26T20:25:00.610624+0000 b4548 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a939a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000ba2:[<0x20000000001/comment-36.xml v1888>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000ba2:[<0x20000000001/comment-36.xml v1888>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.326+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000054f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml auth v1587 ap=1 s=19751 n(v0 rc2024-04-26T20:24:51.075811+0000 b19751 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a86aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000054f:[<0x20000000001/article-13.xml v1587>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000054f:[<0x20000000001/article-13.xml v1587>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.326+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000048c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-4.xml auth{0=1,2=1} v2122 ap=1 s=9127 n(v0 rc2024-04-26T20:26:43.409615+0000 b9127 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a938c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x3000000048c:[<0x20000000001/comment-4.xml v2122>,<0x10000000971/blog-1 v103034>,<0x100000007e0/blogtest_in v1442>,<0x100000007d9/src v1705>,<0x100000005e3/blogbench-1.0 v1486>,<0x100000005e2/tmp v81>,<0x100000001fb/client.0 v81>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v97>,<0x1/volumes v94>]//[3]","memoryvalue":"(4)0x3000000048c:[<0x20000000001/comment-4.xml v2122>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.327+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000039c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml auth v1581 ap=1 s=27246 n(v0 rc2024-04-26T20:24:48.588859+0000 b27246 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8726b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000039c:[<0x20000000001/article-50.xml v1581>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000039c:[<0x20000000001/article-50.xml v1581>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.327+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000028b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-14.xml auth{0=1,2=1} v2040 ap=1 s=5043 n(v0 rc2024-04-26T20:26:05.922348+0000 b5043 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a938cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x3000000028b:[<0x20000000001/comment-14.xml v2040>,<0x10000000971/blog-1 v78340>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x3000000028b:[<0x20000000001/comment-14.xml v2040>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.329+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c5b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg auth v1953 ap=1 s=39059 n(v0 rc2024-04-26T20:25:03.825561+0000 b39059 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8a33600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000c5b:[<0x20000000001/picture-29.jpg v1953>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000c5b:[<0x20000000001/picture-29.jpg v1953>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.332+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000021b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-19.xml auth{0=1,2=1} v2017 ap=1 s=7633 n(v0 rc2024-04-26T20:25:49.685665+0000 b7633 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a938db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x3000000021b:[<0x20000000001/comment-19.xml v2017>,<0x10000000971/blog-1 v71274>,<0x100000007e0/blogtest_in v688>,<0x100000007d9/src v1691>,<0x100000005e3/blogbench-1.0 v1472>,<0x100000005e2/tmp v67>,<0x100000001fb/client.0 v67>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v83>,<0x1/volumes v80>]//[3]","memoryvalue":"(4)0x3000000021b:[<0x20000000001/comment-19.xml v2017>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.335+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000006a0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml auth v1823 ap=1 s=9843 n(v0 rc2024-04-26T20:24:53.389765+0000 b9843 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a94f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000006a0:[<0x20000000001/article-2.xml v1823>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000006a0:[<0x20000000001/article-2.xml v1823>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.336+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000061a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml auth v1821 ap=1 s=28664 n(v0 rc2024-04-26T20:24:52.823776+0000 b28664 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a98c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000061a:[<0x20000000001/article-6.xml v1821>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000061a:[<0x20000000001/article-6.xml v1821>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.682 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.344+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000096d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg auth v1878 ap=1 s=49643 n(v0 rc2024-04-26T20:24:57.786679+0000 b49643 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7b5d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000096d:[<0x20000000001/picture-54.jpg v1878>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000096d:[<0x20000000001/picture-54.jpg v1878>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.683 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.346+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000034e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml auth v1575 ap=1 s=14413 n(v0 rc2024-04-26T20:24:48.243866+0000 b14413 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a85b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000034e:[<0x20000000001/article-56.xml v1575>,<0x10000000971/blog-1 v43453>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000034e:[<0x20000000001/article-56.xml v1575>,<0x10000000971/blog-1 v115628>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.683 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.670+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a91 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-13.jpg auth{0=1} v617 ap=1 s=25349 n(v0 rc2024-04-26T20:25:27.991089+0000 b25349 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9846100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a91:[<0x200000019e7/picture-13.jpg v442>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a91:[<0x200000019e7/picture-13.jpg v617>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.683 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.672+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a87 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-18.jpg auth{0=1} v703 ap=1 s=47707 n(v0 rc2024-04-26T20:25:27.949090+0000 b47707 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9844b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a87:[<0x200000019e7/picture-18.jpg v412>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a87:[<0x200000019e7/picture-18.jpg v703>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.683 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.674+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019f9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-18.xml auth{0=1} v705 ap=1 s=17103 n(v0 rc2024-04-26T20:25:26.655115+0000 b17103 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9845600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019f9:[<0x200000019e7/article-18.xml v52>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019f9:[<0x200000019e7/article-18.xml v705>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.683 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.676+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a84 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-19.jpg auth{0=1} v707 ap=1 s=58207 n(v0 rc2024-04-26T20:25:27.944090+0000 b58207 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9846680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a84:[<0x200000019e7/picture-19.jpg v406>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a84:[<0x200000019e7/picture-19.jpg v707>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:20.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000359 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000601 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x40000000211 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000c33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000009f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x40000000496 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000921 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-76.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x300000001fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000049c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000004f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000503 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x30000000ef2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000004a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000ba2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-36.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000054f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x3000000048c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000039c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x3000000028b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000c5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x3000000021b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000006a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000061a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000096d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000034e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:20.958 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.678+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-4.jpg auth{0=1} v633 ap=1 s=20718 n(v0 rc2024-04-26T20:25:28.066087+0000 b20718 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9847700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa3:[<0x200000019e7/picture-4.jpg v496>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa3:[<0x200000019e7/picture-4.jpg v633>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.958 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.679+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a63 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-35.jpg auth v743 ap=1 s=20256 n(v0 rc2024-04-26T20:25:27.732094+0000 b20256 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a7d22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a63:[<0x200000019e7/picture-35.jpg v310>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a63:[<0x200000019e7/picture-35.jpg v743>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.960 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.681+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-2.jpg auth{0=1} v635 ap=1 s=16787 n(v0 rc2024-04-26T20:25:28.082087+0000 b16787 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a83c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa7:[<0x200000019e7/picture-2.jpg v508>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa7:[<0x200000019e7/picture-2.jpg v635>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.960 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.682+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019f5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-20.xml auth{0=1} v711 ap=1 s=5429 n(v0 rc2024-04-26T20:25:26.647115+0000 b5429 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a83c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019f5:[<0x200000019e7/article-20.xml v40>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019f5:[<0x200000019e7/article-20.xml v711>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.962 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.683+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a8f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-14.jpg auth{0=1} v691 ap=1 s=53743 n(v0 rc2024-04-26T20:25:27.986089+0000 b53743 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a83c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a8f:[<0x200000019e7/picture-14.jpg v436>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a8f:[<0x200000019e7/picture-14.jpg v691>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.684+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a9d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-7.jpg auth{0=1} v677 ap=1 s=33266 n(v0 rc2024-04-26T20:25:28.037088+0000 b33266 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a86d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a9d:[<0x200000019e7/picture-7.jpg v478>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a9d:[<0x200000019e7/picture-7.jpg v677>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.685+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a99 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-9.jpg auth{0=1} v631 ap=1 s=58754 n(v0 rc2024-04-26T20:25:28.021088+0000 b58754 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a86d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a99:[<0x200000019e7/picture-9.jpg v466>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a99:[<0x200000019e7/picture-9.jpg v631>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.686+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a97 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-10.jpg auth{0=1} v609 ap=1 s=57261 n(v0 rc2024-04-26T20:25:28.015088+0000 b57261 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a86d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a97:[<0x200000019e7/picture-10.jpg v460>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a97:[<0x200000019e7/picture-10.jpg v609>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.688+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-1.jpg auth{0=1} v659 ap=1 s=22984 n(v0 rc2024-04-26T20:25:28.088087+0000 b22984 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac02c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa9:[<0x200000019e7/picture-1.jpg v514>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa9:[<0x200000019e7/picture-1.jpg v659>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.689+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a0b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-9.xml auth{0=1} v681 ap=1 s=25114 n(v0 rc2024-04-26T20:25:26.691114+0000 b25114 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac02bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a0b:[<0x200000019e7/article-9.xml v106>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a0b:[<0x200000019e7/article-9.xml v681>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.690+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a9f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-6.jpg auth{0=1} v673 ap=1 s=26154 n(v0 rc2024-04-26T20:25:28.044088+0000 b26154 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac02a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a9f:[<0x200000019e7/picture-6.jpg v484>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a9f:[<0x200000019e7/picture-6.jpg v673>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.692+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019ed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-24.xml auth{0=1} v727 ap=1 s=27024 n(v0 rc2024-04-26T20:25:26.624115+0000 b27024 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac02b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019ed:[<0x200000019e7/article-24.xml v16>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019ed:[<0x200000019e7/article-24.xml v727>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.695+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a72 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-28.jpg auth v615 ap=1 s=60300 n(v0 rc2024-04-26T20:25:27.826092+0000 b60300 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642ac02ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a72:[<0x200000019e7/picture-28.jpg v352>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a72:[<0x200000019e7/picture-28.jpg v615>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.696+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a5f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-37.jpg auth v657 ap=1 s=57615 n(v0 rc2024-04-26T20:25:27.712094+0000 b57615 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642ac02d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a5f:[<0x200000019e7/picture-37.jpg v298>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a5f:[<0x200000019e7/picture-37.jpg v657>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.698+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a89 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-17.jpg auth{0=1} v701 ap=1 s=37369 n(v0 rc2024-04-26T20:25:27.957089+0000 b37369 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abeaf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a89:[<0x200000019e7/picture-17.jpg v418>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a89:[<0x200000019e7/picture-17.jpg v701>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.963 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.699+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a17 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-3.xml auth{0=1} v667 ap=1 s=28450 n(v0 rc2024-04-26T20:25:26.732113+0000 b28450 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abeae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a17:[<0x200000019e7/article-3.xml v142>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a17:[<0x200000019e7/article-3.xml v667>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.700+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a7a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-24.jpg auth{0=1} v725 ap=1 s=61340 n(v0 rc2024-04-26T20:25:27.880091+0000 b61340 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abeae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a7a:[<0x200000019e7/picture-24.jpg v376>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a7a:[<0x200000019e7/picture-24.jpg v725>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.702+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a67 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-33.jpg auth v641 ap=1 s=62037 n(v0 rc2024-04-26T20:25:27.761093+0000 b62037 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a8c45180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a67:[<0x200000019e7/picture-33.jpg v322>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a67:[<0x200000019e7/picture-33.jpg v641>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.710+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a23 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-57.jpg auth v751 ap=1 s=53811 n(v0 rc2024-04-26T20:25:26.789112+0000 b53811 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a8c44680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a23:[<0x200000019e7/picture-57.jpg v178>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a23:[<0x200000019e7/picture-57.jpg v751>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.711+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a0f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-7.xml auth{0=1} v621 ap=1 s=19201 n(v0 rc2024-04-26T20:25:26.705114+0000 b19201 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a8c44100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a0f:[<0x200000019e7/article-7.xml v118>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a0f:[<0x200000019e7/article-7.xml v621>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.712+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a55 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-42.jpg auth v739 ap=1 s=38102 n(v0 rc2024-04-26T20:25:27.643096+0000 b38102 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a8c42b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a55:[<0x200000019e7/picture-42.jpg v268>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a55:[<0x200000019e7/picture-42.jpg v739>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.714+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a5b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-39.jpg auth v745 ap=1 s=57346 n(v0 rc2024-04-26T20:25:27.694095+0000 b57346 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aa2e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a5b:[<0x200000019e7/picture-39.jpg v286>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a5b:[<0x200000019e7/picture-39.jpg v745>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.715+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a78 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-25.jpg auth{0=1} v729 ap=1 s=60880 n(v0 rc2024-04-26T20:25:27.869091+0000 b60880 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aa2eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a78:[<0x200000019e7/picture-25.jpg v370>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a78:[<0x200000019e7/picture-25.jpg v729>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.964 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.716+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a0d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-8.xml auth{0=1} v653 ap=1 s=16931 n(v0 rc2024-04-26T20:25:26.695114+0000 b16931 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aa2ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a0d:[<0x200000019e7/article-8.xml v112>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a0d:[<0x200000019e7/article-8.xml v653>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.987 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.717+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a6b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-31.jpg auth v607 ap=1 s=38686 n(v0 rc2024-04-26T20:25:27.788093+0000 b38686 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aa2e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a6b:[<0x200000019e7/picture-31.jpg v334>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a6b:[<0x200000019e7/picture-31.jpg v607>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.987 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.719+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a37 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-49.jpg auth v639 ap=1 s=42638 n(v0 rc2024-04-26T20:25:27.032107+0000 b42638 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aa2eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a37:[<0x200000019e7/picture-49.jpg v226>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a37:[<0x200000019e7/picture-49.jpg v639>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.720+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a9b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-8.jpg auth{0=1} v679 ap=1 s=36007 n(v0 rc2024-04-26T20:25:28.028088+0000 b36007 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aa2e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a9b:[<0x200000019e7/picture-8.jpg v472>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a9b:[<0x200000019e7/picture-8.jpg v679>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.720+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a76 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-26.jpg auth{0=1} v733 ap=1 s=48744 n(v0 rc2024-04-26T20:25:27.854091+0000 b48744 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aad38b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a76:[<0x200000019e7/picture-26.jpg v364>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a76:[<0x200000019e7/picture-26.jpg v733>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.721+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019f3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-21.xml auth{0=1} v715 ap=1 s=15496 n(v0 rc2024-04-26T20:25:26.643115+0000 b15496 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aad39080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019f3:[<0x200000019e7/article-21.xml v34>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019f3:[<0x200000019e7/article-21.xml v715>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.722+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-30.xml auth v794 ap=1 s=24884 n(v0 rc2024-04-26T20:26:04.030385+0000 b24884 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a8467600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000098f:[<0x200000019e7/article-30.xml v786>,<0x10000000971/blog-39 v84749>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x1000000098f:[<0x200000019e7/article-30.xml v794>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.723+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a11 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-6.xml auth{0=1} v675 ap=1 s=26396 n(v0 rc2024-04-26T20:25:26.712114+0000 b26396 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aaae6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a11:[<0x200000019e7/article-6.xml v124>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a11:[<0x200000019e7/article-6.xml v675>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.725+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a03 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-13.xml auth{0=1} v689 ap=1 s=31021 n(v0 rc2024-04-26T20:25:26.673114+0000 b31021 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aa940c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a03:[<0x200000019e7/article-13.xml v82>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a03:[<0x200000019e7/article-13.xml v689>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.725+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a19 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-2.xml auth{0=1} v663 ap=1 s=7663 n(v0 rc2024-04-26T20:25:26.740113+0000 b7663 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aaae9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a19:[<0x200000019e7/article-2.xml v148>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a19:[<0x200000019e7/article-2.xml v663>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.988 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.726+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a34 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-50.jpg auth v753 ap=1 s=20247 n(v0 rc2024-04-26T20:25:26.968109+0000 b20247 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aafa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a34:[<0x200000019e7/picture-50.jpg v220>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a34:[<0x200000019e7/picture-50.jpg v753>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.999 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.726+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a29 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-54.jpg auth v759 ap=1 s=36671 n(v0 rc2024-04-26T20:25:26.815112+0000 b36671 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aaae7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a29:[<0x200000019e7/picture-54.jpg v196>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a29:[<0x200000019e7/picture-54.jpg v759>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.999 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.727+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a30 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-51.jpg auth v605 ap=1 s=50726 n(v0 rc2024-04-26T20:25:26.870111+0000 b50726 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aaa87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a30:[<0x200000019e7/picture-51.jpg v214>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a30:[<0x200000019e7/picture-51.jpg v605>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.999 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.727+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a47 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-46.jpg auth v643 ap=1 s=52638 n(v0 rc2024-04-26T20:25:27.245103+0000 b52638 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aab48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a47:[<0x200000019e7/picture-46.jpg v244>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a47:[<0x200000019e7/picture-46.jpg v643>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:20.999 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.727+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a70 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-29.jpg auth v763 ap=1 s=64992 n(v0 rc2024-04-26T20:25:27.811092+0000 b64992 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aaae8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a70:[<0x200000019e7/picture-29.jpg v346>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a70:[<0x200000019e7/picture-29.jpg v763>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.000 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.728+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-5.jpg auth{0=1} v671 ap=1 s=61402 n(v0 rc2024-04-26T20:25:28.061087+0000 b61402 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aafa7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa1:[<0x200000019e7/picture-5.jpg v490>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa1:[<0x200000019e7/picture-5.jpg v671>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.000 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.728+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aa5 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-3.jpg auth{0=1} v665 ap=1 s=31630 n(v0 rc2024-04-26T20:25:28.071087+0000 b31630 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a9994b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001aa5:[<0x200000019e7/picture-3.jpg v502>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001aa5:[<0x200000019e7/picture-3.jpg v665>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.000 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.728+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a95 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-11.jpg auth{0=1} v683 ap=1 s=47192 n(v0 rc2024-04-26T20:25:28.008088+0000 b47192 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a95a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a95:[<0x200000019e7/picture-11.jpg v454>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a95:[<0x200000019e7/picture-11.jpg v683>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.006 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.729+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a59 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-40.jpg auth v755 ap=1 s=19128 n(v0 rc2024-04-26T20:25:27.680095+0000 b19128 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aadfb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a59:[<0x200000019e7/picture-40.jpg v280>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a59:[<0x200000019e7/picture-40.jpg v755>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.007 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.731+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019f1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-22.xml auth{0=1} v719 ap=1 s=21458 n(v0 rc2024-04-26T20:25:26.637115+0000 b21458 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aadfc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019f1:[<0x200000019e7/article-22.xml v28>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019f1:[<0x200000019e7/article-22.xml v719>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.007 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.734+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a27 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-55.jpg auth v629 ap=1 s=49090 n(v0 rc2024-04-26T20:25:26.807112+0000 b49090 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a95a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a27:[<0x200000019e7/picture-55.jpg v190>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a27:[<0x200000019e7/picture-55.jpg v629>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.007 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.735+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a13 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-5.xml auth{0=1} v627 ap=1 s=2925 n(v0 rc2024-04-26T20:25:26.717114+0000 b2925 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a95a3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a13:[<0x200000019e7/article-5.xml v130>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a13:[<0x200000019e7/article-5.xml v627>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.007 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.736+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a21 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-58.jpg auth v765 ap=1 s=65298 n(v0 rc2024-04-26T20:25:26.781112+0000 b65298 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aafa4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a21:[<0x200000019e7/picture-58.jpg v172>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a21:[<0x200000019e7/picture-58.jpg v765>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.741+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a7c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-23.jpg auth{0=1} v721 ap=1 s=40893 n(v0 rc2024-04-26T20:25:27.894091+0000 b40893 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a81e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a7c:[<0x200000019e7/picture-23.jpg v382>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a7c:[<0x200000019e7/picture-23.jpg v721>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.742+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a01 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-14.xml auth{0=1} v693 ap=1 s=16703 n(v0 rc2024-04-26T20:25:26.669115+0000 b16703 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a81e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a01:[<0x200000019e7/article-14.xml v76>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a01:[<0x200000019e7/article-14.xml v693>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.743+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a4c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-45.jpg auth v767 ap=1 s=16835 n(v0 rc2024-04-26T20:25:27.297102+0000 b16835 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a81e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a4c:[<0x200000019e7/picture-45.jpg v250>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a4c:[<0x200000019e7/picture-45.jpg v767>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.745+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a57 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-41.jpg auth v741 ap=1 s=52098 n(v0 rc2024-04-26T20:25:27.661095+0000 b52098 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a81e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a57:[<0x200000019e7/picture-41.jpg v274>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a57:[<0x200000019e7/picture-41.jpg v741>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.746+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a1d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-60.jpg auth v625 ap=1 s=51835 n(v0 rc2024-04-26T20:25:26.765113+0000 b51835 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a9425700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a1d:[<0x200000019e7/picture-60.jpg v160>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a1d:[<0x200000019e7/picture-60.jpg v625>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.747+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-46.xml auth v814 ap=1 s=31111 n(v0 rc2024-04-26T20:27:33.429638+0000 b31111 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a9423080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000010b3:[<0x200000019e7/article-46.xml v814>,<0x10000000971/blog-39 v108633>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000010b3:[<0x200000019e7/article-46.xml v814>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.748+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a7e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-22.jpg auth{0=1} v717 ap=1 s=28727 n(v0 rc2024-04-26T20:25:27.910090+0000 b28727 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aadf7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a7e:[<0x200000019e7/picture-22.jpg v388>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a7e:[<0x200000019e7/picture-22.jpg v717>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.018 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.751+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a07 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-11.xml auth{0=1} v685 ap=1 s=18298 n(v0 rc2024-04-26T20:25:26.682114+0000 b18298 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aadf6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a07:[<0x200000019e7/article-11.xml v94>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a07:[<0x200000019e7/article-11.xml v685>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.019 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.753+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-97.jpg auth v792 ap=1 s=65217 n(v0 rc2024-04-26T20:26:04.023385+0000 b65217 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aadf4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000098e:[<0x200000019e7/picture-97.jpg v780>,<0x10000000971/blog-39 v84749>,<0x100000007e0/blogtest_in v894>,<0x100000007d9/src v1695>,<0x100000005e3/blogbench-1.0 v1476>,<0x100000005e2/tmp v71>,<0x100000001fb/client.0 v71>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v74>,<0x10000000001/sv_1 v98>,<0x10000000000/qa v87>,<0x1/volumes v84>]//[3]","memoryvalue":"(4)0x1000000098e:[<0x200000019e7/picture-97.jpg v792>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.019 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.754+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019fd [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-16.xml auth{0=1} v699 ap=1 s=11601 n(v0 rc2024-04-26T20:25:26.662115+0000 b11601 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ab3fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019fd:[<0x200000019e7/article-16.xml v64>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019fd:[<0x200000019e7/article-16.xml v699>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.021 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.756+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019e9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-26.xml auth{0=1} v735 ap=1 s=9615 n(v0 rc2024-04-26T20:25:26.613116+0000 b9615 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ab3f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019e9:[<0x200000019e7/article-26.xml v4>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019e9:[<0x200000019e7/article-26.xml v735>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.757+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a8c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-15.jpg auth{0=1} v695 ap=1 s=51422 n(v0 rc2024-04-26T20:25:27.979089+0000 b51422 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ab3fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a8c:[<0x200000019e7/picture-15.jpg v430>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a8c:[<0x200000019e7/picture-15.jpg v695>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.758+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a25 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-56.jpg auth v645 ap=1 s=14637 n(v0 rc2024-04-26T20:25:26.797112+0000 b14637 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a8528580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a25:[<0x200000019e7/picture-56.jpg v184>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a25:[<0x200000019e7/picture-56.jpg v645>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.759+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a42 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-47.jpg auth v769 ap=1 s=63973 n(v0 rc2024-04-26T20:25:27.191104+0000 b63973 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aba08b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a42:[<0x200000019e7/picture-47.jpg v238>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a42:[<0x200000019e7/picture-47.jpg v769>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.760+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a09 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-10.xml auth{0=1} v619 ap=1 s=31652 n(v0 rc2024-04-26T20:25:26.687114+0000 b31652 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aba09b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a09:[<0x200000019e7/article-10.xml v100>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a09:[<0x200000019e7/article-10.xml v619>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.761+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a93 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-12.jpg auth{0=1} v687 ap=1 s=44697 n(v0 rc2024-04-26T20:25:27.997089+0000 b44697 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a865d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a93:[<0x200000019e7/picture-12.jpg v448>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a93:[<0x200000019e7/picture-12.jpg v687>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.762+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a50 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-44.jpg auth v761 ap=1 s=19863 n(v0 rc2024-04-26T20:25:27.375101+0000 b19863 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642a865a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a50:[<0x200000019e7/picture-44.jpg v256>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a50:[<0x200000019e7/picture-44.jpg v761>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.763+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a15 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-4.xml auth{0=1} v669 ap=1 s=11825 n(v0 rc2024-04-26T20:25:26.724113+0000 b11825 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a865ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a15:[<0x200000019e7/article-4.xml v136>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a15:[<0x200000019e7/article-4.xml v669>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.765+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019eb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-25.xml auth{0=1} v731 ap=1 s=13523 n(v0 rc2024-04-26T20:25:26.618116+0000 b13523 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abbeec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019eb:[<0x200000019e7/article-25.xml v10>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019eb:[<0x200000019e7/article-25.xml v731>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.022 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.766+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a1f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-59.jpg auth v747 ap=1 s=43851 n(v0 rc2024-04-26T20:25:26.773113+0000 b43851 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abbecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a1f:[<0x200000019e7/picture-59.jpg v166>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a1f:[<0x200000019e7/picture-59.jpg v747>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.767+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a80 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-21.jpg auth{0=1} v713 ap=1 s=45200 n(v0 rc2024-04-26T20:25:27.925090+0000 b45200 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abbec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a80:[<0x200000019e7/picture-21.jpg v394>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a80:[<0x200000019e7/picture-21.jpg v713>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.771+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a6d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-30.jpg auth v623 ap=1 s=43770 n(v0 rc2024-04-26T20:25:27.803092+0000 b43770 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abbed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a6d:[<0x200000019e7/picture-30.jpg v340>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a6d:[<0x200000019e7/picture-30.jpg v623>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.773+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019ff [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-15.xml auth{0=1} v697 ap=1 s=28725 n(v0 rc2024-04-26T20:25:26.665115+0000 b28725 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abbef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019ff:[<0x200000019e7/article-15.xml v70>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019ff:[<0x200000019e7/article-15.xml v697>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.774+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a61 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-36.jpg auth v771 ap=1 s=11165 n(v0 rc2024-04-26T20:25:27.719094+0000 b11165 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abbed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a61:[<0x200000019e7/picture-36.jpg v304>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a61:[<0x200000019e7/picture-36.jpg v771>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.776+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019f7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-19.xml auth{0=1} v655 ap=1 s=14165 n(v0 rc2024-04-26T20:25:26.651115+0000 b14165 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac02a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019f7:[<0x200000019e7/article-19.xml v46>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019f7:[<0x200000019e7/article-19.xml v655>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.778+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a53 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-43.jpg auth v613 ap=1 s=51337 n(v0 rc2024-04-26T20:25:27.620096+0000 b51337 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abbec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a53:[<0x200000019e7/picture-43.jpg v262>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a53:[<0x200000019e7/picture-43.jpg v613>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.781+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a82 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-20.jpg auth{0=1} v709 ap=1 s=55655 n(v0 rc2024-04-26T20:25:27.937090+0000 b55655 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aafcd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a82:[<0x200000019e7/picture-20.jpg v400>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a82:[<0x200000019e7/picture-20.jpg v709>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.786+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a5d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-38.jpg auth v775 ap=1 s=56287 n(v0 rc2024-04-26T20:25:27.704094+0000 b56287 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642aafcb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a5d:[<0x200000019e7/picture-38.jpg v292>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a5d:[<0x200000019e7/picture-38.jpg v775>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.787+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a74 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-27.jpg auth{0=1} v737 ap=1 s=40032 n(v0 rc2024-04-26T20:25:27.839092+0000 b40032 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642aafcc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a74:[<0x200000019e7/picture-27.jpg v358>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a74:[<0x200000019e7/picture-27.jpg v737>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.037 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.788+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a05 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-12.xml auth{0=1} v651 ap=1 s=1969 n(v0 rc2024-04-26T20:25:26.677114+0000 b1969 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abe62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a05:[<0x200000019e7/article-12.xml v88>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a05:[<0x200000019e7/article-12.xml v651>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.789+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a2d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-52.jpg auth v637 ap=1 s=20169 n(v0 rc2024-04-26T20:25:26.840111+0000 b20169 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abe61b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a2d:[<0x200000019e7/picture-52.jpg v208>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a2d:[<0x200000019e7/picture-52.jpg v637>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.790+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a1b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-1.xml auth{0=1} v661 ap=1 s=22750 n(v0 rc2024-04-26T20:25:26.750113+0000 b22750 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642abc46b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a1b:[<0x200000019e7/article-1.xml v154>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a1b:[<0x200000019e7/article-1.xml v661>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.790+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-34.jpg auth v812 ap=1 s=55578 n(v0 rc2024-04-26T20:27:33.422638+0000 b55578 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abc48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000010b1:[<0x200000019e7/picture-34.jpg v812>,<0x10000000971/blog-39 v108633>,<0x100000007e0/blogtest_in v1734>,<0x100000007d9/src v1715>,<0x100000005e3/blogbench-1.0 v1496>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v91>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v94>,<0x10000000001/sv_1 v118>,<0x10000000000/qa v107>,<0x1/volumes v104>]//[3]","memoryvalue":"(4)0x100000010b1:[<0x200000019e7/picture-34.jpg v812>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.792+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a2b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-53.jpg auth v647 ap=1 s=14611 n(v0 rc2024-04-26T20:25:26.823112+0000 b14611 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642abc47080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a2b:[<0x200000019e7/picture-53.jpg v202>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a2b:[<0x200000019e7/picture-53.jpg v647>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.792+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a8a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-16.jpg auth{0=1} v649 ap=1 s=46029 n(v0 rc2024-04-26T20:25:27.966089+0000 b46029 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ab0c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a8a:[<0x200000019e7/picture-16.jpg v424>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a8a:[<0x200000019e7/picture-16.jpg v649>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.792+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019ef [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-23.xml auth{0=1} v723 ap=1 s=27826 n(v0 rc2024-04-26T20:25:26.631115+0000 b27826 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a97a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019ef:[<0x200000019e7/article-23.xml v22>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019ef:[<0x200000019e7/article-23.xml v723>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.793+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000019fb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-17.xml auth{0=1} v611 ap=1 s=7175 n(v0 rc2024-04-26T20:25:26.658115+0000 b7175 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a97a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000019fb:[<0x200000019e7/article-17.xml v58>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x200000019fb:[<0x200000019e7/article-17.xml v611>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.043 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.793+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a69 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-32.jpg auth v749 ap=1 s=63801 n(v0 rc2024-04-26T20:25:27.775093+0000 b63801 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642ab0bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a69:[<0x200000019e7/picture-32.jpg v328>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a69:[<0x200000019e7/picture-32.jpg v749>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.044 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:20.798+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001a3b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-48.jpg auth v773 ap=1 s=20436 n(v0 rc2024-04-26T20:25:27.094106+0000 b20436 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5642ab0bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000001a3b:[<0x200000019e7/picture-48.jpg v232>,<0x10000000971/blog-39 v47669>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x20000001a3b:[<0x200000019e7/picture-48.jpg v773>,<0x10000000971/blog-39 v109724>,<0x100000007e0/blogtest_in v1940>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000359 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000601 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x40000000211 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000c33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000009f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x40000000496 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000921 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-76.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x300000001fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000049c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000004f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000503 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x30000000ef2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000004a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000ba2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-36.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000054f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x3000000048c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000039c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x3000000028b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000c5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x3000000021b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000006a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000061a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000096d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:20 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000034e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000359 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000601 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x40000000211 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000c33 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000009f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x40000000496 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000921 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-76.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x300000001fe (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000049c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000004f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000503 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x30000000ef2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000004a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000ba2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-36.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000054f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x3000000048c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000039c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x3000000028b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000c5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x3000000021b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000006a0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000061a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000096d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:21.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:20 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000034e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a91 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-13.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-18.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-18.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a84 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-19.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-4.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-35.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-2.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019f5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a8f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-14.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a9d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-7.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a99 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-9.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a97 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-10.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-1.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-9.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a9f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-6.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-24.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a72 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-28.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-37.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-17.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-3.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a7a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-24.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-33.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-57.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-7.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-42.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-39.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a78 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a9b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a76 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000098f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a34 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-50.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a30 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-51.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-46.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-5.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001aa5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-3.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a95 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-11.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-40.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-22.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-55.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-5.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-58.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a7c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-23.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a4c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-45.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-41.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-60.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-46.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a7e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-22.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-11.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x1000000098e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-97.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-16.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-26.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a8c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-15.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-56.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a42 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-47.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-10.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a93 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-12.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-44.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-25.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-59.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a80 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-21.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-30.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-15.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-36.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-43.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a82 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-20.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-38.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a74 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-27.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-12.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.202 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-52.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-1.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-34.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-53.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a8a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-16.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-23.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000019fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-17.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-32.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000001a3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-48.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:21 smithi082 ceph-mon[28105]: pgmap v578: 129 pgs: 129 active+clean; 904 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.57k op/s 2024-04-26T20:28:22.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-04-26T20:28:22.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:28:22.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a91 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-13.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-18.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-18.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a84 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-19.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-4.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-35.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-2.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019f5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a8f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-14.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a9d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-7.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a99 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-9.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a97 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-10.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-1.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-9.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a9f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-6.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-24.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a72 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-28.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-37.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-17.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-3.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a7a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-24.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-33.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-57.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-7.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-42.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-39.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a78 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a9b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a76 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000098f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a34 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-50.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a30 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-51.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-46.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-5.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001aa5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-3.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a95 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-11.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-40.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-22.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-55.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-5.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-58.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a7c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-23.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a4c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-45.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-41.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-60.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-46.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a7e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-22.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-11.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x1000000098e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-97.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-16.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-26.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a8c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-15.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-56.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.327 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a42 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-47.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-10.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a93 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-12.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-44.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-25.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-59.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a80 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-21.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-30.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-15.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-36.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-43.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.328 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a82 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-20.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-38.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a74 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-27.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-12.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-52.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-1.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-34.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-53.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a8a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-16.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-23.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000019fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-17.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-32.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000001a3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-48.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.329 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:21 smithi139 ceph-mon[32999]: pgmap v578: 129 pgs: 129 active+clean; 904 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.57k op/s 2024-04-26T20:28:22.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-04-26T20:28:22.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:28:22.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a91 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-13.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a87 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-18.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-18.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a84 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-19.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-4.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a63 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-35.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-2.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019f5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a8f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-14.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a9d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-7.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a99 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-9.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a97 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-10.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-1.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a0b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-9.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a9f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-6.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-24.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a72 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-28.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a5f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-37.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a89 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-17.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a17 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-3.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a7a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-24.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a67 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-33.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a23 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-57.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a0f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-7.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a55 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-42.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a5b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-39.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.375 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a78 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a0d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a37 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a9b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a76 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.376 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019f3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000098f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a11 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a03 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a19 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a34 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-50.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.377 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a29 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a30 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-51.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a47 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-46.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a70 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-5.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001aa5 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-3.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a95 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-11.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a59 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-40.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019f1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-22.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a27 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-55.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a13 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-5.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a21 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-58.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a7c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-23.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a01 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a4c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-45.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a57 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-41.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a1d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-60.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.380 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-46.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a7e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-22.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a07 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-11.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x1000000098e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-97.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019fd (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-16.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019e9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-26.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.381 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a8c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-15.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-56.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a42 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-47.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a09 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-10.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a93 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-12.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a50 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-44.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a15 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019eb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-25.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a1f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-59.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a80 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-21.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a6d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-30.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019ff (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-15.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a61 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-36.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019f7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a53 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-43.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a82 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-20.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a5d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-38.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a74 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-27.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-12.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a2d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-52.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a1b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-1.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-34.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a2b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-53.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a8a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-16.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019ef (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-23.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000019fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-17.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a69 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-32.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000001a3b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-48.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:22.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:21 smithi135 ceph-mon[32816]: pgmap v578: 129 pgs: 129 active+clean; 904 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.57k op/s 2024-04-26T20:28:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:22 smithi082 ceph-mon[28105]: pgmap v579: 129 pgs: 129 active+clean; 899 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.1 MiB/s wr, 1.26k op/s 2024-04-26T20:28:23.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:22 smithi139 ceph-mon[32999]: pgmap v579: 129 pgs: 129 active+clean; 899 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.1 MiB/s wr, 1.26k op/s 2024-04-26T20:28:23.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:22 smithi135 ceph-mon[32816]: pgmap v579: 129 pgs: 129 active+clean; 899 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.1 MiB/s wr, 1.26k op/s 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.355+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005f8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg auth v1158 ap=1 s=50545 n(v0 rc2024-04-26T20:24:52.135790+0000 b50545 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a880d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005f8:[<0x200000001f7/picture-13.jpg v1158>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005f8:[<0x200000001f7/picture-13.jpg v1158>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.355+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000256 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml auth v1004 ap=1 s=4640 n(v0 rc2024-04-26T20:24:47.145888+0000 b4640 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8089180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000256:[<0x200000001f7/article-59.xml v1004>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000256:[<0x200000001f7/article-59.xml v1004>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.355+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bd7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml auth v1332 ap=1 s=8659 n(v0 rc2024-04-26T20:25:00.768621+0000 b8659 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7fb4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bd7:[<0x200000001f7/comment-56.xml v1332>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bd7:[<0x200000001f7/comment-56.xml v1332>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.356+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005d2 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg auth v1154 ap=1 s=17161 n(v0 rc2024-04-26T20:24:52.021792+0000 b17161 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a86d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005d2:[<0x200000001f7/picture-18.jpg v1154>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005d2:[<0x200000001f7/picture-18.jpg v1154>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.356+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000229 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml auth v1310 ap=1 s=26706 n(v0 rc2024-04-26T20:24:47.073889+0000 b26706 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7e4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000229:[<0x200000001f7/article-74.xml v1310>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000229:[<0x200000001f7/article-74.xml v1310>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.356+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002c9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml auth v990 ap=1 s=21393 n(v0 rc2024-04-26T20:24:47.488881+0000 b21393 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8312b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002c9:[<0x200000001f7/article-18.xml v990>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002c9:[<0x200000001f7/article-18.xml v990>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.356+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000204 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml auth{0=1,2=1} v1391 ap=1 s=3204 n(v0 rc2024-04-26T20:25:15.102341+0000 b3204 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642a7d94100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x30000000204:[<0x200000001f7/comment-5.xml v1391>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x30000000204:[<0x200000001f7/comment-5.xml v1391>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.698 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.356+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000026e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml auth v1002 ap=1 s=31229 n(v0 rc2024-04-26T20:24:47.185887+0000 b31229 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8222000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000026e:[<0x200000001f7/article-51.xml v1002>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000026e:[<0x200000001f7/article-51.xml v1002>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.699 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.357+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c2c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml auth v1330 ap=1 s=27135 n(v0 rc2024-04-26T20:25:02.004597+0000 b27135 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8104c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000c2c:[<0x200000001f7/article-27.xml v1330>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000c2c:[<0x200000001f7/article-27.xml v1330>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.699 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.357+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005cf [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg auth v1156 ap=1 s=13823 n(v0 rc2024-04-26T20:24:51.996793+0000 b13823 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a86d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005cf:[<0x200000001f7/picture-19.jpg v1156>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005cf:[<0x200000001f7/picture-19.jpg v1156>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.699 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.357+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000063f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg auth v1308 ap=1 s=32641 n(v0 rc2024-04-26T20:24:52.909775+0000 b32641 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a9a9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000063f:[<0x200000001f7/picture-4.jpg v1308>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000063f:[<0x200000001f7/picture-4.jpg v1308>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.702 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.358+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c25 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml auth v1334 ap=1 s=7009 n(v0 rc2024-04-26T20:25:01.847600+0000 b7009 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8102580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000c25:[<0x200000001f7/comment-29.xml v1334>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000c25:[<0x200000001f7/comment-29.xml v1334>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.702 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.358+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000064d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg auth v1312 ap=1 s=47890 n(v0 rc2024-04-26T20:24:52.951774+0000 b47890 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a990b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000064d:[<0x200000001f7/picture-2.jpg v1312>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000064d:[<0x200000001f7/picture-2.jpg v1312>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.702 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.358+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000043a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg auth v1018 ap=1 s=44271 n(v0 rc2024-04-26T20:24:49.376844+0000 b44271 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a81a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000043a:[<0x200000001f7/picture-35.jpg v1018>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000043a:[<0x200000001f7/picture-35.jpg v1018>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.702 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.358+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000235 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml auth v1012 ap=1 s=12981 n(v0 rc2024-04-26T20:24:47.092889+0000 b12981 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7f58000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000235:[<0x200000001f7/article-70.xml v1012>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000235:[<0x200000001f7/article-70.xml v1012>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.702 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.358+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002c4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml auth v992 ap=1 s=3897 n(v0 rc2024-04-26T20:24:47.446882+0000 b3897 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a837cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002c4:[<0x200000001f7/article-20.xml v992>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002c4:[<0x200000001f7/article-20.xml v992>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.706 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.359+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005ee [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg auth v1162 ap=1 s=48047 n(v0 rc2024-04-26T20:24:52.110790+0000 b48047 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7dc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005ee:[<0x200000001f7/picture-14.jpg v1162>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005ee:[<0x200000001f7/picture-14.jpg v1162>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.706 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.359+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000020e [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml auth v1016 ap=1 s=19632 n(v0 rc2024-04-26T20:24:47.027890+0000 b19632 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7d79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000020e:[<0x200000001f7/article-83.xml v1016>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000020e:[<0x200000001f7/article-83.xml v1016>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.706 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.359+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000694 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml auth{0=1,2=1} v1409 ap=1 s=1209 n(v0 rc2024-04-26T20:27:15.621986+0000 b1209 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac095180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x30000000694:[<0x200000001f7/article-61.xml v1409>,<0x10000000971/blog-2 v111907>,<0x100000007e0/blogtest_in v1589>,<0x100000007d9/src v1709>,<0x100000005e3/blogbench-1.0 v1490>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v85>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v88>,<0x10000000001/sv_1 v112>,<0x10000000000/qa v101>,<0x1/volumes v98>]//[3]","memoryvalue":"(4)0x30000000694:[<0x200000001f7/article-61.xml v1409>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.706 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.359+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000028c [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml auth v998 ap=1 s=7793 n(v0 rc2024-04-26T20:24:47.237886+0000 b7793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a834ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000028c:[<0x200000001f7/article-41.xml v998>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000028c:[<0x200000001f7/article-41.xml v998>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.709 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.362+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000280 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml auth v1000 ap=1 s=19599 n(v0 rc2024-04-26T20:24:47.216886+0000 b19599 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a82a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000280:[<0x200000001f7/article-45.xml v1000>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000280:[<0x200000001f7/article-45.xml v1000>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.709 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.362+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b6b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml auth v1328 ap=1 s=10236 n(v0 rc2024-04-26T20:25:00.203632+0000 b10236 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a6bc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000b6b:[<0x200000001f7/comment-92.xml v1328>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000b6b:[<0x200000001f7/comment-92.xml v1328>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.710 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.362+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000237 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml auth v1010 ap=1 s=3538 n(v0 rc2024-04-26T20:24:47.097889+0000 b3538 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7f58b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000237:[<0x200000001f7/article-69.xml v1010>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000237:[<0x200000001f7/article-69.xml v1010>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.710 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.362+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b65 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml auth v1326 ap=1 s=4802 n(v0 rc2024-04-26T20:25:00.175633+0000 b4802 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8e4c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000b65:[<0x200000001f7/comment-94.xml v1326>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000b65:[<0x200000001f7/comment-94.xml v1326>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.710 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.363+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000031a [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg auth v1006 ap=1 s=64591 n(v0 rc2024-04-26T20:24:47.953872+0000 b64591 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7eba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000031a:[<0x200000001f7/picture-61.jpg v1006>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000031a:[<0x200000001f7/picture-61.jpg v1006>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.713 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.368+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000629 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg auth v1302 ap=1 s=15849 n(v0 rc2024-04-26T20:24:52.857776+0000 b15849 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a98f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000629:[<0x200000001f7/picture-7.jpg v1302>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000629:[<0x200000001f7/picture-7.jpg v1302>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.713 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.368+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002a6 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml auth v996 ap=1 s=10782 n(v0 rc2024-04-26T20:24:47.285885+0000 b10782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7c07080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002a6:[<0x200000001f7/article-31.xml v996>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002a6:[<0x200000001f7/article-31.xml v996>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.755 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.368+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000619 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg auth v1306 ap=1 s=59586 n(v0 rc2024-04-26T20:24:52.816777+0000 b59586 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a98c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000619:[<0x200000001f7/picture-9.jpg v1306>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000619:[<0x200000001f7/picture-9.jpg v1306>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.755 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.369+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000110d [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml auth{0=1,3=1} v1345 ap=1 s=9870 n(v0 rc2024-04-26T20:25:12.053400+0000 b9870 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac092b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000110d:[<0x200000001f7/comment-11.xml v1345>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000110d:[<0x200000001f7/comment-11.xml v1345>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.755 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.369+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000000 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml auth{2=1} v1347 ap=1 s=2917 n(v0 rc2024-04-26T20:25:04.460549+0000 b2917 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1},l=25436 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8ecb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x30000000000:[<0x200000001f7/comment-20.xml v1347>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x30000000000:[<0x200000001f7/comment-20.xml v1347>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.755 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.369+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000262 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml auth v1013 ap=1 s=22499 n(v0 rc2024-04-26T20:24:47.165887+0000 b22499 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8117700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000262:[<0x200000001f7/article-55.xml v1013>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000262:[<0x200000001f7/article-55.xml v1013>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.755 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.369+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005bc [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg auth v1152 ap=1 s=31527 n(v0 rc2024-04-26T20:24:51.859795+0000 b31527 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a79f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005bc:[<0x200000001f7/picture-25.jpg v1152>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005bc:[<0x200000001f7/picture-25.jpg v1152>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.370+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bea [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml auth v1344 ap=1 s=2404 n(v0 rc2024-04-26T20:25:00.828620+0000 b2404 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7a41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bea:[<0x200000001f7/comment-47.xml v1344>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bea:[<0x200000001f7/comment-47.xml v1344>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.370+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005a9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg auth v1156 ap=1 s=54829 n(v0 rc2024-04-26T20:24:51.748798+0000 b54829 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8720b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005a9:[<0x200000001f7/picture-31.jpg v1156>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005a9:[<0x200000001f7/picture-31.jpg v1156>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.370+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002e8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml auth v1001 ap=1 s=22208 n(v0 rc2024-04-26T20:24:47.676877+0000 b22208 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7ab0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002e8:[<0x200000001f7/article-8.xml v1001>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002e8:[<0x200000001f7/article-8.xml v1001>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.371+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bec [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml auth v1346 ap=1 s=7256 n(v0 rc2024-04-26T20:25:00.833620+0000 b7256 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7a42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bec:[<0x200000001f7/comment-46.xml v1346>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bec:[<0x200000001f7/comment-46.xml v1346>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.371+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000023b [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml auth v1019 ap=1 s=13792 n(v0 rc2024-04-26T20:24:47.102888+0000 b13792 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7f5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000023b:[<0x200000001f7/article-68.xml v1019>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000023b:[<0x200000001f7/article-68.xml v1019>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.371+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml auth v1342 ap=1 s=4941 n(v0 rc2024-04-26T20:25:00.595624+0000 b4941 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8c23700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bb7:[<0x200000001f7/comment-70.xml v1342>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bb7:[<0x200000001f7/comment-70.xml v1342>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.371+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000398 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg auth v1023 ap=1 s=38035 n(v0 rc2024-04-26T20:24:48.556860+0000 b38035 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8711180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000398:[<0x200000001f7/picture-49.jpg v1023>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000398:[<0x200000001f7/picture-49.jpg v1023>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.373+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b88 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml auth v1338 ap=1 s=3413 n(v0 rc2024-04-26T20:25:00.416628+0000 b3413 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7a84680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000b88:[<0x200000001f7/comment-83.xml v1338>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000b88:[<0x200000001f7/comment-83.xml v1338>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.373+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005b9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg auth v1154 ap=1 s=25007 n(v0 rc2024-04-26T20:24:51.840796+0000 b25007 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a79f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005b9:[<0x200000001f7/picture-26.jpg v1154>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005b9:[<0x200000001f7/picture-26.jpg v1154>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.373+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000623 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg auth v1277 ap=1 s=46726 n(v0 rc2024-04-26T20:24:52.842776+0000 b46726 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a98f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000623:[<0x200000001f7/picture-8.jpg v1277>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000623:[<0x200000001f7/picture-8.jpg v1277>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.374+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002a4 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml auth v1009 ap=1 s=21595 n(v0 rc2024-04-26T20:24:47.281885+0000 b21595 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8451700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002a4:[<0x200000001f7/article-32.xml v1009>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002a4:[<0x200000001f7/article-32.xml v1009>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.374+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml auth v1354 ap=1 s=6101 n(v0 rc2024-04-26T20:25:00.603624+0000 b6101 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7d9e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bb9:[<0x200000001f7/comment-69.xml v1354>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bb9:[<0x200000001f7/comment-69.xml v1354>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.756 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.374+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002c1 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml auth v1005 ap=1 s=20964 n(v0 rc2024-04-26T20:24:47.423882+0000 b20964 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a837bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002c1:[<0x200000001f7/article-21.xml v1005>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002c1:[<0x200000001f7/article-21.xml v1005>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.374+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bae [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml auth v1334 ap=1 s=6900 n(v0 rc2024-04-26T20:25:00.557625+0000 b6900 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8c20580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bae:[<0x200000001f7/comment-74.xml v1334>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bae:[<0x200000001f7/comment-74.xml v1334>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.374+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b73 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml auth v1336 ap=1 s=5927 n(v0 rc2024-04-26T20:25:00.253631+0000 b5927 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a6bc5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000b73:[<0x200000001f7/comment-89.xml v1336>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000b73:[<0x200000001f7/comment-89.xml v1336>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.375+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c05 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml auth v1352 ap=1 s=2776 n(v0 rc2024-04-26T20:25:00.967617+0000 b2776 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8147080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000c05:[<0x200000001f7/comment-36.xml v1352>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000c05:[<0x200000001f7/comment-36.xml v1352>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.375+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002d9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml auth v1003 ap=1 s=32559 n(v0 rc2024-04-26T20:24:47.585879+0000 b32559 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7cb8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002d9:[<0x200000001f7/article-13.xml v1003>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002d9:[<0x200000001f7/article-13.xml v1003>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.375+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bc7 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml auth v1348 ap=1 s=9763 n(v0 rc2024-04-26T20:25:00.671623+0000 b9763 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7ccd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bc7:[<0x200000001f7/comment-64.xml v1348>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bc7:[<0x200000001f7/comment-64.xml v1348>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.375+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002a8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml auth v1007 ap=1 s=4866 n(v0 rc2024-04-26T20:24:47.292885+0000 b4866 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8466580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002a8:[<0x200000001f7/article-30.xml v1007>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002a8:[<0x200000001f7/article-30.xml v1007>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.375+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb3 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml auth v1332 ap=1 s=8098 n(v0 rc2024-04-26T20:25:00.580625+0000 b8098 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8c22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bb3:[<0x200000001f7/comment-72.xml v1332>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bb3:[<0x200000001f7/comment-72.xml v1332>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.377+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000271 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml auth v1011 ap=1 s=21136 n(v0 rc2024-04-26T20:24:47.190887+0000 b21136 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8223080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000271:[<0x200000001f7/article-50.xml v1011>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000271:[<0x200000001f7/article-50.xml v1011>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.377+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b71 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml auth v1340 ap=1 s=5728 n(v0 rc2024-04-26T20:25:00.237631+0000 b5728 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a6bc4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000b71:[<0x200000001f7/comment-90.xml v1340>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000b71:[<0x200000001f7/comment-90.xml v1340>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.377+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002ed [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml auth v999 ap=1 s=11085 n(v0 rc2024-04-26T20:24:47.710877+0000 b11085 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7ab1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002ed:[<0x200000001f7/article-6.xml v999>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002ed:[<0x200000001f7/article-6.xml v999>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.757 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.378+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000002f9 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml auth v997 ap=1 s=25978 n(v0 rc2024-04-26T20:24:47.774875+0000 b25978 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a82d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000002f9:[<0x200000001f7/article-2.xml v997>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000002f9:[<0x200000001f7/article-2.xml v997>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.758 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.378+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000205 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml auth{0=1,2=1} v1394 ap=1 s=2772 n(v0 rc2024-04-26T20:25:23.879169+0000 b2772 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25436 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5642ac092580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x30000000205:[<0x200000001f7/comment-4.xml v1394>,<0x10000000971/blog-2 v51637>,<0x100000007e0/blogtest_in v556>,<0x100000007d9/src v1687>,<0x100000005e3/blogbench-1.0 v1468>,<0x100000005e2/tmp v63>,<0x100000001fb/client.0 v63>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v66>,<0x10000000001/sv_1 v90>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[3]","memoryvalue":"(4)0x30000000205:[<0x200000001f7/comment-4.xml v1394>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.758 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.378+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x300000001fb [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml auth{2=1} v1371 ap=1 s=6370 n(v0 rc2024-04-26T20:25:07.339492+0000 b6370 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1},l=25436 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8a9f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x300000001fb:[<0x200000001f7/comment-14.xml v1371>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x300000001fb:[<0x200000001f7/comment-14.xml v1371>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.758 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.379+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bbf [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml auth v1350 ap=1 s=7726 n(v0 rc2024-04-26T20:25:00.626624+0000 b7726 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7da0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000bbf:[<0x200000001f7/comment-67.xml v1350>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000bbf:[<0x200000001f7/comment-67.xml v1350>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.772 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.379+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000357 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg auth v1017 ap=1 s=29373 n(v0 rc2024-04-26T20:24:48.312865+0000 b29373 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25436=0-4194304@1} caps={25436=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8610580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000357:[<0x200000001f7/picture-54.jpg v1017>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x20000000357:[<0x200000001f7/picture-54.jpg v1017>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.772 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.379+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000001f8 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-90.xml auth v995 ap=1 s=1234 n(v0 rc2024-04-26T20:24:46.991891+0000 b1234 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a7d33080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000001f8:[<0x200000001f7/article-90.xml v995>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000001f8:[<0x200000001f7/article-90.xml v995>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.772 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.379+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000005b0 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg auth v1158 ap=1 s=48043 n(v0 rc2024-04-26T20:24:51.787797+0000 b48043 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8723180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x200000005b0:[<0x200000001f7/picture-29.jpg v1158>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x200000005b0:[<0x200000001f7/picture-29.jpg v1158>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.773 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.380+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000001 [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml auth{2=1} v1369 ap=1 s=7694 n(v0 rc2024-04-26T20:25:04.685544+0000 b7694 1=1+0) caps={25436=pAsLsXsFscr/pFscr@1},l=25436 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8c5b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x30000000001:[<0x200000001f7/comment-19.xml v1369>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x30000000001:[<0x200000001f7/comment-19.xml v1369>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:23.773 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:28:23.380+0000 7f1092000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000025f [2,head] /volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml auth v1015 ap=1 s=28899 n(v0 rc2024-04-26T20:24:47.160887+0000 b28899 1=1+0) (ifile excl) cr={25436=0-4194304@1} caps={25436=pAsLsXsFsxcrwb/pFscr@1},l=25436 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5642a8116680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x2000000025f:[<0x200000001f7/article-56.xml v1015>,<0x10000000971/blog-2 v32165>,<0x100000007e0/blogtest_in v479>,<0x100000007d9/src v1685>,<0x100000005e3/blogbench-1.0 v1466>,<0x100000005e2/tmp v61>,<0x100000001fb/client.0 v61>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[3]","memoryvalue":"(4)0x2000000025f:[<0x200000001f7/article-56.xml v1015>,<0x10000000971/blog-2 v120870>,<0x100000007e0/blogtest_in v1948>,<0x100000007d9/src v1723>,<0x100000005e3/blogbench-1.0 v1453>,<0x100000005e2/tmp v97>,<0x100000001fb/client.0 v53>,<0x100000001fa/1fbfe3b6-e9b5-4d30-8621-0c14b6565def v53>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v64>,<0x1/volumes v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:28:24.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000256 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bd7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005d2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000229 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002c9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x30000000204 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000026e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000c2c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005cf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000063f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000c25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000064d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000043a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000235 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000020e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x30000000694 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000028c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000280 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000b6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000237 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000b65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000031a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000629 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000619 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000110d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x30000000000 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000262 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005a9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000023b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bb7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000398 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000b88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000623 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002a4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bb9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002c1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000b73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000c05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bc7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bb3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000271 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000b71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000002f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x30000000205 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x300000001fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000bbf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x20000000357 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000001f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-90.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x200000005b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x30000000001 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:23 smithi082 ceph-mon[28105]: Scrub error on inode 0x2000000025f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000256 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bd7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005d2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000229 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002c9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x30000000204 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000026e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000c2c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005cf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000063f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000c25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000064d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000043a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000235 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000020e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x30000000694 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000028c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000280 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000b6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000237 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000b65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000031a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000629 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000619 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000110d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x30000000000 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.323 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000262 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005a9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000023b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bb7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000398 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000b88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000623 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002a4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bb9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002c1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.324 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000b73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000c05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bc7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bb3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000271 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000b71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000002f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x30000000205 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x300000001fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.325 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000bbf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x20000000357 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000001f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-90.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x200000005b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x30000000001 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.326 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:23 smithi139 ceph-mon[32999]: Scrub error on inode 0x2000000025f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000256 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bd7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005d2 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000229 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002c9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x30000000204 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000026e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000c2c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005cf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000063f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000c25 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000064d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000043a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000235 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002c4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005ee (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000020e (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x30000000694 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000028c (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000280 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000b6b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000237 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000b65 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000031a (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000629 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002a6 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000619 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000110d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x30000000000 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000262 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005bc (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bea (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.371 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005a9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002e8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bec (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000023b (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bb7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000398 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000b88 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005b9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000623 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002a4 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bb9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002c1 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bae (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000b73 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000c05 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002d9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bc7 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002a8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bb3 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000271 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.373 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000b71 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002ed (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000002f9 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x30000000205 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x300000001fb (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000bbf (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x20000000357 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000001f8 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-90.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x200000005b0 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x30000000001 (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:24.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:23 smithi135 ceph-mon[32816]: Scrub error on inode 0x2000000025f (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml) see mds.g log and `damage ls` output for details 2024-04-26T20:28:25.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:24 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:28:24.903+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:25.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:24 smithi082 ceph-mon[28105]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:25.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:24 smithi082 ceph-mon[28105]: pgmap v580: 129 pgs: 129 active+clean; 892 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 898 op/s 2024-04-26T20:28:25.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:24 smithi139 ceph-mon[32999]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:24 smithi139 ceph-mon[32999]: pgmap v580: 129 pgs: 129 active+clean; 892 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 898 op/s 2024-04-26T20:28:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:24 smithi135 ceph-mon[32816]: scrub summary: idle+waiting paths [/] 2024-04-26T20:28:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:24 smithi135 ceph-mon[32816]: pgmap v580: 129 pgs: 129 active+clean; 892 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 898 op/s 2024-04-26T20:28:26.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:25 smithi082 ceph-mon[28105]: Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:26.206 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:25 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:active 2024-04-26T20:28:26.207 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:25 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:25 smithi139 ceph-mon[32999]: Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:25 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:active 2024-04-26T20:28:26.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:25 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:26.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:25 smithi135 ceph-mon[32816]: Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T20:28:26.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:25 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] up:active 2024-04-26T20:28:26.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:25 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:27.085 INFO:tasks.workunit.client.0.smithi082.stdout: 258 528286 1068 360884 722 181066 1043 2024-04-26T20:28:27.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:26 smithi082 ceph-mon[28105]: pgmap v581: 129 pgs: 129 active+clean; 895 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 832 op/s 2024-04-26T20:28:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:26 smithi139 ceph-mon[32999]: pgmap v581: 129 pgs: 129 active+clean; 895 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 832 op/s 2024-04-26T20:28:27.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:26 smithi135 ceph-mon[32816]: pgmap v581: 129 pgs: 129 active+clean; 895 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 832 op/s 2024-04-26T20:28:30.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:29 smithi082 ceph-mon[28105]: pgmap v582: 129 pgs: 129 active+clean; 899 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 570 op/s 2024-04-26T20:28:30.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:29 smithi139 ceph-mon[32999]: pgmap v582: 129 pgs: 129 active+clean; 899 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 570 op/s 2024-04-26T20:28:30.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:29 smithi135 ceph-mon[32816]: pgmap v582: 129 pgs: 129 active+clean; 899 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 570 op/s 2024-04-26T20:28:32.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:31 smithi082 ceph-mon[28105]: pgmap v583: 129 pgs: 129 active+clean; 913 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 438 op/s 2024-04-26T20:28:32.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:31 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:28:32.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:31 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:28:32.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:31 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:28:32.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:31 smithi139 ceph-mon[32999]: pgmap v583: 129 pgs: 129 active+clean; 913 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 438 op/s 2024-04-26T20:28:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:31 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:28:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:31 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:28:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:31 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:28:32.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:31 smithi135 ceph-mon[32816]: pgmap v583: 129 pgs: 129 active+clean; 913 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 438 op/s 2024-04-26T20:28:32.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:31 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:28:32.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:31 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:28:32.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:31 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:28:33.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:32 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:28:33.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:32 smithi082 ceph-mon[28105]: scrub summary: idle 2024-04-26T20:28:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:32 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:28:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:32 smithi139 ceph-mon[32999]: scrub summary: idle 2024-04-26T20:28:33.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:32 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:28:33.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:32 smithi135 ceph-mon[32816]: scrub summary: idle 2024-04-26T20:28:34.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:33 smithi082 ceph-mon[28105]: pgmap v584: 129 pgs: 129 active+clean; 951 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.0 MiB/s wr, 463 op/s 2024-04-26T20:28:34.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:33 smithi139 ceph-mon[32999]: pgmap v584: 129 pgs: 129 active+clean; 951 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.0 MiB/s wr, 463 op/s 2024-04-26T20:28:34.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:33 smithi135 ceph-mon[32816]: pgmap v584: 129 pgs: 129 active+clean; 951 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.0 MiB/s wr, 463 op/s 2024-04-26T20:28:35.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:34 smithi082 ceph-mon[28105]: pgmap v585: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 411 op/s 2024-04-26T20:28:35.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:34 smithi139 ceph-mon[32999]: pgmap v585: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 411 op/s 2024-04-26T20:28:35.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:34 smithi135 ceph-mon[32816]: pgmap v585: 129 pgs: 129 active+clean; 958 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 411 op/s 2024-04-26T20:28:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.507+0000 7fcaae000640 1 -- 172.21.15.82:0/3402476219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa810a900 msgr2=0x7fcaa810f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.507+0000 7fcaae000640 1 --2- 172.21.15.82:0/3402476219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa810a900 0x7fcaa810f270 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009be0 tx=0x7fcaa002a710 comp rx=0 tx=0).stop 2024-04-26T20:28:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.524+0000 7fcaae000640 1 -- 172.21.15.82:0/3402476219 shutdown_connections 2024-04-26T20:28:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.524+0000 7fcaae000640 1 --2- 172.21.15.82:0/3402476219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa810a900 0x7fcaa810f270 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.524+0000 7fcaae000640 1 --2- 172.21.15.82:0/3402476219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8109f40 0x7fcaa810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.524+0000 7fcaae000640 1 --2- 172.21.15.82:0/3402476219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa8073c60 0x7fcaa8074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.524+0000 7fcaae000640 1 -- 172.21.15.82:0/3402476219 >> 172.21.15.82:0/3402476219 conn(0x7fcaa806f7d0 msgr2=0x7fcaa8071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.561+0000 7fcaae000640 1 -- 172.21.15.82:0/3402476219 shutdown_connections 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.570+0000 7fcaae000640 1 -- 172.21.15.82:0/3402476219 wait complete. 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.572+0000 7fcaae000640 1 Processor -- start 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.579+0000 7fcaae000640 1 -- start start 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.580+0000 7fcaae000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8073c60 0x7fcaa81a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.581+0000 7fcaae000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa8109f40 0x7fcaa81a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.582+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8073c60 0x7fcaa81a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.582+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8073c60 0x7fcaa81a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39278/0 (socket says 172.21.15.82:39278) 2024-04-26T20:28:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.582+0000 7fcaacc00640 1 -- 172.21.15.82:0/3021026078 learned_addr learned my addr 172.21.15.82:0/3021026078 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.582+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa8109f40 0x7fcaa81a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.582+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa810a900 0x7fcaa807ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.583+0000 7fcaad600640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa810a900 0x7fcaa807ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.583+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa811d0d0 con 0x7fcaa8109f40 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.583+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa811cf50 con 0x7fcaa810a900 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.583+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa811d250 con 0x7fcaa8073c60 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.584+0000 7fcaad600640 1 -- 172.21.15.82:0/3021026078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8073c60 msgr2=0x7fcaa81a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.584+0000 7fcaad600640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8073c60 0x7fcaa81a77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.584+0000 7fcaad600640 1 -- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa8109f40 msgr2=0x7fcaa81a7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.584+0000 7fcaad600640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa8109f40 0x7fcaa81a7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.584+0000 7fcaad600640 1 -- 172.21.15.82:0/3021026078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa807b200 con 0x7fcaa810a900 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.585+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa8109f40 0x7fcaa81a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:28:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.585+0000 7fcaad600640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa810a900 0x7fcaa807ab90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009b30 tx=0x7fcaa0031650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.611+0000 7fcaa5600640 1 -- 172.21.15.82:0/3021026078 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0041020 con 0x7fcaa810a900 2024-04-26T20:28:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.611+0000 7fcaa5600640 1 -- 172.21.15.82:0/3021026078 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaa0031940 con 0x7fcaa810a900 2024-04-26T20:28:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.611+0000 7fcaa5600640 1 -- 172.21.15.82:0/3021026078 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0036040 con 0x7fcaa810a900 2024-04-26T20:28:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.644+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa807b490 con 0x7fcaa810a900 2024-04-26T20:28:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.644+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa807b900 con 0x7fcaa810a900 2024-04-26T20:28:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.745+0000 7fcaa5600640 1 -- 172.21.15.82:0/3021026078 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcaa0044020 con 0x7fcaa810a900 2024-04-26T20:28:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.749+0000 7fcaa5600640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca8c0a3e40 0x7fca8c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.749+0000 7fcaa5600640 1 -- 172.21.15.82:0/3021026078 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fcaa00f1330 con 0x7fcaa810a900 2024-04-26T20:28:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.759+0000 7fcab2416740 1 Processor -- start 2024-04-26T20:28:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.760+0000 7fcab2416740 1 -- start start 2024-04-26T20:28:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcab2416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c98eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcab2416740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c98f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcab2416740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c98f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcab2416740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5622c984f380 con 0x5622c98f0920 2024-04-26T20:28:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcab2416740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5622c97ebc30 con 0x5622c98eb7b0 2024-04-26T20:28:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcab2416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5622c984b340 con 0x5622c98eadc0 2024-04-26T20:28:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.761+0000 7fcaacc00640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca8c0a3e40 0x7fca8c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.763+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c98eb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.763+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c98eb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39288/0 (socket says 172.21.15.82:39288) 2024-04-26T20:28:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.763+0000 7fcaacc00640 1 -- 172.21.15.82:0/3195744178 learned_addr learned my addr 172.21.15.82:0/3195744178 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.766+0000 7fcaacc00640 1 -- 172.21.15.82:0/3195744178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 msgr2=0x5622c98f02b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:36.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.766+0000 7fcaacc00640 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c98f02b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.766+0000 7fcaacc00640 1 -- 172.21.15.82:0/3195744178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 msgr2=0x5622c98f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.766+0000 7fcaacc00640 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c98f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.766+0000 7fcaacc00640 1 -- 172.21.15.82:0/3195744178 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c980d940 con 0x5622c98eadc0 2024-04-26T20:28:36.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.772+0000 7fcaacc00640 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c98eb1e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fca98012800 tx=0x7fca98012cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da55bdf8fd02c56c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.780+0000 7fca9dc00640 1 -- 172.21.15.82:0/3195744178 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9800fce0 con 0x5622c98eadc0 2024-04-26T20:28:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.780+0000 7fca9dc00640 1 -- 172.21.15.82:0/3195744178 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9801d8c0 con 0x5622c98eadc0 2024-04-26T20:28:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.780+0000 7fca9dc00640 1 -- 172.21.15.82:0/3195744178 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98010780 con 0x5622c98eadc0 2024-04-26T20:28:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.785+0000 7fcaacc00640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca8c0a3e40 0x7fca8c0a6300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca98022000 tx=0x7fca98010b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.790+0000 7fcab2416740 1 -- 172.21.15.82:0/3195744178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 msgr2=0x5622c98eb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:36.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.795+0000 7fcab2416740 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c98eb1e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fca98012800 tx=0x7fca98012cc0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.827+0000 7fcab2416740 1 -- 172.21.15.82:0/3195744178 shutdown_connections 2024-04-26T20:28:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.827+0000 7fcab2416740 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c98f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.827+0000 7fcab2416740 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c98f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.827+0000 7fcab2416740 1 --2- 172.21.15.82:0/3195744178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c98eb1e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.827+0000 7fcab2416740 1 -- 172.21.15.82:0/3195744178 >> 172.21.15.82:0/3195744178 conn(0x5622c98e6430 msgr2=0x5622c98e6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.858+0000 7fcab2416740 1 -- 172.21.15.82:0/3195744178 shutdown_connections 2024-04-26T20:28:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.860+0000 7fcab2416740 1 -- 172.21.15.82:0/3195744178 wait complete. 2024-04-26T20:28:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.861+0000 7fcab2416740 1 -- start start 2024-04-26T20:28:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.861+0000 7fcab2416740 1 Processor -- start 2024-04-26T20:28:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.873+0000 7fcab2416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c99060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.873+0000 7fcab2416740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c99065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.873+0000 7fcab2416740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c990d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.873+0000 7fcab2416740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5622c99048e0 con 0x5622c98f0920 2024-04-26T20:28:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.873+0000 7fcab2416740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5622c97d6c60 con 0x5622c98eb7b0 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.873+0000 7fcab2416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5622c9904a60 con 0x5622c98eadc0 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.874+0000 7fcab2416740 10 client.0 _ll_register_callbacks cb 0x5622c9802e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.874+0000 7fcaa7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c99065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.874+0000 7fcaa7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c99065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:37826/0 (socket says 172.21.15.82:37826) 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.874+0000 7fcaa7e00640 1 -- 172.21.15.82:0/484792372 learned_addr learned my addr 172.21.15.82:0/484792372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.875+0000 7fcaa7e00640 1 -- 172.21.15.82:0/484792372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 msgr2=0x5622c99060a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.877+0000 7fcaad600640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c990d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.877+0000 7fcaacc00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c99060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.878+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c99060a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.878+0000 7fcaa7e00640 1 -- 172.21.15.82:0/484792372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 msgr2=0x5622c990d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.878+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c990d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.878+0000 7fcaa7e00640 1 -- 172.21.15.82:0/484792372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c97e5510 con 0x5622c98eb7b0 2024-04-26T20:28:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.880+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c99065e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca94005fd0 tx=0x7fca94011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54047480911de0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.892+0000 7fcaacc00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c99060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:28:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.933+0000 7fca92000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:28:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.933+0000 7fca92000640 1 -- 172.21.15.82:0/484792372 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94004300 con 0x5622c98eb7b0 2024-04-26T20:28:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.933+0000 7fca92000640 1 -- 172.21.15.82:0/484792372 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fca9400f920 con 0x5622c98eb7b0 2024-04-26T20:28:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.965+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca9801d8c0 con 0x5622c98eb7b0 2024-04-26T20:28:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.981+0000 7fca92000640 1 -- 172.21.15.82:0/484792372 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fca940044a0 con 0x5622c98eb7b0 2024-04-26T20:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.995+0000 7fcab2416740 10 client.26798 fetch_fsmap learned FSMap version 42 2024-04-26T20:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:36.995+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5622c9561210 con 0x5622c98eb7b0 2024-04-26T20:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fca92000640 1 -- 172.21.15.82:0/484792372 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9801d8c0 con 0x5622c98eb7b0 2024-04-26T20:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fca92000640 1 -- 172.21.15.82:0/484792372 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fca94019410 con 0x5622c98eb7b0 2024-04-26T20:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fcab2416740 10 client.26798 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T20:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fcab2416740 10 client.26798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fcab2416740 20 client.26798 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fcab2416740 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c99120a0 0x5622c9914500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fcab2416740 4 client.26798 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.009+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622c985cf90 con 0x5622c99120a0 2024-04-26T20:28:37.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.053+0000 7fcaacc00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c99120a0 0x5622c9914500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.090+0000 7fcaacc00640 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c99120a0 0x5622c9914500 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e05037a7e43ea4 server_cookie=f7b2f49e2ceba188 in_seq=0 out_seq=0 2024-04-26T20:28:37.095 INFO:tasks.workunit.client.0.smithi082.stdout: 269 447584 642 300247 529 152202 407 2024-04-26T20:28:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.098+0000 7fca92000640 10 client.26798 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.098+0000 7fca92000640 1 -- 172.21.15.82:0/484792372 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5622c985cf90 con 0x5622c99120a0 2024-04-26T20:28:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.098+0000 7fca92000640 10 client.26798 handle_command_reply: tid=0 2024-04-26T20:28:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.099+0000 7fcab2416740 1 client.26798 shutdown 2024-04-26T20:28:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.182+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 msgr2=0x5622c99065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.182+0000 7fcab2416740 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c99065e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca94005fd0 tx=0x7fca94011d90 comp rx=0 tx=0).stop 2024-04-26T20:28:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.226+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 shutdown_connections 2024-04-26T20:28:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.227+0000 7fcab2416740 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c99120a0 0x5622c9914500 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.227+0000 7fcab2416740 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98f0920 0x5622c990d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.227+0000 7fcab2416740 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c99065e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.227+0000 7fcab2416740 1 --2- 172.21.15.82:0/484792372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c99060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.227+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 >> 172.21.15.82:0/484792372 conn(0x5622c98e6430 msgr2=0x5622c98e5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.245+0000 7fca92000640 0 client.26798 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.245+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 shutdown_connections 2024-04-26T20:28:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.246+0000 7fcab2416740 1 -- 172.21.15.82:0/484792372 wait complete. 2024-04-26T20:28:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.252+0000 7fcab2416740 20 client.26798 trim_cache size 0 max 16384 2024-04-26T20:28:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.805+0000 7fcab2416740 1 Processor -- start 2024-04-26T20:28:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.814+0000 7fcab2416740 1 -- start start 2024-04-26T20:28:37.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcab2416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 0x5622c99060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcab2416740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98eadc0 0x5622c99065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcab2416740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c990d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcab2416740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa807d650 con 0x5622c98eadc0 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcab2416740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa807f310 con 0x5622c98eb7b0 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcab2416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa807dd20 con 0x5622c98e6430 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 0x5622c99060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 0x5622c99060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39304/0 (socket says 172.21.15.82:39304) 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.815+0000 7fcaacc00640 1 -- 172.21.15.82:0/2525308573 learned_addr learned my addr 172.21.15.82:0/2525308573 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.816+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98eadc0 0x5622c99065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.817+0000 7fcaacc00640 1 -- 172.21.15.82:0/2525308573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 msgr2=0x5622c990d540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.817+0000 7fcaacc00640 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c990d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.817+0000 7fcaacc00640 1 -- 172.21.15.82:0/2525308573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98eadc0 msgr2=0x5622c99065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.817+0000 7fcaacc00640 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98eadc0 0x5622c99065e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.817+0000 7fcaacc00640 1 -- 172.21.15.82:0/2525308573 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c962d620 con 0x5622c98e6430 2024-04-26T20:28:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.820+0000 7fcaacc00640 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 0x5622c99060a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fca9800f730 tx=0x7fca98029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f3862e2c0eaa70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.848+0000 7fca9d200640 1 -- 172.21.15.82:0/2525308573 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9802f040 con 0x5622c98e6430 2024-04-26T20:28:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.848+0000 7fca9d200640 1 -- 172.21.15.82:0/2525308573 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9800b7e0 con 0x5622c98e6430 2024-04-26T20:28:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.848+0000 7fca9d200640 1 -- 172.21.15.82:0/2525308573 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca980107c0 con 0x5622c98e6430 2024-04-26T20:28:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.865+0000 7fcab2416740 1 -- 172.21.15.82:0/2525308573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 msgr2=0x5622c99060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.865+0000 7fcab2416740 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 0x5622c99060a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fca9800f730 tx=0x7fca98029000 comp rx=0 tx=0).stop 2024-04-26T20:28:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.883+0000 7fcab2416740 1 -- 172.21.15.82:0/2525308573 shutdown_connections 2024-04-26T20:28:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.883+0000 7fcab2416740 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c990d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.883+0000 7fcab2416740 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98eadc0 0x5622c99065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.883+0000 7fcab2416740 1 --2- 172.21.15.82:0/2525308573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98e6430 0x5622c99060a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.883+0000 7fcab2416740 1 -- 172.21.15.82:0/2525308573 >> 172.21.15.82:0/2525308573 conn(0x5622c98f03f0 msgr2=0x5622c98eca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.892+0000 7fcab2416740 1 -- 172.21.15.82:0/2525308573 shutdown_connections 2024-04-26T20:28:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.892+0000 7fcab2416740 1 -- 172.21.15.82:0/2525308573 wait complete. 2024-04-26T20:28:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.892+0000 7fcab2416740 1 -- start start 2024-04-26T20:28:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.893+0000 7fcab2416740 1 Processor -- start 2024-04-26T20:28:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.899+0000 7fcab2416740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 0x5622c990a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.901+0000 7fcab2416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c990a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.901+0000 7fcab2416740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c9976630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.901+0000 7fcaa7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c990a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.901+0000 7fcaa7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c990a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39320/0 (socket says 172.21.15.82:39320) 2024-04-26T20:28:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.902+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 0x5622c990a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.902+0000 7fcaacc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 0x5622c990a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32948/0 (socket says 172.21.15.82:32948) 2024-04-26T20:28:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.907+0000 7fcaa7e00640 1 -- 172.21.15.82:0/667060622 learned_addr learned my addr 172.21.15.82:0/667060622 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.907+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa807eb80 con 0x5622c98e6430 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.907+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa807e3f0 con 0x5622c98eb7b0 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.907+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa81192b0 con 0x5622c98eadc0 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.908+0000 7fcaacc00640 1 -- 172.21.15.82:0/667060622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 msgr2=0x5622c990a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.908+0000 7fcaacc00640 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c990a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.908+0000 7fcaacc00640 1 -- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 msgr2=0x5622c9976630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.908+0000 7fcaacc00640 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c9976630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.908+0000 7fcaacc00640 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c9809cb0 con 0x5622c98e6430 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.908+0000 7fcaacc00640 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 0x5622c990a110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fca980127d0 tx=0x7fca9800bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91daa3010ac7c89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.910+0000 7fcab2416740 10 client.0 _ll_register_callbacks cb 0x7fca94009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.910+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622c9856e00 con 0x5622c98e6430 2024-04-26T20:28:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.944+0000 7fca92000640 10 client.16722 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.944+0000 7fca92000640 1 -- 172.21.15.82:0/667060622 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9802f040 con 0x5622c98e6430 2024-04-26T20:28:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.944+0000 7fca92000640 1 -- 172.21.15.82:0/667060622 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fca98010740 con 0x5622c98e6430 2024-04-26T20:28:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.944+0000 7fca92000640 1 -- 172.21.15.82:0/667060622 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fca98048050 con 0x5622c98e6430 2024-04-26T20:28:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.975+0000 7fcab2416740 10 client.16722 fetch_fsmap learned FSMap version 42 2024-04-26T20:28:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:37.975+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=42}) -- 0x5622c9977580 con 0x5622c98e6430 2024-04-26T20:28:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.031+0000 7fca92000640 1 -- 172.21.15.82:0/667060622 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fca9800fa60 con 0x5622c98e6430 2024-04-26T20:28:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.042+0000 7fcab2416740 10 client.16722 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T20:28:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.042+0000 7fcab2416740 10 client.16722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.042+0000 7fcab2416740 20 client.16722 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.042+0000 7fcab2416740 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c98f0920 0x5622c9979dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.042+0000 7fcab2416740 4 client.16722 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:28:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.042+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5622c97d24b0 con 0x5622c98f0920 2024-04-26T20:28:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.050+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c98f0920 0x5622c9979dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:38.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.055+0000 7fcaa7e00640 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c98f0920 0x5622c9979dc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c91639ac80091c4 server_cookie=8f7536d1f2f1ad66 in_seq=0 out_seq=0 2024-04-26T20:28:38.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:38.055+0000 7fca92000640 10 client.16722 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:38.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:37 smithi082 ceph-mon[28105]: pgmap v586: 129 pgs: 129 active+clean; 989 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.8 MiB/s wr, 543 op/s 2024-04-26T20:28:38.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:37 smithi139 ceph-mon[32999]: pgmap v586: 129 pgs: 129 active+clean; 989 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.8 MiB/s wr, 543 op/s 2024-04-26T20:28:38.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:37 smithi135 ceph-mon[32816]: pgmap v586: 129 pgs: 129 active+clean; 989 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.8 MiB/s wr, 543 op/s 2024-04-26T20:28:39.222 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:38 smithi139 ceph-mon[32999]: pgmap v587: 129 pgs: 129 active+clean; 1013 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 635 op/s 2024-04-26T20:28:39.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:38 smithi135 ceph-mon[32816]: pgmap v587: 129 pgs: 129 active+clean; 1013 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 635 op/s 2024-04-26T20:28:39.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:38 smithi082 ceph-mon[28105]: pgmap v587: 129 pgs: 129 active+clean; 1013 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 635 op/s 2024-04-26T20:28:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.458+0000 7fca92000640 1 -- 172.21.15.82:0/667060622 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622c97d24b0 con 0x5622c98f0920 2024-04-26T20:28:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.458+0000 7fca92000640 10 client.16722 handle_command_reply: tid=0 2024-04-26T20:28:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.464+0000 7fcab2416740 1 client.16722 shutdown 2024-04-26T20:28:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 msgr2=0x5622c990a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 0x5622c990a110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fca980127d0 tx=0x7fca9800bdb0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 shutdown_connections 2024-04-26T20:28:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5622c98f0920 0x5622c9979dc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622c98eb7b0 0x5622c9976630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5622c98eadc0 0x5622c990a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 --2- 172.21.15.82:0/667060622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622c98e6430 0x5622c990a110 secure :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fca980127d0 tx=0x7fca9800bdb0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.496+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 >> 172.21.15.82:0/667060622 conn(0x5622c98f03f0 msgr2=0x5622c9905fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.507+0000 7fca92000640 0 client.16722 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.511+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 shutdown_connections 2024-04-26T20:28:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.511+0000 7fcab2416740 1 -- 172.21.15.82:0/667060622 wait complete. 2024-04-26T20:28:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.514+0000 7fcab2416740 20 client.16722 trim_cache size 0 max 16384 2024-04-26T20:28:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:28:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:28:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:28:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:28:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.565+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca8c0a3e40 msgr2=0x7fca8c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.565+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca8c0a3e40 0x7fca8c0a6300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca98022000 tx=0x7fca98010b40 comp rx=0 tx=0).stop 2024-04-26T20:28:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.565+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa810a900 msgr2=0x7fcaa807ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.565+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa810a900 0x7fcaa807ab90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009b30 tx=0x7fcaa0031650 comp rx=0 tx=0).stop 2024-04-26T20:28:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.569+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 shutdown_connections 2024-04-26T20:28:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.569+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca8c0a3e40 0x7fca8c0a6300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.569+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa810a900 0x7fcaa807ab90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.569+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaa8109f40 0x7fcaa81a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.569+0000 7fcaae000640 1 --2- 172.21.15.82:0/3021026078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8073c60 0x7fcaa81a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.569+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 >> 172.21.15.82:0/3021026078 conn(0x7fcaa806f7d0 msgr2=0x7fcaa80714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.595+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 shutdown_connections 2024-04-26T20:28:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:40.607+0000 7fcaae000640 1 -- 172.21.15.82:0/3021026078 wait complete. 2024-04-26T20:28:42.044 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-mon[32816]: pgmap v588: 129 pgs: 129 active+clean; 1021 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 11 MiB/s wr, 737 op/s 2024-04-26T20:28:42.045 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: src/tcmalloc.cc:332] Attempt to free invalid pointer 0x7faa52da7880 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: *** Caught signal (Aborted) ** 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: in thread 7faa41557700 thread_name:MR_Finisher 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa51115d20] 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2: gsignal() 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 3: abort() 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 4: /lib64/libtcmalloc.so.4(+0x18499) [0x7faa52dd2499] 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 5: /lib64/libtcmalloc.so.4(+0x19d79) [0x7faa52dd3d79] 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 6: /usr/lib64/ceph/libceph-common.so.2(+0x337523) [0x7faa523f3523] 2024-04-26T20:28:42.046 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 7: /usr/lib64/ceph/libceph-common.so.2(+0x337603) [0x7faa523f3603] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 8: (ceph_osd_flag_string[abi:cxx11](unsigned int)+0xc3) [0x7faa528eda73] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 9: (_mosdop::MOSDOp >::print(std::ostream&) const+0x313) [0x55be02be89f3] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 10: (AsyncConnection::send_message(Message*)+0x578) [0x7faa526e1e08] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 11: (Objecter::_send_op(Objecter::Op*)+0x2ab) [0x55be02bc4b1b] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 12: (Objecter::_op_submit(Objecter::Op*, ceph::shunique_lock&, unsigned long*)+0x3bb) [0x55be02bc67cb] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 13: (Objecter::op_submit(Objecter::Op*, unsigned long*, int*)+0xbb) [0x55be02bd376b] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 14: (Filer::_probe(Filer::Probe*, std::unique_lock&)+0x979) [0x55be02ba4179] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 15: (Filer::probe_impl(Filer::Probe*, file_layout_t const*, unsigned long, unsigned long*)+0x87) [0x55be02ba4947] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 16: (Filer::probe(inodeno_t, file_layout_t const*, snapid_t, unsigned long, unsigned long*, std::chrono::time_point > >*, bool, int, Context*)+0x215) [0x55be02ba6815] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 17: (Journaler::_probe(Context*, unsigned long*)+0x262) [0x55be02b70fe2] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 18: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.047 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 19: (Journaler::_finish_reread_head(int, ceph::buffer::v15_2_0::list&, Context*)+0x2e6) [0x55be02b6a286] 2024-04-26T20:28:42.048 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 20: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.048 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 21: (Finisher::finisher_thread_entry()+0x19d) [0x7faa5242de5d] 2024-04-26T20:28:42.048 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 22: /lib64/libpthread.so.0(+0x81ca) [0x7faa5110b1ca] 2024-04-26T20:28:42.048 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 23: clone() 2024-04-26T20:28:42.048 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:41.713+0000 7faa41557700 -1 *** Caught signal (Aborted) ** 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: in thread 7faa41557700 thread_name:MR_Finisher 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa51115d20] 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2: gsignal() 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 3: abort() 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 4: /lib64/libtcmalloc.so.4(+0x18499) [0x7faa52dd2499] 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 5: /lib64/libtcmalloc.so.4(+0x19d79) [0x7faa52dd3d79] 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 6: /usr/lib64/ceph/libceph-common.so.2(+0x337523) [0x7faa523f3523] 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 7: /usr/lib64/ceph/libceph-common.so.2(+0x337603) [0x7faa523f3603] 2024-04-26T20:28:42.049 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 8: (ceph_osd_flag_string[abi:cxx11](unsigned int)+0xc3) [0x7faa528eda73] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 9: (_mosdop::MOSDOp >::print(std::ostream&) const+0x313) [0x55be02be89f3] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 10: (AsyncConnection::send_message(Message*)+0x578) [0x7faa526e1e08] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 11: (Objecter::_send_op(Objecter::Op*)+0x2ab) [0x55be02bc4b1b] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 12: (Objecter::_op_submit(Objecter::Op*, ceph::shunique_lock&, unsigned long*)+0x3bb) [0x55be02bc67cb] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 13: (Objecter::op_submit(Objecter::Op*, unsigned long*, int*)+0xbb) [0x55be02bd376b] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 14: (Filer::_probe(Filer::Probe*, std::unique_lock&)+0x979) [0x55be02ba4179] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 15: (Filer::probe_impl(Filer::Probe*, file_layout_t const*, unsigned long, unsigned long*)+0x87) [0x55be02ba4947] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 16: (Filer::probe(inodeno_t, file_layout_t const*, snapid_t, unsigned long, unsigned long*, std::chrono::time_point > >*, bool, int, Context*)+0x215) [0x55be02ba6815] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 17: (Journaler::_probe(Context*, unsigned long*)+0x262) [0x55be02b70fe2] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 18: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 19: (Journaler::_finish_reread_head(int, ceph::buffer::v15_2_0::list&, Context*)+0x2e6) [0x55be02b6a286] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 20: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.050 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 21: (Finisher::finisher_thread_entry()+0x19d) [0x7faa5242de5d] 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 22: /lib64/libpthread.so.0(+0x81ca) [0x7faa5110b1ca] 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 23: clone() 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 0> 2024-04-26T20:28:41.713+0000 7faa41557700 -1 *** Caught signal (Aborted) ** 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: in thread 7faa41557700 thread_name:MR_Finisher 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa51115d20] 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2: gsignal() 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 3: abort() 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 4: /lib64/libtcmalloc.so.4(+0x18499) [0x7faa52dd2499] 2024-04-26T20:28:42.051 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 5: /lib64/libtcmalloc.so.4(+0x19d79) [0x7faa52dd3d79] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 6: /usr/lib64/ceph/libceph-common.so.2(+0x337523) [0x7faa523f3523] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 7: /usr/lib64/ceph/libceph-common.so.2(+0x337603) [0x7faa523f3603] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 8: (ceph_osd_flag_string[abi:cxx11](unsigned int)+0xc3) [0x7faa528eda73] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 9: (_mosdop::MOSDOp >::print(std::ostream&) const+0x313) [0x55be02be89f3] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 10: (AsyncConnection::send_message(Message*)+0x578) [0x7faa526e1e08] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 11: (Objecter::_send_op(Objecter::Op*)+0x2ab) [0x55be02bc4b1b] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 12: (Objecter::_op_submit(Objecter::Op*, ceph::shunique_lock&, unsigned long*)+0x3bb) [0x55be02bc67cb] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 13: (Objecter::op_submit(Objecter::Op*, unsigned long*, int*)+0xbb) [0x55be02bd376b] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 14: (Filer::_probe(Filer::Probe*, std::unique_lock&)+0x979) [0x55be02ba4179] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 15: (Filer::probe_impl(Filer::Probe*, file_layout_t const*, unsigned long, unsigned long*)+0x87) [0x55be02ba4947] 2024-04-26T20:28:42.052 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 16: (Filer::probe(inodeno_t, file_layout_t const*, snapid_t, unsigned long, unsigned long*, std::chrono::time_point > >*, bool, int, Context*)+0x215) [0x55be02ba6815] 2024-04-26T20:28:42.053 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 17: (Journaler::_probe(Context*, unsigned long*)+0x262) [0x55be02b70fe2] 2024-04-26T20:28:42.053 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 18: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.053 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 19: (Journaler::_finish_reread_head(int, ceph::buffer::v15_2_0::list&, Context*)+0x2e6) [0x55be02b6a286] 2024-04-26T20:28:42.053 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 20: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.053 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 21: (Finisher::finisher_thread_entry()+0x19d) [0x7faa5242de5d] 2024-04-26T20:28:42.053 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 22: /lib64/libpthread.so.0(+0x81ca) [0x7faa5110b1ca] 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 23: clone() 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 0> 2024-04-26T20:28:41.713+0000 7faa41557700 -1 *** Caught signal (Aborted) ** 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: in thread 7faa41557700 thread_name:MR_Finisher 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev) 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faa51115d20] 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2: gsignal() 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 3: abort() 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 4: /lib64/libtcmalloc.so.4(+0x18499) [0x7faa52dd2499] 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 5: /lib64/libtcmalloc.so.4(+0x19d79) [0x7faa52dd3d79] 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 6: /usr/lib64/ceph/libceph-common.so.2(+0x337523) [0x7faa523f3523] 2024-04-26T20:28:42.054 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 7: /usr/lib64/ceph/libceph-common.so.2(+0x337603) [0x7faa523f3603] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 8: (ceph_osd_flag_string[abi:cxx11](unsigned int)+0xc3) [0x7faa528eda73] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 9: (_mosdop::MOSDOp >::print(std::ostream&) const+0x313) [0x55be02be89f3] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 10: (AsyncConnection::send_message(Message*)+0x578) [0x7faa526e1e08] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 11: (Objecter::_send_op(Objecter::Op*)+0x2ab) [0x55be02bc4b1b] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 12: (Objecter::_op_submit(Objecter::Op*, ceph::shunique_lock&, unsigned long*)+0x3bb) [0x55be02bc67cb] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 13: (Objecter::op_submit(Objecter::Op*, unsigned long*, int*)+0xbb) [0x55be02bd376b] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 14: (Filer::_probe(Filer::Probe*, std::unique_lock&)+0x979) [0x55be02ba4179] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 15: (Filer::probe_impl(Filer::Probe*, file_layout_t const*, unsigned long, unsigned long*)+0x87) [0x55be02ba4947] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 16: (Filer::probe(inodeno_t, file_layout_t const*, snapid_t, unsigned long, unsigned long*, std::chrono::time_point > >*, bool, int, Context*)+0x215) [0x55be02ba6815] 2024-04-26T20:28:42.055 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 17: (Journaler::_probe(Context*, unsigned long*)+0x262) [0x55be02b70fe2] 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 18: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 19: (Journaler::_finish_reread_head(int, ceph::buffer::v15_2_0::list&, Context*)+0x2e6) [0x55be02b6a286] 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 20: (Context::complete(int)+0xd) [0x55be0270955d] 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 21: (Finisher::finisher_thread_entry()+0x19d) [0x7faa5242de5d] 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 22: /lib64/libpthread.so.0(+0x81ca) [0x7faa5110b1ca] 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 23: clone() 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[62014]: 2024-04-26T20:28:42.056 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:41 smithi135 podman[65337]: 2024-04-26 20:28:41.77410331 +0000 UTC m=+0.020082111 container died 1c59e136782c3218deb17f11bdea0eb02adeb9755243b75648326a30d4d577a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T20:28:42.147 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:41 smithi082 ceph-mon[28105]: pgmap v588: 129 pgs: 129 active+clean; 1021 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 11 MiB/s wr, 737 op/s 2024-04-26T20:28:42.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:41 smithi139 ceph-mon[32999]: pgmap v588: 129 pgs: 129 active+clean; 1021 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 11 MiB/s wr, 737 op/s 2024-04-26T20:28:42.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:42 smithi135 podman[65337]: 2024-04-26 20:28:42.596431581 +0000 UTC m=+0.842410377 container remove 1c59e136782c3218deb17f11bdea0eb02adeb9755243b75648326a30d4d577a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True) 2024-04-26T20:28:42.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:42 smithi135 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T20:28:42.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:42 smithi135 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T20:28:42.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:42 smithi135 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service: Consumed 7.658s CPU time. 2024-04-26T20:28:43.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-26T20:28:43.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-26T20:28:44.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:43 smithi082 ceph-mon[28105]: pgmap v589: 129 pgs: 129 active+clean; 1024 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 951 op/s 2024-04-26T20:28:44.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:43 smithi139 ceph-mon[32999]: pgmap v589: 129 pgs: 129 active+clean; 1024 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 951 op/s 2024-04-26T20:28:44.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:43 smithi135 ceph-mon[32816]: pgmap v589: 129 pgs: 129 active+clean; 1024 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 951 op/s 2024-04-26T20:28:46.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:45 smithi082 ceph-mon[28105]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.6 MiB/s wr, 809 op/s 2024-04-26T20:28:46.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:45 smithi139 ceph-mon[32999]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.6 MiB/s wr, 809 op/s 2024-04-26T20:28:46.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:45 smithi135 ceph-mon[32816]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.6 MiB/s wr, 809 op/s 2024-04-26T20:28:47.096 INFO:tasks.workunit.client.0.smithi082.stdout: 292 554859 1386 375576 854 179018 747 2024-04-26T20:28:47.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.368+0000 7f03f0a00640 1 -- 172.21.15.82:0/1952243716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec073d70 msgr2=0x7f03ec074190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:47.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.368+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1952243716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec073d70 0x7f03ec074190 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009860 tx=0x7f03dc02a360 comp rx=0 tx=0).stop 2024-04-26T20:28:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.400+0000 7f03f0a00640 1 -- 172.21.15.82:0/1952243716 shutdown_connections 2024-04-26T20:28:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.400+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1952243716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec10f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.400+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1952243716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03ec10a010 0x7f03ec10a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.400+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1952243716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec073d70 0x7f03ec074190 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.400+0000 7f03f0a00640 1 -- 172.21.15.82:0/1952243716 >> 172.21.15.82:0/1952243716 conn(0x7f03ec06f840 msgr2=0x7f03ec071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:47.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.408+0000 7f03f0a00640 1 -- 172.21.15.82:0/1952243716 shutdown_connections 2024-04-26T20:28:47.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.412+0000 7f03f0a00640 1 -- 172.21.15.82:0/1952243716 wait complete. 2024-04-26T20:28:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.414+0000 7f03f0a00640 1 Processor -- start 2024-04-26T20:28:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.414+0000 7f03f0a00640 1 -- start start 2024-04-26T20:28:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03ec073d70 0x7f03ec19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec10a010 0x7f03ec19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec1a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03f0a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec112b20 con 0x7f03ec10a010 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03f0a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1129a0 con 0x7f03ec10a9b0 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03f0a00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec112ca0 con 0x7f03ec073d70 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec1a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec1a66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41528/0 (socket says 172.21.15.82:41528) 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.438+0000 7f03eb200640 1 -- 172.21.15.82:0/1709010923 learned_addr learned my addr 172.21.15.82:0/1709010923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.439+0000 7f03ea800640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03ec073d70 0x7f03ec19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.440+0000 7f03eb200640 1 -- 172.21.15.82:0/1709010923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03ec073d70 msgr2=0x7f03ec19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.440+0000 7f03eb200640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03ec073d70 0x7f03ec19f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.440+0000 7f03eb200640 1 -- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec10a010 msgr2=0x7f03ec19f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.440+0000 7f03eb200640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec10a010 0x7f03ec19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.440+0000 7f03eb200640 1 -- 172.21.15.82:0/1709010923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec1a6d30 con 0x7f03ec10a9b0 2024-04-26T20:28:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.449+0000 7f03eb200640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec1a66c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f03e400b970 tx=0x7f03e400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.461+0000 7f03e3400640 1 -- 172.21.15.82:0/1709010923 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4019070 con 0x7f03ec10a9b0 2024-04-26T20:28:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.462+0000 7f03e3400640 1 -- 172.21.15.82:0/1709010923 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03e4014440 con 0x7f03ec10a9b0 2024-04-26T20:28:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.462+0000 7f03e3400640 1 -- 172.21.15.82:0/1709010923 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4007630 con 0x7f03ec10a9b0 2024-04-26T20:28:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.469+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec1a6fc0 con 0x7f03ec10a9b0 2024-04-26T20:28:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.469+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec1a7490 con 0x7f03ec10a9b0 2024-04-26T20:28:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.531+0000 7f03e3400640 1 -- 172.21.15.82:0/1709010923 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f03e40145f0 con 0x7f03ec10a9b0 2024-04-26T20:28:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.535+0000 7f03f4209740 1 Processor -- start 2024-04-26T20:28:47.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.548+0000 7f03e3400640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f03d00a3e40 0x7f03d00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.548+0000 7f03e3400640 1 -- 172.21.15.82:0/1709010923 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f03e40cfbf0 con 0x7f03ec10a9b0 2024-04-26T20:28:47.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.557+0000 7f03ea800640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f03d00a3e40 0x7f03d00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.561+0000 7f03ea800640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f03d00a3e40 0x7f03d00a6300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f03dc02a950 tx=0x7f03dc030340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 -- start start 2024-04-26T20:28:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b88102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b88107e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b8810a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562b88013030 con 0x562b88103350 2024-04-26T20:28:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b8802e7f0 con 0x562b881084c0 2024-04-26T20:28:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.575+0000 7f03f4209740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b87fe97e0 con 0x562b88102960 2024-04-26T20:28:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b88102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b88102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47538/0 (socket says 172.21.15.82:47538) 2024-04-26T20:28:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 -- 172.21.15.82:0/2203137239 learned_addr learned my addr 172.21.15.82:0/2203137239 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 -- 172.21.15.82:0/2203137239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 msgr2=0x562b8810a950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:28:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b8810a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 -- 172.21.15.82:0/2203137239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 msgr2=0x562b88107e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b88107e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.576+0000 7f03ea800640 1 -- 172.21.15.82:0/2203137239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b87ff5050 con 0x562b88102960 2024-04-26T20:28:47.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.577+0000 7f03ea800640 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b88102d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009860 tx=0x7f03dc03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c987deeacb1dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.590+0000 7f03d7400640 1 -- 172.21.15.82:0/2203137239 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc043070 con 0x562b88102960 2024-04-26T20:28:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.591+0000 7f03d7400640 1 -- 172.21.15.82:0/2203137239 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03dc04f070 con 0x562b88102960 2024-04-26T20:28:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.591+0000 7f03d7400640 1 -- 172.21.15.82:0/2203137239 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc037050 con 0x562b88102960 2024-04-26T20:28:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.592+0000 7f03f4209740 1 -- 172.21.15.82:0/2203137239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 msgr2=0x562b88102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.592+0000 7f03f4209740 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b88102d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009860 tx=0x7f03dc03d000 comp rx=0 tx=0).stop 2024-04-26T20:28:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.618+0000 7f03f4209740 1 -- 172.21.15.82:0/2203137239 shutdown_connections 2024-04-26T20:28:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.618+0000 7f03f4209740 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b8810a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.618+0000 7f03f4209740 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b88107e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.618+0000 7f03f4209740 1 --2- 172.21.15.82:0/2203137239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b88102d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.618+0000 7f03f4209740 1 -- 172.21.15.82:0/2203137239 >> 172.21.15.82:0/2203137239 conn(0x562b880fdfd0 msgr2=0x562b880fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.620+0000 7f03f4209740 1 -- 172.21.15.82:0/2203137239 shutdown_connections 2024-04-26T20:28:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.621+0000 7f03f4209740 1 -- 172.21.15.82:0/2203137239 wait complete. 2024-04-26T20:28:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.621+0000 7f03f4209740 1 -- start start 2024-04-26T20:28:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.622+0000 7f03f4209740 1 Processor -- start 2024-04-26T20:28:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.624+0000 7f03f4209740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b8810c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.628+0000 7f03f4209740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b8810ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.628+0000 7f03ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b8810c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.628+0000 7f03ea800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b8810c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47552/0 (socket says 172.21.15.82:47552) 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.629+0000 7f03e9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b8810ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.629+0000 7f03e9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b8810ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52934/0 (socket says 172.21.15.82:52934) 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.629+0000 7f03e9e00640 1 -- 172.21.15.82:0/3824322616 learned_addr learned my addr 172.21.15.82:0/3824322616 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.629+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b88113d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.631+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562b8806b200 con 0x562b88103350 2024-04-26T20:28:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.631+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b88065ee0 con 0x562b881084c0 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.631+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b88072e70 con 0x562b88102960 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.631+0000 7f03eb200640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b88113d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.632+0000 7f03e9e00640 1 -- 172.21.15.82:0/3824322616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 msgr2=0x562b8810c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.632+0000 7f03e9e00640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b8810c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.632+0000 7f03e9e00640 1 -- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 msgr2=0x562b88113d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.632+0000 7f03e9e00640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b88113d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.632+0000 7f03e9e00640 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b87e427d0 con 0x562b88103350 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.633+0000 7f03e9e00640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b8810ccc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f03d801af80 tx=0x7f03d801f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16ad01cf1613f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.633+0000 7f03ea800640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b8810c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.633+0000 7f03f4209740 10 client.0 _ll_register_callbacks cb 0x562b8805c270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.634+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03dc04f070 con 0x562b88103350 2024-04-26T20:28:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.657+0000 7f03cbe00640 10 client.16728 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.657+0000 7f03cbe00640 1 -- 172.21.15.82:0/3824322616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8004020 con 0x562b88103350 2024-04-26T20:28:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.657+0000 7f03cbe00640 1 -- 172.21.15.82:0/3824322616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f03d80041c0 con 0x562b88103350 2024-04-26T20:28:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.657+0000 7f03cbe00640 1 -- 172.21.15.82:0/3824322616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f03d80043c0 con 0x562b88103350 2024-04-26T20:28:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.666+0000 7f03f4209740 10 client.16728 fetch_fsmap learned FSMap version 42 2024-04-26T20:28:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.667+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=42}) -- 0x562b87d783f0 con 0x562b88103350 2024-04-26T20:28:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03cbe00640 1 -- 172.21.15.82:0/3824322616 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f03d8005020 con 0x562b88103350 2024-04-26T20:28:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03f4209740 10 client.16728 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T20:28:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03f4209740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03f4209740 20 client.16728 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b88118080 0x562b8811a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03f4209740 4 client.16728 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.670+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b880747e0 con 0x562b88118080 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.671+0000 7f03ea800640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b88118080 0x562b8811a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.671+0000 7f03ea800640 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b88118080 0x562b8811a540 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcef0d5bf0f3c62d server_cookie=8a373163323c48ef in_seq=0 out_seq=0 2024-04-26T20:28:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.672+0000 7f03cbe00640 10 client.16728 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.672+0000 7f03cbe00640 1 -- 172.21.15.82:0/3824322616 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562b880747e0 con 0x562b88118080 2024-04-26T20:28:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.672+0000 7f03cbe00640 10 client.16728 handle_command_reply: tid=0 2024-04-26T20:28:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.672+0000 7f03f4209740 1 client.16728 shutdown 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 msgr2=0x562b8810ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b8810ccc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f03d801af80 tx=0x7f03d801f7f0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 shutdown_connections 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b88118080 0x562b8811a540 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b881084c0 0x562b88113d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b88103350 0x562b8810ccc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 --2- 172.21.15.82:0/3824322616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b8810c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.673+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 >> 172.21.15.82:0/3824322616 conn(0x562b880fdfd0 msgr2=0x562b880fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.674+0000 7f03cbe00640 0 client.16728 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.676+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 shutdown_connections 2024-04-26T20:28:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.679+0000 7f03f4209740 1 -- 172.21.15.82:0/3824322616 wait complete. 2024-04-26T20:28:47.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:47.679+0000 7f03f4209740 20 client.16728 trim_cache size 0 max 16384 2024-04-26T20:28:48.170 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:47 smithi135 ceph-mon[32816]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.4 MiB/s wr, 807 op/s 2024-04-26T20:28:48.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:47 smithi082 ceph-mon[28105]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.4 MiB/s wr, 807 op/s 2024-04-26T20:28:48.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:47 smithi139 ceph-mon[32999]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.4 MiB/s wr, 807 op/s 2024-04-26T20:28:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.288+0000 7f03f4209740 1 Processor -- start 2024-04-26T20:28:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 -- start start 2024-04-26T20:28:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b880fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 0x562b880fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88113cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1b3600 con 0x562b881084c0 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1b2010 con 0x562b88103350 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.307+0000 7f03f4209740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1b26e0 con 0x562b88102960 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.313+0000 7f03e9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 0x562b880fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.313+0000 7f03e9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 0x562b880fd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:41552/0 (socket says 172.21.15.82:41552) 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.313+0000 7f03e9e00640 1 -- 172.21.15.82:0/1947339038 learned_addr learned my addr 172.21.15.82:0/1947339038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.316+0000 7f03e9e00640 1 -- 172.21.15.82:0/1947339038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 msgr2=0x562b880fd070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.316+0000 7f03e9e00640 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b880fd070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.316+0000 7f03e9e00640 1 -- 172.21.15.82:0/1947339038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 msgr2=0x562b88113cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.316+0000 7f03e9e00640 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88113cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.316+0000 7f03e9e00640 1 -- 172.21.15.82:0/1947339038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b880f9850 con 0x562b88103350 2024-04-26T20:28:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.318+0000 7f03e9e00640 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 0x562b880fd5b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f03d801f830 tx=0x7f03d8024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1846b6c333f946d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:48.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.343+0000 7f03d6a00640 1 -- 172.21.15.82:0/1947339038 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8005520 con 0x562b88103350 2024-04-26T20:28:48.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.343+0000 7f03d6a00640 1 -- 172.21.15.82:0/1947339038 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03d805e070 con 0x562b88103350 2024-04-26T20:28:48.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.343+0000 7f03d6a00640 1 -- 172.21.15.82:0/1947339038 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8059800 con 0x562b88103350 2024-04-26T20:28:48.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.382+0000 7f03f4209740 1 -- 172.21.15.82:0/1947339038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 msgr2=0x562b880fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:48.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.382+0000 7f03f4209740 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 0x562b880fd5b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f03d801f830 tx=0x7f03d8024000 comp rx=0 tx=0).stop 2024-04-26T20:28:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.408+0000 7f03f4209740 1 -- 172.21.15.82:0/1947339038 shutdown_connections 2024-04-26T20:28:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.408+0000 7f03f4209740 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88113cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.408+0000 7f03f4209740 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88103350 0x562b880fd5b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.408+0000 7f03f4209740 1 --2- 172.21.15.82:0/1947339038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88102960 0x562b880fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.408+0000 7f03f4209740 1 -- 172.21.15.82:0/1947339038 >> 172.21.15.82:0/1947339038 conn(0x562b880fdfd0 msgr2=0x562b880fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:48.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.429+0000 7f03f4209740 1 -- 172.21.15.82:0/1947339038 shutdown_connections 2024-04-26T20:28:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.429+0000 7f03f4209740 1 -- 172.21.15.82:0/1947339038 wait complete. 2024-04-26T20:28:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.429+0000 7f03f4209740 1 -- start start 2024-04-26T20:28:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.430+0000 7f03f4209740 1 Processor -- start 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88102960 0x562b88111210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88103350 0x562b88111750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88112760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1af920 con 0x562b881084c0 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1b2e70 con 0x562b88102960 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec1aff90 con 0x562b88103350 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.448+0000 7f03f4209740 10 client.0 _ll_register_callbacks cb 0x7f03d801abc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88112760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52938/0 (socket says 172.21.15.82:52938) 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 -- 172.21.15.82:0/3974478038 learned_addr learned my addr 172.21.15.82:0/3974478038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 -- 172.21.15.82:0/3974478038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88103350 msgr2=0x562b88111750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88103350 0x562b88111750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 -- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88102960 msgr2=0x562b88111210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88102960 0x562b88111210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.449+0000 7f03eb200640 1 -- 172.21.15.82:0/3974478038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b87d380f0 con 0x562b881084c0 2024-04-26T20:28:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.450+0000 7f03eb200640 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88112760 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f03e4097fd0 tx=0x7f03e409bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555e5c84769fe9f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:48.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.490+0000 7f03cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:48.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.490+0000 7f03cbe00640 1 -- 172.21.15.82:0/3974478038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e40a4730 con 0x562b881084c0 2024-04-26T20:28:48.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.490+0000 7f03cbe00640 1 -- 172.21.15.82:0/3974478038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f03e40a42a0 con 0x562b881084c0 2024-04-26T20:28:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.519+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03d805e070 con 0x562b881084c0 2024-04-26T20:28:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.540+0000 7f03cbe00640 1 -- 172.21.15.82:0/3974478038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f03e40a44a0 con 0x562b881084c0 2024-04-26T20:28:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.541+0000 7f03f4209740 10 client.16731 fetch_fsmap learned FSMap version 42 2024-04-26T20:28:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.541+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562b8802ea30 con 0x562b881084c0 2024-04-26T20:28:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.546+0000 7f03cbe00640 1 -- 172.21.15.82:0/3974478038 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03d805e070 con 0x562b881084c0 2024-04-26T20:28:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.546+0000 7f03cbe00640 1 -- 172.21.15.82:0/3974478038 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f03e409aa30 con 0x562b881084c0 2024-04-26T20:28:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.547+0000 7f03f4209740 10 client.16731 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T20:28:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.547+0000 7f03f4209740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.547+0000 7f03f4209740 20 client.16731 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:48.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.547+0000 7f03f4209740 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b8817ec20 0x562b88181040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:48.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.547+0000 7f03f4209740 4 client.16731 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T20:28:48.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.547+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b8806e650 con 0x562b8817ec20 2024-04-26T20:28:48.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.550+0000 7f03ea800640 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b8817ec20 0x562b88181040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:48.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.560+0000 7f03ea800640 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b8817ec20 0x562b88181040 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e37096fc5bd25446 server_cookie=a6aef87837bbf2da in_seq=0 out_seq=0 2024-04-26T20:28:48.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.560+0000 7f03cbe00640 10 client.16731 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:48.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.569+0000 7f03cbe00640 1 -- 172.21.15.82:0/3974478038 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562b8806e650 con 0x562b8817ec20 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.569+0000 7f03cbe00640 10 client.16731 handle_command_reply: tid=0 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.574+0000 7f03f4209740 1 client.16731 shutdown 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.576+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 msgr2=0x562b88112760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.576+0000 7f03f4209740 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88112760 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f03e4097fd0 tx=0x7f03e409bb70 comp rx=0 tx=0).stop 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 shutdown_connections 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x562b8817ec20 0x562b88181040 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562b881084c0 0x562b88112760 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b88103350 0x562b88111750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 --2- 172.21.15.82:0/3974478038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b88102960 0x562b88111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 >> 172.21.15.82:0/3974478038 conn(0x562b880fdfd0 msgr2=0x562b880fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:48.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03cbe00640 0 client.16731 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:48.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 shutdown_connections 2024-04-26T20:28:48.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.577+0000 7f03f4209740 1 -- 172.21.15.82:0/3974478038 wait complete. 2024-04-26T20:28:48.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.578+0000 7f03f4209740 20 client.16731 trim_cache size 0 max 16384 2024-04-26T20:28:48.587 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:28:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-04-26T20:28:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-04-26T20:28:48.588 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:28:48.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.623+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f03d00a3e40 msgr2=0x7f03d00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:48.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.623+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f03d00a3e40 0x7f03d00a6300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f03dc02a950 tx=0x7f03dc030340 comp rx=0 tx=0).stop 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.623+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 msgr2=0x7f03ec1a66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.623+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec1a66c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f03e400b970 tx=0x7f03e400be30 comp rx=0 tx=0).stop 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 shutdown_connections 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f03d00a3e40 0x7f03d00a6300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03ec10a9b0 0x7f03ec1a66c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ec10a010 0x7f03ec19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 --2- 172.21.15.82:0/1709010923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03ec073d70 0x7f03ec19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 >> 172.21.15.82:0/1709010923 conn(0x7f03ec06f840 msgr2=0x7f03ec10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.624+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 shutdown_connections 2024-04-26T20:28:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:48.625+0000 7f03f0a00640 1 -- 172.21.15.82:0/1709010923 wait complete. 2024-04-26T20:28:49.055 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T20:28:49.055 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:28:49.186 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:48 smithi135 ceph-mon[32816]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 691 op/s 2024-04-26T20:28:49.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:48 smithi082 ceph-mon[28105]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 691 op/s 2024-04-26T20:28:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:48 smithi139 ceph-mon[32999]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 691 op/s 2024-04-26T20:28:52.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:51 smithi082 ceph-mon[28105]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 575 op/s 2024-04-26T20:28:52.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:51 smithi139 ceph-mon[32999]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 575 op/s 2024-04-26T20:28:52.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:51 smithi135 ceph-mon[32816]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 575 op/s 2024-04-26T20:28:53.132 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:52 smithi135 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 1. 2024-04-26T20:28:53.132 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:52 smithi135 systemd[1]: Stopped Ceph mds.h for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:28:53.132 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:52 smithi135 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service: Consumed 7.658s CPU time. 2024-04-26T20:28:53.132 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:52 smithi135 systemd[1]: Starting Ceph mds.h for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:28:53.133 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 podman[65460]: 2024-04-26 20:28:53.000932546 +0000 UTC m=+0.018224516 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:28:53.133 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 podman[65460]: 2024-04-26 20:28:53.132308791 +0000 UTC m=+0.149600754 container create b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-26T20:28:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.756+0000 7f153f800640 1 -- 172.21.15.82:0/1540856796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 msgr2=0x7f153810f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.756+0000 7f153f800640 1 --2- 172.21.15.82:0/1540856796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f153810f120 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f153001af10 tx=0x7f153003bb80 comp rx=0 tx=0).stop 2024-04-26T20:28:53.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.792+0000 7f153f800640 1 -- 172.21.15.82:0/1540856796 shutdown_connections 2024-04-26T20:28:53.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.792+0000 7f153f800640 1 --2- 172.21.15.82:0/1540856796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f153810f120 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:53.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.792+0000 7f153f800640 1 --2- 172.21.15.82:0/1540856796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153810c2a0 0x7f153810e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:53.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.792+0000 7f153f800640 1 --2- 172.21.15.82:0/1540856796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 0x7f153810bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:53.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.792+0000 7f153f800640 1 -- 172.21.15.82:0/1540856796 >> 172.21.15.82:0/1540856796 conn(0x7f153806f7c0 msgr2=0x7f1538071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.820+0000 7f153f800640 1 -- 172.21.15.82:0/1540856796 shutdown_connections 2024-04-26T20:28:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.824+0000 7f153f800640 1 -- 172.21.15.82:0/1540856796 wait complete. 2024-04-26T20:28:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.825+0000 7f153f800640 1 Processor -- start 2024-04-26T20:28:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 -- start start 2024-04-26T20:28:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 0x7f153819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:53.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153810c2a0 0x7f153819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f15381c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1538112b90 con 0x7f153810ec70 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1538112a10 con 0x7f153810c2a0 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.826+0000 7f153f800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1538112d10 con 0x7f1538109930 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.827+0000 7f153ce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 0x7f153819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.827+0000 7f153ce00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 0x7f153819f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:56958/0 (socket says 172.21.15.82:56958) 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.827+0000 7f153ce00640 1 -- 172.21.15.82:0/1092530878 learned_addr learned my addr 172.21.15.82:0/1092530878 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.827+0000 7f153d800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f15381c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.828+0000 7f153d800640 1 -- 172.21.15.82:0/1092530878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 msgr2=0x7f153819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.828+0000 7f153d800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 0x7f153819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.828+0000 7f153d800640 1 -- 172.21.15.82:0/1092530878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153810c2a0 msgr2=0x7f153819f840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.828+0000 7f153d800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153810c2a0 0x7f153819f840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:53.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.828+0000 7f153d800640 1 -- 172.21.15.82:0/1092530878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15381c8f30 con 0x7f153810ec70 2024-04-26T20:28:53.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.828+0000 7f153d800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f15381c88c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f153001ae60 tx=0x7f1530045b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:53.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.848+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530013020 con 0x7f153810ec70 2024-04-26T20:28:53.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.848+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f153000fb20 con 0x7f153810ec70 2024-04-26T20:28:53.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.848+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153000d9e0 con 0x7f153810ec70 2024-04-26T20:28:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.854+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15381c91c0 con 0x7f153810ec70 2024-04-26T20:28:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.854+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15381c9740 con 0x7f153810ec70 2024-04-26T20:28:53.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 podman[65460]: 2024-04-26 20:28:53.395171373 +0000 UTC m=+0.412463327 container init b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:28:53.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 podman[65460]: 2024-04-26 20:28:53.397916882 +0000 UTC m=+0.415208836 container start b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-26T20:28:53.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 ceph-mds[65481]: -- 172.21.15.135:0/471722739 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556db8c9fa40 con 0x556db8c73000 2024-04-26T20:28:53.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[65477]: starting mds.h at 2024-04-26T20:28:53.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 bash[65460]: b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc 2024-04-26T20:28:53.869 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:28:53 smithi135 systemd[1]: Started Ceph mds.h for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.889+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1530016020 con 0x7f153810ec70 2024-04-26T20:28:53.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.871+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15381c9a60 con 0x7f153810ec70 2024-04-26T20:28:53.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.893+0000 7f1535600640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f151c0a3e40 0x7f151c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.898+0000 7f153ce00640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f151c0a3e40 0x7f151c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.899+0000 7f153ce00640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f151c0a3e40 0x7f151c0a6300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1528009960 tx=0x7f1528008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.903+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f15300f1a10 con 0x7f153810ec70 2024-04-26T20:28:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:28:53.934+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f15300bded0 con 0x7f153810ec70 2024-04-26T20:28:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:53 smithi082 ceph-mon[28105]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 535 op/s 2024-04-26T20:28:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:53 smithi082 ceph-mon[28105]: daemon mds.h restarted 2024-04-26T20:28:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:53 smithi139 ceph-mon[32999]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 535 op/s 2024-04-26T20:28:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:53 smithi139 ceph-mon[32999]: daemon mds.h restarted 2024-04-26T20:28:54.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:53 smithi135 ceph-mon[32816]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 535 op/s 2024-04-26T20:28:54.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:53 smithi135 ceph-mon[32816]: daemon mds.h restarted 2024-04-26T20:28:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.993+0000 7fc04b200640 1 -- 172.21.15.82:0/1924365964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 msgr2=0x7fc04c10e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.993+0000 7fc04b200640 1 --2- 172.21.15.82:0/1924365964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 0x7fc04c10e850 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc038009900 tx=0x7fc03802a440 comp rx=0 tx=0).stop 2024-04-26T20:28:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.994+0000 7fc04b200640 1 -- 172.21.15.82:0/1924365964 shutdown_connections 2024-04-26T20:28:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.994+0000 7fc04b200640 1 --2- 172.21.15.82:0/1924365964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10ed90 0x7fc04c115620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.994+0000 7fc04b200640 1 --2- 172.21.15.82:0/1924365964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 0x7fc04c10e850 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.994+0000 7fc04b200640 1 --2- 172.21.15.82:0/1924365964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc04c10d1f0 0x7fc04c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:54.994+0000 7fc04b200640 1 -- 172.21.15.82:0/1924365964 >> 172.21.15.82:0/1924365964 conn(0x7fc04c06d200 msgr2=0x7fc04c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.035+0000 7fc04b200640 1 -- 172.21.15.82:0/1924365964 shutdown_connections 2024-04-26T20:28:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.035+0000 7fc04b200640 1 -- 172.21.15.82:0/1924365964 wait complete. 2024-04-26T20:28:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.037+0000 7fc04b200640 1 Processor -- start 2024-04-26T20:28:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.039+0000 7fc04b200640 1 -- start start 2024-04-26T20:28:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.039+0000 7fc04b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 0x7fc04c071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.041+0000 7fc04b200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 0x7fc04c071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.041+0000 7fc04b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc04c10ed90 0x7fc04c06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.041+0000 7fc04b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c118d70 con 0x7fc04c10d1f0 2024-04-26T20:28:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.041+0000 7fc04b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c118bf0 con 0x7fc04c10ed90 2024-04-26T20:28:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.041+0000 7fc04b200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c118ef0 con 0x7fc04c10e3d0 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 0x7fc04c071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 0x7fc04c071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44290/0 (socket says 172.21.15.82:44290) 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 -- 172.21.15.82:0/3063399447 learned_addr learned my addr 172.21.15.82:0/3063399447 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 -- 172.21.15.82:0/3063399447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 msgr2=0x7fc04c071f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 0x7fc04c071f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 -- 172.21.15.82:0/3063399447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc04c10ed90 msgr2=0x7fc04c06e5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc04c10ed90 0x7fc04c06e5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.042+0000 7fc049e00640 1 -- 172.21.15.82:0/3063399447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c06ee70 con 0x7fc04c10d1f0 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.043+0000 7fc049e00640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 0x7fc04c071a40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00d9d0 tx=0x7fc03c00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.044+0000 7fc042a00640 1 -- 172.21.15.82:0/3063399447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c017070 con 0x7fc04c10d1f0 2024-04-26T20:28:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.044+0000 7fc042a00640 1 -- 172.21.15.82:0/3063399447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc03c009df0 con 0x7fc04c10d1f0 2024-04-26T20:28:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.044+0000 7fc042a00640 1 -- 172.21.15.82:0/3063399447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c003da0 con 0x7fc04c10d1f0 2024-04-26T20:28:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.045+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c1af7a0 con 0x7fc04c10d1f0 2024-04-26T20:28:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.048+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c1afbb0 con 0x7fc04c10d1f0 2024-04-26T20:28:55.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.061+0000 7fc053d6a740 1 Processor -- start 2024-04-26T20:28:55.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.061+0000 7fc053d6a740 1 -- start start 2024-04-26T20:28:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.063+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ab91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.064+0000 7fc04a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ab91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.064+0000 7fc04a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ab91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44292/0 (socket says 172.21.15.82:44292) 2024-04-26T20:28:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab97c0 0x556d02abe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc049400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc049400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60998/0 (socket says 172.21.15.82:60998) 2024-04-26T20:28:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc04a800640 1 -- 172.21.15.82:0/2228845161 learned_addr learned my addr 172.21.15.82:0/2228845161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d02a0c380 con 0x556d02ab8dd0 2024-04-26T20:28:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d029a8c30 con 0x556d02abe930 2024-04-26T20:28:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d02a08340 con 0x556d02ab97c0 2024-04-26T20:28:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.065+0000 7fc042a00640 1 -- 172.21.15.82:0/3063399447 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc03c009940 con 0x7fc04c10d1f0 2024-04-26T20:28:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.070+0000 7fc04a800640 1 -- 172.21.15.82:0/2228845161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab97c0 msgr2=0x556d02abe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.073 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.071+0000 7fc042a00640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0300a3dc0 0x7fc0300a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.072+0000 7fc049e00640 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab97c0 0x556d02abe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.072+0000 7fc04a800640 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab97c0 0x556d02abe2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.072+0000 7fc04a800640 1 -- 172.21.15.82:0/2228845161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 msgr2=0x556d02ac0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.072+0000 7fc04a800640 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.072+0000 7fc04a800640 1 -- 172.21.15.82:0/2228845161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d029ca940 con 0x556d02ab8dd0 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.072+0000 7fc049400640 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:28:55.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.073+0000 7fc04a800640 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ab91f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc044007ec0 tx=0x7fc04400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e188d0c0346ac76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.075+0000 7fc04a800640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0300a3dc0 0x7fc0300a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.076+0000 7fc042a00640 1 -- 172.21.15.82:0/3063399447 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc03c0d0210 con 0x7fc04c10d1f0 2024-04-26T20:28:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.077+0000 7fc04a800640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0300a3dc0 0x7fc0300a6280 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc044007fd0 tx=0x7fc044011000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.078+0000 7fc037400640 1 -- 172.21.15.82:0/2228845161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044021070 con 0x556d02ab8dd0 2024-04-26T20:28:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.078+0000 7fc037400640 1 -- 172.21.15.82:0/2228845161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc044014050 con 0x556d02ab8dd0 2024-04-26T20:28:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.078+0000 7fc037400640 1 -- 172.21.15.82:0/2228845161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044021070 con 0x556d02ab8dd0 2024-04-26T20:28:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.082+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 msgr2=0x556d02ab91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.082+0000 7fc053d6a740 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ab91f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc044007ec0 tx=0x7fc04400c6a0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 shutdown_connections 2024-04-26T20:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab97c0 0x556d02abe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 --2- 172.21.15.82:0/2228845161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ab91f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 >> 172.21.15.82:0/2228845161 conn(0x556d02aa3430 msgr2=0x556d02aa3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 shutdown_connections 2024-04-26T20:28:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.083+0000 7fc053d6a740 1 -- 172.21.15.82:0/2228845161 wait complete. 2024-04-26T20:28:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.084+0000 7fc053d6a740 1 -- start start 2024-04-26T20:28:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.084+0000 7fc053d6a740 1 Processor -- start 2024-04-26T20:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.086+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ac2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.087+0000 7fc049e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ac2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.087+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02ab97c0 0x556d02ac3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.087+0000 7fc049e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ac2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44302/0 (socket says 172.21.15.82:44302) 2024-04-26T20:28:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.088+0000 7fc049e00640 1 -- 172.21.15.82:0/905746752 learned_addr learned my addr 172.21.15.82:0/905746752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.088+0000 7fc049400640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02ab97c0 0x556d02ac3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.088+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02abe930 0x556d02aca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.089+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d02ac18e0 con 0x556d02ab8dd0 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.089+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d02993c60 con 0x556d02ab97c0 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.089+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d02ac1a60 con 0x556d02abe930 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.089+0000 7fc053d6a740 10 client.0 _ll_register_callbacks cb 0x556d029bfe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.090+0000 7fc04a800640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02abe930 0x556d02aca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.091+0000 7fc049e00640 1 -- 172.21.15.82:0/905746752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02abe930 msgr2=0x556d02aca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.091+0000 7fc049e00640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02abe930 0x556d02aca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.091+0000 7fc049e00640 1 -- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02ab97c0 msgr2=0x556d02ac3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.091+0000 7fc049e00640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02ab97c0 0x556d02ac3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.091+0000 7fc049e00640 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d029a2510 con 0x556d02ab8dd0 2024-04-26T20:28:55.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.092+0000 7fc049e00640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ac2fc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009610 tx=0x7fc03c009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd16fc636bd4111 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:55.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.092+0000 7fc02be00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:55.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.092+0000 7fc02be00640 1 -- 172.21.15.82:0/905746752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0a0460 con 0x556d02ab8dd0 2024-04-26T20:28:55.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.093+0000 7fc02be00640 1 -- 172.21.15.82:0/905746752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc03c0cdab0 con 0x556d02ab8dd0 2024-04-26T20:28:55.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.093+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc044014050 con 0x556d02ab8dd0 2024-04-26T20:28:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.097+0000 7fc02be00640 1 -- 172.21.15.82:0/905746752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc03c0a4d20 con 0x556d02ab8dd0 2024-04-26T20:28:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.097+0000 7fc053d6a740 10 client.16749 fetch_fsmap learned FSMap version 44 2024-04-26T20:28:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.097+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556d0271e210 con 0x556d02ab8dd0 2024-04-26T20:28:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.098+0000 7fc02be00640 1 -- 172.21.15.82:0/905746752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc044014050 con 0x556d02ab8dd0 2024-04-26T20:28:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc02be00640 1 -- 172.21.15.82:0/905746752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7fc03c0b0b50 con 0x556d02ab8dd0 2024-04-26T20:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc053d6a740 10 client.16749 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc053d6a740 10 client.16749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc053d6a740 20 client.16749 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02acef40 0x556d02ad13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc053d6a740 4 client.16749 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.099+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d02a19f90 con 0x556d02acef40 2024-04-26T20:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.100+0000 7fc049400640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02acef40 0x556d02ad13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.101+0000 7fc02be00640 10 client.16749 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.101+0000 7fc049400640 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02acef40 0x556d02ad13e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690b0c378473a289 server_cookie=b7da5ab16189d596 in_seq=0 out_seq=0 2024-04-26T20:28:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.104+0000 7fc02be00640 1 -- 172.21.15.82:0/905746752 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d02a19f90 con 0x556d02acef40 2024-04-26T20:28:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.104+0000 7fc02be00640 10 client.16749 handle_command_reply: tid=0 2024-04-26T20:28:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.104+0000 7fc053d6a740 1 client.16749 shutdown 2024-04-26T20:28:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.105+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 msgr2=0x556d02ac2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.105+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ac2fc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009610 tx=0x7fc03c009cf0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 shutdown_connections 2024-04-26T20:28:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02acef40 0x556d02ad13e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc02be00640 0 client.16749 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02abe930 0x556d02aca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02ab97c0 0x556d02ac3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc053d6a740 1 --2- 172.21.15.82:0/905746752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab8dd0 0x556d02ac2fc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.106+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 >> 172.21.15.82:0/905746752 conn(0x556d02aa3430 msgr2=0x556d02aa2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.107+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 shutdown_connections 2024-04-26T20:28:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.108+0000 7fc053d6a740 1 -- 172.21.15.82:0/905746752 wait complete. 2024-04-26T20:28:55.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.108+0000 7fc053d6a740 20 client.16749 trim_cache size 0 max 16384 2024-04-26T20:28:55.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:54 smithi082 ceph-mon[28105]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T20:28:55.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:54 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6836/3855827233,v1:172.21.15.135:6837/3855827233] up:boot 2024-04-26T20:28:55.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:54 smithi082 ceph-mon[28105]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T20:28:55.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:28:55.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:54 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.248+0000 7fc053d6a740 1 Processor -- start 2024-04-26T20:28:55.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.264+0000 7fc053d6a740 1 -- start start 2024-04-26T20:28:55.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.265+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02aa63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.265+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02aca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.265+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02aa6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.266+0000 7fc053d6a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1b1800 con 0x556d02ab97c0 2024-04-26T20:28:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.266+0000 7fc053d6a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1b34c0 con 0x556d02abe930 2024-04-26T20:28:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.266+0000 7fc053d6a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1b1ed0 con 0x556d02ab8dd0 2024-04-26T20:28:55.269 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.267+0000 7fc049e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02aa63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.269 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.267+0000 7fc049e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02aa63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:56986/0 (socket says 172.21.15.82:56986) 2024-04-26T20:28:55.269 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.267+0000 7fc049e00640 1 -- 172.21.15.82:0/1800521004 learned_addr learned my addr 172.21.15.82:0/1800521004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:55.269 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.268+0000 7fc049400640 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02aca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.270+0000 7fc049400640 1 -- 172.21.15.82:0/1800521004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 msgr2=0x556d02aa63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.270+0000 7fc049400640 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02aa63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.270+0000 7fc049400640 1 -- 172.21.15.82:0/1800521004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 msgr2=0x556d02aa6920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.270+0000 7fc049400640 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02aa6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.270+0000 7fc049400640 1 -- 172.21.15.82:0/1800521004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d027ea620 con 0x556d02ab97c0 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.273+0000 7fc049400640 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02aca4d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x556d02aa43a0 tx=0x7fc03802a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f958db608c1776f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.277+0000 7fc036a00640 1 -- 172.21.15.82:0/1800521004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03804a030 con 0x556d02ab97c0 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.277+0000 7fc036a00640 1 -- 172.21.15.82:0/1800521004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556d02a19f90 con 0x556d02ab97c0 2024-04-26T20:28:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.277+0000 7fc036a00640 1 -- 172.21.15.82:0/1800521004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038005350 con 0x556d02ab97c0 2024-04-26T20:28:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.280+0000 7fc053d6a740 1 -- 172.21.15.82:0/1800521004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 msgr2=0x556d02aca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:28:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.280+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02aca4d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x556d02aa43a0 tx=0x7fc03802a440 comp rx=0 tx=0).stop 2024-04-26T20:28:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.287+0000 7fc053d6a740 1 -- 172.21.15.82:0/1800521004 shutdown_connections 2024-04-26T20:28:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.287+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02aa6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.287+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02aca4d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.287+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1800521004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02aa63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.287+0000 7fc053d6a740 1 -- 172.21.15.82:0/1800521004 >> 172.21.15.82:0/1800521004 conn(0x556d02aa3430 msgr2=0x556d02abdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.296+0000 7fc053d6a740 1 -- 172.21.15.82:0/1800521004 shutdown_connections 2024-04-26T20:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.296+0000 7fc053d6a740 1 -- 172.21.15.82:0/1800521004 wait complete. 2024-04-26T20:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.297+0000 7fc053d6a740 1 -- start start 2024-04-26T20:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.297+0000 7fc053d6a740 1 Processor -- start 2024-04-26T20:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.298+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02ac7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.301+0000 7fc053d6a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02ac7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.301+0000 7fc049e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02ac7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.301+0000 7fc049e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02ac7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:57000/0 (socket says 172.21.15.82:57000) 2024-04-26T20:28:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.302+0000 7fc049400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02ac7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.302+0000 7fc049400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02ac7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44320/0 (socket says 172.21.15.82:44320) 2024-04-26T20:28:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.302+0000 7fc049e00640 1 -- 172.21.15.82:0/1124155132 learned_addr learned my addr 172.21.15.82:0/1124155132 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:28:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.303+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.303+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1b2df0 con 0x556d02ab97c0 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.303+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1b2660 con 0x556d02abe930 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.303+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1ab0b0 con 0x556d02ab8dd0 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.304+0000 7fc049400640 1 -- 172.21.15.82:0/1124155132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 msgr2=0x556d02ac7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.304+0000 7fc049400640 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02ac7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.304+0000 7fc049400640 1 -- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 msgr2=0x556d02ac8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.304+0000 7fc049400640 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.304+0000 7fc049400640 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d029c6cb0 con 0x556d02ab97c0 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.304+0000 7fc049400640 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02ac7ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc038009500 tx=0x7fc038004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350175a711a1310 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.305+0000 7fc053d6a740 10 client.0 _ll_register_callbacks cb 0x7fc03c09ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:28:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.305+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d02a19f90 con 0x556d02ab97c0 2024-04-26T20:28:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.305+0000 7fc02be00640 10 client.16755 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:28:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.305+0000 7fc02be00640 1 -- 172.21.15.82:0/1124155132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03804a040 con 0x556d02ab97c0 2024-04-26T20:28:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.305+0000 7fc02be00640 1 -- 172.21.15.82:0/1124155132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc0380052f0 con 0x556d02ab97c0 2024-04-26T20:28:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.317+0000 7fc02be00640 1 -- 172.21.15.82:0/1124155132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc03805e050 con 0x556d02ab97c0 2024-04-26T20:28:55.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:54 smithi139 ceph-mon[32999]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T20:28:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:54 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6836/3855827233,v1:172.21.15.135:6837/3855827233] up:boot 2024-04-26T20:28:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:54 smithi139 ceph-mon[32999]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T20:28:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:28:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:54 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.324+0000 7fc053d6a740 10 client.16755 fetch_fsmap learned FSMap version 44 2024-04-26T20:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.324+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=44}) -- 0x556d02aca000 con 0x556d02ab97c0 2024-04-26T20:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.324+0000 7fc02be00640 1 -- 172.21.15.82:0/1124155132 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7fc038046070 con 0x556d02ab97c0 2024-04-26T20:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.324+0000 7fc053d6a740 10 client.16755 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:28:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.324+0000 7fc053d6a740 10 client.16755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:28:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.324+0000 7fc053d6a740 20 client.16755 populate_metadata read hostname 'smithi082' 2024-04-26T20:28:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.325+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02b35560 0x556d02b37950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:28:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.325+0000 7fc053d6a740 4 client.16755 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:28:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.325+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d02a13e00 con 0x556d02b35560 2024-04-26T20:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.332+0000 7fc049e00640 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02b35560 0x556d02b37950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:28:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.335+0000 7fc049e00640 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02b35560 0x556d02b37950 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e7728178800a2a server_cookie=7fb2ec51f8a810ef in_seq=0 out_seq=0 2024-04-26T20:28:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:28:55.335+0000 7fc02be00640 10 client.16755 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:28:55.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:54 smithi135 ceph-mon[32816]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T20:28:55.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:54 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6836/3855827233,v1:172.21.15.135:6837/3855827233] up:boot 2024-04-26T20:28:55.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:54 smithi135 ceph-mon[32816]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-26T20:28:55.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:28:55.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:54 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:28:56.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:55 smithi082 ceph-mon[28105]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 254 op/s 2024-04-26T20:28:56.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:55 smithi139 ceph-mon[32999]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 254 op/s 2024-04-26T20:28:56.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:55 smithi135 ceph-mon[32816]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 254 op/s 2024-04-26T20:28:57.108 INFO:tasks.workunit.client.0.smithi082.stdout: 303 560634 651 374960 822 174668 56 2024-04-26T20:28:57.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:56 smithi082 ceph-mon[28105]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2024-04-26T20:28:57.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:56 smithi139 ceph-mon[32999]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2024-04-26T20:28:57.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:56 smithi135 ceph-mon[32816]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2024-04-26T20:29:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:28:59 smithi082 ceph-mon[28105]: pgmap v598: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 451 op/s 2024-04-26T20:29:00.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:28:59 smithi139 ceph-mon[32999]: pgmap v598: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 451 op/s 2024-04-26T20:29:00.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:28:59 smithi135 ceph-mon[32816]: pgmap v598: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 451 op/s 2024-04-26T20:29:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.702+0000 7fc02be00640 1 -- 172.21.15.82:0/1124155132 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556d02a13e00 con 0x556d02b35560 2024-04-26T20:29:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.702+0000 7fc02be00640 10 client.16755 handle_command_reply: tid=0 2024-04-26T20:29:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.703+0000 7fc053d6a740 1 client.16755 shutdown 2024-04-26T20:29:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.720+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 msgr2=0x556d02ac7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.720+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02ac7ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc038009500 tx=0x7fc038004770 comp rx=0 tx=0).stop 2024-04-26T20:29:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 shutdown_connections 2024-04-26T20:29:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x556d02b35560 0x556d02b37950 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d02abe930 0x556d02ac8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d02ab97c0 0x556d02ac7ab0 secure :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc038009500 tx=0x7fc038004770 comp rx=0 tx=0).stop 2024-04-26T20:29:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc053d6a740 1 --2- 172.21.15.82:0/1124155132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d02ab8dd0 0x556d02ac7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 >> 172.21.15.82:0/1124155132 conn(0x556d02aa3430 msgr2=0x556d02aa63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.721+0000 7fc02be00640 0 client.16755 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.743+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 shutdown_connections 2024-04-26T20:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.745+0000 7fc053d6a740 1 -- 172.21.15.82:0/1124155132 wait complete. 2024-04-26T20:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.745+0000 7fc053d6a740 20 client.16755 trim_cache size 0 max 16384 2024-04-26T20:29:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:29:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:29:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:29:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:29:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.834+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0300a3dc0 msgr2=0x7fc0300a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.834+0000 7fc04b200640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0300a3dc0 0x7fc0300a6280 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc044007fd0 tx=0x7fc044011000 comp rx=0 tx=0).stop 2024-04-26T20:29:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.834+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 msgr2=0x7fc04c071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:00.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.834+0000 7fc04b200640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 0x7fc04c071a40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00d9d0 tx=0x7fc03c00de90 comp rx=0 tx=0).stop 2024-04-26T20:29:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.854+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 shutdown_connections 2024-04-26T20:29:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.854+0000 7fc04b200640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc0300a3dc0 0x7fc0300a6280 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.854+0000 7fc04b200640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc04c10ed90 0x7fc04c06e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.854+0000 7fc04b200640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c10e3d0 0x7fc04c071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.854+0000 7fc04b200640 1 --2- 172.21.15.82:0/3063399447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04c10d1f0 0x7fc04c071a40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.854+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 >> 172.21.15.82:0/3063399447 conn(0x7fc04c06d200 msgr2=0x7fc04c1116d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.874+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 shutdown_connections 2024-04-26T20:29:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:00.876+0000 7fc04b200640 1 -- 172.21.15.82:0/3063399447 wait complete. 2024-04-26T20:29:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.279+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1510005120 con 0x7f153810ec70 2024-04-26T20:29:01.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.300+0000 7f1535600640 1 -- 172.21.15.82:0/1092530878 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11968 (secure 0 0 0) 0x7f15300bd7d0 con 0x7f153810ec70 2024-04-26T20:29:01.313 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:29:01.313 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:28:53.920773+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":132,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":131,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":133,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26813":{"gid":26813,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3855827233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3855827233},{"type":"v1","addr":"172.21.15.135:6837","nonce":3855827233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:29:01.313 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 44 2024-04-26T20:29:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.331+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f151c0a3e40 msgr2=0x7f151c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:01.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.331+0000 7f153f800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f151c0a3e40 0x7f151c0a6300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1528009960 tx=0x7f1528008040 comp rx=0 tx=0).stop 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.331+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 msgr2=0x7f15381c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.331+0000 7f153f800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f15381c88c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f153001ae60 tx=0x7f1530045b90 comp rx=0 tx=0).stop 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.333+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 shutdown_connections 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.333+0000 7f153f800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f151c0a3e40 0x7f151c0a6300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.333+0000 7f153f800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153810ec70 0x7f15381c88c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.333+0000 7f153f800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153810c2a0 0x7f153819f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:01.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.333+0000 7f153f800640 1 --2- 172.21.15.82:0/1092530878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1538109930 0x7f153819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:01.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.333+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 >> 172.21.15.82:0/1092530878 conn(0x7f153806f7c0 msgr2=0x7f153810cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.343+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 shutdown_connections 2024-04-26T20:29:01.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:01.344+0000 7f153f800640 1 -- 172.21.15.82:0/1092530878 wait complete. 2024-04-26T20:29:01.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-26T20:29:02.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:01 smithi082 ceph-mon[28105]: pgmap v599: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.0 MiB/s wr, 540 op/s 2024-04-26T20:29:02.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:01 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1092530878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:29:02.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:01 smithi139 ceph-mon[32999]: pgmap v599: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.0 MiB/s wr, 540 op/s 2024-04-26T20:29:02.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:01 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1092530878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:29:02.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:01 smithi135 ceph-mon[32816]: pgmap v599: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 8.0 MiB/s wr, 540 op/s 2024-04-26T20:29:02.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:01 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1092530878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:29:04.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:03 smithi082 ceph-mon[28105]: pgmap v600: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.7 MiB/s wr, 680 op/s 2024-04-26T20:29:04.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:03 smithi139 ceph-mon[32999]: pgmap v600: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.7 MiB/s wr, 680 op/s 2024-04-26T20:29:04.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:03 smithi135 ceph-mon[32816]: pgmap v600: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.7 MiB/s wr, 680 op/s 2024-04-26T20:29:06.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.058+0000 7f7a0f600640 1 -- 172.21.15.82:0/928634991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 msgr2=0x7f7a0810bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.058+0000 7f7a0f600640 1 --2- 172.21.15.82:0/928634991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0810bd60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f79f801a910 tx=0x7f79f803b470 comp rx=0 tx=0).stop 2024-04-26T20:29:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.115+0000 7f7a0f600640 1 -- 172.21.15.82:0/928634991 shutdown_connections 2024-04-26T20:29:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.115+0000 7f7a0f600640 1 --2- 172.21.15.82:0/928634991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0810ec70 0x7f7a0810f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.115+0000 7f7a0f600640 1 --2- 172.21.15.82:0/928634991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a0810c2a0 0x7f7a0810e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.115+0000 7f7a0f600640 1 --2- 172.21.15.82:0/928634991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0810bd60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.115+0000 7f7a0f600640 1 -- 172.21.15.82:0/928634991 >> 172.21.15.82:0/928634991 conn(0x7f7a0806f7c0 msgr2=0x7f7a08071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.149+0000 7f7a0f600640 1 -- 172.21.15.82:0/928634991 shutdown_connections 2024-04-26T20:29:06.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.169+0000 7f7a0f600640 1 -- 172.21.15.82:0/928634991 wait complete. 2024-04-26T20:29:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.170+0000 7f7a0f600640 1 Processor -- start 2024-04-26T20:29:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.171+0000 7f7a0f600640 1 -- start start 2024-04-26T20:29:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.171+0000 7f7a0f600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0819f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57246/0 (socket says 172.21.15.82:57246) 2024-04-26T20:29:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:05 smithi082 ceph-mon[28105]: pgmap v601: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 617 op/s 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0f600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0810c2a0 0x7f7a0819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0f600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a0810ec70 0x7f7a081a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0f600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08112bf0 con 0x7f7a0810c2a0 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0f600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08112a70 con 0x7f7a08109930 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.183+0000 7f7a0f600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08112d70 con 0x7f7a0810ec70 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.184+0000 7f7a0cc00640 1 -- 172.21.15.82:0/43129121 learned_addr learned my addr 172.21.15.82:0/43129121 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.191+0000 7f7a0d600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a0810ec70 0x7f7a081a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.191+0000 7f7a0cc00640 1 -- 172.21.15.82:0/43129121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a0810ec70 msgr2=0x7f7a081a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.191+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a0810ec70 0x7f7a081a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.191+0000 7f7a0cc00640 1 -- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0810c2a0 msgr2=0x7f7a0819f6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:29:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.191+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0810c2a0 0x7f7a0819f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.191+0000 7f7a0cc00640 1 -- 172.21.15.82:0/43129121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a081a6da0 con 0x7f7a08109930 2024-04-26T20:29:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.199+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0819f180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f79f803ba60 tx=0x7f79f8004cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:06.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.266+0000 7f7a05600640 1 -- 172.21.15.82:0/43129121 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f804f020 con 0x7f7a08109930 2024-04-26T20:29:06.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.266+0000 7f7a05600640 1 -- 172.21.15.82:0/43129121 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79f8004260 con 0x7f7a08109930 2024-04-26T20:29:06.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.266+0000 7f7a05600640 1 -- 172.21.15.82:0/43129121 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8046070 con 0x7f7a08109930 2024-04-26T20:29:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.294+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a081a7030 con 0x7f7a08109930 2024-04-26T20:29:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.294+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a081a7520 con 0x7f7a08109930 2024-04-26T20:29:06.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:05 smithi139 ceph-mon[32999]: pgmap v601: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 617 op/s 2024-04-26T20:29:06.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.324+0000 7f7a05600640 1 -- 172.21.15.82:0/43129121 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f79f8052020 con 0x7f7a08109930 2024-04-26T20:29:06.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.327+0000 7f7a05600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79ec0a3dc0 0x7f79ec0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:05 smithi135 ceph-mon[32816]: pgmap v601: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 617 op/s 2024-04-26T20:29:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.355+0000 7f7a07e00640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79ec0a3dc0 0x7f79ec0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.360+0000 7f7a12370740 1 Processor -- start 2024-04-26T20:29:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.362+0000 7f7a05600640 1 -- 172.21.15.82:0/43129121 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f79f8101c20 con 0x7f7a08109930 2024-04-26T20:29:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.393+0000 7f7a07e00640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79ec0a3dc0 0x7f79ec0a6280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7a081a0690 tx=0x7f79f4006bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 -- start start 2024-04-26T20:29:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31aea0 0x5631ca31b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 0x5631ca320390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 0x5631ca322e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5631ca27ec70 con 0x5631ca320a00 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5631ca237980 con 0x5631ca31b890 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.402+0000 7f7a12370740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5631ca27ac30 con 0x5631ca31aea0 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.403+0000 7f7a0d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 0x5631ca322e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.403+0000 7f7a0d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 0x5631ca322e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48302/0 (socket says 172.21.15.82:48302) 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.403+0000 7f7a0d600640 1 -- 172.21.15.82:0/1049435100 learned_addr learned my addr 172.21.15.82:0/1049435100 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.404+0000 7f7a0d600640 1 -- 172.21.15.82:0/1049435100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31aea0 msgr2=0x5631ca31b2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.404+0000 7f7a0d600640 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31aea0 0x5631ca31b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.404+0000 7f7a0d600640 1 -- 172.21.15.82:0/1049435100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 msgr2=0x5631ca320390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.404+0000 7f7a0d600640 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 0x5631ca320390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.404+0000 7f7a0d600640 1 -- 172.21.15.82:0/1049435100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631ca20f7b0 con 0x5631ca320a00 2024-04-26T20:29:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.404+0000 7f7a0d600640 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 0x5631ca322e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000a7e0 tx=0x7f7a00009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e15029f726fe22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.406+0000 7f79fdc00640 1 -- 172.21.15.82:0/1049435100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00018020 con 0x5631ca320a00 2024-04-26T20:29:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.406+0000 7f79fdc00640 1 -- 172.21.15.82:0/1049435100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a0000eb50 con 0x5631ca320a00 2024-04-26T20:29:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.406+0000 7f79fdc00640 1 -- 172.21.15.82:0/1049435100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00014b70 con 0x5631ca320a00 2024-04-26T20:29:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.423+0000 7f7a12370740 1 -- 172.21.15.82:0/1049435100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 msgr2=0x5631ca322e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.423+0000 7f7a12370740 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 0x5631ca322e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000a7e0 tx=0x7f7a00009650 comp rx=0 tx=0).stop 2024-04-26T20:29:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.456+0000 7f7a12370740 1 -- 172.21.15.82:0/1049435100 shutdown_connections 2024-04-26T20:29:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.457+0000 7f7a12370740 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca320a00 0x5631ca322e90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.457+0000 7f7a12370740 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 0x5631ca320390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.457+0000 7f7a12370740 1 --2- 172.21.15.82:0/1049435100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31aea0 0x5631ca31b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.457+0000 7f7a12370740 1 -- 172.21.15.82:0/1049435100 >> 172.21.15.82:0/1049435100 conn(0x5631ca316510 msgr2=0x5631ca316910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.476+0000 7f7a12370740 1 -- 172.21.15.82:0/1049435100 shutdown_connections 2024-04-26T20:29:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.476+0000 7f7a12370740 1 -- 172.21.15.82:0/1049435100 wait complete. 2024-04-26T20:29:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.476+0000 7f7a12370740 1 -- start start 2024-04-26T20:29:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.477+0000 7f7a12370740 1 Processor -- start 2024-04-26T20:29:06.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 0x5631ca324fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca3254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca32c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5631ca27df80 con 0x5631ca32a510 2024-04-26T20:29:06.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5631ca22b260 con 0x5631ca31b890 2024-04-26T20:29:06.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5631ca2832a0 con 0x5631ca320a00 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.484+0000 7f7a12370740 10 client.0 _ll_register_callbacks cb 0x5631ca275960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.485+0000 7f7a0d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca32c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.485+0000 7f7a0d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca32c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48308/0 (socket says 172.21.15.82:48308) 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.485+0000 7f7a0d600640 1 -- 172.21.15.82:0/124186876 learned_addr learned my addr 172.21.15.82:0/124186876 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.485+0000 7f7a07e00640 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca3254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.486+0000 7f7a0d600640 1 -- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 msgr2=0x5631ca3254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.486+0000 7f7a0d600640 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca3254e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.486+0000 7f7a0d600640 1 -- 172.21.15.82:0/124186876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 msgr2=0x5631ca324fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.486+0000 7f7a0d600640 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 0x5631ca324fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.486+0000 7f7a0d600640 1 -- 172.21.15.82:0/124186876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631ca20d1c0 con 0x5631ca32a510 2024-04-26T20:29:06.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.486+0000 7f7a0d600640 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca32c900 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009c10 tx=0x7f7a00014630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613410d9bdadd752 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:06.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.487+0000 7f79f2000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:29:06.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.487+0000 7f79f2000640 1 -- 172.21.15.82:0/124186876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00014b10 con 0x5631ca32a510 2024-04-26T20:29:06.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.487+0000 7f79f2000640 1 -- 172.21.15.82:0/124186876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f7a00014cb0 con 0x5631ca32a510 2024-04-26T20:29:06.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.487+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a0000eb50 con 0x5631ca32a510 2024-04-26T20:29:06.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.488+0000 7f79f2000640 1 -- 172.21.15.82:0/124186876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f7a00027440 con 0x5631ca32a510 2024-04-26T20:29:06.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.488+0000 7f7a12370740 10 client.16761 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:06.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.488+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5631c9f903f0 con 0x5631ca32a510 2024-04-26T20:29:06.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.489+0000 7f79f2000640 1 -- 172.21.15.82:0/124186876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a0000eb50 con 0x5631ca32a510 2024-04-26T20:29:06.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.490+0000 7f79f2000640 1 -- 172.21.15.82:0/124186876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f7a00025070 con 0x5631ca32a510 2024-04-26T20:29:06.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.490+0000 7f7a12370740 10 client.16761 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:06.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.490+0000 7f7a12370740 10 client.16761 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:29:06.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.491+0000 7f7a12370740 20 client.16761 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:06.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.491+0000 7f7a12370740 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca332e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.492+0000 7f7a12370740 4 client.16761 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:06.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.492+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631ca28c880 con 0x5631ca330a60 2024-04-26T20:29:06.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.492+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca332e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.493+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca332e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7cb75c75e152e448 server_cookie=d4af3d2ca6f8df03 in_seq=0 out_seq=0 2024-04-26T20:29:06.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.493+0000 7f79f2000640 10 client.16761 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:29:06.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.494+0000 7f79f2000640 1 -- 172.21.15.82:0/124186876 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5631ca28c880 con 0x5631ca330a60 2024-04-26T20:29:06.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.494+0000 7f79f2000640 10 client.16761 handle_command_reply: tid=0 2024-04-26T20:29:06.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.494+0000 7f7a12370740 1 client.16761 shutdown 2024-04-26T20:29:06.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.494+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 msgr2=0x5631ca32c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.494+0000 7f7a12370740 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca32c900 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009c10 tx=0x7f7a00014630 comp rx=0 tx=0).stop 2024-04-26T20:29:06.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.495+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 shutdown_connections 2024-04-26T20:29:06.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.495+0000 7f7a12370740 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca332e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.496+0000 7f79f2000640 0 client.16761 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:29:06.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.496+0000 7f7a12370740 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca32c900 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.496+0000 7f7a12370740 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca3254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.496+0000 7f7a12370740 1 --2- 172.21.15.82:0/124186876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca31b890 0x5631ca324fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.496+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 >> 172.21.15.82:0/124186876 conn(0x5631ca316510 msgr2=0x5631ca315690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.497+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 shutdown_connections 2024-04-26T20:29:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.497+0000 7f7a12370740 1 -- 172.21.15.82:0/124186876 wait complete. 2024-04-26T20:29:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.497+0000 7f7a12370740 20 client.16761 trim_cache size 0 max 16384 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.586+0000 7f7a12370740 1 Processor -- start 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.594+0000 7f7a12370740 1 -- start start 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.594+0000 7f7a12370740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca31b890 0x5631ca315510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.594+0000 7f7a12370740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca315a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.594+0000 7f7a12370740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca32a510 0x5631ca31c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a12370740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081b1830 con 0x5631ca31b890 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a12370740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081b34f0 con 0x5631ca32a510 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a12370740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081b1f00 con 0x5631ca320a00 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca315a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca315a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45332/0 (socket says 172.21.15.82:45332) 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a07e00640 1 -- 172.21.15.82:0/1351852663 learned_addr learned my addr 172.21.15.82:0/1351852663 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.595+0000 7f7a0d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca32a510 0x5631ca31c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.599+0000 7f7a0d600640 1 -- 172.21.15.82:0/1351852663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 msgr2=0x5631ca315a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.599+0000 7f7a0d600640 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca315a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.599+0000 7f7a0d600640 1 -- 172.21.15.82:0/1351852663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca31b890 msgr2=0x5631ca315510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.599+0000 7f7a0d600640 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca31b890 0x5631ca315510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.599+0000 7f7a0d600640 1 -- 172.21.15.82:0/1351852663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631ca05a7d0 con 0x5631ca32a510 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.599+0000 7f7a0d600640 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca32a510 0x5631ca31c330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a00002230 tx=0x7f7a00009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1791c1f06696551 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.601+0000 7f79fd200640 1 -- 172.21.15.82:0/1351852663 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00018070 con 0x5631ca32a510 2024-04-26T20:29:06.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.601+0000 7f79fd200640 1 -- 172.21.15.82:0/1351852663 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a00009c40 con 0x5631ca32a510 2024-04-26T20:29:06.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.601+0000 7f79fd200640 1 -- 172.21.15.82:0/1351852663 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00014dd0 con 0x5631ca32a510 2024-04-26T20:29:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.607+0000 7f7a12370740 1 -- 172.21.15.82:0/1351852663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca32a510 msgr2=0x5631ca31c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.607+0000 7f7a12370740 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca32a510 0x5631ca31c330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a00002230 tx=0x7f7a00009850 comp rx=0 tx=0).stop 2024-04-26T20:29:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.614+0000 7f7a12370740 1 -- 172.21.15.82:0/1351852663 shutdown_connections 2024-04-26T20:29:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.614+0000 7f7a12370740 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca32a510 0x5631ca31c330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.614+0000 7f7a12370740 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca320a00 0x5631ca315a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.614+0000 7f7a12370740 1 --2- 172.21.15.82:0/1351852663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca31b890 0x5631ca315510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.614+0000 7f7a12370740 1 -- 172.21.15.82:0/1351852663 >> 172.21.15.82:0/1351852663 conn(0x5631ca316510 msgr2=0x5631ca314e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.628+0000 7f7a12370740 1 -- 172.21.15.82:0/1351852663 shutdown_connections 2024-04-26T20:29:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.628+0000 7f7a12370740 1 -- 172.21.15.82:0/1351852663 wait complete. 2024-04-26T20:29:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.628+0000 7f7a12370740 1 -- start start 2024-04-26T20:29:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.629+0000 7f7a12370740 1 Processor -- start 2024-04-26T20:29:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.633+0000 7f7a12370740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31b890 0x5631ca341830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.633+0000 7f7a12370740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 0x5631ca341d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a0cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31b890 0x5631ca341830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a0cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31b890 0x5631ca341830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45346/0 (socket says 172.21.15.82:45346) 2024-04-26T20:29:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 0x5631ca341d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 0x5631ca341d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:57284/0 (socket says 172.21.15.82:57284) 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a0cc00640 1 -- 172.21.15.82:0/3167791857 learned_addr learned my addr 172.21.15.82:0/3167791857 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca342d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.634+0000 7f7a0d600640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca342d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081b2e20 con 0x5631ca32a510 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081b2690 con 0x5631ca320a00 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081af8c0 con 0x5631ca31b890 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a07e00640 1 -- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31b890 msgr2=0x5631ca341830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a07e00640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31b890 0x5631ca341830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a07e00640 1 -- 172.21.15.82:0/3167791857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 msgr2=0x5631ca342d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.635+0000 7f7a07e00640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca342d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.636+0000 7f7a07e00640 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631ca2252a0 con 0x5631ca320a00 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.636+0000 7f7a0d600640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca342d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.638+0000 7f7a12370740 10 client.0 _ll_register_callbacks cb 0x7f7a0000a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.638+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a00009c40 con 0x5631ca320a00 2024-04-26T20:29:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.642+0000 7f7a07e00640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 0x5631ca341d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5631ca31aa20 tx=0x7f79f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98443ee2f022e76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.644+0000 7f79f2000640 10 client.26831 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:29:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.644+0000 7f79f2000640 1 -- 172.21.15.82:0/3167791857 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4050050 con 0x5631ca320a00 2024-04-26T20:29:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.644+0000 7f79f2000640 1 -- 172.21.15.82:0/3167791857 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f79f4042840 con 0x5631ca320a00 2024-04-26T20:29:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.644+0000 7f79f2000640 1 -- 172.21.15.82:0/3167791857 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f79f4046070 con 0x5631ca320a00 2024-04-26T20:29:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.667+0000 7f7a12370740 10 client.26831 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:06.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.667+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=44}) -- 0x5631ca3442c0 con 0x5631ca320a00 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.671+0000 7f79f2000640 1 -- 172.21.15.82:0/3167791857 <== mon.2 v2:172.21.15.135:3300/0 4 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f79f4012070 con 0x5631ca320a00 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.672+0000 7f7a12370740 10 client.26831 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.672+0000 7f7a12370740 10 client.26831 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.672+0000 7f7a12370740 20 client.26831 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.672+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca398f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.672+0000 7f7a12370740 4 client.26831 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:29:06.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.672+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 --> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631ca2866f0 con 0x5631ca330a60 2024-04-26T20:29:06.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.674+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca398f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.686+0000 7f7a0cc00640 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca398f10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=51ee540d23e84d65 server_cookie=34bf40981d572d57 in_seq=0 out_seq=0 2024-04-26T20:29:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.686+0000 7f79f2000640 10 client.26831 ms_handle_connect on v2:172.21.15.139:6832/4280186600 2024-04-26T20:29:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.691+0000 7f79f2000640 1 -- 172.21.15.82:0/3167791857 <== mds.4 v2:172.21.15.139:6832/4280186600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631ca2866f0 con 0x5631ca330a60 2024-04-26T20:29:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.691+0000 7f79f2000640 10 client.26831 handle_command_reply: tid=0 2024-04-26T20:29:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.691+0000 7f7a12370740 1 client.26831 shutdown 2024-04-26T20:29:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.691+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 msgr2=0x5631ca341d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.691+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 0x5631ca341d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5631ca31aa20 tx=0x7f79f4004750 comp rx=0 tx=0).stop 2024-04-26T20:29:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 shutdown_connections 2024-04-26T20:29:06.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:6832/4280186600,v1:172.21.15.139:6833/4280186600] conn(0x5631ca330a60 0x5631ca398f10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631ca32a510 0x5631ca342d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631ca320a00 0x5631ca341d70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f7a12370740 1 --2- 172.21.15.82:0/3167791857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5631ca31b890 0x5631ca341830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 >> 172.21.15.82:0/3167791857 conn(0x5631ca316510 msgr2=0x5631ca315690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:06.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.692+0000 7f79f2000640 0 client.26831 ms_handle_reset on v2:172.21.15.139:6832/4280186600 2024-04-26T20:29:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.699+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 shutdown_connections 2024-04-26T20:29:06.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.703+0000 7f7a12370740 1 -- 172.21.15.82:0/3167791857 wait complete. 2024-04-26T20:29:06.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.703+0000 7f7a12370740 20 client.26831 trim_cache size 0 max 16384 2024-04-26T20:29:06.705 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:29:06.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.704+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79ec0a3dc0 msgr2=0x7f79ec0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.704+0000 7f7a0f600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79ec0a3dc0 0x7f79ec0a6280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7a081a0690 tx=0x7f79f4006bd0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 msgr2=0x7f7a0819f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:06.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0819f180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f79f803ba60 tx=0x7f79f8004cd0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 shutdown_connections 2024-04-26T20:29:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f79ec0a3dc0 0x7f79ec0a6280 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a0810ec70 0x7f7a081a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a0810c2a0 0x7f7a0819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 --2- 172.21.15.82:0/43129121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a08109930 0x7f7a0819f180 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.705+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 >> 172.21.15.82:0/43129121 conn(0x7f7a0806f7c0 msgr2=0x7f7a0810a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:06.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.706+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 shutdown_connections 2024-04-26T20:29:06.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:06.706+0000 7f7a0f600640 1 -- 172.21.15.82:0/43129121 wait complete. 2024-04-26T20:29:07.127 INFO:tasks.workunit.client.0.smithi082.stdout: 321 540380 966 366790 957 160945 543 2024-04-26T20:29:07.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-26T20:29:08.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:07 smithi082 ceph-mon[28105]: pgmap v602: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.2 MiB/s wr, 572 op/s 2024-04-26T20:29:08.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:07 smithi139 ceph-mon[32999]: pgmap v602: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.2 MiB/s wr, 572 op/s 2024-04-26T20:29:08.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:07 smithi135 ceph-mon[32816]: pgmap v602: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.2 MiB/s wr, 572 op/s 2024-04-26T20:29:09.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:08 smithi082 ceph-mon[28105]: pgmap v603: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.8 MiB/s wr, 543 op/s 2024-04-26T20:29:09.221 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:08 smithi139 ceph-mon[32999]: pgmap v603: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.8 MiB/s wr, 543 op/s 2024-04-26T20:29:09.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:08 smithi135 ceph-mon[32816]: pgmap v603: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.8 MiB/s wr, 543 op/s 2024-04-26T20:29:10.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.754+0000 7fb3f0800640 1 -- 172.21.15.82:0/2731265844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 msgr2=0x7fb3e810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:10.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.754+0000 7fb3f0800640 1 --2- 172.21.15.82:0/2731265844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e810f760 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009950 tx=0x7fb3dc02a480 comp rx=0 tx=0).stop 2024-04-26T20:29:10.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.792+0000 7fb3f0800640 1 -- 172.21.15.82:0/2731265844 shutdown_connections 2024-04-26T20:29:10.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.792+0000 7fb3f0800640 1 --2- 172.21.15.82:0/2731265844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e810a0e0 0x7fb3e810a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.792+0000 7fb3f0800640 1 --2- 172.21.15.82:0/2731265844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e810f760 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.792+0000 7fb3f0800640 1 --2- 172.21.15.82:0/2731265844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e806b540 0x7fb3e81099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.792+0000 7fb3f0800640 1 -- 172.21.15.82:0/2731265844 >> 172.21.15.82:0/2731265844 conn(0x7fb3e806f980 msgr2=0x7fb3e8071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:10.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.797+0000 7fb3f0800640 1 -- 172.21.15.82:0/2731265844 shutdown_connections 2024-04-26T20:29:10.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.797+0000 7fb3f0800640 1 -- 172.21.15.82:0/2731265844 wait complete. 2024-04-26T20:29:10.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.799+0000 7fb3f0800640 1 Processor -- start 2024-04-26T20:29:10.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.802+0000 7fb3f0800640 1 -- start start 2024-04-26T20:29:10.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.812+0000 7fb3f0800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e806b540 0x7fb3e8117830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.819+0000 7fb3ede00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e806b540 0x7fb3e8117830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.819+0000 7fb3ede00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e806b540 0x7fb3e8117830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51096/0 (socket says 172.21.15.82:51096) 2024-04-26T20:29:10.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.819+0000 7fb3ede00640 1 -- 172.21.15.82:0/3793899462 learned_addr learned my addr 172.21.15.82:0/3793899462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:10.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.819+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e810a0e0 0x7fb3e8117d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.819+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e81143a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.820+0000 7fb3ed400640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e810a0e0 0x7fb3e8117d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.821+0000 7fb3ee800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e81143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.821+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8118e00 con 0x7fb3e810d370 2024-04-26T20:29:10.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.821+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8118c80 con 0x7fb3e810a0e0 2024-04-26T20:29:10.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.821+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8118f80 con 0x7fb3e806b540 2024-04-26T20:29:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.822+0000 7fb3ee800640 1 -- 172.21.15.82:0/3793899462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e806b540 msgr2=0x7fb3e8117830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.822+0000 7fb3ee800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e806b540 0x7fb3e8117830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.822+0000 7fb3ee800640 1 -- 172.21.15.82:0/3793899462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e810a0e0 msgr2=0x7fb3e8117d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.822+0000 7fb3ee800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e810a0e0 0x7fb3e8117d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.822+0000 7fb3ee800640 1 -- 172.21.15.82:0/3793899462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e8114c60 con 0x7fb3e810d370 2024-04-26T20:29:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.823+0000 7fb3ee800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e81143a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400bf70 tx=0x7fb3e400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:10.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.823+0000 7fb3e2a00640 1 -- 172.21.15.82:0/3793899462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4019070 con 0x7fb3e810d370 2024-04-26T20:29:10.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.825+0000 7fb3e2a00640 1 -- 172.21.15.82:0/3793899462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e40148f0 con 0x7fb3e810d370 2024-04-26T20:29:10.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.828+0000 7fb3e2a00640 1 -- 172.21.15.82:0/3793899462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4012910 con 0x7fb3e810d370 2024-04-26T20:29:10.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.828+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e81af9f0 con 0x7fb3e810d370 2024-04-26T20:29:10.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.829+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81afda0 con 0x7fb3e810d370 2024-04-26T20:29:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.839+0000 7fb3e2a00640 1 -- 172.21.15.82:0/3793899462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb3e4014440 con 0x7fb3e810d370 2024-04-26T20:29:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.848+0000 7fb3e2a00640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb3d00a3ba0 0x7fb3d00a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.848+0000 7fb3ede00640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb3d00a3ba0 0x7fb3d00a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.849+0000 7fb3ede00640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb3d00a3ba0 0x7fb3d00a6060 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8006fd0 tx=0x7fb3d8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.850+0000 7fb3e2a00640 1 -- 172.21.15.82:0/3793899462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb3e40cff90 con 0x7fb3e810d370 2024-04-26T20:29:10.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.862+0000 7fb3f35cb740 1 Processor -- start 2024-04-26T20:29:10.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.864+0000 7fb3f35cb740 1 -- start start 2024-04-26T20:29:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.866+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 0x5585de3b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.866+0000 7fb3ede00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 0x5585de3b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.866+0000 7fb3ede00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 0x5585de3b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60862/0 (socket says 172.21.15.82:60862) 2024-04-26T20:29:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.866+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 0x5585de3ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 0x5585de3ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 0x5585de3ba590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38058/0 (socket says 172.21.15.82:38058) 2024-04-26T20:29:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3ede00640 1 -- 172.21.15.82:0/1230799996 learned_addr learned my addr 172.21.15.82:0/1230799996 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3ee800640 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585de318c70 con 0x5585de3b50a0 2024-04-26T20:29:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5585de2d1980 con 0x5585de3b5a90 2024-04-26T20:29:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.867+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5585de314c30 con 0x5585de3bac00 2024-04-26T20:29:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.869+0000 7fb3ed400640 1 -- 172.21.15.82:0/1230799996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 msgr2=0x5585de3bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.869+0000 7fb3ed400640 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.869+0000 7fb3ed400640 1 -- 172.21.15.82:0/1230799996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 msgr2=0x5585de3b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.869+0000 7fb3ed400640 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 0x5585de3b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.869+0000 7fb3ed400640 1 -- 172.21.15.82:0/1230799996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585de2a97b0 con 0x5585de3b5a90 2024-04-26T20:29:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.869+0000 7fb3ede00640 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 0x5585de3b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:29:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.870+0000 7fb3ed400640 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 0x5585de3ba590 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02aa70 tx=0x7fb3dc005370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1939878f3afff982 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.871+0000 7fb3d7000640 1 -- 172.21.15.82:0/1230799996 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc035020 con 0x5585de3b5a90 2024-04-26T20:29:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.871+0000 7fb3d7000640 1 -- 172.21.15.82:0/1230799996 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3dc051070 con 0x5585de3b5a90 2024-04-26T20:29:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.871+0000 7fb3d7000640 1 -- 172.21.15.82:0/1230799996 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc031620 con 0x5585de3b5a90 2024-04-26T20:29:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.872+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 msgr2=0x5585de3ba590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.872+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 0x5585de3ba590 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02aa70 tx=0x7fb3dc005370 comp rx=0 tx=0).stop 2024-04-26T20:29:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 shutdown_connections 2024-04-26T20:29:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b5a90 0x5585de3ba590 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/1230799996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b50a0 0x5585de3b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 >> 172.21.15.82:0/1230799996 conn(0x5585de3b0710 msgr2=0x5585de3b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:10.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 shutdown_connections 2024-04-26T20:29:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.874+0000 7fb3f35cb740 1 -- 172.21.15.82:0/1230799996 wait complete. 2024-04-26T20:29:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.885+0000 7fb3f35cb740 1 -- start start 2024-04-26T20:29:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.885+0000 7fb3f35cb740 1 Processor -- start 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b50a0 0x5585de3bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 0x5585de3c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585de317f80 con 0x5585de3b5a90 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5585de2c5260 con 0x5585de3bac00 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5585de31d2a0 con 0x5585de3b50a0 2024-04-26T20:29:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.887+0000 7fb3f35cb740 10 client.0 _ll_register_callbacks cb 0x5585de30f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.888+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.888+0000 7fb3ee800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 0x5585de3c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.888+0000 7fb3ee800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 0x5585de3c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38068/0 (socket says 172.21.15.82:38068) 2024-04-26T20:29:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.888+0000 7fb3ee800640 1 -- 172.21.15.82:0/576405317 learned_addr learned my addr 172.21.15.82:0/576405317 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.890+0000 7fb3ede00640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b50a0 0x5585de3bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.892+0000 7fb3ed400640 1 -- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b50a0 msgr2=0x5585de3bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.892+0000 7fb3ed400640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b50a0 0x5585de3bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.892+0000 7fb3ed400640 1 -- 172.21.15.82:0/576405317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 msgr2=0x5585de3c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.892+0000 7fb3ed400640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 0x5585de3c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.892+0000 7fb3ed400640 1 -- 172.21.15.82:0/576405317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585de2a71c0 con 0x5585de3b5a90 2024-04-26T20:29:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.892+0000 7fb3ee800640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 0x5585de3c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:29:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.900+0000 7fb3cb400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:29:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.900+0000 7fb3ed400640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3bf4a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x5585de3b15e0 tx=0x7fb3dc004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54877f05c5638b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.901+0000 7fb3cb400640 1 -- 172.21.15.82:0/576405317 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc035030 con 0x5585de3b5a90 2024-04-26T20:29:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.901+0000 7fb3cb400640 1 -- 172.21.15.82:0/576405317 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb3dc004050 con 0x5585de3b5a90 2024-04-26T20:29:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.901+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3dc051070 con 0x5585de3b5a90 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.902+0000 7fb3cb400640 1 -- 172.21.15.82:0/576405317 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb3dc035030 con 0x5585de3b5a90 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.902+0000 7fb3f35cb740 10 client.16776 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.902+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5585de02a3f0 con 0x5585de3b5a90 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.903+0000 7fb3cb400640 1 -- 172.21.15.82:0/576405317 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3dc051070 con 0x5585de3b5a90 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.904+0000 7fb3cb400640 1 -- 172.21.15.82:0/576405317 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7fb3dc03a040 con 0x5585de3b5a90 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.904+0000 7fb3f35cb740 10 client.16776 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.904+0000 7fb3f35cb740 10 client.16776 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.905+0000 7fb3f35cb740 20 client.16776 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.906+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de3caac0 0x5585de3ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.906+0000 7fb3f35cb740 4 client.16776 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.906+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585de326880 con 0x5585de3caac0 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.908+0000 7fb3ede00640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de3caac0 0x5585de3ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.910+0000 7fb3ede00640 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de3caac0 0x5585de3ccef0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9dc04e1a81909084 server_cookie=6dfe02e7c6eb067c in_seq=0 out_seq=0 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.911+0000 7fb3cb400640 10 client.16776 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.912+0000 7fb3cb400640 1 -- 172.21.15.82:0/576405317 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5585de326880 con 0x5585de3caac0 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.912+0000 7fb3cb400640 10 client.16776 handle_command_reply: tid=0 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.913+0000 7fb3f35cb740 1 client.16776 shutdown 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.914+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 msgr2=0x5585de3bf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.914+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3bf4a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x5585de3b15e0 tx=0x7fb3dc004ed0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 shutdown_connections 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de3caac0 0x5585de3ccef0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3bac00 0x5585de3c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3cb400640 0 client.16776 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3bf4a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/576405317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b50a0 0x5585de3bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.917+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 >> 172.21.15.82:0/576405317 conn(0x5585de3b0710 msgr2=0x5585de3af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.919+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 shutdown_connections 2024-04-26T20:29:10.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.919+0000 7fb3f35cb740 1 -- 172.21.15.82:0/576405317 wait complete. 2024-04-26T20:29:10.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:10.919+0000 7fb3f35cb740 20 client.16776 trim_cache size 0 max 16384 2024-04-26T20:29:11.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.513+0000 7fb3f35cb740 1 Processor -- start 2024-04-26T20:29:11.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 -- start start 2024-04-26T20:29:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 0x5585de3b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b1890 con 0x5585de3b5a90 2024-04-26T20:29:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b3550 con 0x5585de3b50a0 2024-04-26T20:29:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.576+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b1f60 con 0x5585de3bac00 2024-04-26T20:29:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.581+0000 7fb3ee800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.581+0000 7fb3ee800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51130/0 (socket says 172.21.15.82:51130) 2024-04-26T20:29:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.581+0000 7fb3ee800640 1 -- 172.21.15.82:0/2147267394 learned_addr learned my addr 172.21.15.82:0/2147267394 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.587+0000 7fb3ee800640 1 -- 172.21.15.82:0/2147267394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 msgr2=0x5585de3b36c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.587+0000 7fb3ee800640 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 0x5585de3b36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.587+0000 7fb3ee800640 1 -- 172.21.15.82:0/2147267394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 msgr2=0x5585de3c6400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.587+0000 7fb3ee800640 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3c6400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.587+0000 7fb3ee800640 1 -- 172.21.15.82:0/2147267394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585de0f47d0 con 0x5585de3bac00 2024-04-26T20:29:11.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.594+0000 7fb3ee800640 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3b3c00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3e409bdf0 tx=0x7fb3e400e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b62eae3e8ccec6d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:11.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.606+0000 7fb3d6600640 1 -- 172.21.15.82:0/2147267394 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40a0210 con 0x5585de3bac00 2024-04-26T20:29:11.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.606+0000 7fb3d6600640 1 -- 172.21.15.82:0/2147267394 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e40a4ad0 con 0x5585de3bac00 2024-04-26T20:29:11.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.606+0000 7fb3d6600640 1 -- 172.21.15.82:0/2147267394 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40a4640 con 0x5585de3bac00 2024-04-26T20:29:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.634+0000 7fb3f35cb740 1 -- 172.21.15.82:0/2147267394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 msgr2=0x5585de3b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.634+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3b3c00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3e409bdf0 tx=0x7fb3e400e040 comp rx=0 tx=0).stop 2024-04-26T20:29:11.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.676+0000 7fb3f35cb740 1 -- 172.21.15.82:0/2147267394 shutdown_connections 2024-04-26T20:29:11.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.676+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3bac00 0x5585de3b3c00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.676+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3b5a90 0x5585de3c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.676+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/2147267394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 0x5585de3b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.676+0000 7fb3f35cb740 1 -- 172.21.15.82:0/2147267394 >> 172.21.15.82:0/2147267394 conn(0x5585de3b0710 msgr2=0x5585de3b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:11.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.710+0000 7fb3f35cb740 1 -- 172.21.15.82:0/2147267394 shutdown_connections 2024-04-26T20:29:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.733+0000 7fb3f35cb740 1 -- 172.21.15.82:0/2147267394 wait complete. 2024-04-26T20:29:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.734+0000 7fb3f35cb740 1 -- start start 2024-04-26T20:29:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.735+0000 7fb3f35cb740 1 Processor -- start 2024-04-26T20:29:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.738+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 0x5585de3c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.738+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 0x5585de3c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3f35cb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3bac00 0x5585de3c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b2e80 con 0x5585de3bac00 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81b26f0 con 0x5585de3b50a0 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3f35cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81ab230 con 0x5585de3b5a90 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3f35cb740 10 client.0 _ll_register_callbacks cb 0x7fb3d8009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 0x5585de3c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 0x5585de3c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51138/0 (socket says 172.21.15.82:51138) 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.739+0000 7fb3ed400640 1 -- 172.21.15.82:0/3325652076 learned_addr learned my addr 172.21.15.82:0/3325652076 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.744+0000 7fb3ed400640 1 -- 172.21.15.82:0/3325652076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 msgr2=0x5585de3c6400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.744+0000 7fb3ed400640 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 0x5585de3c6400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.744+0000 7fb3ed400640 1 -- 172.21.15.82:0/3325652076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3bac00 msgr2=0x5585de3c3520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.744+0000 7fb3ed400640 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3bac00 0x5585de3c3520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.744+0000 7fb3ed400640 1 -- 172.21.15.82:0/3325652076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585de2bf2a0 con 0x5585de3b5a90 2024-04-26T20:29:11.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.756+0000 7fb3ed400640 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 0x5585de3c2ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02a9a0 tx=0x7fb3dc0044f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2b9e84fcba0dba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.771+0000 7fb3cb400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:29:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.771+0000 7fb3cb400640 1 -- 172.21.15.82:0/3325652076 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc035030 con 0x5585de3b5a90 2024-04-26T20:29:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.771+0000 7fb3cb400640 1 -- 172.21.15.82:0/3325652076 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb3dc039380 con 0x5585de3b5a90 2024-04-26T20:29:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.798+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3e40a4ad0 con 0x5585de3b5a90 2024-04-26T20:29:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.801+0000 7fb3cb400640 1 -- 172.21.15.82:0/3325652076 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb3dc072050 con 0x5585de3b5a90 2024-04-26T20:29:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.801+0000 7fb3f35cb740 10 client.26908 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.801+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5585de430210 con 0x5585de3b5a90 2024-04-26T20:29:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.805+0000 7fb3cb400640 1 -- 172.21.15.82:0/3325652076 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e40a4ad0 con 0x5585de3b5a90 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.805+0000 7fb3cb400640 1 -- 172.21.15.82:0/3325652076 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7fb3dc03a040 con 0x5585de3b5a90 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3f35cb740 10 client.26908 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3f35cb740 10 client.26908 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3f35cb740 20 client.26908 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de430a50 0x5585de432e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3f35cb740 4 client.26908 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 --> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585de3206f0 con 0x5585de430a50 2024-04-26T20:29:11.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.810+0000 7fb3ede00640 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de430a50 0x5585de432e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:11.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.824+0000 7fb3ede00640 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de430a50 0x5585de432e70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7b22f7f77d011a98 server_cookie=56d95c0754edd05a in_seq=0 out_seq=0 2024-04-26T20:29:11.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.866+0000 7fb3cb400640 10 client.26908 ms_handle_connect on v2:172.21.15.139:6836/4255230594 2024-04-26T20:29:11.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.866+0000 7fb3cb400640 1 -- 172.21.15.82:0/3325652076 <== mds.3 v2:172.21.15.139:6836/4255230594 1 ==== command_reply(tid 0: 0 ) ==== 8+0+118117 (crc 0 0 0) 0x5585de3206f0 con 0x5585de430a50 2024-04-26T20:29:11.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.866+0000 7fb3cb400640 10 client.26908 handle_command_reply: tid=0 2024-04-26T20:29:11.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.868+0000 7fb3f35cb740 1 client.26908 shutdown 2024-04-26T20:29:11.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.874+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 msgr2=0x5585de3c2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:11.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.874+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 0x5585de3c2ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02a9a0 tx=0x7fb3dc0044f0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 shutdown_connections 2024-04-26T20:29:11.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585de3bac00 0x5585de3c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5585de3b5a90 0x5585de3c2ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.139:6836/4255230594,v1:172.21.15.139:6837/4255230594] conn(0x5585de430a50 0x5585de432e70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3f35cb740 1 --2- 172.21.15.82:0/3325652076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5585de3b50a0 0x5585de3c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:11.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 >> 172.21.15.82:0/3325652076 conn(0x5585de3b0710 msgr2=0x5585de3b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:11.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.875+0000 7fb3cb400640 0 client.26908 ms_handle_reset on v2:172.21.15.139:6836/4255230594 2024-04-26T20:29:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.897+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 shutdown_connections 2024-04-26T20:29:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.916+0000 7fb3f35cb740 1 -- 172.21.15.82:0/3325652076 wait complete. 2024-04-26T20:29:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.928+0000 7fb3f35cb740 20 client.26908 trim_cache size 0 max 16384 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14271385, 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632613, 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-36.xml" 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 25401082, 2024-04-26T20:29:11.937 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632557, 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-55.xml" 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 28096295, 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266897, 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-46.xml" 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.938 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 28339947, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266788, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-89.xml" 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 29689163, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630365, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-23.xml" 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 40143727, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266920, 2024-04-26T20:29:11.939 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-23.xml" 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 40681220, 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262347, 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-44.xml" 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 40922829, 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630303, 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-18.xml" 2024-04-26T20:29:11.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 41790691, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262484, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-29.jpg" 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 52686315, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262386, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-25.xml" 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 63008756, 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262438, 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-52.jpg" 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 69628302, 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264697, 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml" 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 85165041, 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266883, 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-55.xml" 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 86258678, 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630301, 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-20.xml" 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 90178706, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266916, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-27.xml" 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 92473076, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266943, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-11.jpg" 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 107217448, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632656, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-9.xml" 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 112190610, 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262515, 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-17.jpg" 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 117183323, 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632640, 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-16.xml" 2024-04-26T20:29:11.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 139219352, 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630702, 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-3.xml" 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 153825256, 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632535, 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-64.xml" 2024-04-26T20:29:11.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 159270251, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630354, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-34.xml" 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 167877316, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266933, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-10.xml" 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.947 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 183392235, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262407, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-15.xml" 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 184832940, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262500, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-21.jpg" 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 188817764, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630299, 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-22.xml" 2024-04-26T20:29:11.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 196024481, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264598, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-67.xml" 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 197166338, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262440, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-51.jpg" 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.949 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 210459186, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266915, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-28.xml" 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 211250769, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262518, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-16.jpg" 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 234997812, 2024-04-26T20:29:11.950 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632513, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-72.xml" 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 238356037, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266782, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-91.xml" 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 259439716, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264852, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg" 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 263608098, 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264848, 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-5.jpg" 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 272333860, 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632247, 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-54.xml" 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.952 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 275620282, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262450, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-46.jpg" 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 279132785, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632638, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-18.xml" 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 289773123, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632619, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-32.xml" 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 290137649, 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262532, 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-9.jpg" 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 294542105, 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266876, 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-59.xml" 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.954 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 296630826, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264747, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg" 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 296932594, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266925, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-18.xml" 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 323033427, 2024-04-26T20:29:11.955 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264625, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-53.xml" 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 326021337, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264775, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-31.jpg" 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 354496578, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266802, 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-84.xml" 2024-04-26T20:29:11.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 359866577, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266953, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-1.jpg" 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 363570294, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266811, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-81.xml" 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 366659487, 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264739, 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg" 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 367858018, 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630347, 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-41.xml" 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.958 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 380462612, 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264733, 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg" 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 405205631, 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266910, 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-33.xml" 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.959 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 405747472, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266926, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-17.xml" 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 409422722, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632645, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-14.xml" 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 429703412, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630346, 2024-04-26T20:29:11.960 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-42.xml" 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 434002582, 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262434, 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-1.xml" 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 468567037, 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632667, 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-6.xml" 2024-04-26T20:29:11.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 484238455, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264689, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml" 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 486573296, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630339, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-49.xml" 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 497141979, 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262546, 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-2.jpg" 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 498061110, 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630369, 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-19.xml" 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.963 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 500081482, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264618, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-58.xml" 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 523176977, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266778, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-92.xml" 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 528059291, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264705, 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-12.xml" 2024-04-26T20:29:11.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 528762030, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262538, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-6.jpg" 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 532683254, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262354, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-40.xml" 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.965 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 538426275, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266841, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-71.xml" 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 541237587, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264836, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg" 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 543901096, 2024-04-26T20:29:11.966 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630372, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-16.xml" 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 545467683, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630370, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-18.xml" 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 551705527, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264683, 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-23.xml" 2024-04-26T20:29:11.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 562862234, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632234, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-64.xml" 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 568589871, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632540, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-62.xml" 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.968 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 569771040, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630378, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-10.xml" 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 571423319, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630366, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-22.xml" 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 572281977, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630342, 2024-04-26T20:29:11.969 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-46.xml" 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 573160832, 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632499, 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-75.xml" 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 589449207, 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630317, 2024-04-26T20:29:11.970 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-6.xml" 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 594724254, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264715, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-7.xml" 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 598060368, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632621, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-31.xml" 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.971 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 599330028, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264620, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-57.xml" 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 604877046, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266940, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-3.xml" 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 627733353, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632680, 2024-04-26T20:29:11.972 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-2.xml" 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 631829137, 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264780, 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-30.jpg" 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 641689006, 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262530, 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-10.jpg" 2024-04-26T20:29:11.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 644068227, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266936, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-7.xml" 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 651594114, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266922, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-21.xml" 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.974 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 670616161, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264603, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-65.xml" 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 671834866, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264578, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-75.xml" 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 672900624, 2024-04-26T20:29:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264741, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-43.jpg" 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 694486179, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266830, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-75.xml" 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 706934273, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264820, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg" 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 707946868, 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630334, 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-54.xml" 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 713755338, 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632542, 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-61.xml" 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 718466421, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630373, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-15.xml" 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 720502300, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264719, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml" 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 727254677, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632523, 2024-04-26T20:29:11.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-69.xml" 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 729914252, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266905, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-38.xml" 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 736291229, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262526, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-12.jpg" 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 745295868, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632639, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-17.xml" 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 750491431, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264658, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-35.xml" 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 765697963, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264623, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml" 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 768293464, 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266908, 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-35.xml" 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 783289755, 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262374, 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-30.xml" 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.981 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 798431648, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262422, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-7.xml" 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 801590345, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266948, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-6.jpg" 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 809345266, 2024-04-26T20:29:11.982 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630343, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-45.xml" 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 812137272, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266856, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-66.xml" 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 812730208, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632628, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-25.xml" 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 816737435, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264645, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-42.xml" 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 832715780, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266931, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-12.xml" 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 835004455, 2024-04-26T20:29:11.984 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264725, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-2.xml" 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 842968631, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266913, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-30.xml" 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 844419612, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632583, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-45.xml" 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 856786353, 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632637, 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-19.xml" 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 864659098, 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264791, 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-27.jpg" 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.986 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 869298732, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264660, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml" 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 877180980, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266844, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-70.xml" 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 882764298, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264701, 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml" 2024-04-26T20:29:11.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 904561023, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262488, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-27.jpg" 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 907267336, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264830, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg" 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 908904765, 2024-04-26T20:29:11.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266921, 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-22.xml" 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 924139018, 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262397, 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-20.xml" 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 926115077, 2024-04-26T20:29:11.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266924, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-19.xml" 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 940532331, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262474, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-34.jpg" 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 961570991, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630698, 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-7.xml" 2024-04-26T20:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 961807810, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262356, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-39.xml" 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 962200690, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632531, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-66.xml" 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 980481830, 2024-04-26T20:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632669, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-5.xml" 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 988536095, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264846, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-6.jpg" 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 996868205, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632634, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-21.xml" 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1004623994, 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262486, 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-28.jpg" 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1008187121, 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262498, 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-22.jpg" 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1011069211, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262370, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-32.xml" 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1027097638, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266817, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-79.xml" 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1033303174, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264735, 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-46.jpg" 2024-04-26T20:29:11.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1048630804, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632617, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-34.xml" 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1057909447, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264695, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-17.xml" 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1060710033, 2024-04-26T20:29:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266885, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-54.xml" 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1072221864, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630302, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-19.xml" 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1072759491, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264850, 2024-04-26T20:29:11.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg" 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1081450144, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264608, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-63.xml" 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1092688343, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262405, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-16.xml" 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1105057029, 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632580, 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-46.xml" 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1116151475, 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264685, 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml" 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.998 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1135822803, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262368, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-33.xml" 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1136942788, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632574, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-49.xml" 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1143781954, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266847, 2024-04-26T20:29:11.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-69.xml" 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1152265309, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262472, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-35.jpg" 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1160717912, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262490, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-26.jpg" 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1165565663, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630320, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-3.xml" 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1181034173, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262478, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-32.jpg" 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1184667423, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264672, 2024-04-26T20:29:12.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-28.xml" 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1189111925, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264796, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-26.jpg" 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1200535196, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264617, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml" 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1214675012, 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630359, 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-29.xml" 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1217924618, 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264828, 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg" 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1218559104, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262342, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-46.xml" 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1226937547, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630335, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-53.xml" 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1230346303, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266880, 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-57.xml" 2024-04-26T20:29:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1237882123, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266949, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-5.jpg" 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1250708854, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262399, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-19.xml" 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1254862349, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266899, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-44.xml" 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1256986675, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264653, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml" 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1264877994, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266895, 2024-04-26T20:29:12.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-48.xml" 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1265955207, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266808, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-82.xml" 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1272244595, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632522, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-70.xml" 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1287606997, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632578, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-47.xml" 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1291394105, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630200, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-61.jpg" 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1301857606, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264783, 2024-04-26T20:29:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-29.jpg" 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1316520834, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264593, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml" 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1321614577, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630345, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-43.xml" 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1330897095, 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264826, 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-16.jpg" 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1341853636, 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632587, 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-44.xml" 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.010 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1346006263, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264691, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-19.xml" 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1371923745, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262378, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-28.xml" 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1383817484, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264709, 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml" 2024-04-26T20:29:12.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1405054798, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632623, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-29.xml" 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1409961998, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262548, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-1.jpg" 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1410758351, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630376, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-12.xml" 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1430687644, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632592, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-43.xml" 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1445006012, 2024-04-26T20:29:12.013 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264731, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-48.jpg" 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1457393337, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262380, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-27.xml" 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1467932740, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264842, 2024-04-26T20:29:12.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-8.jpg" 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1503352302, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632648, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-12.xml" 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1512590724, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262460, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-41.jpg" 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1525534927, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632596, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-42.xml" 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1530995411, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264596, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-68.xml" 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1539073555, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266937, 2024-04-26T20:29:12.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-6.xml" 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1544542059, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264729, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-49.jpg" 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1549710830, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262492, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-25.jpg" 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.017 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1562322358, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262415, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-11.xml" 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1576842225, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262504, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-20.jpg" 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1607533456, 2024-04-26T20:29:12.018 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266935, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-8.xml" 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1623241307, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264804, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-24.jpg" 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1638150828, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266941, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-2.xml" 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1642198520, 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262390, 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-23.xml" 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1647429758, 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632635, 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-20.xml" 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.020 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1660902519, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630704, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-1.xml" 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1661247696, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262520, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-15.jpg" 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1664976124, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632563, 2024-04-26T20:29:12.021 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-53.xml" 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1684034995, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264824, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-17.jpg" 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1698396571, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262534, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-8.jpg" 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.023 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.023 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1724957445, 2024-04-26T20:29:12.023 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630321, 2024-04-26T20:29:12.023 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-2.xml" 2024-04-26T20:29:12.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.025 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.025 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1725707818, 2024-04-26T20:29:12.025 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264771, 2024-04-26T20:29:12.025 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-32.jpg" 2024-04-26T20:29:12.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1729353947, 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266930, 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-13.xml" 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1731159658, 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262394, 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-21.xml" 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.026 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1736807471, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632527, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-68.xml" 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1751440609, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264840, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg" 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1759488828, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630377, 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-11.xml" 2024-04-26T20:29:12.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1763879450, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262476, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-33.jpg" 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1771300968, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262392, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-22.xml" 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1772019318, 2024-04-26T20:29:12.028 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264651, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-39.xml" 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1775412445, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266900, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-43.xml" 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1799085731, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630310, 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-13.xml" 2024-04-26T20:29:12.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1800703700, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630311, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-12.xml" 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1807089297, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264844, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg" 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1812071145, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266814, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-80.xml" 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1826048888, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266942, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-1.xml" 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1835262120, 2024-04-26T20:29:12.031 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630364, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-24.xml" 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1850363973, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630375, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-13.xml" 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1855391646, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632643, 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-15.xml" 2024-04-26T20:29:12.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1862317488, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630300, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-21.xml" 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1863101449, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630351, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-37.xml" 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.033 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1863893631, 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630358, 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-30.xml" 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1866425578, 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266833, 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-74.xml" 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.034 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1875368385, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632566, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-52.xml" 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1884468487, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630355, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-33.xml" 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1894047607, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262358, 2024-04-26T20:29:12.035 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-38.xml" 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1904613770, 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262452, 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-45.jpg" 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1907531154, 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262524, 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-13.jpg" 2024-04-26T20:29:12.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1918462360, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630332, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-56.xml" 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1923831532, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266887, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-53.xml" 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.037 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1933478503, 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266823, 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-77.xml" 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1935028806, 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264621, 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-56.xml" 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.038 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1952722919, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264585, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-73.xml" 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1955840806, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630341, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-47.xml" 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1960474516, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264622, 2024-04-26T20:29:12.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-55.xml" 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1964357029, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264635, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml" 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1967472318, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264753, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-37.jpg" 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1977887245, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262344, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-45.xml" 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1985981008, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262544, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-3.jpg" 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1986751715, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264610, 2024-04-26T20:29:12.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-62.xml" 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1988904605, 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266901, 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-42.xml" 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1994179968, 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266791, 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-88.xml" 2024-04-26T20:29:12.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2006119234, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262411, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-13.xml" 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2008315015, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264703, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-13.xml" 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2024817678, 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632554, 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-56.xml" 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2025368550, 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266934, 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-9.xml" 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2032945807, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264811, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg" 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2045239817, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630314, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-9.xml" 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2069769509, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264717, 2024-04-26T20:29:12.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-6.xml" 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2073217829, 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266909, 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-34.xml" 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2080334917, 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264668, 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-30.xml" 2024-04-26T20:29:12.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2081880891, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262446, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-48.jpg" 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2092469800, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630313, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-10.xml" 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2098876289, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262428, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-4.xml" 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2102411240, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266952, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-2.jpg" 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2103332196, 2024-04-26T20:29:12.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632500, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-74.xml" 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2104441647, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262522, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-14.jpg" 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2114518091, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266907, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-36.xml" 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2115909025, 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264767, 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-33.jpg" 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2155766624, 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630697, 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-8.xml" 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2179068786, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264814, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-21.jpg" 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2209950685, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266896, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-47.xml" 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2236075338, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630340, 2024-04-26T20:29:12.051 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-48.xml" 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2261785191, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630338, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-50.xml" 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2271591829, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264749, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-39.jpg" 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2274777734, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264713, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-8.xml" 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2281281535, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632545, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-59.xml" 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2288110843, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264745, 2024-04-26T20:29:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg" 2024-04-26T20:29:12.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.054 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.054 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2295549389, 2024-04-26T20:29:12.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632549, 2024-04-26T20:29:12.055 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-58.xml" 2024-04-26T20:29:12.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.055 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2300700926, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632506, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-73.xml" 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2301841808, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262382, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-26.xml" 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2314473000, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262362, 2024-04-26T20:29:12.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-36.xml" 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2323716574, 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262372, 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-31.xml" 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2333178160, 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264587, 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-72.xml" 2024-04-26T20:29:12.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2374159690, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630306, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-16.xml" 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2379376566, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632607, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-38.xml" 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2383181412, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266868, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-62.xml" 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2393039440, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632576, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-48.xml" 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2404698311, 2024-04-26T20:29:12.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266891, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-51.xml" 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2453832876, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266850, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-68.xml" 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2454786547, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266865, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-63.xml" 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2457406207, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632569, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-51.xml" 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2460387380, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632631, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-23.xml" 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2473531278, 2024-04-26T20:29:12.061 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266911, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-32.xml" 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2473802820, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630806, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml" 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2486467643, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630362, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-26.xml" 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2487714749, 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632659, 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-8.xml" 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2500238687, 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262403, 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-17.xml" 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2532231920, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262482, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-30.jpg" 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2563367973, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264808, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg" 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2568596590, 2024-04-26T20:29:12.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630344, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-44.xml" 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2570362335, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266836, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-73.xml" 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2584609203, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630312, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-11.xml" 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2594325681, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264727, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-1.xml" 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2604462238, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266858, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-65.xml" 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2606940179, 2024-04-26T20:29:12.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266797, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-86.xml" 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2608377456, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632630, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-24.xml" 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2615315754, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262494, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-24.jpg" 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2618369003, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264641, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-44.xml" 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2628815334, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632539, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-63.xml" 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2632015143, 2024-04-26T20:29:12.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266898, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-45.xml" 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2652435102, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632683, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-1.xml" 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2653317528, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266938, 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-5.xml" 2024-04-26T20:29:12.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2655518426, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630319, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-4.xml" 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2673831664, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266853, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-67.xml" 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2688219716, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266919, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-24.xml" 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2691033449, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264630, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-50.xml" 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2691331978, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262401, 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-18.xml" 2024-04-26T20:29:12.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2692342900, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630360, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-28.xml" 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2698115672, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262462, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-40.jpg" 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.072 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2724469036, 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632215, 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-66.xml" 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2729752071, 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264605, 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-64.xml" 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2771593504, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266932, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-11.xml" 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2783681314, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632622, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-30.xml" 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2790654576, 2024-04-26T20:29:12.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630201, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-42.xml" 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2798198747, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264626, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-52.xml" 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2810710917, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266923, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-20.xml" 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2822933351, 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630700, 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-5.xml" 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2850463850, 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266893, 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-50.xml" 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2871378942, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262464, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-39.jpg" 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2872211089, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262360, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-37.xml" 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2879327625, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266889, 2024-04-26T20:29:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-52.xml" 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2885307928, 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262456, 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-43.jpg" 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2888533917, 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630357, 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-31.xml" 2024-04-26T20:29:12.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2890249932, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266785, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-90.xml" 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2903389711, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266827, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-76.xml" 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2904423739, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262466, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-38.jpg" 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2922143348, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262349, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-43.xml" 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2929815647, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262512, 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-18.jpg" 2024-04-26T20:29:12.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2937508641, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630371, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-17.xml" 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2937731707, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632601, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-40.xml" 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2950194660, 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266928, 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-15.xml" 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2963336791, 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266951, 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-3.jpg" 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.082 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2964909102, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262426, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-5.xml" 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2967738524, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632647, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-13.xml" 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2968766604, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630703, 2024-04-26T20:29:12.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-2.xml" 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2975919057, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630350, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-38.xml" 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2977649946, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632572, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-50.xml" 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2995967517, 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266805, 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-83.xml" 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2996788492, 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630318, 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-5.xml" 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3001692568, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632606, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-39.xml" 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3005959923, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630367, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-21.xml" 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3025679217, 2024-04-26T20:29:12.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630307, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-15.xml" 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3030536126, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266927, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-16.xml" 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3065793775, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630356, 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-32.xml" 2024-04-26T20:29:12.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3071440129, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264751, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-38.jpg" 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3071567766, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630361, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-27.xml" 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3086751201, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262444, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-49.jpg" 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3089924996, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266820, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-78.xml" 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3110543208, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632651, 2024-04-26T20:29:12.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-11.xml" 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3161207402, 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262417, 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-10.xml" 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3161501553, 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264723, 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-3.xml" 2024-04-26T20:29:12.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3161876773, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632674, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-4.xml" 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3166551078, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266944, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-10.jpg" 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3175626884, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266947, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-7.jpg" 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3179136996, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262352, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-41.xml" 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3184276249, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264832, 2024-04-26T20:29:12.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg" 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3207365493, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266950, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-4.jpg" 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3212754682, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630391, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-83.xml" 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3214308950, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264699, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-15.xml" 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3215428252, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632627, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-26.xml" 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3217481336, 2024-04-26T20:29:12.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262480, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-31.jpg" 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3244580441, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632653, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-10.xml" 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3263099636, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632626, 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-27.xml" 2024-04-26T20:29:12.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3265980306, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266881, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-56.xml" 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3270170274, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264675, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml" 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3273845689, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630363, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-25.xml" 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3281209927, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264758, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg" 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3287086656, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630699, 2024-04-26T20:29:12.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-6.xml" 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3292168425, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266839, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-72.xml" 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3297417486, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266906, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-37.xml" 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3304301526, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264838, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-10.jpg" 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3311815715, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264721, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml" 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3329700067, 2024-04-26T20:29:12.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632616, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-35.xml" 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3333776667, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266945, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-9.jpg" 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3333801045, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266929, 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-14.xml" 2024-04-26T20:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3357208380, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632520, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-71.xml" 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3366224952, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264681, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-24.xml" 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3372162929, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264677, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml" 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3381163258, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630353, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-35.xml" 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3384482568, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632599, 2024-04-26T20:29:12.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-41.xml" 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3388065817, 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264637, 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml" 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3404168412, 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264834, 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg" 2024-04-26T20:29:12.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3405258046, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262366, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-34.xml" 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3428126823, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262542, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-4.jpg" 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.104 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3437104849, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630309, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-14.xml" 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3437477875, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264687, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-21.xml" 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3439960669, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264582, 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-74.xml" 2024-04-26T20:29:12.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3457413482, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632552, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-57.xml" 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3459374394, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630304, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-17.xml" 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3467230117, 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262430, 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-3.xml" 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3479115534, 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632610, 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-37.xml" 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3480160459, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266894, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-49.xml" 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3481734189, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262448, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-47.jpg" 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3490977958, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266878, 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-58.xml" 2024-04-26T20:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3497843858, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262468, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-37.jpg" 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3506601188, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632529, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-67.xml" 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3518056017, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630379, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-9.xml" 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3524296059, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630316, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-7.xml" 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3527326181, 2024-04-26T20:29:12.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264787, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-28.jpg" 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3530390454, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632663, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-7.xml" 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3552375824, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266772, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-94.xml" 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3571052991, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264679, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml" 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3575742161, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630333, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-55.xml" 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3599948676, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266918, 2024-04-26T20:29:12.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-25.xml" 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3601807171, 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264801, 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-25.jpg" 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3608404574, 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264628, 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml" 2024-04-26T20:29:12.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3623691098, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264763, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-34.jpg" 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3624942932, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264575, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-76.xml" 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3640731858, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262496, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-23.jpg" 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3643786276, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266912, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-31.xml" 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3651928452, 2024-04-26T20:29:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262413, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-12.xml" 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3665996181, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630701, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-4.xml" 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3673732736, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630352, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-36.xml" 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3674778224, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632533, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-65.xml" 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3677412163, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630213, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-71.xml" 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3680685266, 2024-04-26T20:29:12.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264632, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml" 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3708290636, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264591, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml" 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3722153709, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266903, 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-40.xml" 2024-04-26T20:29:12.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3722926314, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266917, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-26.xml" 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3730215205, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630349, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-39.xml" 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3780307107, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264601, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-66.xml" 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3787131672, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264612, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml" 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3797222929, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264656, 2024-04-26T20:29:12.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-36.xml" 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3803875296, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632543, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-60.xml" 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3806918887, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632618, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-33.xml" 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3820206426, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264643, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-43.xml" 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3823182914, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632561, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-54.xml" 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3842762776, 2024-04-26T20:29:12.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264662, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-33.xml" 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3851311539, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264755, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-36.jpg" 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3861238696, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266871, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-61.xml" 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3872207528, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262409, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-14.xml" 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3874880125, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264854, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg" 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3875964290, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264639, 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml" 2024-04-26T20:29:12.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3883011480, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262536, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-7.jpg" 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3892599699, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630374, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-14.xml" 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.125 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3900347679, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262436, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-53.jpg" 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3915745922, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630212, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-44.jpg" 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3924996788, 2024-04-26T20:29:12.126 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266902, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-41.xml" 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3928326670, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264647, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml" 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3928398975, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262388, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-24.xml" 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3933657043, 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266874, 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-60.xml" 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3935449523, 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630368, 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-20.xml" 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3951826586, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262458, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-42.jpg" 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3963563201, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630337, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-51.xml" 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3969409355, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262419, 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-9.xml" 2024-04-26T20:29:12.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3978544497, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264818, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-20.jpg" 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4008352715, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630336, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-52.xml" 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4032735394, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266904, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-39.xml" 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4034387754, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264670, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml" 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4055630522, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262470, 2024-04-26T20:29:12.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-36.jpg" 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4056389789, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266794, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-87.xml" 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4063809548, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264711, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-9.xml" 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.132 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4064403921, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266946, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-8.jpg" 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4067495779, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264664, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-32.xml" 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4084718022, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264737, 2024-04-26T20:29:12.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg" 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4087773454, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264666, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml" 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4093059151, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630315, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-8.xml" 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4103400945, 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266939, 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-4.xml" 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4105153363, 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266914, 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-29.xml" 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.135 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4106779422, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632624, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-28.xml" 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4115454484, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632632, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-22.xml" 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4130385718, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262432, 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-2.xml" 2024-04-26T20:29:12.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4131085090, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262424, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-6.xml" 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4134026120, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266862, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-64.xml" 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.137 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4134413236, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262509, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-19.jpg" 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4149348064, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630322, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-1.xml" 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4157768562, 2024-04-26T20:29:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264615, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml" 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4164407220, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264655, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-37.xml" 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4169260814, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266800, 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-85.xml" 2024-04-26T20:29:12.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4179842946, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262442, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-50.jpg" 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4183443632, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632677, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-3.xml" 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.140 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4184559585, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262376, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-29.xml" 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4195207330, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264856, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-1.jpg" 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4196730715, 2024-04-26T20:29:12.141 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264589, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml" 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4198027110, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630348, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-40.xml" 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4201696661, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264822, 2024-04-26T20:29:12.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg" 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4215128125, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264693, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml" 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4218473319, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264743, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-42.jpg" 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4233223066, 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262421, 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-8.xml" 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4240595258, 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266775, 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-93.xml" 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4244995441, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262540, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-5.jpg" 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4264209859, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264649, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-40.xml" 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4282457733, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262364, 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-35.xml" 2024-04-26T20:29:12.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4293339319, 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264707, 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml" 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:29:12.146 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.954+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb3d00a3ba0 msgr2=0x7fb3d00a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.954+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb3d00a3ba0 0x7fb3d00a6060 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8006fd0 tx=0x7fb3d8009190 comp rx=0 tx=0).stop 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.954+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 msgr2=0x7fb3e81143a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:11.954+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e81143a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400bf70 tx=0x7fb3e400c4d0 comp rx=0 tx=0).stop 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.002+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 shutdown_connections 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.002+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb3d00a3ba0 0x7fb3d00a6060 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.002+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e810d370 0x7fb3e81143a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.002+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3e810a0e0 0x7fb3e8117d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.002+0000 7fb3f0800640 1 --2- 172.21.15.82:0/3793899462 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3e806b540 0x7fb3e8117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.002+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 >> 172.21.15.82:0/3793899462 conn(0x7fb3e806f980 msgr2=0x7fb3e8112310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.065+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 shutdown_connections 2024-04-26T20:29:12.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:12.072+0000 7fb3f0800640 1 -- 172.21.15.82:0/3793899462 wait complete. 2024-04-26T20:29:12.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:11 smithi082 ceph-mon[28105]: pgmap v604: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 368 op/s 2024-04-26T20:29:12.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-26T20:29:12.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:11 smithi139 ceph-mon[32999]: pgmap v604: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 368 op/s 2024-04-26T20:29:12.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:11 smithi135 ceph-mon[32816]: pgmap v604: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 368 op/s 2024-04-26T20:29:14.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:13 smithi082 ceph-mon[28105]: pgmap v605: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 374 op/s 2024-04-26T20:29:14.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:13 smithi139 ceph-mon[32999]: pgmap v605: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 374 op/s 2024-04-26T20:29:14.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:13 smithi135 ceph-mon[32816]: pgmap v605: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 374 op/s 2024-04-26T20:29:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:15 smithi082 ceph-mon[28105]: pgmap v606: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 208 op/s 2024-04-26T20:29:16.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:15 smithi139 ceph-mon[32999]: pgmap v606: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 208 op/s 2024-04-26T20:29:16.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:15 smithi135 ceph-mon[32816]: pgmap v606: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 208 op/s 2024-04-26T20:29:17.151 INFO:tasks.workunit.client.0.smithi082.stdout: 340 535744 872 360153 910 157544 1105 2024-04-26T20:29:17.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:16 smithi139 ceph-mon[32999]: pgmap v607: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 272 op/s 2024-04-26T20:29:17.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:16 smithi135 ceph-mon[32816]: pgmap v607: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 272 op/s 2024-04-26T20:29:17.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:16 smithi082 ceph-mon[28105]: pgmap v607: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 272 op/s 2024-04-26T20:29:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.444+0000 7f1f60a00640 1 -- 172.21.15.82:0/1328387489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10c2a0 msgr2=0x7f1f5c10e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.444+0000 7f1f60a00640 1 --2- 172.21.15.82:0/1328387489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10c2a0 0x7f1f5c10e730 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009900 tx=0x7f1f4802a440 comp rx=0 tx=0).stop 2024-04-26T20:29:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.447+0000 7f1f60a00640 1 -- 172.21.15.82:0/1328387489 shutdown_connections 2024-04-26T20:29:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.447+0000 7f1f60a00640 1 --2- 172.21.15.82:0/1328387489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f5c10ec70 0x7f1f5c10f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.447+0000 7f1f60a00640 1 --2- 172.21.15.82:0/1328387489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10c2a0 0x7f1f5c10e730 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.447+0000 7f1f60a00640 1 --2- 172.21.15.82:0/1328387489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 0x7f1f5c10bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.447+0000 7f1f60a00640 1 -- 172.21.15.82:0/1328387489 >> 172.21.15.82:0/1328387489 conn(0x7f1f5c06f7c0 msgr2=0x7f1f5c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:17.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.456+0000 7f1f60a00640 1 -- 172.21.15.82:0/1328387489 shutdown_connections 2024-04-26T20:29:17.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.457+0000 7f1f60a00640 1 -- 172.21.15.82:0/1328387489 wait complete. 2024-04-26T20:29:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.462+0000 7f1f60a00640 1 Processor -- start 2024-04-26T20:29:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.462+0000 7f1f60a00640 1 -- start start 2024-04-26T20:29:17.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.463+0000 7f1f60a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 0x7f1f5c1a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.467+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 0x7f1f5c1a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.467+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 0x7f1f5c1a7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38088/0 (socket says 172.21.15.82:38088) 2024-04-26T20:29:17.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.467+0000 7f1f60a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f5c10c2a0 0x7f1f5c1a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.468+0000 7f1f59e00640 1 -- 172.21.15.82:0/2870023639 learned_addr learned my addr 172.21.15.82:0/2870023639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.470+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10ec70 0x7f1f5c1aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.470+0000 7f1f5a800640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10ec70 0x7f1f5c1aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.470+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c11d310 con 0x7f1f5c10ec70 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.470+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c11d190 con 0x7f1f5c109930 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.470+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c11d490 con 0x7f1f5c10c2a0 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.471+0000 7f1f59400640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f5c10c2a0 0x7f1f5c1a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.472+0000 7f1f5a800640 1 -- 172.21.15.82:0/2870023639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f5c10c2a0 msgr2=0x7f1f5c1a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.472+0000 7f1f5a800640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f5c10c2a0 0x7f1f5c1a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.472+0000 7f1f5a800640 1 -- 172.21.15.82:0/2870023639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 msgr2=0x7f1f5c1a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.472+0000 7f1f5a800640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 0x7f1f5c1a7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.472+0000 7f1f5a800640 1 -- 172.21.15.82:0/2870023639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c1af450 con 0x7f1f5c10ec70 2024-04-26T20:29:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.474+0000 7f1f5a800640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10ec70 0x7f1f5c1aede0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005fd0 tx=0x7f1f5400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.476+0000 7f1f52a00640 1 -- 172.21.15.82:0/2870023639 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54004d20 con 0x7f1f5c10ec70 2024-04-26T20:29:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.476+0000 7f1f52a00640 1 -- 172.21.15.82:0/2870023639 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f54005020 con 0x7f1f5c10ec70 2024-04-26T20:29:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.476+0000 7f1f52a00640 1 -- 172.21.15.82:0/2870023639 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f540226c0 con 0x7f1f5c10ec70 2024-04-26T20:29:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.479+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1110c0 con 0x7f1f5c10ec70 2024-04-26T20:29:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.479+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c111590 con 0x7f1f5c10ec70 2024-04-26T20:29:17.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.499+0000 7f1f639e8740 1 Processor -- start 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.505+0000 7f1f52a00640 1 -- 172.21.15.82:0/2870023639 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1f540054d0 con 0x7f1f5c10ec70 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.509+0000 7f1f639e8740 1 -- start start 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.509+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab3252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.510+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.510+0000 7f1f59400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab3252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.510+0000 7f1f59400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab3252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38094/0 (socket says 172.21.15.82:38094) 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.511+0000 7f1f59400640 1 -- 172.21.15.82:0/3490300853 learned_addr learned my addr 172.21.15.82:0/3490300853 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.511+0000 7f1f59e00640 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.512+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.513+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8ab288c70 con 0x55d8ab32aa00 2024-04-26T20:29:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.513+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8ab241980 con 0x55d8ab324ea0 2024-04-26T20:29:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.513+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8ab284c30 con 0x55d8ab325890 2024-04-26T20:29:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.524+0000 7f1f59e00640 1 -- 172.21.15.82:0/3490300853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 msgr2=0x55d8ab3252c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:17.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.524+0000 7f1f59e00640 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab3252c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.524+0000 7f1f59e00640 1 -- 172.21.15.82:0/3490300853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 msgr2=0x55d8ab32ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:17.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.524+0000 7f1f59e00640 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.524+0000 7f1f59e00640 1 -- 172.21.15.82:0/3490300853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ab2197b0 con 0x55d8ab325890 2024-04-26T20:29:17.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.528+0000 7f1f52a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1f400a3d90 0x7f1f400a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.528+0000 7f1f52a00640 1 -- 172.21.15.82:0/2870023639 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1f540e1c80 con 0x7f1f5c10ec70 2024-04-26T20:29:17.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.533+0000 7f1f59400640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1f400a3d90 0x7f1f400a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.534+0000 7f1f59e00640 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32a390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009c30 tx=0x7f1f4c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=196d214831941431 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.535+0000 7f1f59400640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1f400a3d90 0x7f1f400a6250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55d8ab3260f0 tx=0x7f1f48005df0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.535+0000 7f1f47000640 1 -- 172.21.15.82:0/3490300853 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c012450 con 0x55d8ab325890 2024-04-26T20:29:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.537+0000 7f1f47000640 1 -- 172.21.15.82:0/3490300853 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c012aa0 con 0x55d8ab325890 2024-04-26T20:29:17.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.539+0000 7f1f47000640 1 -- 172.21.15.82:0/3490300853 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00fb30 con 0x55d8ab325890 2024-04-26T20:29:17.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.543+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 msgr2=0x55d8ab32a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.543+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32a390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009c30 tx=0x7f1f4c0117b0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.569+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 shutdown_connections 2024-04-26T20:29:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.569+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.569+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32a390 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.569+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3490300853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab3252c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.569+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 >> 172.21.15.82:0/3490300853 conn(0x55d8ab320510 msgr2=0x55d8ab320910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:17.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.571+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 shutdown_connections 2024-04-26T20:29:17.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.571+0000 7f1f639e8740 1 -- 172.21.15.82:0/3490300853 wait complete. 2024-04-26T20:29:17.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.572+0000 7f1f639e8740 1 -- start start 2024-04-26T20:29:17.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.572+0000 7f1f639e8740 1 Processor -- start 2024-04-26T20:29:17.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.573+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab32ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.575+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab32ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.576+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab32ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38110/0 (socket says 172.21.15.82:38110) 2024-04-26T20:29:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.576+0000 7f1f59e00640 1 -- 172.21.15.82:0/118181124 learned_addr learned my addr 172.21.15.82:0/118181124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.576+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.576+0000 7f1f59400640 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.576+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab3362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.579+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8ab287f80 con 0x55d8ab32aa00 2024-04-26T20:29:17.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.579+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8ab235260 con 0x55d8ab324ea0 2024-04-26T20:29:17.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.579+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8ab28d2a0 con 0x55d8ab325890 2024-04-26T20:29:17.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.579+0000 7f1f639e8740 10 client.0 _ll_register_callbacks cb 0x55d8ab27f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.581+0000 7f1f59e00640 1 -- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 msgr2=0x55d8ab32f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.581+0000 7f1f59e00640 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.581+0000 7f1f59e00640 1 -- 172.21.15.82:0/118181124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 msgr2=0x55d8ab3362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.581+0000 7f1f59e00640 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab3362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.581+0000 7f1f59e00640 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ab2171c0 con 0x55d8ab324ea0 2024-04-26T20:29:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.582+0000 7f1f59e00640 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab32ed60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c000c00 tx=0x7f1f4c012e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0268ff886fd809 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.592+0000 7f1f3b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:29:17.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.592+0000 7f1f3b400640 1 -- 172.21.15.82:0/118181124 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c028070 con 0x55d8ab324ea0 2024-04-26T20:29:17.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.592+0000 7f1f3b400640 1 -- 172.21.15.82:0/118181124 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1f4c012860 con 0x55d8ab324ea0 2024-04-26T20:29:17.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.600+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c012aa0 con 0x55d8ab324ea0 2024-04-26T20:29:17.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.608+0000 7f1f3b400640 1 -- 172.21.15.82:0/118181124 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1f4c032050 con 0x55d8ab324ea0 2024-04-26T20:29:17.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.608+0000 7f1f639e8740 10 client.26852 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:17.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.608+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55d8aaf9a3f0 con 0x55d8ab324ea0 2024-04-26T20:29:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.608+0000 7f1f3b400640 1 -- 172.21.15.82:0/118181124 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c012aa0 con 0x55d8ab324ea0 2024-04-26T20:29:17.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.614+0000 7f1f3b400640 1 -- 172.21.15.82:0/118181124 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f1f4c005040 con 0x55d8ab324ea0 2024-04-26T20:29:17.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f639e8740 10 client.26852 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:17.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f639e8740 10 client.26852 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:29:17.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f639e8740 20 client.26852 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:17.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab33a5a0 0x55d8ab33c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f639e8740 4 client.26852 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:17.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8ab296880 con 0x55d8ab33a5a0 2024-04-26T20:29:17.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.616+0000 7f1f59400640 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab33a5a0 0x55d8ab33c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.622+0000 7f1f59400640 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab33a5a0 0x55d8ab33c990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3671224ba1744f9 server_cookie=592cb9a229ed328b in_seq=0 out_seq=0 2024-04-26T20:29:17.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.623+0000 7f1f3b400640 10 client.26852 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:29:17.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.658+0000 7f1f3b400640 1 -- 172.21.15.82:0/118181124 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8ab296880 con 0x55d8ab33a5a0 2024-04-26T20:29:17.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.658+0000 7f1f3b400640 10 client.26852 handle_command_reply: tid=0 2024-04-26T20:29:17.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.659+0000 7f1f639e8740 1 client.26852 shutdown 2024-04-26T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.680+0000 7efc71200640 1 -- 172.21.15.82:0/1774284418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 msgr2=0x7efc6c10f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.680+0000 7efc71200640 1 --2- 172.21.15.82:0/1774284418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c10f0d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efc64009be0 tx=0x7efc6402a6d0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.685+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 msgr2=0x55d8ab32ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.685+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab32ed60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c000c00 tx=0x7f1f4c012e80 comp rx=0 tx=0).stop 2024-04-26T20:29:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.702+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 shutdown_connections 2024-04-26T20:29:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.702+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab33a5a0 0x55d8ab33c990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.703+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab3362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.703+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab32f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.703+0000 7f1f639e8740 1 --2- 172.21.15.82:0/118181124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab32ed60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.703+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 >> 172.21.15.82:0/118181124 conn(0x55d8ab320510 msgr2=0x55d8ab31f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.703+0000 7f1f3b400640 0 client.26852 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.722+0000 7efc71200640 1 -- 172.21.15.82:0/1774284418 shutdown_connections 2024-04-26T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.722+0000 7efc71200640 1 --2- 172.21.15.82:0/1774284418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c10f0d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.722+0000 7efc71200640 1 --2- 172.21.15.82:0/1774284418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 0x7efc6c10e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.722+0000 7efc71200640 1 --2- 172.21.15.82:0/1774284418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 0x7efc6c10bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.722+0000 7efc71200640 1 -- 172.21.15.82:0/1774284418 >> 172.21.15.82:0/1774284418 conn(0x7efc6c06f9a0 msgr2=0x7efc6c071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.730+0000 7efc71200640 1 -- 172.21.15.82:0/1774284418 shutdown_connections 2024-04-26T20:29:17.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.729+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 shutdown_connections 2024-04-26T20:29:17.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.729+0000 7f1f639e8740 1 -- 172.21.15.82:0/118181124 wait complete. 2024-04-26T20:29:17.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:17.731+0000 7f1f639e8740 20 client.26852 trim_cache size 0 max 16384 2024-04-26T20:29:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.747+0000 7efc71200640 1 -- 172.21.15.82:0/1774284418 wait complete. 2024-04-26T20:29:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.749+0000 7efc71200640 1 Processor -- start 2024-04-26T20:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.754+0000 7efc71200640 1 -- start start 2024-04-26T20:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.757+0000 7efc71200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 0x7efc6c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.763+0000 7efc71200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 0x7efc6c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.764+0000 7efc71200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c1a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.766+0000 7efc69400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 0x7efc6c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.767+0000 7efc69e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 0x7efc6c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.767+0000 7efc69e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 0x7efc6c19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38130/0 (socket says 172.21.15.82:38130) 2024-04-26T20:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.767+0000 7efc69400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 0x7efc6c19f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51184/0 (socket says 172.21.15.82:51184) 2024-04-26T20:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.768+0000 7efc6a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c1a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.773+0000 7efc71200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c112a90 con 0x7efc6c10ec50 2024-04-26T20:29:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.773+0000 7efc71200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c112910 con 0x7efc6c109930 2024-04-26T20:29:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.773+0000 7efc71200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c112c10 con 0x7efc6c10c2a0 2024-04-26T20:29:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.773+0000 7efc69e00640 1 -- 172.21.15.82:0/1658853359 learned_addr learned my addr 172.21.15.82:0/1658853359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.769+0000 7efc6a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c1a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60938/0 (socket says 172.21.15.82:60938) 2024-04-26T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.777+0000 7efc6a800640 1 -- 172.21.15.82:0/1658853359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 msgr2=0x7efc6c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.777+0000 7efc6a800640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 0x7efc6c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.777+0000 7efc6a800640 1 -- 172.21.15.82:0/1658853359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 msgr2=0x7efc6c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.777+0000 7efc6a800640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 0x7efc6c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.777+0000 7efc6a800640 1 -- 172.21.15.82:0/1658853359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c1a6af0 con 0x7efc6c10ec50 2024-04-26T20:29:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.787+0000 7efc6a800640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c1a6480 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc6402acc0 tx=0x7efc64030c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.829+0000 7efc62a00640 1 -- 172.21.15.82:0/1658853359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64040020 con 0x7efc6c10ec50 2024-04-26T20:29:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.829+0000 7efc62a00640 1 -- 172.21.15.82:0/1658853359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc640318f0 con 0x7efc6c10ec50 2024-04-26T20:29:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.829+0000 7efc62a00640 1 -- 172.21.15.82:0/1658853359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64036040 con 0x7efc6c10ec50 2024-04-26T20:29:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.842+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c1a6d80 con 0x7efc6c10ec50 2024-04-26T20:29:17.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.843+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c1a7190 con 0x7efc6c10ec50 2024-04-26T20:29:17.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.890+0000 7efc62a00640 1 -- 172.21.15.82:0/1658853359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efc64043020 con 0x7efc6c10ec50 2024-04-26T20:29:17.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.895+0000 7efc62a00640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efc500a3e80 0x7efc500a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.903+0000 7efc74198740 1 Processor -- start 2024-04-26T20:29:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.909+0000 7efc62a00640 1 -- 172.21.15.82:0/1658853359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7efc640f10f0 con 0x7efc6c10ec50 2024-04-26T20:29:17.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.918+0000 7efc69e00640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efc500a3e80 0x7efc500a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.931+0000 7efc74198740 1 -- start start 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.932+0000 7efc74198740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108cbd0 0x559fa108cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.932+0000 7efc74198740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.932+0000 7efc74198740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 0x559fa1094bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.932+0000 7efc74198740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559fa0ff1380 con 0x559fa1092730 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.932+0000 7efc74198740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559fa0f8dc30 con 0x559fa108cbd0 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.932+0000 7efc74198740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559fa0fed340 con 0x559fa108d5c0 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.934+0000 7efc69400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.934+0000 7efc69400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10920c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51186/0 (socket says 172.21.15.82:51186) 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.934+0000 7efc69400640 1 -- 172.21.15.82:0/1231650498 learned_addr learned my addr 172.21.15.82:0/1231650498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.938+0000 7efc69400640 1 -- 172.21.15.82:0/1231650498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108cbd0 msgr2=0x559fa108cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:17.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.938+0000 7efc69400640 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108cbd0 0x559fa108cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.938+0000 7efc69400640 1 -- 172.21.15.82:0/1231650498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 msgr2=0x559fa1094bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.939+0000 7efc69400640 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 0x559fa1094bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.939+0000 7efc69400640 1 -- 172.21.15.82:0/1231650498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa0faf940 con 0x559fa108d5c0 2024-04-26T20:29:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.942+0000 7efc69400640 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10920c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc5801acb0 tx=0x7efc58022820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2014cb11ea28889 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.944+0000 7efc69e00640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efc500a3e80 0x7efc500a6340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc5c005fd0 tx=0x7efc5c00b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.946+0000 7efc57400640 1 -- 172.21.15.82:0/1231650498 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58004260 con 0x559fa108d5c0 2024-04-26T20:29:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.946+0000 7efc57400640 1 -- 172.21.15.82:0/1231650498 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc58004400 con 0x559fa108d5c0 2024-04-26T20:29:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.946+0000 7efc57400640 1 -- 172.21.15.82:0/1231650498 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5802a7e0 con 0x559fa108d5c0 2024-04-26T20:29:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.948+0000 7efc74198740 1 -- 172.21.15.82:0/1231650498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 msgr2=0x559fa10920c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.948+0000 7efc74198740 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10920c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc5801acb0 tx=0x7efc58022820 comp rx=0 tx=0).stop 2024-04-26T20:29:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.956+0000 7efc74198740 1 -- 172.21.15.82:0/1231650498 shutdown_connections 2024-04-26T20:29:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.956+0000 7efc74198740 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 0x559fa1094bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.958+0000 7efc74198740 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10920c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.958+0000 7efc74198740 1 --2- 172.21.15.82:0/1231650498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108cbd0 0x559fa108cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.958+0000 7efc74198740 1 -- 172.21.15.82:0/1231650498 >> 172.21.15.82:0/1231650498 conn(0x559fa1088240 msgr2=0x559fa1088640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:17.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.960+0000 7efc74198740 1 -- 172.21.15.82:0/1231650498 shutdown_connections 2024-04-26T20:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.960+0000 7efc74198740 1 -- 172.21.15.82:0/1231650498 wait complete. 2024-04-26T20:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.960+0000 7efc74198740 1 -- start start 2024-04-26T20:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.961+0000 7efc74198740 1 Processor -- start 2024-04-26T20:29:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.965+0000 7efc74198740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 0x559fa1096f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.967+0000 7efc74198740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa108d5c0 0x559fa1097470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.968+0000 7efc69e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 0x559fa1096f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.968+0000 7efc69e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 0x559fa1096f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:51190/0 (socket says 172.21.15.82:51190) 2024-04-26T20:29:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.972+0000 7efc69400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa108d5c0 0x559fa1097470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.972+0000 7efc69400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa108d5c0 0x559fa1097470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60964/0 (socket says 172.21.15.82:60964) 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.972+0000 7efc69e00640 1 -- 172.21.15.82:0/3328801391 learned_addr learned my addr 172.21.15.82:0/3328801391 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.972+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1092730 0x559fa109e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.972+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559fa10956e0 con 0x559fa108d5c0 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.973+0000 7efc6a800640 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1092730 0x559fa109e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.973+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559fa0f78c60 con 0x559fa1092730 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.973+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559fa1095860 con 0x559fa108cbd0 2024-04-26T20:29:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.983+0000 7efc74198740 10 client.0 _ll_register_callbacks cb 0x559fa0fa4e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:17.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.984+0000 7efc69e00640 1 -- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1092730 msgr2=0x559fa109e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:17.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.984+0000 7efc69e00640 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1092730 0x559fa109e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.984+0000 7efc69e00640 1 -- 172.21.15.82:0/3328801391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa108d5c0 msgr2=0x559fa1097470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:17.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.984+0000 7efc69e00640 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa108d5c0 0x559fa1097470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:17.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.984+0000 7efc69e00640 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa0f87510 con 0x559fa108cbd0 2024-04-26T20:29:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:17.986+0000 7efc69e00640 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 0x559fa1096f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0116a0 tx=0x7efc5c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ebd84bc7dcd609 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.000+0000 7efc4be00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:29:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.000+0000 7efc4be00640 1 -- 172.21.15.82:0/3328801391 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c005220 con 0x559fa108cbd0 2024-04-26T20:29:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.000+0000 7efc4be00640 1 -- 172.21.15.82:0/3328801391 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7efc5c0053c0 con 0x559fa108cbd0 2024-04-26T20:29:18.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.026+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc58004400 con 0x559fa108cbd0 2024-04-26T20:29:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.043+0000 7efc4be00640 1 -- 172.21.15.82:0/3328801391 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7efc5c0055c0 con 0x559fa108cbd0 2024-04-26T20:29:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.093+0000 7efc74198740 10 client.26932 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.093+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559fa0d03210 con 0x559fa108cbd0 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc4be00640 1 -- 172.21.15.82:0/3328801391 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc58004400 con 0x559fa108cbd0 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc4be00640 1 -- 172.21.15.82:0/3328801391 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7efc5c01cbf0 con 0x559fa108cbd0 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc74198740 10 client.26932 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc74198740 10 client.26932 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc74198740 20 client.26932 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa10a2840 0x559fa10a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc74198740 4 client.26932 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.125+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fa0ffef90 con 0x559fa10a2840 2024-04-26T20:29:18.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.135+0000 7efc69400640 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa10a2840 0x559fa10a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.141+0000 7efc69400640 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa10a2840 0x559fa10a4cc0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c343c0081cf50e1 server_cookie=f6580917c21db7c3 in_seq=0 out_seq=0 2024-04-26T20:29:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.162+0000 7efc4be00640 10 client.26932 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.162+0000 7efc4be00640 1 -- 172.21.15.82:0/3328801391 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559fa0ffef90 con 0x559fa10a2840 2024-04-26T20:29:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.162+0000 7efc4be00640 10 client.26932 handle_command_reply: tid=0 2024-04-26T20:29:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.162+0000 7efc74198740 1 client.26932 shutdown 2024-04-26T20:29:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.173+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 msgr2=0x559fa1096f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.173+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 0x559fa1096f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0116a0 tx=0x7efc5c004730 comp rx=0 tx=0).stop 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 shutdown_connections 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa10a2840 0x559fa10a4cc0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1092730 0x559fa109e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa108d5c0 0x559fa1097470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc74198740 1 --2- 172.21.15.82:0/3328801391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108cbd0 0x559fa1096f30 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0116a0 tx=0x7efc5c004730 comp rx=0 tx=0).stop 2024-04-26T20:29:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 >> 172.21.15.82:0/3328801391 conn(0x559fa1088240 msgr2=0x559fa1087440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.175+0000 7efc4be00640 0 client.26932 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.179+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 shutdown_connections 2024-04-26T20:29:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.179+0000 7efc74198740 1 -- 172.21.15.82:0/3328801391 wait complete. 2024-04-26T20:29:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.185+0000 7efc74198740 20 client.26932 trim_cache size 0 max 16384 2024-04-26T20:29:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.205+0000 7f1f639e8740 1 Processor -- start 2024-04-26T20:29:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.218+0000 7f1f639e8740 1 -- start start 2024-04-26T20:29:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.218+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab323800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.224+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab323800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.224+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab323800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38140/0 (socket says 172.21.15.82:38140) 2024-04-26T20:29:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.224+0000 7f1f59e00640 1 -- 172.21.15.82:0/3219860892 learned_addr learned my addr 172.21.15.82:0/3219860892 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.226+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab323d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.228+0000 7f1f59400640 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab323d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.229+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.231+0000 7f1f5a800640 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.231+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b1870 con 0x55d8ab32aa00 2024-04-26T20:29:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.231+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b3530 con 0x55d8ab324ea0 2024-04-26T20:29:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.231+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b1f40 con 0x55d8ab325890 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.235+0000 7f1f59400640 1 -- 172.21.15.82:0/3219860892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 msgr2=0x55d8ab323800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.235+0000 7f1f59400640 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab323800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.235+0000 7f1f59400640 1 -- 172.21.15.82:0/3219860892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 msgr2=0x55d8ab32e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.235+0000 7f1f59400640 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.235+0000 7f1f59400640 1 -- 172.21.15.82:0/3219860892 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ab0647d0 con 0x55d8ab325890 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.237+0000 7f1f59400640 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab323d40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f48005ec0 tx=0x7f1f4803c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbf8a3491182913 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.240+0000 7f1f46600640 1 -- 172.21.15.82:0/3219860892 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4803f9d0 con 0x55d8ab325890 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.240+0000 7f1f46600640 1 -- 172.21.15.82:0/3219860892 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f48055920 con 0x55d8ab325890 2024-04-26T20:29:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.240+0000 7f1f46600640 1 -- 172.21.15.82:0/3219860892 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48031b70 con 0x55d8ab325890 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.252+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 msgr2=0x55d8ab323d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.252+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab323d40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f48005ec0 tx=0x7f1f4803c000 comp rx=0 tx=0).stop 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.256+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 shutdown_connections 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.256+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab32aa00 0x55d8ab32e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.256+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab325890 0x55d8ab323d40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.256+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3219860892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab323800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.256+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 >> 172.21.15.82:0/3219860892 conn(0x55d8ab320510 msgr2=0x55d8ab3230f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.321+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 shutdown_connections 2024-04-26T20:29:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.333+0000 7f1f639e8740 1 -- 172.21.15.82:0/3219860892 wait complete. 2024-04-26T20:29:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.333+0000 7f1f639e8740 1 -- start start 2024-04-26T20:29:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.333+0000 7f1f639e8740 1 Processor -- start 2024-04-26T20:29:18.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.344+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab332a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.344+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab325890 0x55d8ab332f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.346+0000 7f1f639e8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab32aa00 0x55d8ab333f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.346+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab332a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.346+0000 7f1f59e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab332a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38148/0 (socket says 172.21.15.82:38148) 2024-04-26T20:29:18.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.348+0000 7f1f59e00640 1 -- 172.21.15.82:0/3555337896 learned_addr learned my addr 172.21.15.82:0/3555337896 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:18.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.350+0000 7f1f5a800640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab32aa00 0x55d8ab333f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.350+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b2e60 con 0x55d8ab325890 2024-04-26T20:29:18.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.351+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b26d0 con 0x55d8ab324ea0 2024-04-26T20:29:18.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.351+0000 7f1f59400640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab325890 0x55d8ab332f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.351+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1af870 con 0x55d8ab32aa00 2024-04-26T20:29:18.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.353+0000 7f1f5a800640 1 -- 172.21.15.82:0/3555337896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 msgr2=0x55d8ab332a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:18.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.353+0000 7f1f5a800640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab332a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.353+0000 7f1f5a800640 1 -- 172.21.15.82:0/3555337896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab325890 msgr2=0x55d8ab332f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:18.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.353+0000 7f1f5a800640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab325890 0x55d8ab332f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.353+0000 7f1f5a800640 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ab22f2a0 con 0x55d8ab32aa00 2024-04-26T20:29:18.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.356+0000 7f1f59400640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab325890 0x55d8ab332f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:29:18.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.367+0000 7f1f639e8740 10 client.0 _ll_register_callbacks cb 0x7f1f48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:18.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.367+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8ab2906f0 con 0x55d8ab32aa00 2024-04-26T20:29:18.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.371+0000 7f1f3b400640 10 client.26938 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:29:18.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.356+0000 7f1f5a800640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab32aa00 0x55d8ab333f10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1f540df270 tx=0x7f1f540ad420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4370da7b3e6d6454 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:18.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.429+0000 7f1f3b400640 1 -- 172.21.15.82:0/3555337896 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f540c6030 con 0x55d8ab32aa00 2024-04-26T20:29:18.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.429+0000 7f1f3b400640 1 -- 172.21.15.82:0/3555337896 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1f540df4c0 con 0x55d8ab32aa00 2024-04-26T20:29:18.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.429+0000 7f1f3b400640 1 -- 172.21.15.82:0/3555337896 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1f540b1e70 con 0x55d8ab32aa00 2024-04-26T20:29:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.442+0000 7f1f639e8740 10 client.26938 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.442+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55d8ab3353e0 con 0x55d8ab32aa00 2024-04-26T20:29:18.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.443+0000 7f1f3b400640 1 -- 172.21.15.82:0/3555337896 <== mon.1 v2:172.21.15.139:3300/0 4 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f1f5400f040 con 0x55d8ab32aa00 2024-04-26T20:29:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.449+0000 7f1f639e8740 10 client.26938 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.449+0000 7f1f639e8740 10 client.26938 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-04-26T20:29:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.449+0000 7f1f639e8740 20 client.26938 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.449+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab3a0ab0 0x55d8ab3a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.449+0000 7f1f639e8740 4 client.26938 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:29:18.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.449+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 --> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8ab20b4d0 con 0x55d8ab3a0ab0 2024-04-26T20:29:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.485+0000 7f1f59e00640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab3a0ab0 0x55d8ab3a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.499+0000 7f1f59e00640 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab3a0ab0 0x55d8ab3a2f40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f451121c1bb75cd6 server_cookie=4b9ce406a40a9189 in_seq=0 out_seq=0 2024-04-26T20:29:18.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.511+0000 7f1f3b400640 10 client.26938 ms_handle_connect on v2:172.21.15.139:6838/1238493959 2024-04-26T20:29:18.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.514+0000 7f1f3b400640 1 -- 172.21.15.82:0/3555337896 <== mds.2 v2:172.21.15.139:6838/1238493959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+90259 (crc 0 0 0) 0x55d8ab20b4d0 con 0x55d8ab3a0ab0 2024-04-26T20:29:18.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.514+0000 7f1f3b400640 10 client.26938 handle_command_reply: tid=0 2024-04-26T20:29:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.518+0000 7f1f639e8740 1 client.26938 shutdown 2024-04-26T20:29:18.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.556+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab32aa00 msgr2=0x55d8ab333f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:18.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.556+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab32aa00 0x55d8ab333f10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1f540df270 tx=0x7f1f540ad420 comp rx=0 tx=0).stop 2024-04-26T20:29:18.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 shutdown_connections 2024-04-26T20:29:18.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:6838/1238493959,v1:172.21.15.139:6839/1238493959] conn(0x55d8ab3a0ab0 0x55d8ab3a2f40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8ab32aa00 0x55d8ab333f10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ab325890 0x55d8ab332f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f639e8740 1 --2- 172.21.15.82:0/3555337896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8ab324ea0 0x55d8ab332a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 >> 172.21.15.82:0/3555337896 conn(0x55d8ab320510 msgr2=0x55d8ab323980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:18.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.559+0000 7f1f3b400640 0 client.26938 ms_handle_reset on v2:172.21.15.139:6838/1238493959 2024-04-26T20:29:18.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.561+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 shutdown_connections 2024-04-26T20:29:18.582 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-04-26T20:29:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 54170385, 2024-04-26T20:29:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268407, 2024-04-26T20:29:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml" 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 57639164, 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268322, 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-31.xml" 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 66643222, 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260937, 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg" 2024-04-26T20:29:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 74349870, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260756, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-64.xml" 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 120561872, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260866, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-9.xml" 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 133754784, 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267499, 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg" 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 134364634, 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260716, 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-84.xml" 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.585 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 145799313, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268319, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-32.xml" 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 173601005, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260780, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-52.xml" 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 193750981, 2024-04-26T20:29:18.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268390, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-8.xml" 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 215379492, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631653, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-14.xml" 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 218690886, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260802, 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-41.xml" 2024-04-26T20:29:18.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 222963991, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267411, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg" 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 228331218, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631566, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-79.xml" 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 239123539, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268310, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-35.xml" 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 269747649, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631641, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-26.xml" 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 284240485, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260874, 2024-04-26T20:29:18.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-5.xml" 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 294008873, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260852, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-16.xml" 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 296414320, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268302, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-38.xml" 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 302818681, 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267377, 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml" 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 306320151, 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631654, 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-13.xml" 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 325843685, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260810, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-37.xml" 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 332953525, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267459, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg" 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 340863622, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260808, 2024-04-26T20:29:18.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-38.xml" 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 347306842, 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260921, 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg" 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 358867060, 2024-04-26T20:29:18.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631622, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-45.xml" 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 362645540, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267405, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml" 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 366805241, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260987, 2024-04-26T20:29:18.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-9.jpg" 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 371527857, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260991, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-7.jpg" 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 388418523, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260800, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-42.xml" 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 407968301, 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260826, 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-29.xml" 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 408401878, 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260979, 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-13.jpg" 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 410009507, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260814, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-35.xml" 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 416475377, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260856, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-14.xml" 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 437147003, 2024-04-26T20:29:18.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260872, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-6.xml" 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 449123181, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260995, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-5.jpg" 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 450341099, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268367, 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-16.xml" 2024-04-26T20:29:18.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 452253274, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267485, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg" 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 460464034, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260754, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-65.xml" 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 490581408, 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631629, 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-38.xml" 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 494234121, 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260981, 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-12.jpg" 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 499847816, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631617, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-50.xml" 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 510708026, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632211, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-86.xml" 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 514981213, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630297, 2024-04-26T20:29:18.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-92.xml" 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 568532698, 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631638, 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-29.xml" 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 574025917, 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267473, 2024-04-26T20:29:18.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg" 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 575911877, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260858, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-13.xml" 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 577206765, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267497, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg" 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 589525068, 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268234, 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-60.xml" 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 593459192, 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267427, 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg" 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 598396621, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268245, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-57.xml" 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 610440625, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268242, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-58.xml" 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 640265529, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267479, 2024-04-26T20:29:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg" 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 641930423, 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267449, 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg" 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 652713719, 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631667, 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-9.xml" 2024-04-26T20:29:18.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 662077732, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260718, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-83.xml" 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 662441793, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267483, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg" 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 686789104, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267361, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-24.xml" 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 690729478, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631563, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-80.xml" 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 721373600, 2024-04-26T20:29:18.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260848, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-18.xml" 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 736848684, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268406, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml" 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 740836527, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268384, 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-10.xml" 2024-04-26T20:29:18.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 742314898, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633215, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-31.xml" 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 749462581, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268373, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-14.xml" 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 772807830, 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631643, 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-24.xml" 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 780372068, 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631612, 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-55.xml" 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 795121729, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267383, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml" 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 795760058, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631601, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-63.xml" 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 817246876, 2024-04-26T20:29:18.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260939, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg" 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 830150858, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268364, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-17.xml" 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 832967177, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260722, 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-81.xml" 2024-04-26T20:29:18.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 849960993, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631607, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-60.xml" 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 857156682, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261001, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-2.jpg" 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 859108242, 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260975, 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-15.jpg" 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 863042195, 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631632, 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-35.xml" 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.615 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 872599877, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631615, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-52.xml" 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 873572395, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267359, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-25.xml" 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 951714339, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631645, 2024-04-26T20:29:18.616 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-22.xml" 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 968249025, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268282, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-45.xml" 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 974039814, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260764, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-60.xml" 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 976241444, 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267457, 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg" 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 991920523, 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260736, 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-74.xml" 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1011984496, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260951, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg" 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1048819597, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260941, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg" 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1055762313, 2024-04-26T20:29:18.619 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260868, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-8.xml" 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1088877941, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260740, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-72.xml" 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1094467786, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268388, 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-9.xml" 2024-04-26T20:29:18.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1097993129, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631634, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-33.xml" 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1099384658, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631587, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-71.xml" 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.621 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1104930483, 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268285, 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-44.xml" 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1107825981, 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268342, 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-25.xml" 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.622 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1132736748, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260985, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-10.jpg" 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1144363110, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260894, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg" 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1194997847, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267375, 2024-04-26T20:29:18.623 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml" 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1209333295, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260955, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg" 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1214841596, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268325, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-30.xml" 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1218676010, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260890, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg" 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1221050850, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260792, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-46.xml" 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1251704067, 2024-04-26T20:29:18.625 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268351, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-22.xml" 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1283115043, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631600, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-64.xml" 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1309529958, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267403, 2024-04-26T20:29:18.626 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml" 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1319135992, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260993, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-6.jpg" 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1326585228, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631574, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-76.xml" 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1339568055, 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267495, 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg" 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1340625941, 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267365, 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-22.xml" 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.628 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1345503896, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631599, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-65.xml" 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1360458251, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631630, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-37.xml" 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1373483200, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267441, 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg" 2024-04-26T20:29:18.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1373583586, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260836, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-24.xml" 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1373787000, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260860, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-12.xml" 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.630 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1392518886, 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260840, 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-22.xml" 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1474229902, 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268294, 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-41.xml" 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.631 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1480781358, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267447, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg" 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1486545871, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260876, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-4.xml" 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1491783379, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260915, 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg" 2024-04-26T20:29:18.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1492069322, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631659, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-12.xml" 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1498620127, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631621, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-46.xml" 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.633 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1504361428, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267385, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml" 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1538869580, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631628, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-39.xml" 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1543090982, 2024-04-26T20:29:18.634 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267417, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg" 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1563836016, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260730, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml" 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1567971899, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268404, 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml" 2024-04-26T20:29:18.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1582387034, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260738, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-73.xml" 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1587415764, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267465, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg" 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.636 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1590792418, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260969, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-18.jpg" 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1597715320, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267401, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml" 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1603813718, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260788, 2024-04-26T20:29:18.637 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-48.xml" 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1609448414, 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260774, 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-55.xml" 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1620357046, 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268296, 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-40.xml" 2024-04-26T20:29:18.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1630220862, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631614, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-53.xml" 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1650709405, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260983, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-11.jpg" 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.639 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1673446446, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631609, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-58.xml" 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1701933951, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267469, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg" 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1719140496, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268267, 2024-04-26T20:29:18.640 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-50.xml" 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1723350574, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268269, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-49.xml" 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1756661961, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268370, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-15.xml" 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1763044197, 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631679, 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-4.xml" 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1768591447, 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268229, 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-62.xml" 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.642 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1774741570, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267481, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg" 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1779144760, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631606, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-61.xml" 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1797815357, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260967, 2024-04-26T20:29:18.643 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-19.jpg" 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1812857022, 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267379, 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml" 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1822683926, 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260846, 2024-04-26T20:29:18.644 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-19.xml" 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1832125608, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631584, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-72.xml" 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1836174368, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260892, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg" 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1846318743, 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267437, 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg" 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1854859700, 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630211, 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-67.xml" 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1858356912, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260844, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-20.xml" 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1869664809, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260999, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-3.jpg" 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1871314432, 2024-04-26T20:29:18.647 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267407, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml" 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1872381146, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631681, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-2.xml" 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1885610089, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630293, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-90.xml" 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1902921142, 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260726, 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-79.xml" 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1913598333, 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267475, 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg" 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.649 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1927795555, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260770, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-57.xml" 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1952459107, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631618, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-49.xml" 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1968345757, 2024-04-26T20:29:18.650 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260977, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-14.jpg" 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1972687951, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260963, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg" 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1990862170, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260882, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml" 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1994843746, 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631637, 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-30.xml" 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2008339375, 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260870, 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-7.xml" 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.652 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2019418509, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631680, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-3.xml" 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2042214246, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268223, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-65.xml" 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2048965322, 2024-04-26T20:29:18.653 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268376, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-13.xml" 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2057105724, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260734, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-75.xml" 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2070390474, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631640, 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-27.xml" 2024-04-26T20:29:18.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2071981934, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268379, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-12.xml" 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2096447242, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260917, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg" 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2098110224, 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631578, 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-74.xml" 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2105442053, 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260776, 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-54.xml" 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.656 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2118705321, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260908, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg" 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2140428621, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267493, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg" 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2146564192, 2024-04-26T20:29:18.657 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260880, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-2.xml" 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2153857958, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260728, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-78.xml" 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2156125045, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260945, 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-30.jpg" 2024-04-26T20:29:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2157755620, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260923, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg" 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2173687272, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631608, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-59.xml" 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.659 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2189355132, 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631624, 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-43.xml" 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2217456276, 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268225, 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-64.xml" 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.660 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2221814865, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267477, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg" 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2225611230, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260902, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg" 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2229537017, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631602, 2024-04-26T20:29:18.661 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-62.xml" 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2230026928, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631597, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-67.xml" 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2256797814, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631610, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-57.xml" 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2262290684, 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268272, 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-48.xml" 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2265913319, 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260724, 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-80.xml" 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.663 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2323845277, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260758, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-63.xml" 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2372097007, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260943, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg" 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2378506398, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260898, 2024-04-26T20:29:18.664 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg" 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2381167048, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260796, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-44.xml" 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2388641649, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268402, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml" 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2388925342, 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631635, 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-32.xml" 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2391385533, 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260812, 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-36.xml" 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.666 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2400456486, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260768, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-58.xml" 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2406505728, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260896, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg" 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2414927371, 2024-04-26T20:29:18.667 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631647, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-20.xml" 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2418627009, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268307, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-36.xml" 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2426362331, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260822, 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-31.xml" 2024-04-26T20:29:18.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2431057156, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260910, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg" 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2443986050, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268218, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-67.xml" 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.669 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2448427719, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260933, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg" 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2455505721, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260832, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-26.xml" 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2465637178, 2024-04-26T20:29:18.670 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631613, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-54.xml" 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2468327938, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268278, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-46.xml" 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2471476328, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260790, 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-47.xml" 2024-04-26T20:29:18.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2495869195, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268291, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-42.xml" 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2506118144, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268231, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-61.xml" 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.672 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2516004550, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260973, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-16.jpg" 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2521045094, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260997, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-4.jpg" 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2533675557, 2024-04-26T20:29:18.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268358, 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-19.xml" 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2553248568, 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260878, 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-3.xml" 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2574488468, 2024-04-26T20:29:18.674 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268239, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-59.xml" 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2585485361, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267491, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg" 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2600142798, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267467, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg" 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2610620145, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267421, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg" 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2636537152, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260947, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg" 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2639905574, 2024-04-26T20:29:18.676 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630206, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-95.xml" 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2666234067, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268357, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-20.xml" 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2670116220, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260900, 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg" 2024-04-26T20:29:18.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2675624843, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260862, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-11.xml" 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2681794487, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267489, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg" 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.678 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2685828748, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631569, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-78.xml" 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2690454853, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268262, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-52.xml" 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2701015768, 2024-04-26T20:29:18.679 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631646, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-21.xml" 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2708853862, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631626, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-41.xml" 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2742059388, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631652, 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-15.xml" 2024-04-26T20:29:18.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2742467304, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260820, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-32.xml" 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2750099264, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267373, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml" 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.681 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2767138297, 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631598, 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-66.xml" 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2780771235, 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267455, 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg" 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.682 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2787846532, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631570, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-77.xml" 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2793683232, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268258, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-53.xml" 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2795169989, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260784, 2024-04-26T20:29:18.683 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-50.xml" 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2798297801, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260886, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg" 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2816072220, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267451, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg" 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2829600473, 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267393, 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml" 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2830997712, 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268354, 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-21.xml" 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.685 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2836416420, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631627, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-40.xml" 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2838265460, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630205, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg" 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2854431550, 2024-04-26T20:29:18.686 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261003, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-1.jpg" 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2861192013, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267397, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml" 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2863221506, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267367, 2024-04-26T20:29:18.687 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml" 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2870548699, 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631673, 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-7.xml" 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2874692751, 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260854, 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-15.xml" 2024-04-26T20:29:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2885280970, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260925, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg" 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2896243615, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630219, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-28.xml" 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2910037765, 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268251, 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-55.xml" 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2910986608, 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631589, 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-70.xml" 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2912741535, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267501, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg" 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2913503441, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260806, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-39.xml" 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2939880370, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267381, 2024-04-26T20:29:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml" 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2941281040, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267461, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg" 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2948511200, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268396, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-6.xml" 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2998370503, 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631642, 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-25.xml" 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3003800845, 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260760, 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-62.xml" 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.693 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3004267839, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260953, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg" 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3026469848, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267471, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg" 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3028674476, 2024-04-26T20:29:18.694 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260748, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-68.xml" 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3034247980, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260864, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-10.xml" 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3053747020, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260931, 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg" 2024-04-26T20:29:18.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3067146350, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267389, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml" 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3067606028, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260778, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-53.xml" 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.696 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3067892978, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260804, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-40.xml" 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3072296714, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267387, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml" 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3086370495, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267435, 2024-04-26T20:29:18.697 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg" 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3090617311, 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267487, 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg" 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3095337221, 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260912, 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg" 2024-04-26T20:29:18.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3101005015, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260786, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-49.xml" 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3120420731, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267429, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg" 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.699 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.700 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3133909040, 2024-04-26T20:29:18.700 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260838, 2024-04-26T20:29:18.700 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-23.xml" 2024-04-26T20:29:18.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.700 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.571+0000 7f1f639e8740 1 -- 172.21.15.82:0/3555337896 wait complete. 2024-04-26T20:29:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.573+0000 7f1f639e8740 20 client.26938 trim_cache size 0 max 16384 2024-04-26T20:29:18.701 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3143611634, 2024-04-26T20:29:18.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260957, 2024-04-26T20:29:18.701 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg" 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3164227521, 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268348, 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-23.xml" 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3165397555, 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268381, 2024-04-26T20:29:18.702 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-11.xml" 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3172911732, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631576, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-75.xml" 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3181647465, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267395, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml" 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3184124512, 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267415, 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg" 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3190942282, 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260746, 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-69.xml" 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.704 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3191564138, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631591, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-69.xml" 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3223674443, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260971, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-17.jpg" 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3229152866, 2024-04-26T20:29:18.705 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631649, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-18.xml" 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3234753193, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631625, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-42.xml" 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3239129452, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267453, 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg" 2024-04-26T20:29:18.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3257115464, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631662, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-11.xml" 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3291725800, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267445, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg" 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.707 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3295715413, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260772, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-56.xml" 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3298665782, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260816, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-34.xml" 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3301897992, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260989, 2024-04-26T20:29:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-8.jpg" 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3302657912, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267463, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg" 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3303664706, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267413, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg" 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3305055995, 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631648, 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-19.xml" 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3316925798, 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268333, 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-28.xml" 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.710 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3319736047, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631644, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-23.xml" 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3327290916, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260850, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-17.xml" 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3343953489, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268345, 2024-04-26T20:29:18.711 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-24.xml" 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3356545801, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260818, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-33.xml" 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3356618103, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260794, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-45.xml" 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3359407218, 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631684, 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-1.xml" 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3372242930, 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260965, 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-20.jpg" 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.713 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3376074609, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268299, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-39.xml" 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3376921351, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260834, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-25.xml" 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3377694920, 2024-04-26T20:29:18.714 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267433, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg" 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3380358699, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267439, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg" 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3388002882, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260744, 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-70.xml" 2024-04-26T20:29:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3412799106, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631556, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-82.xml" 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3415724174, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267357, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-26.xml" 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3424030536, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631623, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-44.xml" 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3426756951, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260762, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-61.xml" 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3427182229, 2024-04-26T20:29:18.717 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631620, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-47.xml" 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3428753660, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268361, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-18.xml" 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3436936779, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268255, 2024-04-26T20:29:18.718 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-54.xml" 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3439046557, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631619, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-48.xml" 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3446364438, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267355, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-27.xml" 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3485036138, 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267423, 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg" 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3527156755, 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260720, 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-82.xml" 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.720 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3547387649, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268339, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-26.xml" 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3579351425, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260959, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg" 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3582089587, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267363, 2024-04-26T20:29:18.721 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-23.xml" 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3584535978, 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267399, 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml" 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3594091466, 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260949, 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg" 2024-04-26T20:29:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3595272719, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260904, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg" 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3610209002, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631678, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-5.xml" 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.723 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3634930816, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631631, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-36.xml" 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3645476430, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631560, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-81.xml" 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3648538773, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267419, 2024-04-26T20:29:18.724 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg" 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3659085401, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260732, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-76.xml" 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3665933829, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268248, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-56.xml" 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3679765845, 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260935, 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg" 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3701976647, 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631650, 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-17.xml" 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.726 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3706004980, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268221, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-66.xml" 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3710524922, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260798, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-43.xml" 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3729684696, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268313, 2024-04-26T20:29:18.727 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-34.xml" 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3730213884, 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260830, 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-27.xml" 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3783358466, 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260766, 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-59.xml" 2024-04-26T20:29:18.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3834638272, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267369, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml" 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3841660416, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260919, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg" 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.729 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3854272392, 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260824, 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-30.xml" 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3865862017, 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260961, 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg" 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3878475024, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260888, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg" 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3887702531, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267425, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg" 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3917607252, 2024-04-26T20:29:18.731 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631594, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-68.xml" 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3918819548, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268399, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-5.xml" 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3928131151, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631639, 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-28.xml" 2024-04-26T20:29:18.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3931513686, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268264, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-51.xml" 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3936083402, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260752, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-66.xml" 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.733 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3955189440, 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260927, 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg" 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3966652099, 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267391, 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml" 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.734 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3971012833, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631636, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-31.xml" 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3979344678, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268288, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-43.xml" 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3992238524, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268330, 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-29.xml" 2024-04-26T20:29:18.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3993910666, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631665, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-10.xml" 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3999828138, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631616, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-51.xml" 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.736 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4018719076, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260742, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-71.xml" 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4035786088, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631675, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-6.xml" 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4047934321, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631633, 2024-04-26T20:29:18.737 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-34.xml" 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4055612510, 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268275, 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-47.xml" 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4061441532, 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631651, 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-16.xml" 2024-04-26T20:29:18.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4064249938, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260884, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg" 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4087220370, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268393, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-7.xml" 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.739 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4117409344, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268336, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-27.xml" 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4123550523, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268305, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-37.xml" 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4129256805, 2024-04-26T20:29:18.740 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267371, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml" 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4153380551, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631582, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-73.xml" 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4158634532, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267409, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg" 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4160192042, 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267431, 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg" 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4200101032, 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260782, 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-51.xml" 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.742 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4202714898, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631671, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-8.xml" 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4218887241, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268316, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-33.xml" 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4237685795, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267443, 2024-04-26T20:29:18.743 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg" 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4256176883, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260842, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-21.xml" 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4273890758, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631611, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-56.xml" 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4281596402, 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260906, 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg" 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4291608750, 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023268228, 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-63.xml" 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:29:18.745 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.619+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1f400a3d90 msgr2=0x7f1f400a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.619+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1f400a3d90 0x7f1f400a6250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55d8ab3260f0 tx=0x7f1f48005df0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.619+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10ec70 msgr2=0x7f1f5c1aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.619+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10ec70 0x7f1f5c1aede0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005fd0 tx=0x7f1f5400edd0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.636+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 shutdown_connections 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.636+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1f400a3d90 0x7f1f400a6250 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.636+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5c10ec70 0x7f1f5c1aede0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.636+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f5c10c2a0 0x7f1f5c1a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.636+0000 7f1f60a00640 1 --2- 172.21.15.82:0/2870023639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f5c109930 0x7f1f5c1a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.636+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 >> 172.21.15.82:0/2870023639 conn(0x7f1f5c06f7c0 msgr2=0x7f1f5c10ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.638+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 shutdown_connections 2024-04-26T20:29:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:18.639+0000 7f1f60a00640 1 -- 172.21.15.82:0/2870023639 wait complete. 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.922+0000 7efc74198740 1 Processor -- start 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 -- start start 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 0x559fa109e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 0x559fa108b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1b1800 con 0x559fa1092730 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1b34c0 con 0x559fa1088a80 2024-04-26T20:29:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.932+0000 7efc74198740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1b1ed0 con 0x559fa108d5c0 2024-04-26T20:29:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.942+0000 7efc6a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 0x559fa108b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.942+0000 7efc6a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 0x559fa108b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38150/0 (socket says 172.21.15.82:38150) 2024-04-26T20:29:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.942+0000 7efc6a800640 1 -- 172.21.15.82:0/77734290 learned_addr learned my addr 172.21.15.82:0/77734290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.953+0000 7efc69e00640 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.957+0000 7efc6a800640 1 -- 172.21.15.82:0/77734290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 msgr2=0x559fa10973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.957+0000 7efc6a800640 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.957+0000 7efc6a800640 1 -- 172.21.15.82:0/77734290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 msgr2=0x559fa109e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.957+0000 7efc6a800640 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 0x559fa109e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.957+0000 7efc6a800640 1 -- 172.21.15.82:0/77734290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa0dcf620 con 0x559fa1088a80 2024-04-26T20:29:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.957+0000 7efc6a800640 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 0x559fa108b900 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efc640bcfb0 tx=0x7efc640bcc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d004ae4a896ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.961+0000 7efc56a00640 1 -- 172.21.15.82:0/77734290 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640c13d0 con 0x559fa1088a80 2024-04-26T20:29:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.961+0000 7efc56a00640 1 -- 172.21.15.82:0/77734290 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc640c5c90 con 0x559fa1088a80 2024-04-26T20:29:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.961+0000 7efc56a00640 1 -- 172.21.15.82:0/77734290 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640bb320 con 0x559fa1088a80 2024-04-26T20:29:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.991+0000 7efc74198740 1 -- 172.21.15.82:0/77734290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 msgr2=0x559fa108b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:18.991+0000 7efc74198740 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 0x559fa108b900 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efc640bcfb0 tx=0x7efc640bcc20 comp rx=0 tx=0).stop 2024-04-26T20:29:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.011+0000 7efc74198740 1 -- 172.21.15.82:0/77734290 shutdown_connections 2024-04-26T20:29:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.011+0000 7efc74198740 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa1088a80 0x559fa108b900 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.011+0000 7efc74198740 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1092730 0x559fa109e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.011+0000 7efc74198740 1 --2- 172.21.15.82:0/77734290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa108d5c0 0x559fa10973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.011+0000 7efc74198740 1 -- 172.21.15.82:0/77734290 >> 172.21.15.82:0/77734290 conn(0x559fa1088240 msgr2=0x559fa108b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.027+0000 7efc74198740 1 -- 172.21.15.82:0/77734290 shutdown_connections 2024-04-26T20:29:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.027+0000 7efc74198740 1 -- 172.21.15.82:0/77734290 wait complete. 2024-04-26T20:29:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.029+0000 7efc74198740 1 -- start start 2024-04-26T20:29:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.029+0000 7efc74198740 1 Processor -- start 2024-04-26T20:29:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.036+0000 7efc74198740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 0x559fa109be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.036+0000 7efc74198740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108d5c0 0x559fa109c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc74198740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa1092730 0x559fa109d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc69e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 0x559fa109be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc69e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 0x559fa109be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60988/0 (socket says 172.21.15.82:60988) 2024-04-26T20:29:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc74198740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1b2df0 con 0x559fa1088a80 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc74198740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1b2660 con 0x559fa108d5c0 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc74198740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1af7e0 con 0x559fa1092730 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.037+0000 7efc74198740 10 client.0 _ll_register_callbacks cb 0x7efc5c00ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc69e00640 1 -- 172.21.15.82:0/1519173359 learned_addr learned my addr 172.21.15.82:0/1519173359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc6a800640 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa1092730 0x559fa109d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc69e00640 1 -- 172.21.15.82:0/1519173359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa1092730 msgr2=0x559fa109d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc69e00640 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa1092730 0x559fa109d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc69e00640 1 -- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108d5c0 msgr2=0x559fa109c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc69e00640 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108d5c0 0x559fa109c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.038+0000 7efc69e00640 1 -- 172.21.15.82:0/1519173359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa0fabcb0 con 0x559fa1088a80 2024-04-26T20:29:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.039+0000 7efc69e00640 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 0x559fa109be10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efc5c026480 tx=0x7efc5c026d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ac53fc5acd4822 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.070+0000 7efc4be00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:29:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.070+0000 7efc4be00640 1 -- 172.21.15.82:0/1519173359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c03e020 con 0x559fa1088a80 2024-04-26T20:29:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.070+0000 7efc4be00640 1 -- 172.21.15.82:0/1519173359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7efc5c01cb20 con 0x559fa1088a80 2024-04-26T20:29:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.099+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc640c5c90 con 0x559fa1088a80 2024-04-26T20:29:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.115+0000 7efc4be00640 1 -- 172.21.15.82:0/1519173359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7efc5c00be80 con 0x559fa1088a80 2024-04-26T20:29:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.119+0000 7efc74198740 10 client.16797 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.120+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559fa1108f90 con 0x559fa1088a80 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc4be00640 1 -- 172.21.15.82:0/1519173359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc640c5c90 con 0x559fa1088a80 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc4be00640 1 -- 172.21.15.82:0/1519173359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7efc5c01eae0 con 0x559fa1088a80 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc74198740 10 client.16797 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc74198740 10 client.16797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc74198740 20 client.16797 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc74198740 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa11099d0 0x559fa110bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc74198740 4 client.16797 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559fa0ff8e00 con 0x559fa11099d0 2024-04-26T20:29:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.122+0000 7efc69400640 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa11099d0 0x559fa110bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.130+0000 7efc69400640 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa11099d0 0x559fa110bdf0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8805453e0421650 server_cookie=c4f99157a5872454 in_seq=0 out_seq=0 2024-04-26T20:29:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:19.130+0000 7efc4be00640 10 client.16797 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:19.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-26T20:29:20.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:19 smithi082 ceph-mon[28105]: pgmap v608: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 368 op/s 2024-04-26T20:29:20.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:19 smithi139 ceph-mon[32999]: pgmap v608: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 368 op/s 2024-04-26T20:29:20.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:19 smithi135 ceph-mon[32816]: pgmap v608: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 368 op/s 2024-04-26T20:29:22.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:21 smithi082 ceph-mon[28105]: pgmap v609: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 413 op/s 2024-04-26T20:29:22.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:21 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:22.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:21 smithi139 ceph-mon[32999]: pgmap v609: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 413 op/s 2024-04-26T20:29:22.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:21 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:22.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:21 smithi135 ceph-mon[32816]: pgmap v609: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 413 op/s 2024-04-26T20:29:22.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:21 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.747+0000 7efc4be00640 1 -- 172.21.15.82:0/1519173359 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559fa0ff8e00 con 0x559fa11099d0 2024-04-26T20:29:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.747+0000 7efc4be00640 10 client.16797 handle_command_reply: tid=0 2024-04-26T20:29:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.747+0000 7efc74198740 1 client.16797 shutdown 2024-04-26T20:29:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.748+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 msgr2=0x559fa109be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.748+0000 7efc74198740 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 0x559fa109be10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efc5c026480 tx=0x7efc5c026d70 comp rx=0 tx=0).stop 2024-04-26T20:29:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 shutdown_connections 2024-04-26T20:29:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc74198740 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559fa11099d0 0x559fa110bdf0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc74198740 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559fa1092730 0x559fa109d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc74198740 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fa108d5c0 0x559fa109c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc74198740 1 --2- 172.21.15.82:0/1519173359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fa1088a80 0x559fa109be10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 >> 172.21.15.82:0/1519173359 conn(0x559fa1088240 msgr2=0x559fa1086bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.756+0000 7efc4be00640 0 client.16797 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.791+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 shutdown_connections 2024-04-26T20:29:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.791+0000 7efc74198740 1 -- 172.21.15.82:0/1519173359 wait complete. 2024-04-26T20:29:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.797+0000 7efc74198740 20 client.16797 trim_cache size 0 max 16384 2024-04-26T20:29:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:29:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:29:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:29:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.860+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efc500a3e80 msgr2=0x7efc500a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.860+0000 7efc71200640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efc500a3e80 0x7efc500a6340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc5c005fd0 tx=0x7efc5c00b480 comp rx=0 tx=0).stop 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.860+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 msgr2=0x7efc6c1a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.860+0000 7efc71200640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c1a6480 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc6402acc0 tx=0x7efc64030c10 comp rx=0 tx=0).stop 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.861+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 shutdown_connections 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.861+0000 7efc71200640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efc500a3e80 0x7efc500a6340 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.861+0000 7efc71200640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc6c10ec50 0x7efc6c1a6480 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.861+0000 7efc71200640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc6c10c2a0 0x7efc6c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.861+0000 7efc71200640 1 --2- 172.21.15.82:0/1658853359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc6c109930 0x7efc6c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.861+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 >> 172.21.15.82:0/1658853359 conn(0x7efc6c06f9a0 msgr2=0x7efc6c10c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.876+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 shutdown_connections 2024-04-26T20:29:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:22.899+0000 7efc71200640 1 -- 172.21.15.82:0/1658853359 wait complete. 2024-04-26T20:29:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.166+0000 7f861a200640 1 -- 172.21.15.82:0/3995796240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8614073d70 msgr2=0x7f8614074190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.166+0000 7f861a200640 1 --2- 172.21.15.82:0/3995796240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8614073d70 0x7f8614074190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f86040098b0 tx=0x7f860402a3d0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 -- 172.21.15.82:0/3995796240 shutdown_connections 2024-04-26T20:29:23.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 --2- 172.21.15.82:0/3995796240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861410a9b0 0x7f861410f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 --2- 172.21.15.82:0/3995796240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861410a010 0x7f861410a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 --2- 172.21.15.82:0/3995796240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8614073d70 0x7f8614074190 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 -- 172.21.15.82:0/3995796240 >> 172.21.15.82:0/3995796240 conn(0x7f861406f840 msgr2=0x7f8614071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:23.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 -- 172.21.15.82:0/3995796240 shutdown_connections 2024-04-26T20:29:23.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.177+0000 7f861a200640 1 -- 172.21.15.82:0/3995796240 wait complete. 2024-04-26T20:29:23.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:22 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.183+0000 7f861a200640 1 Processor -- start 2024-04-26T20:29:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.184+0000 7f861a200640 1 -- start start 2024-04-26T20:29:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.184+0000 7f861a200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 0x7f8614116050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.198+0000 7f8618e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 0x7f8614116050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.198+0000 7f8618e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 0x7f8614116050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37838/0 (socket says 172.21.15.82:37838) 2024-04-26T20:29:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.200+0000 7f861a200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 0x7f8614116590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.201+0000 7f8613e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 0x7f8614116590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.201+0000 7f8613e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 0x7f8614116590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54960/0 (socket says 172.21.15.82:54960) 2024-04-26T20:29:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.201+0000 7f8613e00640 1 -- 172.21.15.82:0/2279908366 learned_addr learned my addr 172.21.15.82:0/2279908366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.201+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861410a9b0 0x7f86141b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.202+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f861411d220 con 0x7f861410a010 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.202+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f861411d0a0 con 0x7f861410a9b0 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.202+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f861411d3a0 con 0x7f8614073d70 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.204+0000 7f8619800640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861410a9b0 0x7f86141b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.205+0000 7f8618e00640 1 -- 172.21.15.82:0/2279908366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861410a9b0 msgr2=0x7f86141b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.205+0000 7f8618e00640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861410a9b0 0x7f86141b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.205+0000 7f8618e00640 1 -- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 msgr2=0x7f8614116590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.205+0000 7f8618e00640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 0x7f8614116590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.205+0000 7f8618e00640 1 -- 172.21.15.82:0/2279908366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86141b7e70 con 0x7f8614073d70 2024-04-26T20:29:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.207+0000 7f8613e00640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 0x7f8614116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:29:23.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.210+0000 7f8618e00640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 0x7f8614116050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f860402a9c0 tx=0x7f8604005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.220+0000 7f8611600640 1 -- 172.21.15.82:0/2279908366 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604040070 con 0x7f8614073d70 2024-04-26T20:29:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.220+0000 7f8611600640 1 -- 172.21.15.82:0/2279908366 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86040044d0 con 0x7f8614073d70 2024-04-26T20:29:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.220+0000 7f8611600640 1 -- 172.21.15.82:0/2279908366 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604004920 con 0x7f8614073d70 2024-04-26T20:29:23.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.223+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86141b8040 con 0x7f8614073d70 2024-04-26T20:29:23.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.224+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86141b84d0 con 0x7f8614073d70 2024-04-26T20:29:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.279+0000 7f861e632740 1 Processor -- start 2024-04-26T20:29:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.287+0000 7f861e632740 1 -- start start 2024-04-26T20:29:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.287+0000 7f861e632740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 0x559b2ceaa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.288+0000 7f8619800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 0x559b2ceaa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.288+0000 7f8619800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 0x559b2ceaa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54976/0 (socket says 172.21.15.82:54976) 2024-04-26T20:29:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.288+0000 7f8619800640 1 -- 172.21.15.82:0/3310600986 learned_addr learned my addr 172.21.15.82:0/3310600986 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.288+0000 7f861e632740 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaaa90 0x559b2ceaf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.288+0000 7f861e632740 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceafc00 0x559b2ceb2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.290+0000 7f8613e00640 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceafc00 0x559b2ceb2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.290+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559b2ce0dc70 con 0x559b2ceaa0a0 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.290+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559b2cdc6980 con 0x559b2ceafc00 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.290+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559b2ce09c30 con 0x559b2ceaaa90 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.291+0000 7f8619800640 1 -- 172.21.15.82:0/3310600986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaaa90 msgr2=0x559b2ceaf590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.291+0000 7f8619800640 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaaa90 0x559b2ceaf590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.291+0000 7f8619800640 1 -- 172.21.15.82:0/3310600986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceafc00 msgr2=0x559b2ceb2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.291+0000 7f8619800640 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceafc00 0x559b2ceb2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.291+0000 7f8619800640 1 -- 172.21.15.82:0/3310600986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2cd9e7b0 con 0x559b2ceaa0a0 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.291+0000 7f8613e00640 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceafc00 0x559b2ceb2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:29:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.293+0000 7f8619800640 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 0x559b2ceaa4c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f860c009f60 tx=0x7f860c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1b3ce83c0b539c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.295+0000 7f860a000640 1 -- 172.21.15.82:0/3310600986 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c01a070 con 0x559b2ceaa0a0 2024-04-26T20:29:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.296+0000 7f860a000640 1 -- 172.21.15.82:0/3310600986 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f860c0158c0 con 0x559b2ceaa0a0 2024-04-26T20:29:23.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.296+0000 7f860a000640 1 -- 172.21.15.82:0/3310600986 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c00a880 con 0x559b2ceaa0a0 2024-04-26T20:29:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.299+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 msgr2=0x559b2ceaa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.299+0000 7f861e632740 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 0x559b2ceaa4c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f860c009f60 tx=0x7f860c009f90 comp rx=0 tx=0).stop 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:22 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.311+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 shutdown_connections 2024-04-26T20:29:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.311+0000 7f861e632740 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceafc00 0x559b2ceb2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.311+0000 7f861e632740 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaaa90 0x559b2ceaf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.311+0000 7f861e632740 1 --2- 172.21.15.82:0/3310600986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceaa0a0 0x559b2ceaa4c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.311+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 >> 172.21.15.82:0/3310600986 conn(0x559b2cea5710 msgr2=0x559b2cea5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:23.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:22 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:29:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.399+0000 7f8611600640 1 -- 172.21.15.82:0/2279908366 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8604039040 con 0x7f8614073d70 2024-04-26T20:29:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.406+0000 7f8611600640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f85f80a3e40 0x7f85f80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.406+0000 7f8611600640 1 -- 172.21.15.82:0/2279908366 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f86040f1240 con 0x7f8614073d70 2024-04-26T20:29:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.407+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 shutdown_connections 2024-04-26T20:29:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.407+0000 7f8613e00640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f85f80a3e40 0x7f85f80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.408+0000 7f861e632740 1 -- 172.21.15.82:0/3310600986 wait complete. 2024-04-26T20:29:23.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.409+0000 7f861e632740 1 -- start start 2024-04-26T20:29:23.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.410+0000 7f861e632740 1 Processor -- start 2024-04-26T20:29:23.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.411+0000 7f8613e00640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f85f80a3e40 0x7f85f80a6300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x559b2cea65e0 tx=0x7f860000b3d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:23.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.414+0000 7f861e632740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ceb40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.415+0000 7f861e632740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ceb4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.415+0000 7f8613e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ceb4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.415+0000 7f8618e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ceb40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.415+0000 7f8613e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ceb4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54992/0 (socket says 172.21.15.82:54992) 2024-04-26T20:29:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.416+0000 7f8613e00640 1 -- 172.21.15.82:0/2767290569 learned_addr learned my addr 172.21.15.82:0/2767290569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.416+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2cebba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.416+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559b2ce0cf80 con 0x559b2ceafc00 2024-04-26T20:29:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.416+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559b2cdba260 con 0x559b2ceb9660 2024-04-26T20:29:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.416+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559b2ce122a0 con 0x559b2ceaa0a0 2024-04-26T20:29:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f8613e00640 1 -- 172.21.15.82:0/2767290569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 msgr2=0x559b2ceb40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f8613e00640 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ceb40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f8613e00640 1 -- 172.21.15.82:0/2767290569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 msgr2=0x559b2cebba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f8613e00640 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2cebba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f8613e00640 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2cd9c1c0 con 0x559b2ceafc00 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f861e632740 10 client.0 _ll_register_callbacks cb 0x559b2ce04960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f860c0158c0 con 0x559b2ceafc00 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f8613e00640 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ceb4630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8600011e60 tx=0x7f86000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789f75d877679e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.417+0000 7f85fea00640 10 client.16809 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.429+0000 7f85fea00640 1 -- 172.21.15.82:0/2767290569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860000bd00 con 0x559b2ceafc00 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.429+0000 7f85fea00640 1 -- 172.21.15.82:0/2767290569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8600005020 con 0x559b2ceafc00 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.432+0000 7f85fea00640 1 -- 172.21.15.82:0/2767290569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f860000bea0 con 0x559b2ceafc00 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.432+0000 7f861e632740 10 client.16809 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.432+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=44}) -- 0x559b2cb1f3f0 con 0x559b2ceafc00 2024-04-26T20:29:23.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.433+0000 7f85fea00640 1 -- 172.21.15.82:0/2767290569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f8600005220 con 0x559b2ceafc00 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.433+0000 7f861e632740 10 client.16809 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.433+0000 7f861e632740 10 client.16809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.433+0000 7f861e632740 20 client.16809 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.434+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cebfd90 0x559b2cec2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.434+0000 7f861e632740 4 client.16809 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.434+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2ce1b880 con 0x559b2cebfd90 2024-04-26T20:29:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.434+0000 7f8618e00640 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cebfd90 0x559b2cec2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.435+0000 7f8618e00640 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cebfd90 0x559b2cec2250 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70268e3525ebf59a server_cookie=908c5f9b9d829543 in_seq=0 out_seq=0 2024-04-26T20:29:23.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.435+0000 7f85fea00640 10 client.16809 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:29:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.440+0000 7f85fea00640 1 -- 172.21.15.82:0/2767290569 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b2ce1b880 con 0x559b2cebfd90 2024-04-26T20:29:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.440+0000 7f85fea00640 10 client.16809 handle_command_reply: tid=0 2024-04-26T20:29:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.442+0000 7f861e632740 1 client.16809 shutdown 2024-04-26T20:29:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.450+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 msgr2=0x559b2ceb4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.450+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ceb4630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8600011e60 tx=0x7f86000046c0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.451+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 shutdown_connections 2024-04-26T20:29:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.452+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cebfd90 0x559b2cec2250 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.464+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2cebba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.466+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ceb4630 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.466+0000 7f861e632740 1 --2- 172.21.15.82:0/2767290569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ceb40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.466+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 >> 172.21.15.82:0/2767290569 conn(0x559b2cea5710 msgr2=0x559b2cea4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.467+0000 7f85fea00640 0 client.16809 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.468+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 shutdown_connections 2024-04-26T20:29:23.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.468+0000 7f861e632740 1 -- 172.21.15.82:0/2767290569 wait complete. 2024-04-26T20:29:23.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.469+0000 7f861e632740 20 client.16809 trim_cache size 0 max 16384 2024-04-26T20:29:23.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.870+0000 7f861e632740 1 Processor -- start 2024-04-26T20:29:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.904+0000 7f861e632740 1 -- start start 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f861e632740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceaa0a0 0x559b2cea8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f861e632740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2cea8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f861e632740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 0x559b2ceab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f861e632740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86141c2930 con 0x559b2ceafc00 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f861e632740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86141c45f0 con 0x559b2ceaa0a0 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f861e632740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86141c3000 con 0x559b2ceb9660 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f8619800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 0x559b2ceab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f8619800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 0x559b2ceab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37852/0 (socket says 172.21.15.82:37852) 2024-04-26T20:29:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.905+0000 7f8619800640 1 -- 172.21.15.82:0/4191199282 learned_addr learned my addr 172.21.15.82:0/4191199282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.907+0000 7f8619800640 1 -- 172.21.15.82:0/4191199282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceaa0a0 msgr2=0x559b2cea8620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.907+0000 7f8619800640 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceaa0a0 0x559b2cea8620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.907+0000 7f8619800640 1 -- 172.21.15.82:0/4191199282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 msgr2=0x559b2cea8b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.907+0000 7f8619800640 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2cea8b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.907+0000 7f8619800640 1 -- 172.21.15.82:0/4191199282 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ceb3c30 con 0x559b2ceb9660 2024-04-26T20:29:23.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.910+0000 7f8619800640 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 0x559b2ceab530 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f860c00cfd0 tx=0x7f860c009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b587f5630be7035 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:23.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.953+0000 7f8609600640 1 -- 172.21.15.82:0/4191199282 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c01a040 con 0x559b2ceb9660 2024-04-26T20:29:23.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.953+0000 7f8609600640 1 -- 172.21.15.82:0/4191199282 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f860c0154d0 con 0x559b2ceb9660 2024-04-26T20:29:23.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.953+0000 7f8609600640 1 -- 172.21.15.82:0/4191199282 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c0042a0 con 0x559b2ceb9660 2024-04-26T20:29:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.985+0000 7f861e632740 1 -- 172.21.15.82:0/4191199282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 msgr2=0x559b2ceab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:23.985+0000 7f861e632740 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 0x559b2ceab530 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f860c00cfd0 tx=0x7f860c009c90 comp rx=0 tx=0).stop 2024-04-26T20:29:24.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.044+0000 7f861e632740 1 -- 172.21.15.82:0/4191199282 shutdown_connections 2024-04-26T20:29:24.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.044+0000 7f861e632740 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceb9660 0x559b2ceab530 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.044+0000 7f861e632740 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2cea8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.044+0000 7f861e632740 1 --2- 172.21.15.82:0/4191199282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceaa0a0 0x559b2cea8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.044+0000 7f861e632740 1 -- 172.21.15.82:0/4191199282 >> 172.21.15.82:0/4191199282 conn(0x559b2cea5710 msgr2=0x559b2cea5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:24.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.055+0000 7f861e632740 1 -- 172.21.15.82:0/4191199282 shutdown_connections 2024-04-26T20:29:24.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.057+0000 7f861e632740 1 -- 172.21.15.82:0/4191199282 wait complete. 2024-04-26T20:29:24.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.058+0000 7f861e632740 1 -- start start 2024-04-26T20:29:24.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.058+0000 7f861e632740 1 Processor -- start 2024-04-26T20:29:24.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ced0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:24.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ced1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:24.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2ced20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:24.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86141c3f20 con 0x559b2ceafc00 2024-04-26T20:29:24.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86141c3790 con 0x559b2ceb9660 2024-04-26T20:29:24.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86141c0910 con 0x559b2ceaa0a0 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.080+0000 7f861e632740 10 client.0 _ll_register_callbacks cb 0x7f860000b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.081+0000 7f8619800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2ced20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.081+0000 7f8619800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2ced20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39622/0 (socket says 172.21.15.82:39622) 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.081+0000 7f8619800640 1 -- 172.21.15.82:0/1223989816 learned_addr learned my addr 172.21.15.82:0/1223989816 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.081+0000 7f8613e00640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ced1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.082+0000 7f8618e00640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ced0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.082+0000 7f8619800640 1 -- 172.21.15.82:0/1223989816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 msgr2=0x559b2ced0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.083+0000 7f8619800640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ced0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.083+0000 7f8619800640 1 -- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 msgr2=0x559b2ced1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.083+0000 7f8619800640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ced1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.083+0000 7f8619800640 1 -- 172.21.15.82:0/1223989816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2cbe97d0 con 0x559b2ceb9660 2024-04-26T20:29:24.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.089+0000 7f8619800640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2ced20d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f860c00cd40 tx=0x7f860c009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9a64aee42a7fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.115+0000 7f85fea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:29:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.115+0000 7f85fea00640 1 -- 172.21.15.82:0/1223989816 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c01a040 con 0x559b2ceb9660 2024-04-26T20:29:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.115+0000 7f85fea00640 1 -- 172.21.15.82:0/1223989816 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f860c00a400 con 0x559b2ceb9660 2024-04-26T20:29:24.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.127+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f860c0154d0 con 0x559b2ceb9660 2024-04-26T20:29:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.129+0000 7f85fea00640 1 -- 172.21.15.82:0/1223989816 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f860c00a600 con 0x559b2ceb9660 2024-04-26T20:29:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.129+0000 7f861e632740 10 client.26876 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.129+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559b2cdb42a0 con 0x559b2ceb9660 2024-04-26T20:29:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.130+0000 7f85fea00640 1 -- 172.21.15.82:0/1223989816 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f860c0154d0 con 0x559b2ceb9660 2024-04-26T20:29:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f85fea00640 1 -- 172.21.15.82:0/1223989816 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f860c01d070 con 0x559b2ceb9660 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f861e632740 10 client.26876 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f861e632740 10 client.26876 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f861e632740 20 client.26876 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f861e632740 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cf25f80 0x559b2cf28370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f861e632740 4 client.26876 mds_command: new command op to 24554 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.131+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 --> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b2ceb34b0 con 0x559b2cf25f80 2024-04-26T20:29:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.132+0000 7f8618e00640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cf25f80 0x559b2cf28370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:24.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.132+0000 7f8618e00640 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cf25f80 0x559b2cf28370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=359d6fc70fb5ded1 server_cookie=7f1d955de1fe11ce in_seq=0 out_seq=0 2024-04-26T20:29:24.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.133+0000 7f85fea00640 10 client.26876 ms_handle_connect on v2:172.21.15.82:6838/1585592636 2024-04-26T20:29:24.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.144+0000 7f85fea00640 1 -- 172.21.15.82:0/1223989816 <== mds.1 v2:172.21.15.82:6838/1585592636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+43092 (crc 0 0 0) 0x559b2ceb34b0 con 0x559b2cf25f80 2024-04-26T20:29:24.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.144+0000 7f85fea00640 10 client.26876 handle_command_reply: tid=0 2024-04-26T20:29:24.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.145+0000 7f861e632740 1 client.26876 shutdown 2024-04-26T20:29:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.146+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 msgr2=0x559b2ced20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.146+0000 7f861e632740 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2ced20d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f860c00cd40 tx=0x7f860c009a90 comp rx=0 tx=0).stop 2024-04-26T20:29:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 shutdown_connections 2024-04-26T20:29:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f861e632740 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:6838/1585592636,v1:172.21.15.82:6839/1585592636] conn(0x559b2cf25f80 0x559b2cf28370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f861e632740 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b2ceb9660 0x559b2ced20d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f861e632740 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559b2ceafc00 0x559b2ced1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f861e632740 1 --2- 172.21.15.82:0/1223989816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b2ceaa0a0 0x559b2ced0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 >> 172.21.15.82:0/1223989816 conn(0x559b2cea5710 msgr2=0x559b2cea8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.151+0000 7f85fea00640 0 client.26876 ms_handle_reset on v2:172.21.15.82:6838/1585592636 2024-04-26T20:29:24.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.158+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 shutdown_connections 2024-04-26T20:29:24.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.158+0000 7f861e632740 1 -- 172.21.15.82:0/1223989816 wait complete. 2024-04-26T20:29:24.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.159+0000 7f861e632740 20 client.26876 trim_cache size 0 max 16384 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 6664877, 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262375, 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-2.jpg" 2024-04-26T20:29:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 18462984, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262338, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-20.jpg" 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 37153521, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262303, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-37.jpg" 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 85341715, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256409, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml" 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 149057688, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258661, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml" 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 163111199, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262249, 2024-04-26T20:29:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-54.jpg" 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 165738479, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257151, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg" 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 173696872, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534887154, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-74.xml" 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 179161835, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256123, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml" 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 181610586, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262213, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-12.xml" 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 187380481, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262237, 2024-04-26T20:29:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-60.jpg" 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 231651643, 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256835, 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml" 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 336692499, 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262215, 2024-04-26T20:29:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-11.xml" 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 354668244, 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262219, 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-9.xml" 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 373562714, 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262351, 2024-04-26T20:29:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-14.jpg" 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 379869969, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262221, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-8.xml" 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 414874210, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262231, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-3.xml" 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 421158202, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256150, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml" 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 507589965, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256105, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml" 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 510492525, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256177, 2024-04-26T20:29:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml" 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 516175027, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256232, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml" 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 516202112, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262357, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-11.jpg" 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 516357880, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256281, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml" 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 525551867, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262241, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-58.jpg" 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 582460421, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262332, 2024-04-26T20:29:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-23.jpg" 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 615728986, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262191, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-23.xml" 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 619705766, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262297, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-40.jpg" 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 620276305, 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262207, 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-15.xml" 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 642925557, 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256117, 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml" 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 666501720, 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262197, 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-20.xml" 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 673333638, 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256119, 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml" 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 714930858, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258504, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml" 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 730692715, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262326, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-26.jpg" 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 733605749, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262189, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-24.xml" 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 764173847, 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258469, 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml" 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 903469848, 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258542, 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml" 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 904835491, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258097, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg" 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 954085536, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257042, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg" 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1005090152, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262284, 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-45.jpg" 2024-04-26T20:29:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1022613809, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257008, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg" 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1023919138, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262229, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-4.xml" 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1032876500, 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258583, 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml" 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1037424094, 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256313, 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml" 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1055768316, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256476, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml" 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1066319307, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262251, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-53.jpg" 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1076205616, 2024-04-26T20:29:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262355, 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-12.jpg" 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1162215660, 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262239, 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-59.jpg" 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1189254201, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883844, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml" 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1196217637, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258567, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml" 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1236713924, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262199, 2024-04-26T20:29:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-19.xml" 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1244307814, 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262353, 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-13.jpg" 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1264660557, 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262195, 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-21.xml" 2024-04-26T20:29:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1268941787, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262260, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-50.jpg" 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1285798552, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883867, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-19.xml" 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1308860351, 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257965, 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg" 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1310172351, 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262295, 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-41.jpg" 2024-04-26T20:29:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1346705666, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258551, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml" 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1365393544, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262315, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-31.jpg" 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1415843937, 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257248, 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml" 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1428913861, 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256192, 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml" 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1436813598, 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262330, 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-24.jpg" 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1448138997, 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256056, 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-90.xml" 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1473700052, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262235, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-1.xml" 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1492937007, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257089, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml" 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1533483657, 2024-04-26T20:29:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262340, 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-19.jpg" 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1542656694, 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258559, 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml" 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1554895145, 2024-04-26T20:29:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256634, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg" 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1575518094, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258481, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml" 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1577096957, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630222, 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-97.jpg" 2024-04-26T20:29:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1578940621, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259917, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml" 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1585147521, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258604, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml" 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1586172121, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262291, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-43.jpg" 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1605567330, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262320, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-29.jpg" 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1626436590, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257113, 2024-04-26T20:29:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg" 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1688957696, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262311, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-33.jpg" 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1710459817, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257123, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg" 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1766790564, 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883845, 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml" 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1809835994, 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262205, 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-16.xml" 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1817040249, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534885012, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml" 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1830707887, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262245, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-56.jpg" 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1832853392, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257020, 2024-04-26T20:29:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg" 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1834502342, 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262263, 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-49.jpg" 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1835216941, 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258475, 2024-04-26T20:29:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml" 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1860917210, 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262348, 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-15.jpg" 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1864346209, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257017, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg" 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1867014734, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 4398046511633, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg" 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1873997366, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883979, 2024-04-26T20:29:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-14.xml" 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1906693161, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262336, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-21.jpg" 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1912858907, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262193, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-22.xml" 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1930750951, 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256078, 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml" 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1998192452, 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262299, 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-39.jpg" 2024-04-26T20:29:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2005309563, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262233, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-2.xml" 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2032255695, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262345, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-17.jpg" 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2104133780, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258530, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-36.xml" 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2122705483, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262227, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-5.xml" 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2166816692, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258629, 2024-04-26T20:29:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml" 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2206056544, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883328, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml" 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2216879549, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883835, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml" 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2242302755, 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262307, 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-35.jpg" 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2253168742, 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257070, 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg" 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2314311688, 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262223, 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-7.xml" 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2338579791, 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256732, 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml" 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2338818648, 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883838, 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg" 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2397969984, 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262203, 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-17.xml" 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2416324102, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257039, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg" 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2455605405, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632051, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-46.xml" 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2518542485, 2024-04-26T20:29:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262324, 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-27.jpg" 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2523573247, 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262369, 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-5.jpg" 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2546162581, 2024-04-26T20:29:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256257, 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml" 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2570923936, 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262317, 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-30.jpg" 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2571933537, 2024-04-26T20:29:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256346, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg" 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2597210650, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262301, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-38.jpg" 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2620016887, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262288, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-44.jpg" 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2638552236, 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262346, 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-16.jpg" 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2649079664, 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256228, 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml" 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2658918096, 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257049, 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml" 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2663386851, 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256911, 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml" 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2686745980, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 4398046512278, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg" 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2714110069, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262365, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-7.jpg" 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2729550994, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256174, 2024-04-26T20:29:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml" 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2763010387, 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258553, 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml" 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2804436295, 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258602, 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml" 2024-04-26T20:29:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2853691708, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262305, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-36.jpg" 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2875830634, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262211, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-13.xml" 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2887290091, 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262274, 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-47.jpg" 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2916944716, 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262367, 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-6.jpg" 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2936734491, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256819, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-83.xml" 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2947887895, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256204, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml" 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2986556425, 2024-04-26T20:29:24.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262373, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-3.jpg" 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2997532545, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256301, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml" 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3001166756, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257080, 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg" 2024-04-26T20:29:24.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3030754312, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256265, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml" 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3076718732, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258483, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml" 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3126658445, 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262267, 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-48.jpg" 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3127673158, 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262217, 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-10.xml" 2024-04-26T20:29:24.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.222 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.222 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3155464403, 2024-04-26T20:29:24.222 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262256, 2024-04-26T20:29:24.222 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-51.jpg" 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3182150828, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256742, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml" 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3212188089, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257001, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg" 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3227944794, 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262201, 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-18.xml" 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3232274579, 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262247, 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-55.jpg" 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3244361837, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258675, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg" 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3256512679, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262361, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-9.jpg" 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3273939797, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256407, 2024-04-26T20:29:24.225 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg" 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3279232431, 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262371, 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-4.jpg" 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3310724192, 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262363, 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-8.jpg" 2024-04-26T20:29:24.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3332868137, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262328, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-25.jpg" 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3392150293, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256162, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml" 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3416249638, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262209, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-14.xml" 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3464338337, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534884492, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-4.xml" 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3504777489, 2024-04-26T20:29:24.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257114, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml" 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3506837380, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262279, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-46.jpg" 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3517183949, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258668, 2024-04-26T20:29:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml" 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3524450712, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262225, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-6.xml" 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3524659232, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258715, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg" 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.230 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3616762919, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262185, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-26.xml" 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3624501701, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258547, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml" 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3630033328, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256398, 2024-04-26T20:29:24.231 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml" 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3633662709, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534883329, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml" 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3650899846, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256296, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml" 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3686782660, 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257165, 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg" 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3702356738, 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632049, 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-34.jpg" 2024-04-26T20:29:24.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3702494976, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262322, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-28.jpg" 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3716770125, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262243, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-57.jpg" 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3760320153, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262359, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-10.jpg" 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3767451021, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262343, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-18.jpg" 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3790486852, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630223, 2024-04-26T20:29:24.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-30.xml" 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3811395082, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257889, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-76.xml" 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3814946775, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262293, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-42.jpg" 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.236 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3825774730, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262187, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-25.xml" 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3842233747, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262334, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-22.jpg" 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3933345574, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256472, 2024-04-26T20:29:24.237 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg" 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4001279799, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256159, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml" 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4077788075, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262377, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-1.jpg" 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4117503670, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262253, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-52.jpg" 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4210557875, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257129, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg" 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4272130575, 2024-04-26T20:29:24.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256230, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml" 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4278086610, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262313, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-32.jpg" 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4281346332, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023256260, 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml" 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:29:24.240 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-04-26T20:29:24.241 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:23 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-26T20:29:24.241 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:23 smithi082 ceph-mon[28105]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-26T20:29:24.241 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:23 smithi082 ceph-mon[28105]: Unable to set osd_memory_target on smithi135 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T20:29:24.241 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:23 smithi082 ceph-mon[28105]: Unable to set osd_memory_target on smithi139 to 184768819: error parsing value: Value '184768819' is below minimum 939524096 2024-04-26T20:29:24.241 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:23 smithi082 ceph-mon[28105]: pgmap v610: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 653 op/s 2024-04-26T20:29:24.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f85f80a3e40 msgr2=0x7f85f80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f85f80a3e40 0x7f85f80a6300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x559b2cea65e0 tx=0x7f860000b3d0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 msgr2=0x7f8614116050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 0x7f8614116050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f860402a9c0 tx=0x7f8604005270 comp rx=0 tx=0).stop 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 shutdown_connections 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f85f80a3e40 0x7f85f80a6300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861410a9b0 0x7f86141b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f861410a010 0x7f8614116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 --2- 172.21.15.82:0/2279908366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8614073d70 0x7f8614116050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.191+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 >> 172.21.15.82:0/2279908366 conn(0x7f861406f840 msgr2=0x7f86140714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.219+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 shutdown_connections 2024-04-26T20:29:24.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:24.230+0000 7f861a200640 1 -- 172.21.15.82:0/2279908366 wait complete. 2024-04-26T20:29:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:23 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-26T20:29:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:23 smithi139 ceph-mon[32999]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-26T20:29:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:23 smithi139 ceph-mon[32999]: Unable to set osd_memory_target on smithi135 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T20:29:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:23 smithi139 ceph-mon[32999]: Unable to set osd_memory_target on smithi139 to 184768819: error parsing value: Value '184768819' is below minimum 939524096 2024-04-26T20:29:24.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:23 smithi139 ceph-mon[32999]: pgmap v610: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 653 op/s 2024-04-26T20:29:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:23 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-26T20:29:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:23 smithi135 ceph-mon[32816]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-26T20:29:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:23 smithi135 ceph-mon[32816]: Unable to set osd_memory_target on smithi135 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-26T20:29:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:23 smithi135 ceph-mon[32816]: Unable to set osd_memory_target on smithi139 to 184768819: error parsing value: Value '184768819' is below minimum 939524096 2024-04-26T20:29:24.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:23 smithi135 ceph-mon[32816]: pgmap v610: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 653 op/s 2024-04-26T20:29:24.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-26T20:29:24.929 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:24 smithi082 ceph-mon[28105]: pgmap v611: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 748 op/s 2024-04-26T20:29:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:24 smithi139 ceph-mon[32999]: pgmap v611: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 748 op/s 2024-04-26T20:29:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:24 smithi135 ceph-mon[32816]: pgmap v611: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 10 MiB/s wr, 748 op/s 2024-04-26T20:29:27.139 INFO:tasks.workunit.client.0.smithi082.stdout: 348 464884 484 317318 339 143240 1149 2024-04-26T20:29:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:27 smithi082 ceph-mon[28105]: pgmap v612: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.4 MiB/s wr, 728 op/s 2024-04-26T20:29:28.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:27 smithi139 ceph-mon[32999]: pgmap v612: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.4 MiB/s wr, 728 op/s 2024-04-26T20:29:28.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:27 smithi135 ceph-mon[32816]: pgmap v612: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.4 MiB/s wr, 728 op/s 2024-04-26T20:29:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.300+0000 7f4e46800640 1 -- 172.21.15.82:0/2877955735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 msgr2=0x7f4e4010f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.300+0000 7f4e46800640 1 --2- 172.21.15.82:0/2877955735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 0x7f4e4010f270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009ca0 tx=0x7f4e3802a8f0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.300+0000 7f4e46800640 1 -- 172.21.15.82:0/2877955735 shutdown_connections 2024-04-26T20:29:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.301+0000 7f4e46800640 1 --2- 172.21.15.82:0/2877955735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 0x7f4e4010f270 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.301+0000 7f4e46800640 1 --2- 172.21.15.82:0/2877955735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e4010a010 0x7f4e4010a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.301+0000 7f4e46800640 1 --2- 172.21.15.82:0/2877955735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e40073d70 0x7f4e40074190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.301+0000 7f4e46800640 1 -- 172.21.15.82:0/2877955735 >> 172.21.15.82:0/2877955735 conn(0x7f4e4006f840 msgr2=0x7f4e40071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:29.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.301+0000 7f4e46800640 1 -- 172.21.15.82:0/2877955735 shutdown_connections 2024-04-26T20:29:29.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.304+0000 7f4e46800640 1 -- 172.21.15.82:0/2877955735 wait complete. 2024-04-26T20:29:29.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.305+0000 7f4e46800640 1 Processor -- start 2024-04-26T20:29:29.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.305+0000 7f4e46800640 1 -- start start 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e46800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e40073d70 0x7f4e401a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e46800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 0x7f4e401a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e46800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 0x7f4e401aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e46800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4011d1d0 con 0x7f4e40073d70 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e46800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4011d050 con 0x7f4e4010a9b0 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e46800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4011d350 con 0x7f4e4010a010 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.310+0000 7f4e44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 0x7f4e401a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.311+0000 7f4e44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 0x7f4e401a7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37864/0 (socket says 172.21.15.82:37864) 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.311+0000 7f4e44a00640 1 -- 172.21.15.82:0/3156842538 learned_addr learned my addr 172.21.15.82:0/3156842538 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.311+0000 7f4e45e00640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 0x7f4e401aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.312+0000 7f4e44a00640 1 -- 172.21.15.82:0/3156842538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 msgr2=0x7f4e401aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.312+0000 7f4e44a00640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 0x7f4e401aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.312+0000 7f4e44a00640 1 -- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e40073d70 msgr2=0x7f4e401a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.312+0000 7f4e44a00640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e40073d70 0x7f4e401a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.312+0000 7f4e44a00640 1 -- 172.21.15.82:0/3156842538 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e401af2e0 con 0x7f4e4010a010 2024-04-26T20:29:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.312+0000 7f4e44a00640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 0x7f4e401a7c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00ea60 tx=0x7f4e2c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:29.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.321+0000 7f4e3e000640 1 -- 172.21.15.82:0/3156842538 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00cde0 con 0x7f4e4010a010 2024-04-26T20:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.321+0000 7f4e3e000640 1 -- 172.21.15.82:0/3156842538 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e2c0035f0 con 0x7f4e4010a010 2024-04-26T20:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.321+0000 7f4e3e000640 1 -- 172.21.15.82:0/3156842538 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c010690 con 0x7f4e4010a010 2024-04-26T20:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.321+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e401af5d0 con 0x7f4e4010a010 2024-04-26T20:29:29.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.321+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401afb50 con 0x7f4e4010a010 2024-04-26T20:29:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.363+0000 7f4e3e000640 1 -- 172.21.15.82:0/3156842538 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4e2c010830 con 0x7f4e4010a010 2024-04-26T20:29:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.368+0000 7f4e4ab93740 1 Processor -- start 2024-04-26T20:29:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.380+0000 7f4e3e000640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4e280a3e40 0x7f4e280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.380+0000 7f4e3e000640 1 -- 172.21.15.82:0/3156842538 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f4e2c0037a0 con 0x7f4e4010a010 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 -- start start 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564add490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564ae2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ae5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555564a40c70 con 0x555564ae2bd0 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5555649f9980 con 0x555564add070 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.384+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555564a3cc30 con 0x555564adda60 2024-04-26T20:29:29.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.386+0000 7f4e44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564ae2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.386+0000 7f4e44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564ae2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37874/0 (socket says 172.21.15.82:37874) 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.386+0000 7f4e44a00640 1 -- 172.21.15.82:0/1550663757 learned_addr learned my addr 172.21.15.82:0/1550663757 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.389+0000 7f4e44a00640 1 -- 172.21.15.82:0/1550663757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 msgr2=0x555564add490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.389+0000 7f4e44a00640 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564add490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.389+0000 7f4e44a00640 1 -- 172.21.15.82:0/1550663757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 msgr2=0x555564ae5060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.389+0000 7f4e44a00640 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ae5060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.389+0000 7f4e44a00640 1 -- 172.21.15.82:0/1550663757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555649d17b0 con 0x555564adda60 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.390+0000 7f4e45e00640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4e280a3e40 0x7f4e280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.390+0000 7f4e44a00640 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564ae2560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c099ce0 tx=0x7f4e2c09e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c2bea741dabc1ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:29.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.391+0000 7f4e45e00640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4e280a3e40 0x7f4e280a6300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4e38004ab0 tx=0x7f4e38004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:29.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.408+0000 7f4e32600640 1 -- 172.21.15.82:0/1550663757 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0a64f0 con 0x555564adda60 2024-04-26T20:29:29.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.408+0000 7f4e32600640 1 -- 172.21.15.82:0/1550663757 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e2c09bb80 con 0x555564adda60 2024-04-26T20:29:29.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.408+0000 7f4e32600640 1 -- 172.21.15.82:0/1550663757 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c09ebb0 con 0x555564adda60 2024-04-26T20:29:29.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.411+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1550663757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 msgr2=0x555564ae2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:29.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.411+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564ae2560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c099ce0 tx=0x7f4e2c09e040 comp rx=0 tx=0).stop 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.438+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1550663757 shutdown_connections 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.438+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ae5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.438+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564ae2560 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.438+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1550663757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564add490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.438+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1550663757 >> 172.21.15.82:0/1550663757 conn(0x555564ad86e0 msgr2=0x555564ad8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.438+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1550663757 shutdown_connections 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.444+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1550663757 wait complete. 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.444+0000 7f4e4ab93740 1 -- start start 2024-04-26T20:29:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.445+0000 7f4e4ab93740 1 Processor -- start 2024-04-26T20:29:29.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564add070 0x555564af8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564adda60 0x555564af8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564ae2bd0 0x555564aff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555564a3ff80 con 0x555564add070 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5555649ed260 con 0x555564adda60 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555564a452a0 con 0x555564ae2bd0 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.450+0000 7f4e4ab93740 10 client.0 _ll_register_callbacks cb 0x555564a37960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.451+0000 7f4e45400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564add070 0x555564af8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.451+0000 7f4e45400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564add070 0x555564af8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55016/0 (socket says 172.21.15.82:55016) 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.451+0000 7f4e45400640 1 -- 172.21.15.82:0/409125236 learned_addr learned my addr 172.21.15.82:0/409125236 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.452+0000 7f4e44a00640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564adda60 0x555564af8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.453+0000 7f4e45e00640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564ae2bd0 0x555564aff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.453+0000 7f4e44a00640 1 -- 172.21.15.82:0/409125236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564ae2bd0 msgr2=0x555564aff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:29.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.453+0000 7f4e44a00640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564ae2bd0 0x555564aff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.453+0000 7f4e44a00640 1 -- 172.21.15.82:0/409125236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564add070 msgr2=0x555564af8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:29.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.453+0000 7f4e44a00640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564add070 0x555564af8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.453+0000 7f4e44a00640 1 -- 172.21.15.82:0/409125236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555649cf1c0 con 0x555564adda60 2024-04-26T20:29:29.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.454+0000 7f4e44a00640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564adda60 0x555564af8590 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x555564ade4d0 tx=0x7f4e2c0cf440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9928465be1a7d33d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:29.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.481+0000 7f4e26a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:29:29.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.481+0000 7f4e26a00640 1 -- 172.21.15.82:0/409125236 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0aa070 con 0x555564adda60 2024-04-26T20:29:29.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.481+0000 7f4e26a00640 1 -- 172.21.15.82:0/409125236 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f4e2c09edc0 con 0x555564adda60 2024-04-26T20:29:29.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.507+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e2c09bb80 con 0x555564adda60 2024-04-26T20:29:29.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.524+0000 7f4e26a00640 1 -- 172.21.15.82:0/409125236 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f4e2c010b20 con 0x555564adda60 2024-04-26T20:29:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.541+0000 7f4e4ab93740 10 client.26885 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.541+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5555647523f0 con 0x555564adda60 2024-04-26T20:29:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.548+0000 7f4e26a00640 1 -- 172.21.15.82:0/409125236 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e2c09bb80 con 0x555564adda60 2024-04-26T20:29:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.548+0000 7f4e26a00640 1 -- 172.21.15.82:0/409125236 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f4e2c0ad030 con 0x555564adda60 2024-04-26T20:29:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.548+0000 7f4e4ab93740 10 client.26885 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.549+0000 7f4e4ab93740 10 client.26885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:29:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.549+0000 7f4e4ab93740 20 client.26885 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.549+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b03730 0x555564b05b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.549+0000 7f4e4ab93740 4 client.26885 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.549+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555564a4e880 con 0x555564b03730 2024-04-26T20:29:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.557+0000 7f4e45400640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b03730 0x555564b05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:29.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.589+0000 7f4e45400640 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b03730 0x555564b05b20 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3664671b1bc727 server_cookie=932bb1356651fc78 in_seq=0 out_seq=0 2024-04-26T20:29:29.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.603+0000 7f4e26a00640 10 client.26885 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:29.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.603+0000 7f4e26a00640 1 -- 172.21.15.82:0/409125236 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555564a4e880 con 0x555564b03730 2024-04-26T20:29:29.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.603+0000 7f4e26a00640 10 client.26885 handle_command_reply: tid=0 2024-04-26T20:29:29.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.606+0000 7f4e4ab93740 1 client.26885 shutdown 2024-04-26T20:29:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.610+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564adda60 msgr2=0x555564af8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.610+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564adda60 0x555564af8590 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x555564ade4d0 tx=0x7f4e2c0cf440 comp rx=0 tx=0).stop 2024-04-26T20:29:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 shutdown_connections 2024-04-26T20:29:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b03730 0x555564b05b20 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564ae2bd0 0x555564aff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564adda60 0x555564af8590 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/409125236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564add070 0x555564af8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:29.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 >> 172.21.15.82:0/409125236 conn(0x555564ad86e0 msgr2=0x555564ad7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:29.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.632+0000 7f4e26a00640 0 client.26885 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:29.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.642+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 shutdown_connections 2024-04-26T20:29:29.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.651+0000 7f4e4ab93740 1 -- 172.21.15.82:0/409125236 wait complete. 2024-04-26T20:29:29.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:29.652+0000 7f4e4ab93740 20 client.26885 trim_cache size 0 max 16384 2024-04-26T20:29:30.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:29 smithi082 ceph-mon[28105]: pgmap v613: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.9 MiB/s wr, 717 op/s 2024-04-26T20:29:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.285+0000 7f4e4ab93740 1 Processor -- start 2024-04-26T20:29:30.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:29 smithi139 ceph-mon[32999]: pgmap v613: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.9 MiB/s wr, 717 op/s 2024-04-26T20:29:30.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 -- start start 2024-04-26T20:29:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564adbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564aff590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ad76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2000fbc0 con 0x555564ae2bd0 2024-04-26T20:29:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e20011880 con 0x555564add070 2024-04-26T20:29:30.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.338+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4e20010290 con 0x555564adda60 2024-04-26T20:29:30.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.340+0000 7f4e45400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564adbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.340+0000 7f4e45400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564adbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39654/0 (socket says 172.21.15.82:39654) 2024-04-26T20:29:30.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.340+0000 7f4e45400640 1 -- 172.21.15.82:0/2549974699 learned_addr learned my addr 172.21.15.82:0/2549974699 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:30.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.340+0000 7f4e44a00640 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564aff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.340+0000 7f4e45e00640 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ad76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.341+0000 7f4e45e00640 1 -- 172.21.15.82:0/2549974699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 msgr2=0x555564aff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.341+0000 7f4e45e00640 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564aff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.341+0000 7f4e45e00640 1 -- 172.21.15.82:0/2549974699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 msgr2=0x555564adbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.341+0000 7f4e45e00640 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564adbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.341+0000 7f4e45e00640 1 -- 172.21.15.82:0/2549974699 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55556481c7d0 con 0x555564ae2bd0 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.341+0000 7f4e45e00640 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ad76e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4e3802aee0 tx=0x7f4e3803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ce7f63e6e30ced server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.346+0000 7f4e31c00640 1 -- 172.21.15.82:0/2549974699 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38031e40 con 0x555564ae2bd0 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.346+0000 7f4e31c00640 1 -- 172.21.15.82:0/2549974699 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e38036040 con 0x555564ae2bd0 2024-04-26T20:29:30.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.346+0000 7f4e31c00640 1 -- 172.21.15.82:0/2549974699 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38049420 con 0x555564ae2bd0 2024-04-26T20:29:30.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.347+0000 7f4e4ab93740 1 -- 172.21.15.82:0/2549974699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 msgr2=0x555564ad76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:30.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.347+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ad76e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4e3802aee0 tx=0x7f4e3803f000 comp rx=0 tx=0).stop 2024-04-26T20:29:30.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:29 smithi135 ceph-mon[32816]: pgmap v613: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.9 MiB/s wr, 717 op/s 2024-04-26T20:29:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.389+0000 7f4e4ab93740 1 -- 172.21.15.82:0/2549974699 shutdown_connections 2024-04-26T20:29:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.389+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564ad76e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.389+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564aff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.389+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/2549974699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564adbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.389+0000 7f4e4ab93740 1 -- 172.21.15.82:0/2549974699 >> 172.21.15.82:0/2549974699 conn(0x555564ad86e0 msgr2=0x555564ad6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:30.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.398+0000 7f4e4ab93740 1 -- 172.21.15.82:0/2549974699 shutdown_connections 2024-04-26T20:29:30.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.398+0000 7f4e4ab93740 1 -- 172.21.15.82:0/2549974699 wait complete. 2024-04-26T20:29:30.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.399+0000 7f4e4ab93740 1 -- start start 2024-04-26T20:29:30.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.400+0000 7f4e4ab93740 1 Processor -- start 2024-04-26T20:29:30.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.409+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564afc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.420+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564afcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.421+0000 7f4e44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564afcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.421+0000 7f4e44a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564afcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:37898/0 (socket says 172.21.15.82:37898) 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.421+0000 7f4e4ab93740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564afddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.422+0000 7f4e45e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564afddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.422+0000 7f4e4ab93740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e200111b0 con 0x555564ae2bd0 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.422+0000 7f4e45e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564afddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55038/0 (socket says 172.21.15.82:55038) 2024-04-26T20:29:30.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.422+0000 7f4e45e00640 1 -- 172.21.15.82:0/1536351324 learned_addr learned my addr 172.21.15.82:0/1536351324 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:30.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.438+0000 7f4e45400640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564afc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.443+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e20010a20 con 0x555564add070 2024-04-26T20:29:30.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.443+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2000dba0 con 0x555564adda60 2024-04-26T20:29:30.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.443+0000 7f4e4ab93740 10 client.0 _ll_register_callbacks cb 0x7f4e2c09d1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.456+0000 7f4e45e00640 1 -- 172.21.15.82:0/1536351324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 msgr2=0x555564afcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.456+0000 7f4e45e00640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564afcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.456+0000 7f4e45e00640 1 -- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 msgr2=0x555564afc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:30.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.456+0000 7f4e45e00640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564afc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.456+0000 7f4e45e00640 1 -- 172.21.15.82:0/1536351324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555649e72a0 con 0x555564ae2bd0 2024-04-26T20:29:30.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.456+0000 7f4e44a00640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564afcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:29:30.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.457+0000 7f4e45400640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564afc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:29:30.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.459+0000 7f4e45e00640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564afddd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4e38030850 tx=0x7f4e38031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166f502cf2348cac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:30.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.461+0000 7f4e26a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:29:30.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.464+0000 7f4e26a00640 1 -- 172.21.15.82:0/1536351324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3805f020 con 0x555564ae2bd0 2024-04-26T20:29:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.472+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e38036040 con 0x555564ae2bd0 2024-04-26T20:29:30.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.475+0000 7f4e26a00640 1 -- 172.21.15.82:0/1536351324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f4e3802fd10 con 0x555564ae2bd0 2024-04-26T20:29:30.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.477+0000 7f4e26a00640 1 -- 172.21.15.82:0/1536351324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f4e3806a050 con 0x555564ae2bd0 2024-04-26T20:29:30.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.481+0000 7f4e4ab93740 10 client.16824 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:30.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.485+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x555564aff4f0 con 0x555564ae2bd0 2024-04-26T20:29:30.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.506+0000 7f4e26a00640 1 -- 172.21.15.82:0/1536351324 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e38036040 con 0x555564ae2bd0 2024-04-26T20:29:30.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.506+0000 7f4e26a00640 1 -- 172.21.15.82:0/1536351324 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f4e3805a030 con 0x555564ae2bd0 2024-04-26T20:29:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.510+0000 7f4e4ab93740 10 client.16824 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.510+0000 7f4e4ab93740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-26T20:29:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.510+0000 7f4e4ab93740 20 client.16824 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.510+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b69fe0 0x555564b6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.510+0000 7f4e4ab93740 4 client.16824 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-26T20:29:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.510+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555564a486f0 con 0x555564b69fe0 2024-04-26T20:29:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.514+0000 7f4e45400640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b69fe0 0x555564b6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.519+0000 7f4e45400640 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b69fe0 0x555564b6c400 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dbd6f3328a9eff5 server_cookie=d6311dca0c746696 in_seq=0 out_seq=0 2024-04-26T20:29:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.519+0000 7f4e26a00640 10 client.16824 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.519+0000 7f4e26a00640 1 -- 172.21.15.82:0/1536351324 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555564a486f0 con 0x555564b69fe0 2024-04-26T20:29:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.519+0000 7f4e26a00640 10 client.16824 handle_command_reply: tid=0 2024-04-26T20:29:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.519+0000 7f4e4ab93740 1 client.16824 shutdown 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 msgr2=0x555564afddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564afddd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4e38030850 tx=0x7f4e38031000 comp rx=0 tx=0).stop 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 shutdown_connections 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555564b69fe0 0x555564b6c400 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555564ae2bd0 0x555564afddd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555564adda60 0x555564afcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 --2- 172.21.15.82:0/1536351324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555564add070 0x555564afc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 >> 172.21.15.82:0/1536351324 conn(0x555564ad86e0 msgr2=0x555564adbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.520+0000 7f4e26a00640 0 client.16824 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.570+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 shutdown_connections 2024-04-26T20:29:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.572+0000 7f4e4ab93740 1 -- 172.21.15.82:0/1536351324 wait complete. 2024-04-26T20:29:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.573+0000 7f4e4ab93740 20 client.16824 trim_cache size 0 max 16384 2024-04-26T20:29:30.586 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-04-26T20:29:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4e280a3e40 msgr2=0x7f4e280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4e280a3e40 0x7f4e280a6300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4e38004ab0 tx=0x7f4e38004a40 comp rx=0 tx=0).stop 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 msgr2=0x7f4e401a7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 0x7f4e401a7c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00ea60 tx=0x7f4e2c00ef20 comp rx=0 tx=0).stop 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 shutdown_connections 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f4e280a3e40 0x7f4e280a6300 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e4010a9b0 0x7f4e401aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e4010a010 0x7f4e401a7c00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 --2- 172.21.15.82:0/3156842538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e40073d70 0x7f4e401a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.621+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 >> 172.21.15.82:0/3156842538 conn(0x7f4e4006f840 msgr2=0x7f4e4010b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:30.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.632+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 shutdown_connections 2024-04-26T20:29:30.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:29:30.632+0000 7f4e46800640 1 -- 172.21.15.82:0/3156842538 wait complete. 2024-04-26T20:29:31.009 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 14271385, 'ino': 1099511632613, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 25401082, 'ino': 1099511632557, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 28096295, 'ino': 2199023266897, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-46.xml'}, {'damage_type': 'backtrace', 'id': 28339947, 'ino': 2199023266788, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-89.xml'}, {'damage_type': 'backtrace', 'id': 29689163, 'ino': 1099511630365, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 40143727, 'ino': 2199023266920, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-23.xml'}, {'damage_type': 'backtrace', 'id': 40681220, 'ino': 2199023262347, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-44.xml'}, {'damage_type': 'backtrace', 'id': 40922829, 'ino': 1099511630303, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 41790691, 'ino': 2199023262484, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 52686315, 'ino': 2199023262386, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-25.xml'}, {'damage_type': 'backtrace', 'id': 63008756, 'ino': 2199023262438, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 69628302, 'ino': 2199023264697, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml'}, {'damage_type': 'backtrace', 'id': 85165041, 'ino': 2199023266883, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-55.xml'}, {'damage_type': 'backtrace', 'id': 86258678, 'ino': 1099511630301, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 90178706, 'ino': 2199023266916, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-27.xml'}, {'damage_type': 'backtrace', 'id': 92473076, 'ino': 2199023266943, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 107217448, 'ino': 1099511632656, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 112190610, 'ino': 2199023262515, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 117183323, 'ino': 1099511632640, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 139219352, 'ino': 1099511630702, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 153825256, 'ino': 1099511632535, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 159270251, 'ino': 1099511630354, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 167877316, 'ino': 2199023266933, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-10.xml'}, {'damage_type': 'backtrace', 'id': 183392235, 'ino': 2199023262407, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-15.xml'}, {'damage_type': 'backtrace', 'id': 184832940, 'ino': 2199023262500, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 188817764, 'ino': 1099511630299, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 196024481, 'ino': 2199023264598, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-67.xml'}, {'damage_type': 'backtrace', 'id': 197166338, 'ino': 2199023262440, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 210459186, 'ino': 2199023266915, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-28.xml'}, {'damage_type': 'backtrace', 'id': 211250769, 'ino': 2199023262518, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 234997812, 'ino': 1099511632513, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 238356037, 'ino': 2199023266782, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-91.xml'}, {'damage_type': 'backtrace', 'id': 259439716, 'ino': 2199023264852, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 263608098, 'ino': 2199023264848, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 272333860, 'ino': 1099511632247, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-54.xml'}, {'damage_type': 'backtrace', 'id': 275620282, 'ino': 2199023262450, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 279132785, 'ino': 1099511632638, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 289773123, 'ino': 1099511632619, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 290137649, 'ino': 2199023262532, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 294542105, 'ino': 2199023266876, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-59.xml'}, {'damage_type': 'backtrace', 'id': 296630826, 'ino': 2199023264747, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 296932594, 'ino': 2199023266925, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-18.xml'}, {'damage_type': 'backtrace', 'id': 323033427, 'ino': 2199023264625, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-53.xml'}, {'damage_type': 'backtrace', 'id': 326021337, 'ino': 2199023264775, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 354496578, 'ino': 2199023266802, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-84.xml'}, {'damage_type': 'backtrace', 'id': 359866577, 'ino': 2199023266953, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 363570294, 'ino': 2199023266811, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-81.xml'}, {'damage_type': 'backtrace', 'id': 366659487, 'ino': 2199023264739, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 367858018, 'ino': 1099511630347, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 380462612, 'ino': 2199023264733, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 405205631, 'ino': 2199023266910, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-33.xml'}, {'damage_type': 'backtrace', 'id': 405747472, 'ino': 2199023266926, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-17.xml'}, {'damage_type': 'backtrace', 'id': 409422722, 'ino': 1099511632645, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 429703412, 'ino': 1099511630346, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 434002582, 'ino': 2199023262434, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-1.xml'}, {'damage_type': 'backtrace', 'id': 468567037, 'ino': 1099511632667, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 484238455, 'ino': 2199023264689, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml'}, {'damage_type': 'backtrace', 'id': 486573296, 'ino': 1099511630339, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 497141979, 'ino': 2199023262546, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 498061110, 'ino': 1099511630369, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 500081482, 'ino': 2199023264618, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-58.xml'}, {'damage_type': 'backtrace', 'id': 523176977, 'ino': 2199023266778, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-92.xml'}, {'damage_type': 'backtrace', 'id': 528059291, 'ino': 2199023264705, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-12.xml'}, {'damage_type': 'backtrace', 'id': 528762030, 'ino': 2199023262538, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 532683254, 'ino': 2199023262354, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-40.xml'}, {'damage_type': 'backtrace', 'id': 538426275, 'ino': 2199023266841, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-71.xml'}, {'damage_type': 'backtrace', 'id': 541237587, 'ino': 2199023264836, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 543901096, 'ino': 1099511630372, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 545467683, 'ino': 1099511630370, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 551705527, 'ino': 2199023264683, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-23.xml'}, {'damage_type': 'backtrace', 'id': 562862234, 'ino': 1099511632234, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-64.xml'}, {'damage_type': 'backtrace', 'id': 568589871, 'ino': 1099511632540, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 569771040, 'ino': 1099511630378, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 571423319, 'ino': 1099511630366, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 572281977, 'ino': 1099511630342, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 573160832, 'ino': 1099511632499, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 589449207, 'ino': 1099511630317, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 594724254, 'ino': 2199023264715, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-7.xml'}, {'damage_type': 'backtrace', 'id': 598060368, 'ino': 1099511632621, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 599330028, 'ino': 2199023264620, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-57.xml'}, {'damage_type': 'backtrace', 'id': 604877046, 'ino': 2199023266940, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-3.xml'}, {'damage_type': 'backtrace', 'id': 627733353, 'ino': 1099511632680, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 631829137, 'ino': 2199023264780, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 641689006, 'ino': 2199023262530, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 644068227, 'ino': 2199023266936, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-7.xml'}, {'damage_type': 'backtrace', 'id': 651594114, 'ino': 2199023266922, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-21.xml'}, {'damage_type': 'backtrace', 'id': 670616161, 'ino': 2199023264603, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-65.xml'}, {'damage_type': 'backtrace', 'id': 671834866, 'ino': 2199023264578, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-75.xml'}, {'damage_type': 'backtrace', 'id': 672900624, 'ino': 2199023264741, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 694486179, 'ino': 2199023266830, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-75.xml'}, {'damage_type': 'backtrace', 'id': 706934273, 'ino': 2199023264820, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 707946868, 'ino': 1099511630334, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 713755338, 'ino': 1099511632542, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 718466421, 'ino': 1099511630373, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 720502300, 'ino': 2199023264719, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml'}, {'damage_type': 'backtrace', 'id': 727254677, 'ino': 1099511632523, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 729914252, 'ino': 2199023266905, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-38.xml'}, {'damage_type': 'backtrace', 'id': 736291229, 'ino': 2199023262526, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 745295868, 'ino': 1099511632639, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 750491431, 'ino': 2199023264658, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-35.xml'}, {'damage_type': 'backtrace', 'id': 765697963, 'ino': 2199023264623, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml'}, {'damage_type': 'backtrace', 'id': 768293464, 'ino': 2199023266908, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-35.xml'}, {'damage_type': 'backtrace', 'id': 783289755, 'ino': 2199023262374, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-30.xml'}, {'damage_type': 'backtrace', 'id': 798431648, 'ino': 2199023262422, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-7.xml'}, {'damage_type': 'backtrace', 'id': 801590345, 'ino': 2199023266948, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 809345266, 'ino': 1099511630343, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 812137272, 'ino': 2199023266856, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-66.xml'}, {'damage_type': 'backtrace', 'id': 812730208, 'ino': 1099511632628, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 816737435, 'ino': 2199023264645, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-42.xml'}, {'damage_type': 'backtrace', 'id': 832715780, 'ino': 2199023266931, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-12.xml'}, {'damage_type': 'backtrace', 'id': 835004455, 'ino': 2199023264725, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-2.xml'}, {'damage_type': 'backtrace', 'id': 842968631, 'ino': 2199023266913, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-30.xml'}, {'damage_type': 'backtrace', 'id': 844419612, 'ino': 1099511632583, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 856786353, 'ino': 1099511632637, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 864659098, 'ino': 2199023264791, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 869298732, 'ino': 2199023264660, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml'}, {'damage_type': 'backtrace', 'id': 877180980, 'ino': 2199023266844, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-70.xml'}, {'damage_type': 'backtrace', 'id': 882764298, 'ino': 2199023264701, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml'}, {'damage_type': 'backtrace', 'id': 904561023, 'ino': 2199023262488, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 907267336, 'ino': 2199023264830, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 908904765, 'ino': 2199023266921, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-22.xml'}, {'damage_type': 'backtrace', 'id': 924139018, 'ino': 2199023262397, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-20.xml'}, {'damage_type': 'backtrace', 'id': 926115077, 'ino': 2199023266924, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-19.xml'}, {'damage_type': 'backtrace', 'id': 940532331, 'ino': 2199023262474, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 961570991, 'ino': 1099511630698, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 961807810, 'ino': 2199023262356, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-39.xml'}, {'damage_type': 'backtrace', 'id': 962200690, 'ino': 1099511632531, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 980481830, 'ino': 1099511632669, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 988536095, 'ino': 2199023264846, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 996868205, 'ino': 1099511632634, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1004623994, 'ino': 2199023262486, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1008187121, 'ino': 2199023262498, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1011069211, 'ino': 2199023262370, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1027097638, 'ino': 2199023266817, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-79.xml'}, {'damage_type': 'backtrace', 'id': 1033303174, 'ino': 2199023264735, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1048630804, 'ino': 1099511632617, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 1057909447, 'ino': 2199023264695, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1060710033, 'ino': 2199023266885, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-54.xml'}, {'damage_type': 'backtrace', 'id': 1072221864, 'ino': 1099511630302, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 1072759491, 'ino': 2199023264850, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1081450144, 'ino': 2199023264608, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1092688343, 'ino': 2199023262405, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1105057029, 'ino': 1099511632580, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 1116151475, 'ino': 2199023264685, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1135822803, 'ino': 2199023262368, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1136942788, 'ino': 1099511632574, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1143781954, 'ino': 2199023266847, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1152265309, 'ino': 2199023262472, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1160717912, 'ino': 2199023262490, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1165565663, 'ino': 1099511630320, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 1181034173, 'ino': 2199023262478, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1184667423, 'ino': 2199023264672, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1189111925, 'ino': 2199023264796, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1200535196, 'ino': 2199023264617, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1214675012, 'ino': 1099511630359, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 1217924618, 'ino': 2199023264828, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1218559104, 'ino': 2199023262342, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1226937547, 'ino': 1099511630335, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1230346303, 'ino': 2199023266880, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1237882123, 'ino': 2199023266949, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1250708854, 'ino': 2199023262399, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1254862349, 'ino': 2199023266899, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1256986675, 'ino': 2199023264653, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml'}, {'damage_type': 'backtrace', 'id': 1264877994, 'ino': 2199023266895, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1265955207, 'ino': 2199023266808, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-82.xml'}, {'damage_type': 'backtrace', 'id': 1272244595, 'ino': 1099511632522, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1287606997, 'ino': 1099511632578, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1291394105, 'ino': 1099511630200, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1301857606, 'ino': 2199023264783, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1316520834, 'ino': 2199023264593, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1321614577, 'ino': 1099511630345, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 1330897095, 'ino': 2199023264826, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1341853636, 'ino': 1099511632587, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1346006263, 'ino': 2199023264691, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1371923745, 'ino': 2199023262378, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1383817484, 'ino': 2199023264709, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1405054798, 'ino': 1099511632623, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 1409961998, 'ino': 2199023262548, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1410758351, 'ino': 1099511630376, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1430687644, 'ino': 1099511632592, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 1445006012, 'ino': 2199023264731, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1457393337, 'ino': 2199023262380, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1467932740, 'ino': 2199023264842, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1503352302, 'ino': 1099511632648, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1512590724, 'ino': 2199023262460, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1525534927, 'ino': 1099511632596, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1530995411, 'ino': 2199023264596, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-68.xml'}, {'damage_type': 'backtrace', 'id': 1539073555, 'ino': 2199023266937, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1544542059, 'ino': 2199023264729, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1549710830, 'ino': 2199023262492, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1562322358, 'ino': 2199023262415, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1576842225, 'ino': 2199023262504, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1607533456, 'ino': 2199023266935, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1623241307, 'ino': 2199023264804, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1638150828, 'ino': 2199023266941, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1642198520, 'ino': 2199023262390, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1647429758, 'ino': 1099511632635, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1660902519, 'ino': 1099511630704, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 1661247696, 'ino': 2199023262520, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1664976124, 'ino': 1099511632563, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1684034995, 'ino': 2199023264824, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1698396571, 'ino': 2199023262534, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1724957445, 'ino': 1099511630321, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 1725707818, 'ino': 2199023264771, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1729353947, 'ino': 2199023266930, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1731159658, 'ino': 2199023262394, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1736807471, 'ino': 1099511632527, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 1751440609, 'ino': 2199023264840, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1759488828, 'ino': 1099511630377, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 1763879450, 'ino': 2199023262476, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1771300968, 'ino': 2199023262392, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1772019318, 'ino': 2199023264651, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1775412445, 'ino': 2199023266900, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1799085731, 'ino': 1099511630310, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 1800703700, 'ino': 1099511630311, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1807089297, 'ino': 2199023264844, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1812071145, 'ino': 2199023266814, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-80.xml'}, {'damage_type': 'backtrace', 'id': 1826048888, 'ino': 2199023266942, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1835262120, 'ino': 1099511630364, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1850363973, 'ino': 1099511630375, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 1855391646, 'ino': 1099511632643, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 1862317488, 'ino': 1099511630300, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1863101449, 'ino': 1099511630351, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 1863893631, 'ino': 1099511630358, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1866425578, 'ino': 2199023266833, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-74.xml'}, {'damage_type': 'backtrace', 'id': 1875368385, 'ino': 1099511632566, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 1884468487, 'ino': 1099511630355, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1894047607, 'ino': 2199023262358, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-38.xml'}, {'damage_type': 'backtrace', 'id': 1904613770, 'ino': 2199023262452, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1907531154, 'ino': 2199023262524, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1918462360, 'ino': 1099511630332, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 1923831532, 'ino': 2199023266887, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1933478503, 'ino': 2199023266823, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-77.xml'}, {'damage_type': 'backtrace', 'id': 1935028806, 'ino': 2199023264621, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1952722919, 'ino': 2199023264585, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1955840806, 'ino': 1099511630341, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1960474516, 'ino': 2199023264622, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1964357029, 'ino': 2199023264635, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1967472318, 'ino': 2199023264753, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1977887245, 'ino': 2199023262344, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1985981008, 'ino': 2199023262544, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1986751715, 'ino': 2199023264610, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1988904605, 'ino': 2199023266901, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1994179968, 'ino': 2199023266791, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-88.xml'}, {'damage_type': 'backtrace', 'id': 2006119234, 'ino': 2199023262411, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2008315015, 'ino': 2199023264703, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2024817678, 'ino': 1099511632554, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 2025368550, 'ino': 2199023266934, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2032945807, 'ino': 2199023264811, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2045239817, 'ino': 1099511630314, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 2069769509, 'ino': 2199023264717, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2073217829, 'ino': 2199023266909, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2080334917, 'ino': 2199023264668, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2081880891, 'ino': 2199023262446, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2092469800, 'ino': 1099511630313, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 2098876289, 'ino': 2199023262428, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2102411240, 'ino': 2199023266952, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2103332196, 'ino': 1099511632500, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2104441647, 'ino': 2199023262522, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2114518091, 'ino': 2199023266907, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2115909025, 'ino': 2199023264767, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2155766624, 'ino': 1099511630697, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 2179068786, 'ino': 2199023264814, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2209950685, 'ino': 2199023266896, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2236075338, 'ino': 1099511630340, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 2261785191, 'ino': 1099511630338, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 2271591829, 'ino': 2199023264749, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2274777734, 'ino': 2199023264713, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2281281535, 'ino': 1099511632545, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2288110843, 'ino': 2199023264745, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2295549389, 'ino': 1099511632549, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 2300700926, 'ino': 1099511632506, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 2301841808, 'ino': 2199023262382, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2314473000, 'ino': 2199023262362, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2323716574, 'ino': 2199023262372, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2333178160, 'ino': 2199023264587, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-72.xml'}, {'damage_type': 'backtrace', 'id': 2374159690, 'ino': 1099511630306, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 2379376566, 'ino': 1099511632607, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2383181412, 'ino': 2199023266868, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-62.xml'}, {'damage_type': 'backtrace', 'id': 2393039440, 'ino': 1099511632576, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 2404698311, 'ino': 2199023266891, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2453832876, 'ino': 2199023266850, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2454786547, 'ino': 2199023266865, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2457406207, 'ino': 1099511632569, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2460387380, 'ino': 1099511632631, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 2473531278, 'ino': 2199023266911, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2473802820, 'ino': 1099511630806, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2486467643, 'ino': 1099511630362, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 2487714749, 'ino': 1099511632659, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 2500238687, 'ino': 2199023262403, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2532231920, 'ino': 2199023262482, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2563367973, 'ino': 2199023264808, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2568596590, 'ino': 1099511630344, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 2570362335, 'ino': 2199023266836, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-73.xml'}, {'damage_type': 'backtrace', 'id': 2584609203, 'ino': 1099511630312, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 2594325681, 'ino': 2199023264727, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2604462238, 'ino': 2199023266858, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2606940179, 'ino': 2199023266797, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-86.xml'}, {'damage_type': 'backtrace', 'id': 2608377456, 'ino': 1099511632630, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 2615315754, 'ino': 2199023262494, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2618369003, 'ino': 2199023264641, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2628815334, 'ino': 1099511632539, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2632015143, 'ino': 2199023266898, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2652435102, 'ino': 1099511632683, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 2653317528, 'ino': 2199023266938, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2655518426, 'ino': 1099511630319, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 2673831664, 'ino': 2199023266853, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2688219716, 'ino': 2199023266919, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2691033449, 'ino': 2199023264630, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2691331978, 'ino': 2199023262401, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2692342900, 'ino': 1099511630360, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 2698115672, 'ino': 2199023262462, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2724469036, 'ino': 1099511632215, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-66.xml'}, {'damage_type': 'backtrace', 'id': 2729752071, 'ino': 2199023264605, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2771593504, 'ino': 2199023266932, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2783681314, 'ino': 1099511632622, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 2790654576, 'ino': 1099511630201, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2798198747, 'ino': 2199023264626, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-52.xml'}, {'damage_type': 'backtrace', 'id': 2810710917, 'ino': 2199023266923, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2822933351, 'ino': 1099511630700, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 2850463850, 'ino': 2199023266893, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2871378942, 'ino': 2199023262464, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2872211089, 'ino': 2199023262360, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2879327625, 'ino': 2199023266889, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-52.xml'}, {'damage_type': 'backtrace', 'id': 2885307928, 'ino': 2199023262456, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2888533917, 'ino': 1099511630357, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2890249932, 'ino': 2199023266785, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-90.xml'}, {'damage_type': 'backtrace', 'id': 2903389711, 'ino': 2199023266827, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-76.xml'}, {'damage_type': 'backtrace', 'id': 2904423739, 'ino': 2199023262466, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2922143348, 'ino': 2199023262349, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2929815647, 'ino': 2199023262512, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2937508641, 'ino': 1099511630371, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 2937731707, 'ino': 1099511632601, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2950194660, 'ino': 2199023266928, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2963336791, 'ino': 2199023266951, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2964909102, 'ino': 2199023262426, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2967738524, 'ino': 1099511632647, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 2968766604, 'ino': 1099511630703, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 2975919057, 'ino': 1099511630350, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2977649946, 'ino': 1099511632572, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 2995967517, 'ino': 2199023266805, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-83.xml'}, {'damage_type': 'backtrace', 'id': 2996788492, 'ino': 1099511630318, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 3001692568, 'ino': 1099511632606, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3005959923, 'ino': 1099511630367, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 3025679217, 'ino': 1099511630307, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 3030536126, 'ino': 2199023266927, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3065793775, 'ino': 1099511630356, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3071440129, 'ino': 2199023264751, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3071567766, 'ino': 1099511630361, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3086751201, 'ino': 2199023262444, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3089924996, 'ino': 2199023266820, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-78.xml'}, {'damage_type': 'backtrace', 'id': 3110543208, 'ino': 1099511632651, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3161207402, 'ino': 2199023262417, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3161501553, 'ino': 2199023264723, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3161876773, 'ino': 1099511632674, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 3166551078, 'ino': 2199023266944, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3175626884, 'ino': 2199023266947, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3179136996, 'ino': 2199023262352, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3184276249, 'ino': 2199023264832, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3207365493, 'ino': 2199023266950, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3212754682, 'ino': 1099511630391, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-83.xml'}, {'damage_type': 'backtrace', 'id': 3214308950, 'ino': 2199023264699, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3215428252, 'ino': 1099511632627, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3217481336, 'ino': 2199023262480, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3244580441, 'ino': 1099511632653, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 3263099636, 'ino': 1099511632626, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3265980306, 'ino': 2199023266881, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3270170274, 'ino': 2199023264675, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3273845689, 'ino': 1099511630363, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 3281209927, 'ino': 2199023264758, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3287086656, 'ino': 1099511630699, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 3292168425, 'ino': 2199023266839, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-72.xml'}, {'damage_type': 'backtrace', 'id': 3297417486, 'ino': 2199023266906, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3304301526, 'ino': 2199023264838, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3311815715, 'ino': 2199023264721, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3329700067, 'ino': 1099511632616, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3333776667, 'ino': 2199023266945, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3333801045, 'ino': 2199023266929, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3357208380, 'ino': 1099511632520, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 3366224952, 'ino': 2199023264681, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3372162929, 'ino': 2199023264677, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3381163258, 'ino': 1099511630353, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3384482568, 'ino': 1099511632599, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3388065817, 'ino': 2199023264637, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3404168412, 'ino': 2199023264834, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3405258046, 'ino': 2199023262366, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-34.xml'}, {'damage_type': 'backtrace', 'id': 3428126823, 'ino': 2199023262542, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3437104849, 'ino': 1099511630309, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 3437477875, 'ino': 2199023264687, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3439960669, 'ino': 2199023264582, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3457413482, 'ino': 1099511632552, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 3459374394, 'ino': 1099511630304, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3467230117, 'ino': 2199023262430, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3479115534, 'ino': 1099511632610, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3480160459, 'ino': 2199023266894, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3481734189, 'ino': 2199023262448, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3490977958, 'ino': 2199023266878, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3497843858, 'ino': 2199023262468, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3506601188, 'ino': 1099511632529, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 3518056017, 'ino': 1099511630379, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 3524296059, 'ino': 1099511630316, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3527326181, 'ino': 2199023264787, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3530390454, 'ino': 1099511632663, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3552375824, 'ino': 2199023266772, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-94.xml'}, {'damage_type': 'backtrace', 'id': 3571052991, 'ino': 2199023264679, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3575742161, 'ino': 1099511630333, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 3599948676, 'ino': 2199023266918, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3601807171, 'ino': 2199023264801, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3608404574, 'ino': 2199023264628, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml'}, {'damage_type': 'backtrace', 'id': 3623691098, 'ino': 2199023264763, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3624942932, 'ino': 2199023264575, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-76.xml'}, {'damage_type': 'backtrace', 'id': 3640731858, 'ino': 2199023262496, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3643786276, 'ino': 2199023266912, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3651928452, 'ino': 2199023262413, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3665996181, 'ino': 1099511630701, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 3673732736, 'ino': 1099511630352, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 3674778224, 'ino': 1099511632533, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 3677412163, 'ino': 1099511630213, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-71.xml'}, {'damage_type': 'backtrace', 'id': 3680685266, 'ino': 2199023264632, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3708290636, 'ino': 2199023264591, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3722153709, 'ino': 2199023266903, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3722926314, 'ino': 2199023266917, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3730215205, 'ino': 1099511630349, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3780307107, 'ino': 2199023264601, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-66.xml'}, {'damage_type': 'backtrace', 'id': 3787131672, 'ino': 2199023264612, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3797222929, 'ino': 2199023264656, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3803875296, 'ino': 1099511632543, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 3806918887, 'ino': 1099511632618, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 3820206426, 'ino': 2199023264643, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3823182914, 'ino': 1099511632561, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 3842762776, 'ino': 2199023264662, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3851311539, 'ino': 2199023264755, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3861238696, 'ino': 2199023266871, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3872207528, 'ino': 2199023262409, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3874880125, 'ino': 2199023264854, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3875964290, 'ino': 2199023264639, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3883011480, 'ino': 2199023262536, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3892599699, 'ino': 1099511630374, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 3900347679, 'ino': 2199023262436, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3915745922, 'ino': 1099511630212, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3924996788, 'ino': 2199023266902, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3928326670, 'ino': 2199023264647, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3928398975, 'ino': 2199023262388, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3933657043, 'ino': 2199023266874, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-60.xml'}, {'damage_type': 'backtrace', 'id': 3935449523, 'ino': 1099511630368, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 3951826586, 'ino': 2199023262458, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3963563201, 'ino': 1099511630337, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 3969409355, 'ino': 2199023262419, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3978544497, 'ino': 2199023264818, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 4008352715, 'ino': 1099511630336, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 4032735394, 'ino': 2199023266904, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-39.xml'}, {'damage_type': 'backtrace', 'id': 4034387754, 'ino': 2199023264670, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml'}, {'damage_type': 'backtrace', 'id': 4055630522, 'ino': 2199023262470, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 4056389789, 'ino': 2199023266794, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-87.xml'}, {'damage_type': 'backtrace', 'id': 4063809548, 'ino': 2199023264711, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-9.xml'}, {'damage_type': 'backtrace', 'id': 4064403921, 'ino': 2199023266946, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4067495779, 'ino': 2199023264664, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-32.xml'}, {'damage_type': 'backtrace', 'id': 4084718022, 'ino': 2199023264737, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 4087773454, 'ino': 2199023264666, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml'}, {'damage_type': 'backtrace', 'id': 4093059151, 'ino': 1099511630315, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 4103400945, 'ino': 2199023266939, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-4.xml'}, {'damage_type': 'backtrace', 'id': 4105153363, 'ino': 2199023266914, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-29.xml'}, {'damage_type': 'backtrace', 'id': 4106779422, 'ino': 1099511632624, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 4115454484, 'ino': 1099511632632, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 4130385718, 'ino': 2199023262432, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-2.xml'}, {'damage_type': 'backtrace', 'id': 4131085090, 'ino': 2199023262424, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-6.xml'}, {'damage_type': 'backtrace', 'id': 4134026120, 'ino': 2199023266862, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-64.xml'}, {'damage_type': 'backtrace', 'id': 4134413236, 'ino': 2199023262509, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 4149348064, 'ino': 1099511630322, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 4157768562, 'ino': 2199023264615, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml'}, {'damage_type': 'backtrace', 'id': 4164407220, 'ino': 2199023264655, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-37.xml'}, {'damage_type': 'backtrace', 'id': 4169260814, 'ino': 2199023266800, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-85.xml'}, {'damage_type': 'backtrace', 'id': 4179842946, 'ino': 2199023262442, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 4183443632, 'ino': 1099511632677, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 4184559585, 'ino': 2199023262376, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-29.xml'}, {'damage_type': 'backtrace', 'id': 4195207330, 'ino': 2199023264856, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 4196730715, 'ino': 2199023264589, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml'}, {'damage_type': 'backtrace', 'id': 4198027110, 'ino': 1099511630348, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 4201696661, 'ino': 2199023264822, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4215128125, 'ino': 2199023264693, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml'}, {'damage_type': 'backtrace', 'id': 4218473319, 'ino': 2199023264743, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 4233223066, 'ino': 2199023262421, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4240595258, 'ino': 2199023266775, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-79/article-93.xml'}, {'damage_type': 'backtrace', 'id': 4244995441, 'ino': 2199023262540, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 4264209859, 'ino': 2199023264649, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-40.xml'}, {'damage_type': 'backtrace', 'id': 4282457733, 'ino': 2199023262364, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/article-35.xml'}, {'damage_type': 'backtrace', 'id': 4293339319, 'ino': 2199023264707, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml'}] 2024-04-26T20:29:31.010 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 54170385, 'ino': 2199023268407, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 57639164, 'ino': 2199023268322, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 66643222, 'ino': 2199023260937, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 74349870, 'ino': 2199023260756, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-64.xml'}, {'damage_type': 'backtrace', 'id': 120561872, 'ino': 2199023260866, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-9.xml'}, {'damage_type': 'backtrace', 'id': 133754784, 'ino': 2199023267499, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 134364634, 'ino': 2199023260716, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-84.xml'}, {'damage_type': 'backtrace', 'id': 145799313, 'ino': 2199023268319, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 173601005, 'ino': 2199023260780, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-52.xml'}, {'damage_type': 'backtrace', 'id': 193750981, 'ino': 2199023268390, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 215379492, 'ino': 1099511631653, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 218690886, 'ino': 2199023260802, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-41.xml'}, {'damage_type': 'backtrace', 'id': 222963991, 'ino': 2199023267411, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 228331218, 'ino': 1099511631566, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 239123539, 'ino': 2199023268310, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 269747649, 'ino': 1099511631641, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 284240485, 'ino': 2199023260874, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-5.xml'}, {'damage_type': 'backtrace', 'id': 294008873, 'ino': 2199023260852, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-16.xml'}, {'damage_type': 'backtrace', 'id': 296414320, 'ino': 2199023268302, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 302818681, 'ino': 2199023267377, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml'}, {'damage_type': 'backtrace', 'id': 306320151, 'ino': 1099511631654, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 325843685, 'ino': 2199023260810, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-37.xml'}, {'damage_type': 'backtrace', 'id': 332953525, 'ino': 2199023267459, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 340863622, 'ino': 2199023260808, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-38.xml'}, {'damage_type': 'backtrace', 'id': 347306842, 'ino': 2199023260921, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 358867060, 'ino': 1099511631622, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 362645540, 'ino': 2199023267405, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml'}, {'damage_type': 'backtrace', 'id': 366805241, 'ino': 2199023260987, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 371527857, 'ino': 2199023260991, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 388418523, 'ino': 2199023260800, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-42.xml'}, {'damage_type': 'backtrace', 'id': 407968301, 'ino': 2199023260826, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-29.xml'}, {'damage_type': 'backtrace', 'id': 408401878, 'ino': 2199023260979, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 410009507, 'ino': 2199023260814, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-35.xml'}, {'damage_type': 'backtrace', 'id': 416475377, 'ino': 2199023260856, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-14.xml'}, {'damage_type': 'backtrace', 'id': 437147003, 'ino': 2199023260872, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-6.xml'}, {'damage_type': 'backtrace', 'id': 449123181, 'ino': 2199023260995, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 450341099, 'ino': 2199023268367, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 452253274, 'ino': 2199023267485, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 460464034, 'ino': 2199023260754, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-65.xml'}, {'damage_type': 'backtrace', 'id': 490581408, 'ino': 1099511631629, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 494234121, 'ino': 2199023260981, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 499847816, 'ino': 1099511631617, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 510708026, 'ino': 1099511632211, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-86.xml'}, {'damage_type': 'backtrace', 'id': 514981213, 'ino': 1099511630297, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-92.xml'}, {'damage_type': 'backtrace', 'id': 568532698, 'ino': 1099511631638, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 574025917, 'ino': 2199023267473, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 575911877, 'ino': 2199023260858, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-13.xml'}, {'damage_type': 'backtrace', 'id': 577206765, 'ino': 2199023267497, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 589525068, 'ino': 2199023268234, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 593459192, 'ino': 2199023267427, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 598396621, 'ino': 2199023268245, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 610440625, 'ino': 2199023268242, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 640265529, 'ino': 2199023267479, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 641930423, 'ino': 2199023267449, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 652713719, 'ino': 1099511631667, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 662077732, 'ino': 2199023260718, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-83.xml'}, {'damage_type': 'backtrace', 'id': 662441793, 'ino': 2199023267483, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 686789104, 'ino': 2199023267361, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-24.xml'}, {'damage_type': 'backtrace', 'id': 690729478, 'ino': 1099511631563, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 721373600, 'ino': 2199023260848, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-18.xml'}, {'damage_type': 'backtrace', 'id': 736848684, 'ino': 2199023268406, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 740836527, 'ino': 2199023268384, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 742314898, 'ino': 1099511633215, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-31.xml'}, {'damage_type': 'backtrace', 'id': 749462581, 'ino': 2199023268373, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 772807830, 'ino': 1099511631643, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 780372068, 'ino': 1099511631612, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 795121729, 'ino': 2199023267383, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml'}, {'damage_type': 'backtrace', 'id': 795760058, 'ino': 1099511631601, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 817246876, 'ino': 2199023260939, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 830150858, 'ino': 2199023268364, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 832967177, 'ino': 2199023260722, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-81.xml'}, {'damage_type': 'backtrace', 'id': 849960993, 'ino': 1099511631607, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 857156682, 'ino': 2199023261001, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 859108242, 'ino': 2199023260975, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 863042195, 'ino': 1099511631632, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 872599877, 'ino': 1099511631615, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 873572395, 'ino': 2199023267359, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-25.xml'}, {'damage_type': 'backtrace', 'id': 951714339, 'ino': 1099511631645, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 968249025, 'ino': 2199023268282, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 974039814, 'ino': 2199023260764, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-60.xml'}, {'damage_type': 'backtrace', 'id': 976241444, 'ino': 2199023267457, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 991920523, 'ino': 2199023260736, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-74.xml'}, {'damage_type': 'backtrace', 'id': 1011984496, 'ino': 2199023260951, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1048819597, 'ino': 2199023260941, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1055762313, 'ino': 2199023260868, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1088877941, 'ino': 2199023260740, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-72.xml'}, {'damage_type': 'backtrace', 'id': 1094467786, 'ino': 2199023268388, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 1097993129, 'ino': 1099511631634, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1099384658, 'ino': 1099511631587, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1104930483, 'ino': 2199023268285, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1107825981, 'ino': 2199023268342, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 1132736748, 'ino': 2199023260985, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1144363110, 'ino': 2199023260894, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1194997847, 'ino': 2199023267375, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1209333295, 'ino': 2199023260955, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1214841596, 'ino': 2199023268325, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1218676010, 'ino': 2199023260890, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1221050850, 'ino': 2199023260792, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1251704067, 'ino': 2199023268351, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 1283115043, 'ino': 1099511631600, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1309529958, 'ino': 2199023267403, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1319135992, 'ino': 2199023260993, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1326585228, 'ino': 1099511631574, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 1339568055, 'ino': 2199023267495, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1340625941, 'ino': 2199023267365, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1345503896, 'ino': 1099511631599, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 1360458251, 'ino': 1099511631630, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 1373483200, 'ino': 2199023267441, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1373583586, 'ino': 2199023260836, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1373787000, 'ino': 2199023260860, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1392518886, 'ino': 2199023260840, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1474229902, 'ino': 2199023268294, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 1480781358, 'ino': 2199023267447, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1486545871, 'ino': 2199023260876, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1491783379, 'ino': 2199023260915, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1492069322, 'ino': 1099511631659, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1498620127, 'ino': 1099511631621, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 1504361428, 'ino': 2199023267385, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1538869580, 'ino': 1099511631628, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 1543090982, 'ino': 2199023267417, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1563836016, 'ino': 2199023260730, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml'}, {'damage_type': 'backtrace', 'id': 1567971899, 'ino': 2199023268404, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 1582387034, 'ino': 2199023260738, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1587415764, 'ino': 2199023267465, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1590792418, 'ino': 2199023260969, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1597715320, 'ino': 2199023267401, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1603813718, 'ino': 2199023260788, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1609448414, 'ino': 2199023260774, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1620357046, 'ino': 2199023268296, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 1630220862, 'ino': 1099511631614, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1650709405, 'ino': 2199023260983, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1673446446, 'ino': 1099511631609, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 1701933951, 'ino': 2199023267469, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1719140496, 'ino': 2199023268267, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 1723350574, 'ino': 2199023268269, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1756661961, 'ino': 2199023268370, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 1763044197, 'ino': 1099511631679, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1768591447, 'ino': 2199023268229, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 1774741570, 'ino': 2199023267481, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1779144760, 'ino': 1099511631606, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 1797815357, 'ino': 2199023260967, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1812857022, 'ino': 2199023267379, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1822683926, 'ino': 2199023260846, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1832125608, 'ino': 1099511631584, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 1836174368, 'ino': 2199023260892, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1846318743, 'ino': 2199023267437, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1854859700, 'ino': 1099511630211, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-67.xml'}, {'damage_type': 'backtrace', 'id': 1858356912, 'ino': 2199023260844, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1869664809, 'ino': 2199023260999, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1871314432, 'ino': 2199023267407, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1872381146, 'ino': 1099511631681, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 1885610089, 'ino': 1099511630293, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-90.xml'}, {'damage_type': 'backtrace', 'id': 1902921142, 'ino': 2199023260726, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-79.xml'}, {'damage_type': 'backtrace', 'id': 1913598333, 'ino': 2199023267475, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1927795555, 'ino': 2199023260770, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1952459107, 'ino': 1099511631618, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1968345757, 'ino': 2199023260977, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1972687951, 'ino': 2199023260963, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1990862170, 'ino': 2199023260882, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1994843746, 'ino': 1099511631637, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 2008339375, 'ino': 2199023260870, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2019418509, 'ino': 1099511631680, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 2042214246, 'ino': 2199023268223, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2048965322, 'ino': 2199023268376, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 2057105724, 'ino': 2199023260734, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2070390474, 'ino': 1099511631640, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 2071981934, 'ino': 2199023268379, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 2096447242, 'ino': 2199023260917, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2098110224, 'ino': 1099511631578, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2105442053, 'ino': 2199023260776, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2118705321, 'ino': 2199023260908, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2140428621, 'ino': 2199023267493, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2146564192, 'ino': 2199023260880, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2153857958, 'ino': 2199023260728, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-78.xml'}, {'damage_type': 'backtrace', 'id': 2156125045, 'ino': 2199023260945, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2157755620, 'ino': 2199023260923, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2173687272, 'ino': 1099511631608, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2189355132, 'ino': 1099511631624, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 2217456276, 'ino': 2199023268225, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 2221814865, 'ino': 2199023267477, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2225611230, 'ino': 2199023260902, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2229537017, 'ino': 1099511631602, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 2230026928, 'ino': 1099511631597, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2256797814, 'ino': 1099511631610, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2262290684, 'ino': 2199023268272, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 2265913319, 'ino': 2199023260724, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-80.xml'}, {'damage_type': 'backtrace', 'id': 2323845277, 'ino': 2199023260758, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2372097007, 'ino': 2199023260943, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 2378506398, 'ino': 2199023260898, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 2381167048, 'ino': 2199023260796, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2388641649, 'ino': 2199023268402, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 2388925342, 'ino': 1099511631635, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2391385533, 'ino': 2199023260812, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2400456486, 'ino': 2199023260768, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2406505728, 'ino': 2199023260896, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2414927371, 'ino': 1099511631647, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 2418627009, 'ino': 2199023268307, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2426362331, 'ino': 2199023260822, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2431057156, 'ino': 2199023260910, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2443986050, 'ino': 2199023268218, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2448427719, 'ino': 2199023260933, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2455505721, 'ino': 2199023260832, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2465637178, 'ino': 1099511631613, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2468327938, 'ino': 2199023268278, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2471476328, 'ino': 2199023260790, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2495869195, 'ino': 2199023268291, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 2506118144, 'ino': 2199023268231, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 2516004550, 'ino': 2199023260973, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2521045094, 'ino': 2199023260997, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2533675557, 'ino': 2199023268358, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 2553248568, 'ino': 2199023260878, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2574488468, 'ino': 2199023268239, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2585485361, 'ino': 2199023267491, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2600142798, 'ino': 2199023267467, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2610620145, 'ino': 2199023267421, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2636537152, 'ino': 2199023260947, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 2639905574, 'ino': 1099511630206, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-95.xml'}, {'damage_type': 'backtrace', 'id': 2666234067, 'ino': 2199023268357, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 2670116220, 'ino': 2199023260900, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2675624843, 'ino': 2199023260862, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2681794487, 'ino': 2199023267489, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2685828748, 'ino': 1099511631569, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 2690454853, 'ino': 2199023268262, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 2701015768, 'ino': 1099511631646, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2708853862, 'ino': 1099511631626, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 2742059388, 'ino': 1099511631652, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2742467304, 'ino': 2199023260820, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2750099264, 'ino': 2199023267373, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2767138297, 'ino': 1099511631598, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 2780771235, 'ino': 2199023267455, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2787846532, 'ino': 1099511631570, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 2793683232, 'ino': 2199023268258, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 2795169989, 'ino': 2199023260784, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2798297801, 'ino': 2199023260886, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 2816072220, 'ino': 2199023267451, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2829600473, 'ino': 2199023267393, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2830997712, 'ino': 2199023268354, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2836416420, 'ino': 1099511631627, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2838265460, 'ino': 1099511630205, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2854431550, 'ino': 2199023261003, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2861192013, 'ino': 2199023267397, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2863221506, 'ino': 2199023267367, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2870548699, 'ino': 1099511631673, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 2874692751, 'ino': 2199023260854, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2885280970, 'ino': 2199023260925, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2896243615, 'ino': 1099511630219, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2910037765, 'ino': 2199023268251, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 2910986608, 'ino': 1099511631589, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 2912741535, 'ino': 2199023267501, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2913503441, 'ino': 2199023260806, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-39.xml'}, {'damage_type': 'backtrace', 'id': 2939880370, 'ino': 2199023267381, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2941281040, 'ino': 2199023267461, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2948511200, 'ino': 2199023268396, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 2998370503, 'ino': 1099511631642, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 3003800845, 'ino': 2199023260760, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3004267839, 'ino': 2199023260953, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3026469848, 'ino': 2199023267471, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3028674476, 'ino': 2199023260748, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-68.xml'}, {'damage_type': 'backtrace', 'id': 3034247980, 'ino': 2199023260864, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3053747020, 'ino': 2199023260931, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3067146350, 'ino': 2199023267389, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3067606028, 'ino': 2199023260778, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3067892978, 'ino': 2199023260804, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3072296714, 'ino': 2199023267387, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3086370495, 'ino': 2199023267435, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3090617311, 'ino': 2199023267487, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3095337221, 'ino': 2199023260912, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3101005015, 'ino': 2199023260786, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3120420731, 'ino': 2199023267429, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3133909040, 'ino': 2199023260838, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3143611634, 'ino': 2199023260957, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3164227521, 'ino': 2199023268348, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3165397555, 'ino': 2199023268381, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3172911732, 'ino': 1099511631576, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3181647465, 'ino': 2199023267395, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3184124512, 'ino': 2199023267415, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3190942282, 'ino': 2199023260746, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3191564138, 'ino': 1099511631591, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 3223674443, 'ino': 2199023260971, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3229152866, 'ino': 1099511631649, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3234753193, 'ino': 1099511631625, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 3239129452, 'ino': 2199023267453, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3257115464, 'ino': 1099511631662, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3291725800, 'ino': 2199023267445, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 3295715413, 'ino': 2199023260772, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3298665782, 'ino': 2199023260816, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-34.xml'}, {'damage_type': 'backtrace', 'id': 3301897992, 'ino': 2199023260989, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3302657912, 'ino': 2199023267463, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3303664706, 'ino': 2199023267413, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3305055995, 'ino': 1099511631648, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3316925798, 'ino': 2199023268333, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 3319736047, 'ino': 1099511631644, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3327290916, 'ino': 2199023260850, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3343953489, 'ino': 2199023268345, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 3356545801, 'ino': 2199023260818, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3356618103, 'ino': 2199023260794, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3359407218, 'ino': 1099511631684, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 3372242930, 'ino': 2199023260965, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3376074609, 'ino': 2199023268299, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3376921351, 'ino': 2199023260834, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3377694920, 'ino': 2199023267433, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3380358699, 'ino': 2199023267439, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3388002882, 'ino': 2199023260744, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3412799106, 'ino': 1099511631556, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 3415724174, 'ino': 2199023267357, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3424030536, 'ino': 1099511631623, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 3426756951, 'ino': 2199023260762, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3427182229, 'ino': 1099511631620, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 3428753660, 'ino': 2199023268361, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3436936779, 'ino': 2199023268255, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 3439046557, 'ino': 1099511631619, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 3446364438, 'ino': 2199023267355, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3485036138, 'ino': 2199023267423, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3527156755, 'ino': 2199023260720, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-82.xml'}, {'damage_type': 'backtrace', 'id': 3547387649, 'ino': 2199023268339, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3579351425, 'ino': 2199023260959, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3582089587, 'ino': 2199023267363, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3584535978, 'ino': 2199023267399, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3594091466, 'ino': 2199023260949, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3595272719, 'ino': 2199023260904, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 3610209002, 'ino': 1099511631678, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 3634930816, 'ino': 1099511631631, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 3645476430, 'ino': 1099511631560, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 3648538773, 'ino': 2199023267419, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3659085401, 'ino': 2199023260732, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-76.xml'}, {'damage_type': 'backtrace', 'id': 3665933829, 'ino': 2199023268248, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3679765845, 'ino': 2199023260935, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3701976647, 'ino': 1099511631650, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3706004980, 'ino': 2199023268221, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 3710524922, 'ino': 2199023260798, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3729684696, 'ino': 2199023268313, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 3730213884, 'ino': 2199023260830, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3783358466, 'ino': 2199023260766, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3834638272, 'ino': 2199023267369, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3841660416, 'ino': 2199023260919, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3854272392, 'ino': 2199023260824, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3865862017, 'ino': 2199023260961, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3878475024, 'ino': 2199023260888, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 3887702531, 'ino': 2199023267425, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3917607252, 'ino': 1099511631594, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3918819548, 'ino': 2199023268399, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 3928131151, 'ino': 1099511631639, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 3931513686, 'ino': 2199023268264, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 3936083402, 'ino': 2199023260752, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-66.xml'}, {'damage_type': 'backtrace', 'id': 3955189440, 'ino': 2199023260927, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3966652099, 'ino': 2199023267391, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3971012833, 'ino': 1099511631636, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 3979344678, 'ino': 2199023268288, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3992238524, 'ino': 2199023268330, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 3993910666, 'ino': 1099511631665, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 3999828138, 'ino': 1099511631616, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 4018719076, 'ino': 2199023260742, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-71.xml'}, {'damage_type': 'backtrace', 'id': 4035786088, 'ino': 1099511631675, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 4047934321, 'ino': 1099511631633, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 4055612510, 'ino': 2199023268275, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 4061441532, 'ino': 1099511631651, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 4064249938, 'ino': 2199023260884, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 4087220370, 'ino': 2199023268393, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 4117409344, 'ino': 2199023268336, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 4123550523, 'ino': 2199023268305, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 4129256805, 'ino': 2199023267371, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml'}, {'damage_type': 'backtrace', 'id': 4153380551, 'ino': 1099511631582, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 4158634532, 'ino': 2199023267409, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 4160192042, 'ino': 2199023267431, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 4200101032, 'ino': 2199023260782, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-51.xml'}, {'damage_type': 'backtrace', 'id': 4202714898, 'ino': 1099511631671, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 4218887241, 'ino': 2199023268316, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 4237685795, 'ino': 2199023267443, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4256176883, 'ino': 2199023260842, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-21.xml'}, {'damage_type': 'backtrace', 'id': 4273890758, 'ino': 1099511631611, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 4281596402, 'ino': 2199023260906, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 4291608750, 'ino': 2199023268228, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-63.xml'}] 2024-04-26T20:29:31.010 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 6664877, 'ino': 2199023262375, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 18462984, 'ino': 2199023262338, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 37153521, 'ino': 2199023262303, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 85341715, 'ino': 2199023256409, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-55.xml'}, {'damage_type': 'backtrace', 'id': 149057688, 'ino': 2199023258661, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 163111199, 'ino': 2199023262249, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 165738479, 'ino': 2199023257151, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 173696872, 'ino': 3298534887154, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 179161835, 'ino': 2199023256123, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-68.xml'}, {'damage_type': 'backtrace', 'id': 181610586, 'ino': 2199023262213, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-12.xml'}, {'damage_type': 'backtrace', 'id': 187380481, 'ino': 2199023262237, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 231651643, 'ino': 2199023256835, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-21.xml'}, {'damage_type': 'backtrace', 'id': 336692499, 'ino': 2199023262215, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-11.xml'}, {'damage_type': 'backtrace', 'id': 354668244, 'ino': 2199023262219, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-9.xml'}, {'damage_type': 'backtrace', 'id': 373562714, 'ino': 2199023262351, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 379869969, 'ino': 2199023262221, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-8.xml'}, {'damage_type': 'backtrace', 'id': 414874210, 'ino': 2199023262231, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-3.xml'}, {'damage_type': 'backtrace', 'id': 421158202, 'ino': 2199023256150, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml'}, {'damage_type': 'backtrace', 'id': 507589965, 'ino': 2199023256105, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml'}, {'damage_type': 'backtrace', 'id': 510492525, 'ino': 2199023256177, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-50.xml'}, {'damage_type': 'backtrace', 'id': 516175027, 'ino': 2199023256232, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-30.xml'}, {'damage_type': 'backtrace', 'id': 516202112, 'ino': 2199023262357, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 516357880, 'ino': 2199023256281, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-13.xml'}, {'damage_type': 'backtrace', 'id': 525551867, 'ino': 2199023262241, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 582460421, 'ino': 2199023262332, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 615728986, 'ino': 2199023262191, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-23.xml'}, {'damage_type': 'backtrace', 'id': 619705766, 'ino': 2199023262297, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 620276305, 'ino': 2199023262207, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-15.xml'}, {'damage_type': 'backtrace', 'id': 642925557, 'ino': 2199023256117, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml'}, {'damage_type': 'backtrace', 'id': 666501720, 'ino': 2199023262197, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-20.xml'}, {'damage_type': 'backtrace', 'id': 673333638, 'ino': 2199023256119, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml'}, {'damage_type': 'backtrace', 'id': 714930858, 'ino': 2199023258504, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 730692715, 'ino': 2199023262326, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 733605749, 'ino': 2199023262189, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-24.xml'}, {'damage_type': 'backtrace', 'id': 764173847, 'ino': 2199023258469, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 903469848, 'ino': 2199023258542, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 904835491, 'ino': 2199023258097, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 954085536, 'ino': 2199023257042, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1005090152, 'ino': 2199023262284, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1022613809, 'ino': 2199023257008, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1023919138, 'ino': 2199023262229, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1032876500, 'ino': 2199023258583, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 1037424094, 'ino': 2199023256313, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1055768316, 'ino': 2199023256476, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-50.xml'}, {'damage_type': 'backtrace', 'id': 1066319307, 'ino': 2199023262251, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1076205616, 'ino': 2199023262355, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1162215660, 'ino': 2199023262239, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1189254201, 'ino': 3298534883844, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 1196217637, 'ino': 2199023258567, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1236713924, 'ino': 2199023262199, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1244307814, 'ino': 2199023262353, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1264660557, 'ino': 2199023262195, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1268941787, 'ino': 2199023262260, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1285798552, 'ino': 3298534883867, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 1308860351, 'ino': 2199023257965, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 1310172351, 'ino': 2199023262295, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1346705666, 'ino': 2199023258551, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1365393544, 'ino': 2199023262315, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1415843937, 'ino': 2199023257248, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1428913861, 'ino': 2199023256192, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1436813598, 'ino': 2199023262330, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1448138997, 'ino': 2199023256056, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-90.xml'}, {'damage_type': 'backtrace', 'id': 1473700052, 'ino': 2199023262235, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1492937007, 'ino': 2199023257089, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1533483657, 'ino': 2199023262340, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1542656694, 'ino': 2199023258559, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 1554895145, 'ino': 2199023256634, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1575518094, 'ino': 2199023258481, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 1577096957, 'ino': 1099511630222, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-97.jpg'}, {'damage_type': 'backtrace', 'id': 1578940621, 'ino': 2199023259917, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 1585147521, 'ino': 2199023258604, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 1586172121, 'ino': 2199023262291, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1605567330, 'ino': 2199023262320, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1626436590, 'ino': 2199023257113, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1688957696, 'ino': 2199023262311, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1710459817, 'ino': 2199023257123, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1766790564, 'ino': 3298534883845, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1809835994, 'ino': 2199023262205, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1817040249, 'ino': 3298534885012, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1830707887, 'ino': 2199023262245, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1832853392, 'ino': 2199023257020, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1834502342, 'ino': 2199023262263, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1835216941, 'ino': 2199023258475, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 1860917210, 'ino': 2199023262348, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1864346209, 'ino': 2199023257017, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1867014734, 'ino': 4398046511633, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1873997366, 'ino': 3298534883979, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 1906693161, 'ino': 2199023262336, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1912858907, 'ino': 2199023262193, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1930750951, 'ino': 2199023256078, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-83.xml'}, {'damage_type': 'backtrace', 'id': 1998192452, 'ino': 2199023262299, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2005309563, 'ino': 2199023262233, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2032255695, 'ino': 2199023262345, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2104133780, 'ino': 2199023258530, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2122705483, 'ino': 2199023262227, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2166816692, 'ino': 2199023258629, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2206056544, 'ino': 3298534883328, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 2216879549, 'ino': 3298534883835, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 2242302755, 'ino': 2199023262307, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 2253168742, 'ino': 2199023257070, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2314311688, 'ino': 2199023262223, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2338579791, 'ino': 2199023256732, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2338818648, 'ino': 3298534883838, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2397969984, 'ino': 2199023262203, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2416324102, 'ino': 2199023257039, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2455605405, 'ino': 1099511632051, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2518542485, 'ino': 2199023262324, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2523573247, 'ino': 2199023262369, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2546162581, 'ino': 2199023256257, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2570923936, 'ino': 2199023262317, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2571933537, 'ino': 2199023256346, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 2597210650, 'ino': 2199023262301, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2620016887, 'ino': 2199023262288, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2638552236, 'ino': 2199023262346, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2649079664, 'ino': 2199023256228, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2658918096, 'ino': 2199023257049, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2663386851, 'ino': 2199023256911, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2686745980, 'ino': 4398046512278, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2714110069, 'ino': 2199023262365, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2729550994, 'ino': 2199023256174, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2763010387, 'ino': 2199023258553, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 2804436295, 'ino': 2199023258602, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 2853691708, 'ino': 2199023262305, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2875830634, 'ino': 2199023262211, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2887290091, 'ino': 2199023262274, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2916944716, 'ino': 2199023262367, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2936734491, 'ino': 2199023256819, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 2947887895, 'ino': 2199023256204, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2986556425, 'ino': 2199023262373, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2997532545, 'ino': 2199023256301, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3001166756, 'ino': 2199023257080, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3030754312, 'ino': 2199023256265, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3076718732, 'ino': 2199023258483, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 3126658445, 'ino': 2199023262267, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3127673158, 'ino': 2199023262217, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3155464403, 'ino': 2199023262256, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3182150828, 'ino': 2199023256742, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3212188089, 'ino': 2199023257001, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3227944794, 'ino': 2199023262201, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3232274579, 'ino': 2199023262247, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3244361837, 'ino': 2199023258675, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3256512679, 'ino': 2199023262361, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3273939797, 'ino': 2199023256407, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3279232431, 'ino': 2199023262371, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3310724192, 'ino': 2199023262363, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3332868137, 'ino': 2199023262328, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3392150293, 'ino': 2199023256162, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-55.xml'}, {'damage_type': 'backtrace', 'id': 3416249638, 'ino': 2199023262209, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3464338337, 'ino': 3298534884492, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 3504777489, 'ino': 2199023257114, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3506837380, 'ino': 2199023262279, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3517183949, 'ino': 2199023258668, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3524450712, 'ino': 2199023262225, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3524659232, 'ino': 2199023258715, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 3616762919, 'ino': 2199023262185, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3624501701, 'ino': 2199023258547, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 3630033328, 'ino': 2199023256398, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3633662709, 'ino': 3298534883329, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3650899846, 'ino': 2199023256296, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3686782660, 'ino': 2199023257165, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3702356738, 'ino': 1099511632049, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3702494976, 'ino': 2199023262322, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3716770125, 'ino': 2199023262243, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 3760320153, 'ino': 2199023262359, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3767451021, 'ino': 2199023262343, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3790486852, 'ino': 1099511630223, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3811395082, 'ino': 2199023257889, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-1/article-76.xml'}, {'damage_type': 'backtrace', 'id': 3814946775, 'ino': 2199023262293, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3825774730, 'ino': 2199023262187, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3842233747, 'ino': 2199023262334, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3933345574, 'ino': 2199023256472, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 4001279799, 'ino': 2199023256159, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-56.xml'}, {'damage_type': 'backtrace', 'id': 4077788075, 'ino': 2199023262377, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 4117503670, 'ino': 2199023262253, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 4210557875, 'ino': 2199023257129, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 4272130575, 'ino': 2199023256230, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml'}, {'damage_type': 'backtrace', 'id': 4278086610, 'ino': 2199023262313, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-39/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 4281346332, 'ino': 2199023256260, 'path': '/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml'}] 2024-04-26T20:29:31.011 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-04-26T20:29:31.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:30 smithi082 ceph-mon[28105]: pgmap v614: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 628 op/s 2024-04-26T20:29:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:30 smithi139 ceph-mon[32999]: pgmap v614: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 628 op/s 2024-04-26T20:29:31.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:30 smithi135 ceph-mon[32816]: pgmap v614: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 628 op/s 2024-04-26T20:29:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:32 smithi139 ceph-mon[32999]: pgmap v615: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-04-26T20:29:33.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:32 smithi135 ceph-mon[32816]: pgmap v615: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-04-26T20:29:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:32 smithi082 ceph-mon[28105]: pgmap v615: 129 pgs: 129 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-04-26T20:29:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:35 smithi082 ceph-mon[28105]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 361 op/s 2024-04-26T20:29:36.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:35 smithi139 ceph-mon[32999]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 361 op/s 2024-04-26T20:29:36.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:35 smithi135 ceph-mon[32816]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 361 op/s 2024-04-26T20:29:37.131 INFO:tasks.workunit.client.0.smithi082.stdout: 373 544733 1310 369159 999 166230 1753 2024-04-26T20:29:38.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:37 smithi082 ceph-mon[28105]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 225 op/s 2024-04-26T20:29:38.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:37 smithi139 ceph-mon[32999]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 225 op/s 2024-04-26T20:29:38.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:37 smithi135 ceph-mon[32816]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 225 op/s 2024-04-26T20:29:40.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:39 smithi082 ceph-mon[28105]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 263 op/s 2024-04-26T20:29:40.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:39 smithi139 ceph-mon[32999]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 263 op/s 2024-04-26T20:29:40.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:39 smithi135 ceph-mon[32816]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 263 op/s 2024-04-26T20:29:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.154+0000 7ff2b8600640 1 -- 172.21.15.82:0/3440397329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 msgr2=0x7ff2b010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.155+0000 7ff2b8600640 1 --2- 172.21.15.82:0/3440397329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b010f0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009900 tx=0x7ff2a402a440 comp rx=0 tx=0).stop 2024-04-26T20:29:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.178+0000 7ff2b8600640 1 -- 172.21.15.82:0/3440397329 shutdown_connections 2024-04-26T20:29:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.178+0000 7ff2b8600640 1 --2- 172.21.15.82:0/3440397329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b010f0d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.178+0000 7ff2b8600640 1 --2- 172.21.15.82:0/3440397329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b010c2a0 0x7ff2b010e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.178+0000 7ff2b8600640 1 --2- 172.21.15.82:0/3440397329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b0109930 0x7ff2b010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.178+0000 7ff2b8600640 1 -- 172.21.15.82:0/3440397329 >> 172.21.15.82:0/3440397329 conn(0x7ff2b006f9a0 msgr2=0x7ff2b0071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:41.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.204+0000 7ff2b8600640 1 -- 172.21.15.82:0/3440397329 shutdown_connections 2024-04-26T20:29:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.204+0000 7ff2b8600640 1 -- 172.21.15.82:0/3440397329 wait complete. 2024-04-26T20:29:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.205+0000 7ff2b8600640 1 Processor -- start 2024-04-26T20:29:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.213+0000 7ff2b8600640 1 -- start start 2024-04-26T20:29:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.221+0000 7ff2b8600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b0109930 0x7ff2b01a7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.236+0000 7ff2b8600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b010c2a0 0x7ff2b01a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.239+0000 7ff2b5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b010c2a0 0x7ff2b01a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.239+0000 7ff2b5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b010c2a0 0x7ff2b01a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34320/0 (socket says 172.21.15.82:34320) 2024-04-26T20:29:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.239+0000 7ff2b5200640 1 -- 172.21.15.82:0/2653335125 learned_addr learned my addr 172.21.15.82:0/2653335125 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.253+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b0109930 0x7ff2b01a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.267+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b01aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.268+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b011d2d0 con 0x7ff2b010c2a0 2024-04-26T20:29:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.268+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b011d150 con 0x7ff2b0109930 2024-04-26T20:29:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.268+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b011d450 con 0x7ff2b010ec50 2024-04-26T20:29:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.272+0000 7ff2b6600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b01aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.287+0000 7ff2b6600640 1 -- 172.21.15.82:0/2653335125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b0109930 msgr2=0x7ff2b01a7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.287+0000 7ff2b6600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b0109930 0x7ff2b01a7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.287+0000 7ff2b6600640 1 -- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b010c2a0 msgr2=0x7ff2b01a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.287+0000 7ff2b6600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b010c2a0 0x7ff2b01a7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.287+0000 7ff2b6600640 1 -- 172.21.15.82:0/2653335125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b01af430 con 0x7ff2b010ec50 2024-04-26T20:29:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.296+0000 7ff2b6600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b01aedc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4033040 tx=0x7ff2a4004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.301+0000 7ff2ae000640 1 -- 172.21.15.82:0/2653335125 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4040030 con 0x7ff2b010ec50 2024-04-26T20:29:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.301+0000 7ff2ae000640 1 -- 172.21.15.82:0/2653335125 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a40050f0 con 0x7ff2b010ec50 2024-04-26T20:29:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.301+0000 7ff2ae000640 1 -- 172.21.15.82:0/2653335125 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a403c800 con 0x7ff2b010ec50 2024-04-26T20:29:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.301+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b01af6c0 con 0x7ff2b010ec50 2024-04-26T20:29:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.301+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b01afb30 con 0x7ff2b010ec50 2024-04-26T20:29:41.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:40 smithi139 ceph-mon[32999]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.2 MiB/s wr, 327 op/s 2024-04-26T20:29:41.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:40 smithi135 ceph-mon[32816]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.2 MiB/s wr, 327 op/s 2024-04-26T20:29:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.367+0000 7ff2ae000640 1 -- 172.21.15.82:0/2653335125 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff2a4043030 con 0x7ff2b010ec50 2024-04-26T20:29:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.370+0000 7ff2ae000640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2980a3f00 0x7ff2980a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.370+0000 7ff2ae000640 1 -- 172.21.15.82:0/2653335125 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ff2a4004ca0 con 0x7ff2b010ec50 2024-04-26T20:29:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.375+0000 7ff2bb432740 1 Processor -- start 2024-04-26T20:29:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.383+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2980a3f00 0x7ff2980a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.408+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2980a3f00 0x7ff2980a63c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00bbe0 tx=0x7ff29c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 -- start start 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a19ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a1f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a21bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55566697e380 con 0x555666a1a5c0 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55566691ac30 con 0x555666a19bd0 2024-04-26T20:29:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.423+0000 7ff2bb432740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55566697a340 con 0x555666a1f730 2024-04-26T20:29:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.428+0000 7ff2b5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a19ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.428+0000 7ff2b5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a19ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:43964/0 (socket says 172.21.15.82:43964) 2024-04-26T20:29:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.428+0000 7ff2b5c00640 1 -- 172.21.15.82:0/568023279 learned_addr learned my addr 172.21.15.82:0/568023279 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.430+0000 7ff2b5200640 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a1f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.430+0000 7ff2b6600640 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a21bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.432+0000 7ff2b5c00640 1 -- 172.21.15.82:0/568023279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 msgr2=0x555666a21bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.432+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a21bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.432+0000 7ff2b5c00640 1 -- 172.21.15.82:0/568023279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 msgr2=0x555666a1f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.432+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a1f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.432+0000 7ff2b5c00640 1 -- 172.21.15.82:0/568023279 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566693c940 con 0x555666a19bd0 2024-04-26T20:29:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.436+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a19ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff29c005d00 tx=0x7ff29c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6053b012ab4c07e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:41.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:40 smithi082 ceph-mon[28105]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.2 MiB/s wr, 327 op/s 2024-04-26T20:29:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.456+0000 7ff2a2a00640 1 -- 172.21.15.82:0/568023279 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c005220 con 0x555666a19bd0 2024-04-26T20:29:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.457+0000 7ff2a2a00640 1 -- 172.21.15.82:0/568023279 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff29c004c50 con 0x555666a19bd0 2024-04-26T20:29:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.457+0000 7ff2a2a00640 1 -- 172.21.15.82:0/568023279 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c01e9c0 con 0x555666a19bd0 2024-04-26T20:29:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.476+0000 7ff2bb432740 1 -- 172.21.15.82:0/568023279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 msgr2=0x555666a19ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.476+0000 7ff2bb432740 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a19ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff29c005d00 tx=0x7ff29c013000 comp rx=0 tx=0).stop 2024-04-26T20:29:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.497+0000 7ff2bb432740 1 -- 172.21.15.82:0/568023279 shutdown_connections 2024-04-26T20:29:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.497+0000 7ff2bb432740 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a21bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.497+0000 7ff2bb432740 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a1f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.497+0000 7ff2bb432740 1 --2- 172.21.15.82:0/568023279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a19ff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.497+0000 7ff2bb432740 1 -- 172.21.15.82:0/568023279 >> 172.21.15.82:0/568023279 conn(0x555666a15240 msgr2=0x555666a15640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.507+0000 7ff2bb432740 1 -- 172.21.15.82:0/568023279 shutdown_connections 2024-04-26T20:29:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.511+0000 7ff2bb432740 1 -- 172.21.15.82:0/568023279 wait complete. 2024-04-26T20:29:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.511+0000 7ff2bb432740 1 -- start start 2024-04-26T20:29:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.512+0000 7ff2bb432740 1 Processor -- start 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a34e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a3c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555666a336f0 con 0x555666a1a5c0 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555666905c60 con 0x555666a19bd0 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555666a33870 con 0x555666a1f730 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.552+0000 7ff2bb432740 10 client.0 _ll_register_callbacks cb 0x555666931e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.553+0000 7ff2b6600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a3c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.555+0000 7ff2b6600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a3c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60990/0 (socket says 172.21.15.82:60990) 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.555+0000 7ff2b6600640 1 -- 172.21.15.82:0/449773966 learned_addr learned my addr 172.21.15.82:0/449773966 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.557+0000 7ff2b6600640 1 -- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 msgr2=0x555666a34e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:29:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.557+0000 7ff2b6600640 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a34e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.557+0000 7ff2b6600640 1 -- 172.21.15.82:0/449773966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 msgr2=0x555666a353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.557+0000 7ff2b6600640 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.557+0000 7ff2b6600640 1 -- 172.21.15.82:0/449773966 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555666914510 con 0x555666a1f730 2024-04-26T20:29:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.558+0000 7ff2b6600640 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a3c3e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40bdd40 tx=0x7ff2a40be5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffc4d9252a08cdd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.582+0000 7ff297400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:29:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.582+0000 7ff297400640 1 -- 172.21.15.82:0/449773966 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a404a070 con 0x555666a1f730 2024-04-26T20:29:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.582+0000 7ff297400640 1 -- 172.21.15.82:0/449773966 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ff2a40be210 con 0x555666a1f730 2024-04-26T20:29:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.658+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29c004c50 con 0x555666a1f730 2024-04-26T20:29:41.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.664+0000 7ff297400640 1 -- 172.21.15.82:0/449773966 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff2a40d7200 con 0x555666a1f730 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.665+0000 7ff2bb432740 10 client.26977 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.665+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x555666690210 con 0x555666a1f730 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.668+0000 7ff297400640 1 -- 172.21.15.82:0/449773966 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff29c004c50 con 0x555666a1f730 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.668+0000 7ff297400640 1 -- 172.21.15.82:0/449773966 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7ff2a40c4040 con 0x555666a1f730 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.670+0000 7ff2bb432740 10 client.26977 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.670+0000 7ff2bb432740 10 client.26977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.670+0000 7ff2bb432740 20 client.26977 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.670+0000 7ff2bb432740 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666a40a80 0x555666a42f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.670+0000 7ff2bb432740 4 client.26977 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:29:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.670+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55566698bf90 con 0x555666a40a80 2024-04-26T20:29:41.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.671+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666a40a80 0x555666a42f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:41.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.684+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666a40a80 0x555666a42f20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e90a5b8fa9dca728 server_cookie=43fc65d3cf11f5f8 in_seq=0 out_seq=0 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.697+0000 7ff297400640 10 client.26977 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.697+0000 7ff297400640 1 -- 172.21.15.82:0/449773966 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55566698bf90 con 0x555666a40a80 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.697+0000 7ff297400640 10 client.26977 handle_command_reply: tid=0 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.697+0000 7ff2bb432740 1 client.26977 shutdown 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.707+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 msgr2=0x555666a3c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.707+0000 7ff2bb432740 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a3c3e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40bdd40 tx=0x7ff2a40be5f0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.738+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 shutdown_connections 2024-04-26T20:29:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.738+0000 7ff2bb432740 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666a40a80 0x555666a42f20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.738+0000 7ff2bb432740 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666a3c3e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.738+0000 7ff2bb432740 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.738+0000 7ff2bb432740 1 --2- 172.21.15.82:0/449773966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a34e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.738+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 >> 172.21.15.82:0/449773966 conn(0x555666a15240 msgr2=0x555666a14440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:41.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.755+0000 7ff297400640 0 client.26977 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:41.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.767+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 shutdown_connections 2024-04-26T20:29:41.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.768+0000 7ff2bb432740 1 -- 172.21.15.82:0/449773966 wait complete. 2024-04-26T20:29:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:41.779+0000 7ff2bb432740 20 client.26977 trim_cache size 0 max 16384 2024-04-26T20:29:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.350+0000 7ff2bb432740 1 Processor -- start 2024-04-26T20:29:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.357+0000 7ff2bb432740 1 -- start start 2024-04-26T20:29:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a19bd0 0x555666a18900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 0x555666a3c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a1f730 0x555666a13bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2bb432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff29000fbf0 con 0x555666a19bd0 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2bb432740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900118b0 con 0x555666a1f730 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2bb432740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900102c0 con 0x555666a1a5c0 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.358+0000 7ff2b5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 0x555666a3c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 0x555666a3c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:32768/0 (socket says 172.21.15.82:32768) 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 -- 172.21.15.82:0/3589516204 learned_addr learned my addr 172.21.15.82:0/3589516204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 -- 172.21.15.82:0/3589516204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a1f730 msgr2=0x555666a13bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:29:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a1f730 0x555666a13bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 -- 172.21.15.82:0/3589516204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a19bd0 msgr2=0x555666a18900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a19bd0 0x555666a18900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.359+0000 7ff2b5200640 1 -- 172.21.15.82:0/3589516204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566675c620 con 0x555666a1a5c0 2024-04-26T20:29:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.362+0000 7ff2b5200640 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 0x555666a3c3a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff2b01a8d20 tx=0x7ff2a8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a685a4b88612640 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.381+0000 7ff2a2000640 1 -- 172.21.15.82:0/3589516204 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8004840 con 0x555666a1a5c0 2024-04-26T20:29:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.381+0000 7ff2a2000640 1 -- 172.21.15.82:0/3589516204 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a8012900 con 0x555666a1a5c0 2024-04-26T20:29:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.381+0000 7ff2a2000640 1 -- 172.21.15.82:0/3589516204 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8011a10 con 0x555666a1a5c0 2024-04-26T20:29:42.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.404+0000 7ff2bb432740 1 -- 172.21.15.82:0/3589516204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 msgr2=0x555666a3c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:42.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.404+0000 7ff2bb432740 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 0x555666a3c3a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff2b01a8d20 tx=0x7ff2a8009f90 comp rx=0 tx=0).stop 2024-04-26T20:29:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.435+0000 7ff2bb432740 1 -- 172.21.15.82:0/3589516204 shutdown_connections 2024-04-26T20:29:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.435+0000 7ff2bb432740 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a1f730 0x555666a13bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.435+0000 7ff2bb432740 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1a5c0 0x555666a3c3a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.435+0000 7ff2bb432740 1 --2- 172.21.15.82:0/3589516204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a19bd0 0x555666a18900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.435+0000 7ff2bb432740 1 -- 172.21.15.82:0/3589516204 >> 172.21.15.82:0/3589516204 conn(0x555666a15240 msgr2=0x555666a181f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.442+0000 7ff2bb432740 1 -- 172.21.15.82:0/3589516204 shutdown_connections 2024-04-26T20:29:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.442+0000 7ff2bb432740 1 -- 172.21.15.82:0/3589516204 wait complete. 2024-04-26T20:29:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.442+0000 7ff2bb432740 1 -- start start 2024-04-26T20:29:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.444+0000 7ff2bb432740 1 Processor -- start 2024-04-26T20:29:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.444+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a39010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.453+0000 7ff2bb432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a39550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.453+0000 7ff2b5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a39010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.453+0000 7ff2b5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a39010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:43984/0 (socket says 172.21.15.82:43984) 2024-04-26T20:29:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.456+0000 7ff2b5c00640 1 -- 172.21.15.82:0/1676000945 learned_addr learned my addr 172.21.15.82:0/1676000945 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:29:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.472+0000 7ff2b5200640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a39550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.483+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666aa5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.483+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900111e0 con 0x555666a1a5c0 2024-04-26T20:29:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.483+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff290010a50 con 0x555666a19bd0 2024-04-26T20:29:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.483+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff29000dbd0 con 0x555666a1f730 2024-04-26T20:29:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.483+0000 7ff2bb432740 10 client.0 _ll_register_callbacks cb 0x7ff2a40b9930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:29:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.487+0000 7ff2b5c00640 1 -- 172.21.15.82:0/1676000945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 msgr2=0x555666aa5050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:29:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.487+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666aa5050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.487+0000 7ff2b5c00640 1 -- 172.21.15.82:0/1676000945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 msgr2=0x555666a39550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:29:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.487+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a39550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.487+0000 7ff2b5c00640 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555666938cb0 con 0x555666a19bd0 2024-04-26T20:29:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.488+0000 7ff2b5c00640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a39010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c0109c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edfc0f114695d429 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:29:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.489+0000 7ff2b5200640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a39550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:29:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.506+0000 7ff297400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:29:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.507+0000 7ff297400640 1 -- 172.21.15.82:0/1676000945 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c005450 con 0x555666a19bd0 2024-04-26T20:29:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.507+0000 7ff297400640 1 -- 172.21.15.82:0/1676000945 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ff29c0055f0 con 0x555666a19bd0 2024-04-26T20:29:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.527+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a8012900 con 0x555666a19bd0 2024-04-26T20:29:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.528+0000 7ff297400640 1 -- 172.21.15.82:0/1676000945 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff29c004620 con 0x555666a19bd0 2024-04-26T20:29:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.545+0000 7ff2bb432740 10 client.26900 fetch_fsmap learned FSMap version 44 2024-04-26T20:29:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.546+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x555666aa64b0 con 0x555666a19bd0 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.560+0000 7ff297400640 1 -- 172.21.15.82:0/1676000945 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a8012900 con 0x555666a19bd0 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.560+0000 7ff297400640 1 -- 172.21.15.82:0/1676000945 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7ff29c034540 con 0x555666a19bd0 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.561+0000 7ff2bb432740 10 client.26900 fetch_fsmap finished waiting for FSMap version 44 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.561+0000 7ff2bb432740 10 client.26900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.561+0000 7ff2bb432740 20 client.26900 populate_metadata read hostname 'smithi082' 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.561+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666aa6cf0 0x555666aa9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:29:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.561+0000 7ff2bb432740 4 client.26900 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:29:42.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.561+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555666985e00 con 0x555666aa6cf0 2024-04-26T20:29:42.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.566+0000 7ff2b5200640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666aa6cf0 0x555666aa9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:29:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.585+0000 7ff297400640 10 client.26900 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:42.585+0000 7ff2b5200640 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666aa6cf0 0x555666aa9110 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22467664f6f48ea7 server_cookie=c45b1efbe3350119 in_seq=0 out_seq=0 2024-04-26T20:29:44.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:43 smithi082 ceph-mon[28105]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 509 op/s 2024-04-26T20:29:44.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:43 smithi139 ceph-mon[32999]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 509 op/s 2024-04-26T20:29:44.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:43 smithi135 ceph-mon[32816]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 509 op/s 2024-04-26T20:29:45.320 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:44 smithi139 ceph-mon[32999]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.8 MiB/s wr, 658 op/s 2024-04-26T20:29:45.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:44 smithi135 ceph-mon[32816]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.8 MiB/s wr, 658 op/s 2024-04-26T20:29:45.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:44 smithi082 ceph-mon[28105]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.8 MiB/s wr, 658 op/s 2024-04-26T20:29:47.132 INFO:tasks.workunit.client.0.smithi082.stdout: 378 454466 305 304854 187 145510 71 2024-04-26T20:29:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.140+0000 7ff297400640 1 -- 172.21.15.82:0/1676000945 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555666985e00 con 0x555666aa6cf0 2024-04-26T20:29:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.140+0000 7ff297400640 10 client.26900 handle_command_reply: tid=0 2024-04-26T20:29:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.140+0000 7ff2bb432740 1 client.26900 shutdown 2024-04-26T20:29:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 msgr2=0x555666a39010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a39010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c0109c0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 shutdown_connections 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x555666aa6cf0 0x555666aa9110 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555666a1f730 0x555666aa5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555666a1a5c0 0x555666a39550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 --2- 172.21.15.82:0/1676000945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555666a19bd0 0x555666a39010 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 >> 172.21.15.82:0/1676000945 conn(0x555666a15240 msgr2=0x555666a13bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.141+0000 7ff297400640 0 client.26900 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:29:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.144+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 shutdown_connections 2024-04-26T20:29:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.148+0000 7ff2bb432740 1 -- 172.21.15.82:0/1676000945 wait complete. 2024-04-26T20:29:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.152+0000 7ff2bb432740 20 client.26900 trim_cache size 0 max 16384 2024-04-26T20:29:47.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:29:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:29:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:29:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:29:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.185+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2980a3f00 msgr2=0x7ff2980a63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.186+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2980a3f00 0x7ff2980a63c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00bbe0 tx=0x7ff29c00b390 comp rx=0 tx=0).stop 2024-04-26T20:29:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.186+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 msgr2=0x7ff2b01aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:29:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.186+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b01aedc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4033040 tx=0x7ff2a4004580 comp rx=0 tx=0).stop 2024-04-26T20:29:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.190+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 shutdown_connections 2024-04-26T20:29:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.190+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff2980a3f00 0x7ff2980a63c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.191+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2b010ec50 0x7ff2b01aedc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.192+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2b010c2a0 0x7ff2b01a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.192+0000 7ff2b8600640 1 --2- 172.21.15.82:0/2653335125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2b0109930 0x7ff2b01a7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:29:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.192+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 >> 172.21.15.82:0/2653335125 conn(0x7ff2b006f9a0 msgr2=0x7ff2b010bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:29:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.195+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 shutdown_connections 2024-04-26T20:29:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:29:47.196+0000 7ff2b8600640 1 -- 172.21.15.82:0/2653335125 wait complete. 2024-04-26T20:29:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:46 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:46 smithi139 ceph-mon[32999]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.7 MiB/s wr, 714 op/s 2024-04-26T20:29:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:46 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:29:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:46 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:47.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:47.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:46 smithi135 ceph-mon[32816]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.7 MiB/s wr, 714 op/s 2024-04-26T20:29:47.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:46 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:29:47.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:46 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:47.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:47.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:47.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:46 smithi082 ceph-mon[28105]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.7 MiB/s wr, 714 op/s 2024-04-26T20:29:47.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:46 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:29:50.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:49 smithi082 ceph-mon[28105]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 798 op/s 2024-04-26T20:29:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:49 smithi139 ceph-mon[32999]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 798 op/s 2024-04-26T20:29:50.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:49 smithi135 ceph-mon[32816]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.8 MiB/s wr, 798 op/s 2024-04-26T20:29:51.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:50 smithi139 ceph-mon[32999]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.7 MiB/s wr, 826 op/s 2024-04-26T20:29:51.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:50 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:51.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:50 smithi135 ceph-mon[32816]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.7 MiB/s wr, 826 op/s 2024-04-26T20:29:51.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:50 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:51.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:50 smithi082 ceph-mon[28105]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.7 MiB/s wr, 826 op/s 2024-04-26T20:29:51.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:50 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:54.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:53 smithi082 ceph-mon[28105]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.0 MiB/s wr, 714 op/s 2024-04-26T20:29:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:53 smithi139 ceph-mon[32999]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.0 MiB/s wr, 714 op/s 2024-04-26T20:29:54.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:53 smithi135 ceph-mon[32816]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.0 MiB/s wr, 714 op/s 2024-04-26T20:29:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:54 smithi139 ceph-mon[32999]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 2.9 MiB/s wr, 532 op/s 2024-04-26T20:29:55.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:54 smithi135 ceph-mon[32816]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 2.9 MiB/s wr, 532 op/s 2024-04-26T20:29:55.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:54 smithi082 ceph-mon[28105]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 2.9 MiB/s wr, 532 op/s 2024-04-26T20:29:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:56 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:56 smithi139 ceph-mon[32999]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 1.5 MiB/s wr, 363 op/s 2024-04-26T20:29:57.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:56 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:57.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:56 smithi135 ceph-mon[32816]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 1.5 MiB/s wr, 363 op/s 2024-04-26T20:29:57.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:56 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:29:57.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:56 smithi082 ceph-mon[28105]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 1.5 MiB/s wr, 363 op/s 2024-04-26T20:30:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:29:59 smithi082 ceph-mon[28105]: pgmap v628: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-04-26T20:30:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:29:59.999+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 3 MDSs report damaged metadata 2024-04-26T20:30:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:29:59.999+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 3 MDSs report damaged metadata 2024-04-26T20:30:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:29:59.999+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : mds.c(mds.3): Metadata damage detected 2024-04-26T20:30:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:29:59.999+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : mds.i(mds.2): Metadata damage detected 2024-04-26T20:30:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:29:59.999+0000 7f7379600700 -1 log_channel(cluster) log [ERR] : mds.g(mds.1): Metadata damage detected 2024-04-26T20:30:00.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:29:59 smithi139 ceph-mon[32999]: pgmap v628: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 -- 172.21.15.82:0/248799496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc101bd0 msgr2=0x7f07fc101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 --2- 172.21.15.82:0/248799496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc101bd0 0x7f07fc101ff0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009900 tx=0x7f07e402a410 comp rx=0 tx=0).stop 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 -- 172.21.15.82:0/248799496 shutdown_connections 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 --2- 172.21.15.82:0/248799496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07fc100fe0 0x7f07fc102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 --2- 172.21.15.82:0/248799496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc100620 0x7f07fc100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 --2- 172.21.15.82:0/248799496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc101bd0 0x7f07fc101ff0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 -- 172.21.15.82:0/248799496 >> 172.21.15.82:0/248799496 conn(0x7f07fc0fc150 msgr2=0x7f07fc0fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 -- 172.21.15.82:0/248799496 shutdown_connections 2024-04-26T20:30:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.358+0000 7f0803600640 1 -- 172.21.15.82:0/248799496 wait complete. 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.359+0000 7f0803600640 1 Processor -- start 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.359+0000 7f0803600640 1 -- start start 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0803600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07fc100620 0x7f07fc19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0803600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 0x7f07fc19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0803600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc101bd0 0x7f07fc1a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0803600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1106e0 con 0x7f07fc100fe0 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0803600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc110560 con 0x7f07fc101bd0 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0803600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc110860 con 0x7f07fc100620 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 0x7f07fc19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0800c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07fc100620 0x7f07fc19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 0x7f07fc19b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60378/0 (socket says 172.21.15.82:60378) 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f07f3e00640 1 -- 172.21.15.82:0/769990818 learned_addr learned my addr 172.21.15.82:0/769990818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.360+0000 7f0801600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc101bd0 0x7f07fc1a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07f3e00640 1 -- 172.21.15.82:0/769990818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07fc100620 msgr2=0x7f07fc19ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07f3e00640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07fc100620 0x7f07fc19ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07f3e00640 1 -- 172.21.15.82:0/769990818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc101bd0 msgr2=0x7f07fc1a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07f3e00640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc101bd0 0x7f07fc1a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07f3e00640 1 -- 172.21.15.82:0/769990818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc1a29b0 con 0x7f07fc100fe0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f0801600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc101bd0 0x7f07fc1a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07f3e00640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 0x7f07fc19b2e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e9c0 tx=0x7f07ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07fa000640 1 -- 172.21.15.82:0/769990818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00cd80 con 0x7f07fc100fe0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07fa000640 1 -- 172.21.15.82:0/769990818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07ec0035f0 con 0x7f07fc100fe0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc1a2ca0 con 0x7f07fc100fe0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f07fa000640 1 -- 172.21.15.82:0/769990818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec010690 con 0x7f07fc100fe0 2024-04-26T20:30:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.361+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc1a31c0 con 0x7f07fc100fe0 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.364+0000 7f080659a740 1 Processor -- start 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f07fa000640 1 -- 172.21.15.82:0/769990818 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f07ec0037a0 con 0x7f07fc100fe0 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 -- start start 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e53ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dae5db8380 con 0x55dae5e59730 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dae5d54c30 con 0x55dae5e53bd0 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f080659a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dae5db4340 con 0x55dae5e545c0 2024-04-26T20:30:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f0801600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e53ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f0801600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e53ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60954/0 (socket says 172.21.15.82:60954) 2024-04-26T20:30:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f0801600640 1 -- 172.21.15.82:0/2049044128 learned_addr learned my addr 172.21.15.82:0/2049044128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.365+0000 7f0800c00640 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f0801600640 1 -- 172.21.15.82:0/2049044128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 msgr2=0x55dae5e590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f0801600640 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f0801600640 1 -- 172.21.15.82:0/2049044128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 msgr2=0x55dae5e5bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f0801600640 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f0801600640 1 -- 172.21.15.82:0/2049044128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dae5d76940 con 0x55dae5e53bd0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f0801600640 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e53ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07f400f410 tx=0x7f07f400f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d297f880a43d1a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f07fa000640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07dc0a3cf0 0x7f07dc0a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f07f1c00640 1 -- 172.21.15.82:0/2049044128 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4015070 con 0x55dae5e53bd0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f07f1c00640 1 -- 172.21.15.82:0/2049044128 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f4011bb0 con 0x55dae5e53bd0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f07f1c00640 1 -- 172.21.15.82:0/2049044128 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4010c70 con 0x55dae5e53bd0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.366+0000 7f07fa000640 1 -- 172.21.15.82:0/769990818 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f07ec0d0df0 con 0x7f07fc100fe0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f0800c00640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07dc0a3cf0 0x7f07dc0a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 -- 172.21.15.82:0/2049044128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 msgr2=0x55dae5e53ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f0800c00640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07dc0a3cf0 0x7f07dc0a61b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f07e4031500 tx=0x7f07e4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e53ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07f400f410 tx=0x7f07f400f8d0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 -- 172.21.15.82:0/2049044128 shutdown_connections 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 --2- 172.21.15.82:0/2049044128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e53ff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.367+0000 7f080659a740 1 -- 172.21.15.82:0/2049044128 >> 172.21.15.82:0/2049044128 conn(0x55dae5e4f240 msgr2=0x55dae5e4f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.368+0000 7f080659a740 1 -- 172.21.15.82:0/2049044128 shutdown_connections 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.368+0000 7f080659a740 1 -- 172.21.15.82:0/2049044128 wait complete. 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.368+0000 7f080659a740 1 -- start start 2024-04-26T20:30:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.368+0000 7f080659a740 1 Processor -- start 2024-04-26T20:30:00.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:29:59 smithi135 ceph-mon[32816]: pgmap v628: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e53bd0 0x55dae5e5de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e545c0 0x55dae5e5e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dae5e5c6e0 con 0x55dae5e59730 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dae5d3fc60 con 0x55dae5e545c0 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dae5e5c860 con 0x55dae5e53bd0 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f080659a740 10 client.0 _ll_register_callbacks cb 0x55dae5d6be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0801600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0800c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e53bd0 0x55dae5e5de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e545c0 0x55dae5e5e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0801600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60390/0 (socket says 172.21.15.82:60390) 2024-04-26T20:30:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0801600640 1 -- 172.21.15.82:0/2138139888 learned_addr learned my addr 172.21.15.82:0/2138139888 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0800c00640 1 -- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e545c0 msgr2=0x55dae5e5e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0800c00640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e545c0 0x55dae5e5e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0800c00640 1 -- 172.21.15.82:0/2138139888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 msgr2=0x55dae5e653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0800c00640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0800c00640 1 -- 172.21.15.82:0/2138139888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dae5d4e510 con 0x55dae5e53bd0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f07f3e00640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e545c0 0x55dae5e5e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.369+0000 7f0801600640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f0800c00640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e53bd0 0x55dae5e5de20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07e402aa00 tx=0x7f07e4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d30ea7d785526d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f07ea000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f07ea000640 1 -- 172.21.15.82:0/2138139888 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4035040 con 0x55dae5e53bd0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f4011bb0 con 0x55dae5e53bd0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f07ea000640 1 -- 172.21.15.82:0/2138139888 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f07e40037f0 con 0x55dae5e53bd0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f07ea000640 1 -- 172.21.15.82:0/2138139888 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f07e4031e40 con 0x55dae5e53bd0 2024-04-26T20:30:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f080659a740 10 client.26992 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.370+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55dae5aca210 con 0x55dae5e53bd0 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f07ea000640 1 -- 172.21.15.82:0/2138139888 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f4011bb0 con 0x55dae5e53bd0 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f07ea000640 1 -- 172.21.15.82:0/2138139888 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f07e4044030 con 0x55dae5e53bd0 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f080659a740 10 client.26992 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f080659a740 10 client.26992 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f080659a740 20 client.26992 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f080659a740 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5e69910 0x55dae5e6bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f080659a740 4 client.26992 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dae5dc5f90 con 0x55dae5e69910 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.371+0000 7f07f3e00640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5e69910 0x55dae5e6bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.372+0000 7f07f3e00640 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5e69910 0x55dae5e6bd90 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5bd2f0eb7c7c37b server_cookie=17cb381ade7462dd in_seq=0 out_seq=0 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.372+0000 7f07ea000640 10 client.26992 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f07ea000640 1 -- 172.21.15.82:0/2138139888 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dae5dc5f90 con 0x55dae5e69910 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f07ea000640 10 client.26992 handle_command_reply: tid=0 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 client.26992 shutdown 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e53bd0 msgr2=0x55dae5e5de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e53bd0 0x55dae5e5de20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07e402aa00 tx=0x7f07e4009260 comp rx=0 tx=0).stop 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 shutdown_connections 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5e69910 0x55dae5e6bd90 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e545c0 0x55dae5e5e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 --2- 172.21.15.82:0/2138139888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e53bd0 0x55dae5e5de20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f07ea000640 0 client.26992 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 >> 172.21.15.82:0/2138139888 conn(0x55dae5e4f240 msgr2=0x55dae5e4e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 shutdown_connections 2024-04-26T20:30:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 1 -- 172.21.15.82:0/2138139888 wait complete. 2024-04-26T20:30:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.373+0000 7f080659a740 20 client.26992 trim_cache size 0 max 16384 2024-04-26T20:30:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 Processor -- start 2024-04-26T20:30:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 -- start start 2024-04-26T20:30:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e5da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e65360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1ad5f0 con 0x55dae5e59730 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.389+0000 7f080659a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1af2b0 con 0x55dae5e53bd0 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f080659a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1adcc0 con 0x55dae5e545c0 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0800c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e5da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f07f3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e65360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60404/0 (socket says 172.21.15.82:60404) 2024-04-26T20:30:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 -- 172.21.15.82:0/3658187491 learned_addr learned my addr 172.21.15.82:0/3658187491 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 -- 172.21.15.82:0/3658187491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 msgr2=0x55dae5e65360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e65360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 -- 172.21.15.82:0/3658187491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 msgr2=0x55dae5e5da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e5da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0801600640 1 -- 172.21.15.82:0/3658187491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dae5b96620 con 0x55dae5e59730 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.390+0000 7f0800c00640 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e5da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.391+0000 7f0801600640 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5df70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f4009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fe5d0bf1277369 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.391+0000 7f07f1200640 1 -- 172.21.15.82:0/3658187491 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4015040 con 0x55dae5e59730 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.391+0000 7f07f1200640 1 -- 172.21.15.82:0/3658187491 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f4004be0 con 0x55dae5e59730 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.391+0000 7f07f1200640 1 -- 172.21.15.82:0/3658187491 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4005280 con 0x55dae5e59730 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 -- 172.21.15.82:0/3658187491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 msgr2=0x55dae5e5df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5df70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f4009520 comp rx=0 tx=0).stop 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 -- 172.21.15.82:0/3658187491 shutdown_connections 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e59730 0x55dae5e5df70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e65360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 --2- 172.21.15.82:0/3658187491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e53bd0 0x55dae5e5da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 -- 172.21.15.82:0/3658187491 >> 172.21.15.82:0/3658187491 conn(0x55dae5e4f240 msgr2=0x55dae5e4f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 -- 172.21.15.82:0/3658187491 shutdown_connections 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 -- 172.21.15.82:0/3658187491 wait complete. 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 -- start start 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.392+0000 7f080659a740 1 Processor -- start 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 0x55dae5e624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e62a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e59730 0x55dae5e63a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1aebe0 con 0x55dae5e53bd0 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1ae450 con 0x55dae5e59730 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1ab5d0 con 0x55dae5e545c0 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f080659a740 10 client.0 _ll_register_callbacks cb 0x7f07e4005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:00.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 0x55dae5e624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 0x55dae5e624c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60406/0 (socket says 172.21.15.82:60406) 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 -- 172.21.15.82:0/1020562987 learned_addr learned my addr 172.21.15.82:0/1020562987 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f07f3e00640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e62a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0801600640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e59730 0x55dae5e63a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 -- 172.21.15.82:0/1020562987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 msgr2=0x55dae5e62a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e62a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 -- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e59730 msgr2=0x55dae5e63a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e59730 0x55dae5e63a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0800c00640 1 -- 172.21.15.82:0/1020562987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dae5d72cb0 con 0x55dae5e53bd0 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.393+0000 7f0801600640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e59730 0x55dae5e63a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f0800c00640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 0x55dae5e624c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07e4051ab0 tx=0x7f07e4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba830a487826def6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f07ea000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:30:00.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f07ea000640 1 -- 172.21.15.82:0/1020562987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4062060 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f07ea000640 1 -- 172.21.15.82:0/1020562987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f07e4047d30 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f4004be0 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f07ea000640 1 -- 172.21.15.82:0/1020562987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f07e4069050 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f080659a740 10 client.16851 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.394+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55dae5e651b0 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f07ea000640 1 -- 172.21.15.82:0/1020562987 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f4004be0 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f07ea000640 1 -- 172.21.15.82:0/1020562987 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f07e4044040 con 0x55dae5e53bd0 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f080659a740 10 client.16851 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f080659a740 10 client.16851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f080659a740 20 client.16851 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f080659a740 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5ed0280 0x55dae5ed26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f080659a740 4 client.16851 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:30:00.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dae5dbfe00 con 0x55dae5ed0280 2024-04-26T20:30:00.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.395+0000 7f07f3e00640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5ed0280 0x55dae5ed26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:00.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.396+0000 7f07f3e00640 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5ed0280 0x55dae5ed26a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f0deab71927421 server_cookie=7298180c744716e7 in_seq=0 out_seq=0 2024-04-26T20:30:00.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.396+0000 7f07ea000640 10 client.16851 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f07ea000640 1 -- 172.21.15.82:0/1020562987 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dae5dbfe00 con 0x55dae5ed0280 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f07ea000640 10 client.16851 handle_command_reply: tid=0 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 client.16851 shutdown 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 msgr2=0x55dae5e624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 0x55dae5e624c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07e4051ab0 tx=0x7f07e4004610 comp rx=0 tx=0).stop 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 shutdown_connections 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55dae5ed0280 0x55dae5ed26a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dae5e59730 0x55dae5e63a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dae5e545c0 0x55dae5e62a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 --2- 172.21.15.82:0/1020562987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dae5e53bd0 0x55dae5e624c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 >> 172.21.15.82:0/1020562987 conn(0x55dae5e4f240 msgr2=0x55dae5e5da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f07ea000640 0 client.16851 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 shutdown_connections 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 1 -- 172.21.15.82:0/1020562987 wait complete. 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.802+0000 7f080659a740 20 client.16851 trim_cache size 0 max 16384 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:30:00.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:30:00.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07dc0a3cf0 msgr2=0x7f07dc0a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07dc0a3cf0 0x7f07dc0a61b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f07e4031500 tx=0x7f07e4005a20 comp rx=0 tx=0).stop 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 msgr2=0x7f07fc19b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 0x7f07fc19b2e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00e9c0 tx=0x7f07ec00ee80 comp rx=0 tx=0).stop 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 shutdown_connections 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07dc0a3cf0 0x7f07dc0a61b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07fc101bd0 0x7f07fc1a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc100fe0 0x7f07fc19b2e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 --2- 172.21.15.82:0/769990818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07fc100620 0x7f07fc19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 >> 172.21.15.82:0/769990818 conn(0x7f07fc0fc150 msgr2=0x7f07fc0fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 shutdown_connections 2024-04-26T20:30:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:00.803+0000 7f0803600640 1 -- 172.21.15.82:0/769990818 wait complete. 2024-04-26T20:30:01.291 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-mon[28105]: Health detail: HEALTH_ERR 3 MDSs report damaged metadata 2024-04-26T20:30:01.291 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-mon[28105]: [ERR] MDS_DAMAGE: 3 MDSs report damaged metadata 2024-04-26T20:30:01.291 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-mon[28105]: mds.c(mds.3): Metadata damage detected 2024-04-26T20:30:01.291 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-mon[28105]: mds.i(mds.2): Metadata damage detected 2024-04-26T20:30:01.291 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-mon[28105]: mds.g(mds.1): Metadata damage detected 2024-04-26T20:30:01.291 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:00 smithi082 ceph-mon[28105]: pgmap v629: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T20:30:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:00 smithi139 ceph-mon[32999]: Health detail: HEALTH_ERR 3 MDSs report damaged metadata 2024-04-26T20:30:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:00 smithi139 ceph-mon[32999]: [ERR] MDS_DAMAGE: 3 MDSs report damaged metadata 2024-04-26T20:30:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:00 smithi139 ceph-mon[32999]: mds.c(mds.3): Metadata damage detected 2024-04-26T20:30:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:00 smithi139 ceph-mon[32999]: mds.i(mds.2): Metadata damage detected 2024-04-26T20:30:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:00 smithi139 ceph-mon[32999]: mds.g(mds.1): Metadata damage detected 2024-04-26T20:30:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:00 smithi139 ceph-mon[32999]: pgmap v629: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T20:30:01.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:00 smithi135 ceph-mon[32816]: Health detail: HEALTH_ERR 3 MDSs report damaged metadata 2024-04-26T20:30:01.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:00 smithi135 ceph-mon[32816]: [ERR] MDS_DAMAGE: 3 MDSs report damaged metadata 2024-04-26T20:30:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:00 smithi135 ceph-mon[32816]: mds.c(mds.3): Metadata damage detected 2024-04-26T20:30:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:00 smithi135 ceph-mon[32816]: mds.i(mds.2): Metadata damage detected 2024-04-26T20:30:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:00 smithi135 ceph-mon[32816]: mds.g(mds.1): Metadata damage detected 2024-04-26T20:30:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:00 smithi135 ceph-mon[32816]: pgmap v629: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T20:30:04.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:03 smithi082 ceph-mon[28105]: pgmap v630: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 345 KiB/s wr, 133 op/s 2024-04-26T20:30:04.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:03 smithi139 ceph-mon[32999]: pgmap v630: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 345 KiB/s wr, 133 op/s 2024-04-26T20:30:04.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:03 smithi135 ceph-mon[32816]: pgmap v630: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 345 KiB/s wr, 133 op/s 2024-04-26T20:30:05.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:04 smithi139 ceph-mon[32999]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 462 KiB/s wr, 207 op/s 2024-04-26T20:30:05.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:04 smithi135 ceph-mon[32816]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 462 KiB/s wr, 207 op/s 2024-04-26T20:30:05.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:04 smithi082 ceph-mon[28105]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 462 KiB/s wr, 207 op/s 2024-04-26T20:30:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:06 smithi139 ceph-mon[32999]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 483 KiB/s wr, 207 op/s 2024-04-26T20:30:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:06 smithi135 ceph-mon[32816]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 483 KiB/s wr, 207 op/s 2024-04-26T20:30:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:06 smithi082 ceph-mon[28105]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 483 KiB/s wr, 207 op/s 2024-04-26T20:30:09.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:08 smithi139 ceph-mon[32999]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 665 KiB/s wr, 216 op/s 2024-04-26T20:30:09.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:08 smithi135 ceph-mon[32816]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 665 KiB/s wr, 216 op/s 2024-04-26T20:30:09.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:08 smithi082 ceph-mon[28105]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 665 KiB/s wr, 216 op/s 2024-04-26T20:30:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:10 smithi139 ceph-mon[32999]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 1.3 MiB/s wr, 246 op/s 2024-04-26T20:30:11.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:10 smithi135 ceph-mon[32816]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 1.3 MiB/s wr, 246 op/s 2024-04-26T20:30:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:10 smithi082 ceph-mon[28105]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 1.3 MiB/s wr, 246 op/s 2024-04-26T20:30:13.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:12 smithi139 ceph-mon[32999]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-04-26T20:30:13.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:12 smithi135 ceph-mon[32816]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-04-26T20:30:13.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:12 smithi082 ceph-mon[28105]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 -- 172.21.15.82:0/1811409139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d0075390 msgr2=0x7f42d0075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 --2- 172.21.15.82:0/1811409139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d0075390 0x7f42d0075810 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009900 tx=0x7f42bc02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 -- 172.21.15.82:0/1811409139 shutdown_connections 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 --2- 172.21.15.82:0/1811409139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42d010a670 0x7f42d010cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 --2- 172.21.15.82:0/1811409139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d0075390 0x7f42d0075810 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 --2- 172.21.15.82:0/1811409139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d0074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 -- 172.21.15.82:0/1811409139 >> 172.21.15.82:0/1811409139 conn(0x7f42d00fdd40 msgr2=0x7f42d0100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 -- 172.21.15.82:0/1811409139 shutdown_connections 2024-04-26T20:30:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.944+0000 7f42cfe00640 1 -- 172.21.15.82:0/1811409139 wait complete. 2024-04-26T20:30:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.945+0000 7f42cfe00640 1 Processor -- start 2024-04-26T20:30:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.945+0000 7f42cfe00640 1 -- start start 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.945+0000 7f42cfe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42d0075390 0x7f42d019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d010a670 0x7f42d01a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cfe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42d0110510 con 0x7f42d010a670 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cfe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42d0110390 con 0x7f42d0076970 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cfe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42d0110690 con 0x7f42d0075390 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cf400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d010a670 0x7f42d01a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d019b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:47432/0 (socket says 172.21.15.82:47432) 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 -- 172.21.15.82:0/3269862158 learned_addr learned my addr 172.21.15.82:0/3269862158 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cea00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42d0075390 0x7f42d019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 -- 172.21.15.82:0/3269862158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42d0075390 msgr2=0x7f42d019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42d0075390 0x7f42d019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 -- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d010a670 msgr2=0x7f42d01a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d010a670 0x7f42d01a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42ce000640 1 -- 172.21.15.82:0/3269862158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d01a2830 con 0x7f42d0076970 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.946+0000 7f42cf400640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d010a670 0x7f42d01a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.947+0000 7f42ce000640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d019b160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005ab0 tx=0x7f42bc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.947+0000 7f42c7400640 1 -- 172.21.15.82:0/3269862158 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc03f070 con 0x7f42d0076970 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.947+0000 7f42c7400640 1 -- 172.21.15.82:0/3269862158 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42bc031c50 con 0x7f42d0076970 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.947+0000 7f42c7400640 1 -- 172.21.15.82:0/3269862158 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc035030 con 0x7f42d0076970 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.947+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d01a2ac0 con 0x7f42d0076970 2024-04-26T20:30:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.947+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d01a2fb0 con 0x7f42d0076970 2024-04-26T20:30:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.950+0000 7f42d8999740 1 Processor -- start 2024-04-26T20:30:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.950+0000 7f42d8999740 1 -- start start 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.950+0000 7f42c7400640 1 -- 172.21.15.82:0/3269862158 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f42bc042070 con 0x7f42d0076970 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42d8999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d33de0 0x564e04d34200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42d8999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 0x564e04d392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42d8999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d39940 0x564e04d3bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42d8999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564e04c98380 con 0x564e04d347d0 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42d8999740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e04c34c30 con 0x564e04d39940 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42d8999740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564e04c94340 con 0x564e04d33de0 2024-04-26T20:30:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 0x564e04d392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d33de0 0x564e04d34200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 0x564e04d392d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42458/0 (socket says 172.21.15.82:42458) 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 -- 172.21.15.82:0/3606642593 learned_addr learned my addr 172.21.15.82:0/3606642593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42ce000640 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d39940 0x564e04d3bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 -- 172.21.15.82:0/3606642593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d33de0 msgr2=0x564e04d34200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d33de0 0x564e04d34200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 -- 172.21.15.82:0/3606642593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d39940 msgr2=0x564e04d3bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d39940 0x564e04d3bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.951+0000 7f42cea00640 1 -- 172.21.15.82:0/3606642593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e04c56940 con 0x564e04d347d0 2024-04-26T20:30:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.952+0000 7f42cea00640 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 0x564e04d392d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009c90 tx=0x7f42c0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf3c7fb1dd0f455 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.952+0000 7f42bbe00640 1 -- 172.21.15.82:0/3606642593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0005220 con 0x564e04d347d0 2024-04-26T20:30:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.952+0000 7f42bbe00640 1 -- 172.21.15.82:0/3606642593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42c0004c50 con 0x564e04d347d0 2024-04-26T20:30:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.952+0000 7f42bbe00640 1 -- 172.21.15.82:0/3606642593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0019780 con 0x564e04d347d0 2024-04-26T20:30:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.952+0000 7f42c7400640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42b40a3c30 0x7f42b40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42c7400640 1 -- 172.21.15.82:0/3269862158 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f42bc0f1110 con 0x7f42d0076970 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42cf400640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42b40a3c30 0x7f42b40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 -- 172.21.15.82:0/3606642593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 msgr2=0x564e04d392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 0x564e04d392d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009c90 tx=0x7f42c0011810 comp rx=0 tx=0).stop 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 -- 172.21.15.82:0/3606642593 shutdown_connections 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d39940 0x564e04d3bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d347d0 0x564e04d392d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 --2- 172.21.15.82:0/3606642593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d33de0 0x564e04d34200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 -- 172.21.15.82:0/3606642593 >> 172.21.15.82:0/3606642593 conn(0x564e04d2f450 msgr2=0x564e04d2f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 -- 172.21.15.82:0/3606642593 shutdown_connections 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42d8999740 1 -- 172.21.15.82:0/3606642593 wait complete. 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.953+0000 7f42cf400640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42b40a3c30 0x7f42b40a60f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x564e04d35030 tx=0x7f42c8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 -- start start 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 Processor -- start 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d33de0 0x564e04d3e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 0x564e04d3e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d39940 0x564e04d45550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564e04d3c8f0 con 0x564e04d39940 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e04c1fc60 con 0x564e04d33de0 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564e04d3ca70 con 0x564e04d347d0 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.954+0000 7f42d8999740 10 client.0 _ll_register_callbacks cb 0x564e04c4be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 0x564e04d3e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42cea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d33de0 0x564e04d3e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 0x564e04d3e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:56394/0 (socket says 172.21.15.82:56394) 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 -- 172.21.15.82:0/1033481908 learned_addr learned my addr 172.21.15.82:0/1033481908 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42cf400640 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d39940 0x564e04d45550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 -- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d33de0 msgr2=0x564e04d3e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d33de0 0x564e04d3e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 -- 172.21.15.82:0/1033481908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d39940 msgr2=0x564e04d45550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d39940 0x564e04d45550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 -- 172.21.15.82:0/1033481908 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e04c2e510 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42ce000640 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 0x564e04d3e5f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f42bc031500 tx=0x7f42bc03b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81e2a61d86876dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.955+0000 7f42b8c00640 1 -- 172.21.15.82:0/1033481908 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc049070 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42b8c00640 1 -- 172.21.15.82:0/1033481908 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f42bc0ee950 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c0004c50 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42b8c00640 1 -- 172.21.15.82:0/1033481908 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f42bc0bcac0 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 10 client.27010 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x564e049aa210 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42b8c00640 1 -- 172.21.15.82:0/1033481908 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42c0004c50 con 0x564e04d347d0 2024-04-26T20:30:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42b8c00640 1 -- 172.21.15.82:0/1033481908 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f42bc0c56b0 con 0x564e04d347d0 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 10 client.27010 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 10 client.27010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 20 client.27010 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04d49bc0 0x564e04d4c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 4 client.27010 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.956+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e04ca5f90 con 0x564e04d49bc0 2024-04-26T20:30:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.957+0000 7f42cea00640 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04d49bc0 0x564e04d4c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.957+0000 7f42cea00640 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04d49bc0 0x564e04d4c040 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6528d637236dc0e8 server_cookie=fc65faec24e562e6 in_seq=0 out_seq=0 2024-04-26T20:30:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.957+0000 7f42b8c00640 10 client.27010 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.958+0000 7f42b8c00640 1 -- 172.21.15.82:0/1033481908 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564e04ca5f90 con 0x564e04d49bc0 2024-04-26T20:30:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.958+0000 7f42b8c00640 10 client.27010 handle_command_reply: tid=0 2024-04-26T20:30:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 client.27010 shutdown 2024-04-26T20:30:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 msgr2=0x564e04d3e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 0x564e04d3e5f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f42bc031500 tx=0x7f42bc03b790 comp rx=0 tx=0).stop 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 shutdown_connections 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04d49bc0 0x564e04d4c040 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d39940 0x564e04d45550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d347d0 0x564e04d3e5f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42b8c00640 0 client.27010 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 --2- 172.21.15.82:0/1033481908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d33de0 0x564e04d3e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 >> 172.21.15.82:0/1033481908 conn(0x564e04d2f450 msgr2=0x564e04d2e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 shutdown_connections 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 1 -- 172.21.15.82:0/1033481908 wait complete. 2024-04-26T20:30:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.959+0000 7f42d8999740 20 client.27010 trim_cache size 0 max 16384 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.975+0000 7f42d8999740 1 Processor -- start 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.975+0000 7f42d8999740 1 -- start start 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42d8999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d32400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42d8999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d45510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42d8999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04d32940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42d8999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01ad480 con 0x564e04d33de0 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42d8999740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01af140 con 0x564e04d347d0 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42d8999740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01adb50 con 0x564e04d39940 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42cea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d32400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42cea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d32400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42474/0 (socket says 172.21.15.82:42474) 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42cea00640 1 -- 172.21.15.82:0/668397773 learned_addr learned my addr 172.21.15.82:0/668397773 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42cf400640 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04d32940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.976+0000 7f42ce000640 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d45510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42cea00640 1 -- 172.21.15.82:0/668397773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 msgr2=0x564e04d32940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42cea00640 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04d32940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42cea00640 1 -- 172.21.15.82:0/668397773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 msgr2=0x564e04d45510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42cea00640 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d45510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42cea00640 1 -- 172.21.15.82:0/668397773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e04a76620 con 0x564e04d33de0 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42ce000640 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d45510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42cea00640 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d32400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f42c0005d10 tx=0x7f42c0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4528856eb9ff6afa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42bb400640 1 -- 172.21.15.82:0/668397773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0032070 con 0x564e04d33de0 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42bb400640 1 -- 172.21.15.82:0/668397773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42c002ddd0 con 0x564e04d33de0 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.977+0000 7f42bb400640 1 -- 172.21.15.82:0/668397773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0005570 con 0x564e04d33de0 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 -- 172.21.15.82:0/668397773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 msgr2=0x564e04d32400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d32400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f42c0005d10 tx=0x7f42c0009850 comp rx=0 tx=0).stop 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 -- 172.21.15.82:0/668397773 shutdown_connections 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04d32940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d45510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 --2- 172.21.15.82:0/668397773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d32400 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 -- 172.21.15.82:0/668397773 >> 172.21.15.82:0/668397773 conn(0x564e04d2f450 msgr2=0x564e04d35a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 -- 172.21.15.82:0/668397773 shutdown_connections 2024-04-26T20:30:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.978+0000 7f42d8999740 1 -- 172.21.15.82:0/668397773 wait complete. 2024-04-26T20:30:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 -- start start 2024-04-26T20:30:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 Processor -- start 2024-04-26T20:30:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d42730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d42c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04dae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01aea70 con 0x564e04d33de0 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01ae2e0 con 0x564e04d347d0 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42d01ab460 con 0x564e04d39940 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.979+0000 7f42d8999740 10 client.0 _ll_register_callbacks cb 0x7f42bc005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d42730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d42730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42480/0 (socket says 172.21.15.82:42480) 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 -- 172.21.15.82:0/2385633229 learned_addr learned my addr 172.21.15.82:0/2385633229 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42ce000640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d42c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cf400640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04dae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 -- 172.21.15.82:0/2385633229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 msgr2=0x564e04dae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04dae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 -- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 msgr2=0x564e04d42c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d42c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 -- 172.21.15.82:0/2385633229 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e04c52cb0 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cf400640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04dae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42cea00640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d42730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f42c0006010 tx=0x7f42c0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7119e298f0a512e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.980+0000 7f42b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42b8c00640 1 -- 172.21.15.82:0/2385633229 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c003a070 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c002ddd0 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42b8c00640 1 -- 172.21.15.82:0/2385633229 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f42c00052f0 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42b8c00640 1 -- 172.21.15.82:0/2385633229 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f42c0032040 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 10 client.16869 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x564e04daf8a0 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42b8c00640 1 -- 172.21.15.82:0/2385633229 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42c002ddd0 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42b8c00640 1 -- 172.21.15.82:0/2385633229 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f42c0035050 con 0x564e04d33de0 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 10 client.16869 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 20 client.16869 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04db00d0 0x564e04db24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 4 client.16869 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:30:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.981+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e04c9fe00 con 0x564e04db00d0 2024-04-26T20:30:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.982+0000 7f42ce000640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04db00d0 0x564e04db24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.982+0000 7f42ce000640 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04db00d0 0x564e04db24f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c06cbd5545c7e3 server_cookie=a8f6a3148cc15bee in_seq=0 out_seq=0 2024-04-26T20:30:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:13.982+0000 7f42b8c00640 10 client.16869 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42b8c00640 1 -- 172.21.15.82:0/2385633229 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e04c9fe00 con 0x564e04db00d0 2024-04-26T20:30:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42b8c00640 10 client.16869 handle_command_reply: tid=0 2024-04-26T20:30:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 client.16869 shutdown 2024-04-26T20:30:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 msgr2=0x564e04d42730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d42730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f42c0006010 tx=0x7f42c0009f90 comp rx=0 tx=0).stop 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 shutdown_connections 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x564e04db00d0 0x564e04db24f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564e04d39940 0x564e04dae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e04d347d0 0x564e04d42c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42b8c00640 0 client.16869 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 --2- 172.21.15.82:0/2385633229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564e04d33de0 0x564e04d42730 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 >> 172.21.15.82:0/2385633229 conn(0x564e04d2f450 msgr2=0x564e04d3e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 shutdown_connections 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.010+0000 7f42d8999740 1 -- 172.21.15.82:0/2385633229 wait complete. 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42d8999740 20 client.16869 trim_cache size 0 max 16384 2024-04-26T20:30:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:30:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:30:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:30:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42b40a3c30 msgr2=0x7f42b40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42b40a3c30 0x7f42b40a60f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x564e04d35030 tx=0x7f42c8009500 comp rx=0 tx=0).stop 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 msgr2=0x7f42d019b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d019b160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005ab0 tx=0x7f42bc003b90 comp rx=0 tx=0).stop 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 shutdown_connections 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f42b40a3c30 0x7f42b40a60f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d010a670 0x7f42d01a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d0076970 0x7f42d019b160 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 --2- 172.21.15.82:0/3269862158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42d0075390 0x7f42d019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.011+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 >> 172.21.15.82:0/3269862158 conn(0x7f42d00fdd40 msgr2=0x7f42d0106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.012+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 shutdown_connections 2024-04-26T20:30:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:14.012+0000 7f42cfe00640 1 -- 172.21.15.82:0/3269862158 wait complete. 2024-04-26T20:30:15.240 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:14 smithi082 ceph-mon[28105]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.1 MiB/s wr, 253 op/s 2024-04-26T20:30:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:14 smithi139 ceph-mon[32999]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.1 MiB/s wr, 253 op/s 2024-04-26T20:30:15.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:14 smithi135 ceph-mon[32816]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.1 MiB/s wr, 253 op/s 2024-04-26T20:30:17.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:16 smithi139 ceph-mon[32999]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 3.2 MiB/s wr, 186 op/s 2024-04-26T20:30:17.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:16 smithi135 ceph-mon[32816]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 3.2 MiB/s wr, 186 op/s 2024-04-26T20:30:17.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:16 smithi082 ceph-mon[28105]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 3.2 MiB/s wr, 186 op/s 2024-04-26T20:30:19.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:18 smithi139 ceph-mon[32999]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 3.2 MiB/s wr, 176 op/s 2024-04-26T20:30:19.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:18 smithi135 ceph-mon[32816]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 3.2 MiB/s wr, 176 op/s 2024-04-26T20:30:19.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:18 smithi082 ceph-mon[28105]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 3.2 MiB/s wr, 176 op/s 2024-04-26T20:30:21.172 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:20 smithi135 ceph-mon[32816]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 179 op/s 2024-04-26T20:30:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:20 smithi139 ceph-mon[32999]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 179 op/s 2024-04-26T20:30:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:20 smithi082 ceph-mon[28105]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 179 op/s 2024-04-26T20:30:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:22 smithi139 ceph-mon[32999]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2024-04-26T20:30:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:22 smithi135 ceph-mon[32816]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2024-04-26T20:30:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:22 smithi082 ceph-mon[28105]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2024-04-26T20:30:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:24 smithi139 ceph-mon[32999]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 114 op/s 2024-04-26T20:30:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:24 smithi135 ceph-mon[32816]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 114 op/s 2024-04-26T20:30:25.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:24 smithi082 ceph-mon[28105]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.8 MiB/s wr, 114 op/s 2024-04-26T20:30:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 -- 172.21.15.82:0/2889074275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c34109fd0 msgr2=0x7f9c3410a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 --2- 172.21.15.82:0/2889074275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c34109fd0 0x7f9c3410a450 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009900 tx=0x7f9c2002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 -- 172.21.15.82:0/2889074275 shutdown_connections 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 --2- 172.21.15.82:0/2889074275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c3410a990 0x7f9c34111220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 --2- 172.21.15.82:0/2889074275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c34109fd0 0x7f9c3410a450 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 --2- 172.21.15.82:0/2889074275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c34108de0 0x7f9c34109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 -- 172.21.15.82:0/2889074275 >> 172.21.15.82:0/2889074275 conn(0x7f9c34077dc0 msgr2=0x7f9c3407a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 -- 172.21.15.82:0/2889074275 shutdown_connections 2024-04-26T20:30:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.153+0000 7f9c39c00640 1 -- 172.21.15.82:0/2889074275 wait complete. 2024-04-26T20:30:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.154+0000 7f9c39c00640 1 Processor -- start 2024-04-26T20:30:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.154+0000 7f9c39c00640 1 -- start start 2024-04-26T20:30:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c34108de0 0x7f9c3419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c34109fd0 0x7f9c3419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 0x7f9c341a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341148f0 con 0x7f9c3410a990 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34114770 con 0x7f9c34109fd0 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34114a70 con 0x7f9c34108de0 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 0x7f9c341a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c33e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c34108de0 0x7f9c3419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 0x7f9c341a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36832/0 (socket says 172.21.15.82:36832) 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c39200640 1 -- 172.21.15.82:0/3675577923 learned_addr learned my addr 172.21.15.82:0/3675577923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.155+0000 7f9c33400640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c34109fd0 0x7f9c3419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39200640 1 -- 172.21.15.82:0/3675577923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c34108de0 msgr2=0x7f9c3419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39200640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c34108de0 0x7f9c3419eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39200640 1 -- 172.21.15.82:0/3675577923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c34109fd0 msgr2=0x7f9c3419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39200640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c34109fd0 0x7f9c3419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39200640 1 -- 172.21.15.82:0/3675577923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c341a6c10 con 0x7f9c3410a990 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39200640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 0x7f9c341a65a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009fd0 tx=0x7f9c2c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c30c00640 1 -- 172.21.15.82:0/3675577923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c017070 con 0x7f9c3410a990 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c30c00640 1 -- 172.21.15.82:0/3675577923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2c003e20 con 0x7f9c3410a990 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c30c00640 1 -- 172.21.15.82:0/3675577923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c010460 con 0x7f9c3410a990 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c341a6f00 con 0x7f9c3410a990 2024-04-26T20:30:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.156+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c341a73c0 con 0x7f9c3410a990 2024-04-26T20:30:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.159+0000 7f9c3e021740 1 Processor -- start 2024-04-26T20:30:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c30c00640 1 -- 172.21.15.82:0/3675577923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9c2c003970 con 0x7f9c3410a990 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 -- start start 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 0x559741951200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x5597419562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x559741958dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5597418b5380 con 0x559741956940 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559741851c30 con 0x559741950de0 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c3e021740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5597418b1340 con 0x5597419517d0 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.160+0000 7f9c33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 0x559741951200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 0x559741951200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39500/0 (socket says 172.21.15.82:39500) 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 -- 172.21.15.82:0/1386823129 learned_addr learned my addr 172.21.15.82:0/1386823129 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x559741958dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33e00640 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x5597419562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 -- 172.21.15.82:0/1386823129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 msgr2=0x5597419562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x5597419562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 -- 172.21.15.82:0/1386823129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 msgr2=0x559741958dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x559741958dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 -- 172.21.15.82:0/1386823129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559741873940 con 0x559741950de0 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c30c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9c180a3cb0 0x7f9c180a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c33400640 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 0x559741951200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9c2002a910 tx=0x7f9c20009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ac8ca137d7a72c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c30c00640 1 -- 172.21.15.82:0/3675577923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9c2c0d05d0 con 0x7f9c3410a990 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.161+0000 7f9c29600640 1 -- 172.21.15.82:0/1386823129 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20035040 con 0x559741950de0 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.162+0000 7f9c33e00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9c180a3cb0 0x7f9c180a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.162+0000 7f9c29600640 1 -- 172.21.15.82:0/1386823129 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c20031700 con 0x559741950de0 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.162+0000 7f9c29600640 1 -- 172.21.15.82:0/1386823129 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20003b20 con 0x559741950de0 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.162+0000 7f9c3e021740 1 -- 172.21.15.82:0/1386823129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 msgr2=0x559741951200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.162+0000 7f9c33e00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9c180a3cb0 0x7f9c180a6170 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559741951bd0 tx=0x7f9c2400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.162+0000 7f9c3e021740 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 0x559741951200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9c2002a910 tx=0x7f9c20009260 comp rx=0 tx=0).stop 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 -- 172.21.15.82:0/1386823129 shutdown_connections 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x559741958dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x5597419562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 --2- 172.21.15.82:0/1386823129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741950de0 0x559741951200 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 -- 172.21.15.82:0/1386823129 >> 172.21.15.82:0/1386823129 conn(0x55974194c450 msgr2=0x55974194c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 -- 172.21.15.82:0/1386823129 shutdown_connections 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 -- 172.21.15.82:0/1386823129 wait complete. 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 -- start start 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.163+0000 7f9c3e021740 1 Processor -- start 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x55974195b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 0x5597419625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559741959890 con 0x559741950de0 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55974183cc60 con 0x5597419517d0 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559741959a10 con 0x559741956940 2024-04-26T20:30:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c3e021740 10 client.0 _ll_register_callbacks cb 0x559741868e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 0x5597419625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 0x5597419625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41588/0 (socket says 172.21.15.82:41588) 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 -- 172.21.15.82:0/2986573422 learned_addr learned my addr 172.21.15.82:0/2986573422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c33400640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x55974195b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 -- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 msgr2=0x55974195b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x55974195b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 -- 172.21.15.82:0/2986573422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 msgr2=0x55974195b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.164+0000 7f9c39200640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c39200640 1 -- 172.21.15.82:0/2986573422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55974184b510 con 0x559741956940 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c39200640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 0x5597419625a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c098e10 tx=0x7f9c2c09be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=282ef3b9244acafe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c1e000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c1e000640 1 -- 172.21.15.82:0/2986573422 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c020070 con 0x559741956940 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c1e000640 1 -- 172.21.15.82:0/2986573422 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9c2c0040b0 con 0x559741956940 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c20031700 con 0x559741956940 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c1e000640 1 -- 172.21.15.82:0/2986573422 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f9c2c09c440 con 0x559741956940 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c3e021740 10 client.27028 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.165+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5597415c7210 con 0x559741956940 2024-04-26T20:30:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c1e000640 1 -- 172.21.15.82:0/2986573422 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c20031700 con 0x559741956940 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c1e000640 1 -- 172.21.15.82:0/2986573422 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f9c2c098ab0 con 0x559741956940 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c3e021740 10 client.27028 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c3e021740 10 client.27028 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c3e021740 20 client.27028 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559741966b10 0x559741968f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c3e021740 4 client.27028 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597418c2f90 con 0x559741966b10 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.166+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559741966b10 0x559741968f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.167+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559741966b10 0x559741968f90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=badd9ebc6c4d24db server_cookie=b4d3a4d9928bba0b in_seq=0 out_seq=0 2024-04-26T20:30:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.167+0000 7f9c1e000640 10 client.27028 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c1e000640 1 -- 172.21.15.82:0/2986573422 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5597418c2f90 con 0x559741966b10 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c1e000640 10 client.27028 handle_command_reply: tid=0 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 client.27028 shutdown 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 msgr2=0x5597419625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 0x5597419625a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c098e10 tx=0x7f9c2c09be20 comp rx=0 tx=0).stop 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 shutdown_connections 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559741966b10 0x559741968f90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741956940 0x5597419625a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x55974195b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2986573422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 >> 172.21.15.82:0/2986573422 conn(0x55974194c450 msgr2=0x55974194b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c1e000640 0 client.27028 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 shutdown_connections 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.168+0000 7f9c3e021740 1 -- 172.21.15.82:0/2986573422 wait complete. 2024-04-26T20:30:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.169+0000 7f9c3e021740 20 client.27028 trim_cache size 0 max 16384 2024-04-26T20:30:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.184+0000 7f9c3e021740 1 Processor -- start 2024-04-26T20:30:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.184+0000 7f9c3e021740 1 -- start start 2024-04-26T20:30:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741950de0 0x55974194c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x559741962560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x55974195b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c3e021740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341b1750 con 0x559741956940 2024-04-26T20:30:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c3e021740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341b3410 con 0x5597419517d0 2024-04-26T20:30:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c3e021740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341b1e20 con 0x559741950de0 2024-04-26T20:30:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c39200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x55974195b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x559741962560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x559741962560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39524/0 (socket says 172.21.15.82:39524) 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c39200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x55974195b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36840/0 (socket says 172.21.15.82:36840) 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 -- 172.21.15.82:0/2696812129 learned_addr learned my addr 172.21.15.82:0/2696812129 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741950de0 0x55974194c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 -- 172.21.15.82:0/2696812129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741950de0 msgr2=0x55974194c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741950de0 0x55974194c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 -- 172.21.15.82:0/2696812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 msgr2=0x55974195b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x55974195b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.185+0000 7f9c33400640 1 -- 172.21.15.82:0/2696812129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559741693620 con 0x5597419517d0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.186+0000 7f9c33400640 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x559741962560 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c2002a910 tx=0x7f9c200035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6fdc1d95fc7db0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.186+0000 7f9c28c00640 1 -- 172.21.15.82:0/2696812129 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2004e020 con 0x5597419517d0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.186+0000 7f9c28c00640 1 -- 172.21.15.82:0/2696812129 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c20031c10 con 0x5597419517d0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.186+0000 7f9c28c00640 1 -- 172.21.15.82:0/2696812129 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20035040 con 0x5597419517d0 2024-04-26T20:30:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 -- 172.21.15.82:0/2696812129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 msgr2=0x559741962560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x559741962560 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c2002a910 tx=0x7f9c200035f0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 -- 172.21.15.82:0/2696812129 shutdown_connections 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741956940 0x55974195b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597419517d0 0x559741962560 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2696812129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559741950de0 0x55974194c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 -- 172.21.15.82:0/2696812129 >> 172.21.15.82:0/2696812129 conn(0x55974194c450 msgr2=0x559741956020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 -- 172.21.15.82:0/2696812129 shutdown_connections 2024-04-26T20:30:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 -- 172.21.15.82:0/2696812129 wait complete. 2024-04-26T20:30:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.187+0000 7f9c3e021740 1 -- start start 2024-04-26T20:30:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 Processor -- start 2024-04-26T20:30:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x55974195f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741956940 0x5597419cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341b2d40 con 0x559741950de0 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341b25b0 con 0x559741956940 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c341af730 con 0x5597419517d0 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c3e021740 10 client.0 _ll_register_callbacks cb 0x7f9c2c004380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c33e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c33e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36842/0 (socket says 172.21.15.82:36842) 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c33e00640 1 -- 172.21.15.82:0/2311691606 learned_addr learned my addr 172.21.15.82:0/2311691606 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c33400640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x55974195f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.188+0000 7f9c39200640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741956940 0x5597419cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c33e00640 1 -- 172.21.15.82:0/2311691606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 msgr2=0x55974195f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x55974195f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c33e00640 1 -- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741956940 msgr2=0x5597419cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741956940 0x5597419cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c33e00640 1 -- 172.21.15.82:0/2311691606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55974186fcb0 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c39200640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741956940 0x5597419cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c33e00640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195f200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9c24003d50 tx=0x7f9c240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829241d315f85178 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c1e000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c1e000640 1 -- 172.21.15.82:0/2311691606 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2402e070 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c1e000640 1 -- 172.21.15.82:0/2311691606 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9c2402a530 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c20031c10 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c1e000640 1 -- 172.21.15.82:0/2311691606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f9c2403a050 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c3e021740 10 client.16887 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.189+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5597419cc570 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c1e000640 1 -- 172.21.15.82:0/2311691606 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c20031c10 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c1e000640 1 -- 172.21.15.82:0/2311691606 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f9c240115f0 con 0x559741950de0 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c3e021740 10 client.16887 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c3e021740 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c3e021740 20 client.16887 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5597419cd010 0x5597419cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c3e021740 4 client.16887 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597418bce00 con 0x5597419cd010 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.190+0000 7f9c33400640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5597419cd010 0x5597419cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.191+0000 7f9c33400640 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5597419cd010 0x5597419cf430 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=580b87475993679 server_cookie=ed2448261d6c125e in_seq=0 out_seq=0 2024-04-26T20:30:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.191+0000 7f9c1e000640 10 client.16887 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.211+0000 7f9c1e000640 1 -- 172.21.15.82:0/2311691606 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597418bce00 con 0x5597419cd010 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.211+0000 7f9c1e000640 10 client.16887 handle_command_reply: tid=0 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.211+0000 7f9c3e021740 1 client.16887 shutdown 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.211+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 msgr2=0x55974195f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.211+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195f200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9c24003d50 tx=0x7f9c240046c0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 shutdown_connections 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5597419cd010 0x5597419cf430 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559741956940 0x5597419cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597419517d0 0x55974195f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c1e000640 0 client.16887 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 --2- 172.21.15.82:0/2311691606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559741950de0 0x55974195f200 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 >> 172.21.15.82:0/2311691606 conn(0x55974194c450 msgr2=0x55974194c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 shutdown_connections 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 1 -- 172.21.15.82:0/2311691606 wait complete. 2024-04-26T20:30:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.212+0000 7f9c3e021740 20 client.16887 trim_cache size 0 max 16384 2024-04-26T20:30:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:30:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:30:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:30:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9c180a3cb0 msgr2=0x7f9c180a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9c180a3cb0 0x7f9c180a6170 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559741951bd0 tx=0x7f9c2400b390 comp rx=0 tx=0).stop 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 msgr2=0x7f9c341a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 0x7f9c341a65a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009fd0 tx=0x7f9c2c00b260 comp rx=0 tx=0).stop 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 shutdown_connections 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9c180a3cb0 0x7f9c180a6170 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c3410a990 0x7f9c341a65a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c34109fd0 0x7f9c3419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 --2- 172.21.15.82:0/3675577923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c34108de0 0x7f9c3419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 >> 172.21.15.82:0/3675577923 conn(0x7f9c34077dc0 msgr2=0x7f9c3410d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 shutdown_connections 2024-04-26T20:30:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:27.213+0000 7f9c39c00640 1 -- 172.21.15.82:0/3675577923 wait complete. 2024-04-26T20:30:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:26 smithi139 ceph-mon[32999]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-26T20:30:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:26 smithi135 ceph-mon[32816]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-26T20:30:27.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:26 smithi082 ceph-mon[28105]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-26T20:30:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:28 smithi139 ceph-mon[32999]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.1 MiB/s wr, 75 op/s 2024-04-26T20:30:29.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:28 smithi135 ceph-mon[32816]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.1 MiB/s wr, 75 op/s 2024-04-26T20:30:29.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:28 smithi082 ceph-mon[28105]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.1 MiB/s wr, 75 op/s 2024-04-26T20:30:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:30 smithi139 ceph-mon[32999]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 1.9 MiB/s wr, 69 op/s 2024-04-26T20:30:31.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:30 smithi135 ceph-mon[32816]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 1.9 MiB/s wr, 69 op/s 2024-04-26T20:30:31.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:30 smithi082 ceph-mon[28105]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 1.9 MiB/s wr, 69 op/s 2024-04-26T20:30:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:32 smithi139 ceph-mon[32999]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.5 MiB/s wr, 57 op/s 2024-04-26T20:30:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:32 smithi135 ceph-mon[32816]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.5 MiB/s wr, 57 op/s 2024-04-26T20:30:33.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:32 smithi082 ceph-mon[28105]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.5 MiB/s wr, 57 op/s 2024-04-26T20:30:34.547 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-04-26T20:30:34.547 INFO:tasks.workunit.client.0.smithi082.stdout:Final score for writes: 378 2024-04-26T20:30:34.547 INFO:tasks.workunit.client.0.smithi082.stdout:Final score for reads : 269349 2024-04-26T20:30:34.547 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-04-26T20:30:34.550 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T20:30:34.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T20:30:35.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:34 smithi139 ceph-mon[32999]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1.2 MiB/s wr, 48 op/s 2024-04-26T20:30:35.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:34 smithi135 ceph-mon[32816]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1.2 MiB/s wr, 48 op/s 2024-04-26T20:30:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:34 smithi082 ceph-mon[28105]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1.2 MiB/s wr, 48 op/s 2024-04-26T20:30:37.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:36 smithi139 ceph-mon[32999]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 399 KiB/s wr, 41 op/s 2024-04-26T20:30:37.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:36 smithi135 ceph-mon[32816]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 399 KiB/s wr, 41 op/s 2024-04-26T20:30:37.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:36 smithi082 ceph-mon[28105]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 399 KiB/s wr, 41 op/s 2024-04-26T20:30:39.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:38 smithi139 ceph-mon[32999]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 529 KiB/s wr, 52 op/s 2024-04-26T20:30:39.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:38 smithi135 ceph-mon[32816]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 529 KiB/s wr, 52 op/s 2024-04-26T20:30:39.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:38 smithi082 ceph-mon[28105]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 529 KiB/s wr, 52 op/s 2024-04-26T20:30:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 -- 172.21.15.82:0/4170004208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 msgr2=0x7face4105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 --2- 172.21.15.82:0/4170004208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face4105800 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7facd4009860 tx=0x7facd402a340 comp rx=0 tx=0).stop 2024-04-26T20:30:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 -- 172.21.15.82:0/4170004208 shutdown_connections 2024-04-26T20:30:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 --2- 172.21.15.82:0/4170004208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face4108670 0x7face410aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 --2- 172.21.15.82:0/4170004208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4105d40 0x7face4108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 --2- 172.21.15.82:0/4170004208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face4105800 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 -- 172.21.15.82:0/4170004208 >> 172.21.15.82:0/4170004208 conn(0x7face40fce20 msgr2=0x7face40ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 -- 172.21.15.82:0/4170004208 shutdown_connections 2024-04-26T20:30:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.363+0000 7face9800640 1 -- 172.21.15.82:0/4170004208 wait complete. 2024-04-26T20:30:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.364+0000 7face9800640 1 Processor -- start 2024-04-26T20:30:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.364+0000 7face9800640 1 -- start start 2024-04-26T20:30:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face4105d40 0x7face419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face9800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4108670 0x7face41a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face9800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7face410e4c0 con 0x7face4103410 2024-04-26T20:30:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face9800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7face410e340 con 0x7face4105d40 2024-04-26T20:30:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face9800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7face410e640 con 0x7face4108670 2024-04-26T20:30:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4108670 0x7face41a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face419ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58186/0 (socket says 172.21.15.82:58186) 2024-04-26T20:30:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4108670 0x7face41a2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44984/0 (socket says 172.21.15.82:44984) 2024-04-26T20:30:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 -- 172.21.15.82:0/2304723455 learned_addr learned my addr 172.21.15.82:0/2304723455 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2000640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face4105d40 0x7face419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 -- 172.21.15.82:0/2304723455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4108670 msgr2=0x7face41a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4108670 0x7face41a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 -- 172.21.15.82:0/2304723455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face4105d40 msgr2=0x7face419b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face4105d40 0x7face419b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.365+0000 7face2a00640 1 -- 172.21.15.82:0/2304723455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face41a2970 con 0x7face4103410 2024-04-26T20:30:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.366+0000 7face2a00640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face419ad50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7facd4005940 tx=0x7facd402ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.366+0000 7facdb400640 1 -- 172.21.15.82:0/2304723455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4040020 con 0x7face4103410 2024-04-26T20:30:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.366+0000 7facdb400640 1 -- 172.21.15.82:0/2304723455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd4030e50 con 0x7face4103410 2024-04-26T20:30:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.366+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face41a2c00 con 0x7face4103410 2024-04-26T20:30:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.366+0000 7facdb400640 1 -- 172.21.15.82:0/2304723455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4037040 con 0x7face4103410 2024-04-26T20:30:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.366+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41a30f0 con 0x7face4103410 2024-04-26T20:30:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.369+0000 7facdb400640 1 -- 172.21.15.82:0/2304723455 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7facd4043020 con 0x7face4103410 2024-04-26T20:30:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.370+0000 7facec7b0740 1 Processor -- start 2024-04-26T20:30:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 -- start start 2024-04-26T20:30:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facdb400640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facc80a3cf0 0x7facc80a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87aa5c0 0x5645b87af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5645b870e380 con 0x5645b87aa5c0 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5645b86aac30 con 0x5645b87a9bd0 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facec7b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5645b870a340 con 0x5645b87af730 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7facdb400640 1 -- 172.21.15.82:0/2304723455 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7facd40f0520 con 0x7face4103410 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face3400640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facc80a3cf0 0x7facc80a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87aa5c0 0x5645b87af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44988/0 (socket says 172.21.15.82:44988) 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face3400640 1 -- 172.21.15.82:0/3499727205 learned_addr learned my addr 172.21.15.82:0/3499727205 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87aa5c0 0x5645b87af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58194/0 (socket says 172.21.15.82:58194) 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.371+0000 7face2a00640 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 -- 172.21.15.82:0/3499727205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 msgr2=0x5645b87a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 -- 172.21.15.82:0/3499727205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87aa5c0 msgr2=0x5645b87af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87aa5c0 0x5645b87af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 -- 172.21.15.82:0/3499727205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b86cc940 con 0x5645b87af730 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87b1bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7facdc010e50 tx=0x7facdc00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3509e85be6c4f84c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7face3400640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facc80a3cf0 0x7facc80a61b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7facdc00fbd0 tx=0x7facdc018000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7faccfe00640 1 -- 172.21.15.82:0/3499727205 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc019040 con 0x5645b87af730 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7faccfe00640 1 -- 172.21.15.82:0/3499727205 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facdc009e00 con 0x5645b87af730 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.372+0000 7faccfe00640 1 -- 172.21.15.82:0/3499727205 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc0055c0 con 0x5645b87af730 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 -- 172.21.15.82:0/3499727205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 msgr2=0x5645b87b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87b1bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7facdc010e50 tx=0x7facdc00f790 comp rx=0 tx=0).stop 2024-04-26T20:30:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 -- 172.21.15.82:0/3499727205 shutdown_connections 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87b1bc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87aa5c0 0x5645b87af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 --2- 172.21.15.82:0/3499727205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 -- 172.21.15.82:0/3499727205 >> 172.21.15.82:0/3499727205 conn(0x5645b87a5240 msgr2=0x5645b87a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 -- 172.21.15.82:0/3499727205 shutdown_connections 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.373+0000 7facec7b0740 1 -- 172.21.15.82:0/3499727205 wait complete. 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 -- start start 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 Processor -- start 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 0x5645b87b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87aa5c0 0x5645b87b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87bb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5645b87b2680 con 0x5645b87a9bd0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5645b8695c60 con 0x5645b87aa5c0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.374+0000 7facec7b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5645b87b2800 con 0x5645b87af730 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7facec7b0740 10 client.0 _ll_register_callbacks cb 0x5645b86c1e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 0x5645b87b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87bb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 0x5645b87b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58202/0 (socket says 172.21.15.82:58202) 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 -- 172.21.15.82:0/2136033850 learned_addr learned my addr 172.21.15.82:0/2136033850 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2000640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87aa5c0 0x5645b87b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 -- 172.21.15.82:0/2136033850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 msgr2=0x5645b87bb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87bb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 -- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87aa5c0 msgr2=0x5645b87b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87aa5c0 0x5645b87b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 -- 172.21.15.82:0/2136033850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b86a4510 con 0x5645b87a9bd0 2024-04-26T20:30:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face3400640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87bb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2000640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87aa5c0 0x5645b87b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7face2a00640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 0x5645b87b3e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7facd40b8850 tx=0x7facd40bbff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafd8156867a179f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.375+0000 7facccc00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facccc00640 1 -- 172.21.15.82:0/2136033850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd40bc3f0 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facccc00640 1 -- 172.21.15.82:0/2136033850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7facd40040d0 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facdc009e00 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facccc00640 1 -- 172.21.15.82:0/2136033850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7facd40c07a0 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facec7b0740 10 client.16899 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5645b8420210 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.376+0000 7facccc00640 1 -- 172.21.15.82:0/2136033850 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facdc009e00 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facccc00640 1 -- 172.21.15.82:0/2136033850 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7facd404d060 con 0x5645b87a9bd0 2024-04-26T20:30:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facec7b0740 10 client.16899 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facec7b0740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facec7b0740 20 client.16899 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facec7b0740 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b87bf950 0x5645b87c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facec7b0740 4 client.16899 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645b871bf90 con 0x5645b87bf950 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7face2000640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b87bf950 0x5645b87c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7face2000640 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b87bf950 0x5645b87c1df0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc15615d4f03cba5 server_cookie=be866715d99cdefb in_seq=0 out_seq=0 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.377+0000 7facccc00640 10 client.16899 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facccc00640 1 -- 172.21.15.82:0/2136033850 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5645b871bf90 con 0x5645b87bf950 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facccc00640 10 client.16899 handle_command_reply: tid=0 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 client.16899 shutdown 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 msgr2=0x5645b87b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 0x5645b87b3e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7facd40b8850 tx=0x7facd40bbff0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 shutdown_connections 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b87bf950 0x5645b87c1df0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87af730 0x5645b87bb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87aa5c0 0x5645b87b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facccc00640 0 client.16899 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 --2- 172.21.15.82:0/2136033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87a9bd0 0x5645b87b3e20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.378+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 >> 172.21.15.82:0/2136033850 conn(0x5645b87a5240 msgr2=0x5645b87a4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.379+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 shutdown_connections 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.379+0000 7facec7b0740 1 -- 172.21.15.82:0/2136033850 wait complete. 2024-04-26T20:30:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.379+0000 7facec7b0740 20 client.16899 trim_cache size 0 max 16384 2024-04-26T20:30:40.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 Processor -- start 2024-04-26T20:30:40.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 -- start start 2024-04-26T20:30:40.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7face41ad4e0 con 0x5645b87af730 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7face41af1a0 con 0x5645b87a9bd0 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7facec7b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7face41adbb0 con 0x5645b87aa5c0 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.396+0000 7face2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45020/0 (socket says 172.21.15.82:45020) 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 -- 172.21.15.82:0/4064529535 learned_addr learned my addr 172.21.15.82:0/4064529535 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face3400640 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 -- 172.21.15.82:0/4064529535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 msgr2=0x5645b87b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 -- 172.21.15.82:0/4064529535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 msgr2=0x5645b87c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 -- 172.21.15.82:0/4064529535 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b84ec620 con 0x5645b87aa5c0 2024-04-26T20:30:40.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2a00640 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:40.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7face2000640 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87bb2c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7facd0010600 tx=0x7facd00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a897698c36d5292 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:40.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.397+0000 7faccf400640 1 -- 172.21.15.82:0/4064529535 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd001e630 con 0x5645b87aa5c0 2024-04-26T20:30:40.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7faccf400640 1 -- 172.21.15.82:0/4064529535 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd0024070 con 0x5645b87aa5c0 2024-04-26T20:30:40.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7faccf400640 1 -- 172.21.15.82:0/4064529535 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd001c6a0 con 0x5645b87aa5c0 2024-04-26T20:30:40.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 -- 172.21.15.82:0/4064529535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 msgr2=0x5645b87bb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87bb2c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7facd0010600 tx=0x7facd00046c0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 -- 172.21.15.82:0/4064529535 shutdown_connections 2024-04-26T20:30:40.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87bb2c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 --2- 172.21.15.82:0/4064529535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 -- 172.21.15.82:0/4064529535 >> 172.21.15.82:0/4064529535 conn(0x5645b87a5240 msgr2=0x5645b87b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:40.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.398+0000 7facec7b0740 1 -- 172.21.15.82:0/4064529535 shutdown_connections 2024-04-26T20:30:40.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.399+0000 7facec7b0740 1 -- 172.21.15.82:0/4064529535 wait complete. 2024-04-26T20:30:40.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.399+0000 7facec7b0740 1 -- start start 2024-04-26T20:30:40.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.399+0000 7facec7b0740 1 Processor -- start 2024-04-26T20:30:40.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.399+0000 7facec7b0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7facec7b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7facec7b0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7facec7b0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7face41aead0 con 0x5645b87af730 2024-04-26T20:30:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7facec7b0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7face41ae340 con 0x5645b87a9bd0 2024-04-26T20:30:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7facec7b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7face41ab4c0 con 0x5645b87aa5c0 2024-04-26T20:30:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7facec7b0740 10 client.0 _ll_register_callbacks cb 0x7facd40097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58218/0 (socket says 172.21.15.82:58218) 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87b89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:45022/0 (socket says 172.21.15.82:45022) 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face3400640 1 -- 172.21.15.82:0/1236234032 learned_addr learned my addr 172.21.15.82:0/1236234032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 -- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 msgr2=0x5645b87b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 -- 172.21.15.82:0/1236234032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 msgr2=0x5645b87b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.400+0000 7face2000640 1 -- 172.21.15.82:0/1236234032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b86c8cb0 con 0x5645b87aa5c0 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7face2000640 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87b89b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7facd00092a0 tx=0x7facd0003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=650e30f8792b013c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facccc00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facccc00640 1 -- 172.21.15.82:0/1236234032 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd001e840 con 0x5645b87aa5c0 2024-04-26T20:30:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facd0024070 con 0x5645b87aa5c0 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facccc00640 1 -- 172.21.15.82:0/1236234032 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7facd00035f0 con 0x5645b87aa5c0 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facccc00640 1 -- 172.21.15.82:0/1236234032 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7facd0039050 con 0x5645b87aa5c0 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facec7b0740 10 client.27052 fetch_fsmap learned FSMap version 47 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5645b87bb0f0 con 0x5645b87aa5c0 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facccc00640 1 -- 172.21.15.82:0/1236234032 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd0024070 con 0x5645b87aa5c0 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facccc00640 1 -- 172.21.15.82:0/1236234032 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7facd0004850 con 0x5645b87aa5c0 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facec7b0740 10 client.27052 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T20:30:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facec7b0740 10 client.27052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.401+0000 7facec7b0740 20 client.27052 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.402+0000 7facec7b0740 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b88261d0 0x5645b88285f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.402+0000 7facec7b0740 4 client.27052 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.402+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5645b8715e00 con 0x5645b88261d0 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.402+0000 7face2a00640 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b88261d0 0x5645b88285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.402+0000 7face2a00640 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b88261d0 0x5645b88285f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abd67ca06df7d4 server_cookie=dd6f588cfc833362 in_seq=0 out_seq=0 2024-04-26T20:30:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.402+0000 7facccc00640 10 client.27052 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facccc00640 1 -- 172.21.15.82:0/1236234032 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5645b8715e00 con 0x5645b88261d0 2024-04-26T20:30:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facccc00640 10 client.27052 handle_command_reply: tid=0 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 client.27052 shutdown 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 msgr2=0x5645b87b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87b89b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7facd00092a0 tx=0x7facd0003f00 comp rx=0 tx=0).stop 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 shutdown_connections 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5645b88261d0 0x5645b88285f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b87af730 0x5645b87b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5645b87aa5c0 0x5645b87b89b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facccc00640 0 client.27052 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 --2- 172.21.15.82:0/1236234032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645b87a9bd0 0x5645b87b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.421+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 >> 172.21.15.82:0/1236234032 conn(0x5645b87a5240 msgr2=0x5645b87a4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 shutdown_connections 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7facec7b0740 1 -- 172.21.15.82:0/1236234032 wait complete. 2024-04-26T20:30:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7facec7b0740 20 client.27052 trim_cache size 0 max 16384 2024-04-26T20:30:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:30:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:30:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:30:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facc80a3cf0 msgr2=0x7facc80a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facc80a3cf0 0x7facc80a61b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7facdc00fbd0 tx=0x7facdc018000 comp rx=0 tx=0).stop 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 msgr2=0x7face419ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face419ad50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7facd4005940 tx=0x7facd402ae20 comp rx=0 tx=0).stop 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 shutdown_connections 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7facc80a3cf0 0x7facc80a61b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7face4108670 0x7face41a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face4105d40 0x7face419b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 --2- 172.21.15.82:0/2304723455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face4103410 0x7face419ad50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.422+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 >> 172.21.15.82:0/2304723455 conn(0x7face40fce20 msgr2=0x7face4102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.423+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 shutdown_connections 2024-04-26T20:30:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:40.423+0000 7face9800640 1 -- 172.21.15.82:0/2304723455 wait complete. 2024-04-26T20:30:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:40 smithi139 ceph-mon[32999]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 801 KiB/s wr, 98 op/s 2024-04-26T20:30:41.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:40 smithi135 ceph-mon[32816]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 801 KiB/s wr, 98 op/s 2024-04-26T20:30:41.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:40 smithi082 ceph-mon[28105]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 801 KiB/s wr, 98 op/s 2024-04-26T20:30:43.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:42 smithi139 ceph-mon[32999]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 795 KiB/s wr, 147 op/s 2024-04-26T20:30:43.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:42 smithi135 ceph-mon[32816]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 795 KiB/s wr, 147 op/s 2024-04-26T20:30:43.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:42 smithi082 ceph-mon[28105]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 795 KiB/s wr, 147 op/s 2024-04-26T20:30:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:45 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:45.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:45 smithi139 ceph-mon[32999]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 206 op/s 2024-04-26T20:30:45.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:45 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:45.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:45 smithi135 ceph-mon[32816]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 206 op/s 2024-04-26T20:30:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:45 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:45 smithi082 ceph-mon[28105]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 206 op/s 2024-04-26T20:30:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:46 smithi139 ceph-mon[32999]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 259 op/s 2024-04-26T20:30:47.332 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:46 smithi082 ceph-mon[28105]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 259 op/s 2024-04-26T20:30:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:46 smithi135 ceph-mon[32816]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 259 op/s 2024-04-26T20:30:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:47 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:48.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:47 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:48.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:47 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:30:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:49 smithi139 ceph-mon[32999]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 308 op/s 2024-04-26T20:30:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:30:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:49 smithi135 ceph-mon[32816]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 308 op/s 2024-04-26T20:30:49.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:49.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:49.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:30:49.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:49 smithi082 ceph-mon[28105]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 308 op/s 2024-04-26T20:30:51.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:51 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:51.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:51 smithi139 ceph-mon[32999]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-04-26T20:30:51.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:51 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:51.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:51 smithi135 ceph-mon[32816]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-04-26T20:30:51.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:51 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:51.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:51 smithi082 ceph-mon[28105]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-04-26T20:30:53.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:52 smithi139 ceph-mon[32999]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 370 op/s 2024-04-26T20:30:53.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:52 smithi135 ceph-mon[32816]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 370 op/s 2024-04-26T20:30:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:52 smithi082 ceph-mon[28105]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 370 op/s 2024-04-26T20:30:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 -- 172.21.15.82:0/2664630188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 msgr2=0x7f9468109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 --2- 172.21.15.82:0/2664630188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f9468109200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9458009900 tx=0x7f945802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 -- 172.21.15.82:0/2664630188 shutdown_connections 2024-04-26T20:30:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 --2- 172.21.15.82:0/2664630188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f946810a990 0x7f9468111220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 --2- 172.21.15.82:0/2664630188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 0x7f946810a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 --2- 172.21.15.82:0/2664630188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f9468109200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 -- 172.21.15.82:0/2664630188 >> 172.21.15.82:0/2664630188 conn(0x7f9468077dc0 msgr2=0x7f946807a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 -- 172.21.15.82:0/2664630188 shutdown_connections 2024-04-26T20:30:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.563+0000 7f9467200640 1 -- 172.21.15.82:0/2664630188 wait complete. 2024-04-26T20:30:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.564+0000 7f9467200640 1 Processor -- start 2024-04-26T20:30:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.564+0000 7f9467200640 1 -- start start 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9467200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f946819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9467200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 0x7f946819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9467200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f946810a990 0x7f94681a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9467200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9468114960 con 0x7f9468109fd0 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9467200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94681147e0 con 0x7f9468108de0 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9467200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9468114ae0 con 0x7f946810a990 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f946819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f946819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39364/0 (socket says 172.21.15.82:39364) 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 -- 172.21.15.82:0/955876561 learned_addr learned my addr 172.21.15.82:0/955876561 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9466800640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f946810a990 0x7f94681a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f945d400640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 0x7f946819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 -- 172.21.15.82:0/955876561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f946810a990 msgr2=0x7f94681a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f946810a990 0x7f94681a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 -- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 msgr2=0x7f946819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 0x7f946819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.565+0000 7f9465e00640 1 -- 172.21.15.82:0/955876561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94681a6b60 con 0x7f9468108de0 2024-04-26T20:30:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.566+0000 7f945d400640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 0x7f946819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:30:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.566+0000 7f9465e00640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f946819ef40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9458031500 tx=0x7f9458003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.566+0000 7f945f400640 1 -- 172.21.15.82:0/955876561 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945803f070 con 0x7f9468108de0 2024-04-26T20:30:53.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.566+0000 7f945f400640 1 -- 172.21.15.82:0/955876561 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9458003e70 con 0x7f9468108de0 2024-04-26T20:30:53.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.566+0000 7f945f400640 1 -- 172.21.15.82:0/955876561 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458035030 con 0x7f9468108de0 2024-04-26T20:30:53.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.566+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94681a6df0 con 0x7f9468108de0 2024-04-26T20:30:53.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.567+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681a7200 con 0x7f9468108de0 2024-04-26T20:30:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.570+0000 7f946fddc740 1 Processor -- start 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.570+0000 7f946fddc740 1 -- start start 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f946fddc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 0x559e67077200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f946fddc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e670777d0 0x559e6707c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f946fddc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e6707edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f946fddc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559e66fdb380 con 0x559e67076de0 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f946fddc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e66f77c30 con 0x559e670777d0 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f946fddc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e66fd7340 con 0x559e6707c940 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f9466800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 0x559e67077200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f9466800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 0x559e67077200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47780/0 (socket says 172.21.15.82:47780) 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f9466800640 1 -- 172.21.15.82:0/2963628594 learned_addr learned my addr 172.21.15.82:0/2963628594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.571+0000 7f945d400640 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e6707edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f9466800640 1 -- 172.21.15.82:0/2963628594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 msgr2=0x559e6707edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f9466800640 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e6707edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f9466800640 1 -- 172.21.15.82:0/2963628594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e670777d0 msgr2=0x559e6707c2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f9466800640 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e670777d0 0x559e6707c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f9466800640 1 -- 172.21.15.82:0/2963628594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e66f99940 con 0x559e67076de0 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f9466800640 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 0x559e67077200 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9460010370 tx=0x7f9460010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82948e3243b701f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.572+0000 7f945f400640 1 -- 172.21.15.82:0/955876561 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9458042070 con 0x7f9468108de0 2024-04-26T20:30:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.575+0000 7f945f400640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f944c0a3cb0 0x7f944c0a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.575+0000 7f945f400640 1 -- 172.21.15.82:0/955876561 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f94580f0ec0 con 0x7f9468108de0 2024-04-26T20:30:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.575+0000 7f9465e00640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f944c0a3cb0 0x7f944c0a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.576+0000 7f9457400640 1 -- 172.21.15.82:0/2963628594 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460016070 con 0x559e67076de0 2024-04-26T20:30:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.576+0000 7f9457400640 1 -- 172.21.15.82:0/2963628594 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9460004d20 con 0x559e67076de0 2024-04-26T20:30:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.576+0000 7f9457400640 1 -- 172.21.15.82:0/2963628594 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460005440 con 0x559e67076de0 2024-04-26T20:30:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 -- 172.21.15.82:0/2963628594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 msgr2=0x559e67077200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f9465e00640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f944c0a3cb0 0x7f944c0a6170 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x559e67077bd0 tx=0x7f9458005b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 0x559e67077200 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9460010370 tx=0x7f9460010830 comp rx=0 tx=0).stop 2024-04-26T20:30:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 -- 172.21.15.82:0/2963628594 shutdown_connections 2024-04-26T20:30:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e6707edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e670777d0 0x559e6707c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 --2- 172.21.15.82:0/2963628594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e67076de0 0x559e67077200 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 -- 172.21.15.82:0/2963628594 >> 172.21.15.82:0/2963628594 conn(0x559e67072450 msgr2=0x559e67072850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 -- 172.21.15.82:0/2963628594 shutdown_connections 2024-04-26T20:30:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.577+0000 7f946fddc740 1 -- 172.21.15.82:0/2963628594 wait complete. 2024-04-26T20:30:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.578+0000 7f946fddc740 1 -- start start 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.578+0000 7f946fddc740 1 Processor -- start 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e670810e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e670777d0 0x559e67081620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e670885f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559e6707f8f0 con 0x559e670777d0 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e66f62c60 con 0x559e67076de0 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e6707fa70 con 0x559e6707c940 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f946fddc740 10 client.0 _ll_register_callbacks cb 0x559e66f8ee50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f9466800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e670810e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f9466800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e670810e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39370/0 (socket says 172.21.15.82:39370) 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f9466800640 1 -- 172.21.15.82:0/792351365 learned_addr learned my addr 172.21.15.82:0/792351365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f945d400640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e670777d0 0x559e67081620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.579+0000 7f9466800640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e670885f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f945d400640 1 -- 172.21.15.82:0/792351365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 msgr2=0x559e670885f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f945d400640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e670885f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f945d400640 1 -- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 msgr2=0x559e670810e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f945d400640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e670810e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f945d400640 1 -- 172.21.15.82:0/792351365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e66f71510 con 0x559e670777d0 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f9466800640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e670810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f945d400640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e670777d0 0x559e67081620 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9450005fd0 tx=0x7f9450011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246bb48ea487c559 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.580+0000 7f944be00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:30:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f944be00640 1 -- 172.21.15.82:0/792351365 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945000f910 con 0x559e670777d0 2024-04-26T20:30:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f944be00640 1 -- 172.21.15.82:0/792351365 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f945000fab0 con 0x559e670777d0 2024-04-26T20:30:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9460004d20 con 0x559e670777d0 2024-04-26T20:30:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f944be00640 1 -- 172.21.15.82:0/792351365 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f9450023050 con 0x559e670777d0 2024-04-26T20:30:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f946fddc740 10 client.16914 fetch_fsmap learned FSMap version 49 2024-04-26T20:30:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559e66ced210 con 0x559e670777d0 2024-04-26T20:30:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.581+0000 7f944be00640 1 -- 172.21.15.82:0/792351365 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9460004d20 con 0x559e670777d0 2024-04-26T20:30:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f944be00640 1 -- 172.21.15.82:0/792351365 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f9450018020 con 0x559e670777d0 2024-04-26T20:30:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f946fddc740 10 client.16914 fetch_fsmap finished waiting for FSMap version 49 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f946fddc740 10 client.16914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f946fddc740 20 client.16914 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f946fddc740 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e6708ccb0 0x559e6708f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f946fddc740 4 client.16914 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e66fe8f90 con 0x559e6708ccb0 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.582+0000 7f9466800640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e6708ccb0 0x559e6708f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.583+0000 7f9466800640 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e6708ccb0 0x559e6708f0d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24d11f67a785b37b server_cookie=bcc68142a5897532 in_seq=0 out_seq=0 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.583+0000 7f944be00640 10 client.16914 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.584+0000 7f944be00640 1 -- 172.21.15.82:0/792351365 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e66fe8f90 con 0x559e6708ccb0 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.584+0000 7f944be00640 10 client.16914 handle_command_reply: tid=0 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.584+0000 7f946fddc740 1 client.16914 shutdown 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e670777d0 msgr2=0x559e67081620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e670777d0 0x559e67081620 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9450005fd0 tx=0x7f9450011c20 comp rx=0 tx=0).stop 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 shutdown_connections 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e6708ccb0 0x559e6708f0d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6707c940 0x559e670885f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e670777d0 0x559e67081620 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 --2- 172.21.15.82:0/792351365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e670810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 >> 172.21.15.82:0/792351365 conn(0x559e67072450 msgr2=0x559e67071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f944be00640 0 client.16914 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 shutdown_connections 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 1 -- 172.21.15.82:0/792351365 wait complete. 2024-04-26T20:30:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.585+0000 7f946fddc740 20 client.16914 trim_cache size 0 max 16384 2024-04-26T20:30:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.603+0000 7f946fddc740 1 Processor -- start 2024-04-26T20:30:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.603+0000 7f946fddc740 1 -- start start 2024-04-26T20:30:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f946fddc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e6706d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f946fddc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e670885b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f946fddc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e670810e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f946fddc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94681b1740 con 0x559e6707c940 2024-04-26T20:30:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f946fddc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94681b34c0 con 0x559e67076de0 2024-04-26T20:30:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f946fddc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94681b1ed0 con 0x559e6706d810 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f9466800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e6706d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f9466800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e6706d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39384/0 (socket says 172.21.15.82:39384) 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f9466800640 1 -- 172.21.15.82:0/1855479271 learned_addr learned my addr 172.21.15.82:0/1855479271 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f9466800640 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e670810e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.604+0000 7f945d400640 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e670885b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9466800640 1 -- 172.21.15.82:0/1855479271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 msgr2=0x559e670810e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9466800640 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e670810e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9466800640 1 -- 172.21.15.82:0/1855479271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 msgr2=0x559e670885b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9466800640 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e670885b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9466800640 1 -- 172.21.15.82:0/1855479271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e66db9620 con 0x559e67076de0 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9466800640 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e6706d2d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9460000f80 tx=0x7f9460009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbb35b8729b1eb75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9456a00640 1 -- 172.21.15.82:0/1855479271 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460016040 con 0x559e67076de0 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9456a00640 1 -- 172.21.15.82:0/1855479271 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f946002e670 con 0x559e67076de0 2024-04-26T20:30:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.605+0000 7f9456a00640 1 -- 172.21.15.82:0/1855479271 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460012b30 con 0x559e67076de0 2024-04-26T20:30:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 -- 172.21.15.82:0/1855479271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 msgr2=0x559e6706d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e6706d2d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9460000f80 tx=0x7f9460009600 comp rx=0 tx=0).stop 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 -- 172.21.15.82:0/1855479271 shutdown_connections 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e670810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e670885b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 --2- 172.21.15.82:0/1855479271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e6706d2d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 -- 172.21.15.82:0/1855479271 >> 172.21.15.82:0/1855479271 conn(0x559e67072450 msgr2=0x559e67072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.606+0000 7f946fddc740 1 -- 172.21.15.82:0/1855479271 shutdown_connections 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.607+0000 7f946fddc740 1 -- 172.21.15.82:0/1855479271 wait complete. 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.607+0000 7f946fddc740 1 -- start start 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.607+0000 7f946fddc740 1 Processor -- start 2024-04-26T20:30:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e67085810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e67085d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e67086d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94681b2df0 con 0x559e6707c940 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94681b2660 con 0x559e67076de0 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94681af720 con 0x559e6706d810 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f946fddc740 10 client.0 _ll_register_callbacks cb 0x7f9450011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e67085d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f9466800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e67085810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f9466800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e67086d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e67085d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:39400/0 (socket says 172.21.15.82:39400) 2024-04-26T20:30:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 -- 172.21.15.82:0/1195815567 learned_addr learned my addr 172.21.15.82:0/1195815567 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:30:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 -- 172.21.15.82:0/1195815567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 msgr2=0x559e67085810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e67085810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 -- 172.21.15.82:0/1195815567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 msgr2=0x559e67086d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:30:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e67086d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.608+0000 7f945d400640 1 -- 172.21.15.82:0/1195815567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e66f95cb0 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f945d400640 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e67085d50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9450000c00 tx=0x7f94500055c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cf5123c472ea788 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f944be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f944be00640 1 -- 172.21.15.82:0/1195815567 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945000f9a0 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f946002e670 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f944be00640 1 -- 172.21.15.82:0/1195815567 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f945000fb40 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f944be00640 1 -- 172.21.15.82:0/1195815567 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f945003a050 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f946fddc740 10 client.26987 fetch_fsmap learned FSMap version 49 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.609+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x559e67088530 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f944be00640 1 -- 172.21.15.82:0/1195815567 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f946002e670 con 0x559e67076de0 2024-04-26T20:30:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f944be00640 1 -- 172.21.15.82:0/1195815567 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) ==== 8438+0+0 (secure 0 0 0) 0x7f945002f020 con 0x559e67076de0 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f946fddc740 10 client.26987 fetch_fsmap finished waiting for FSMap version 49 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f946fddc740 10 client.26987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f946fddc740 20 client.26987 populate_metadata read hostname 'smithi082' 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f946fddc740 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e670f36e0 0x559e670f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f946fddc740 4 client.26987 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e66fe2e00 con 0x559e670f36e0 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.610+0000 7f9466800640 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e670f36e0 0x559e670f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.611+0000 7f9466800640 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e670f36e0 0x559e670f5b00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f6e1fae700c593 server_cookie=3b840cdb46c0ca4c in_seq=0 out_seq=0 2024-04-26T20:30:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:53.611+0000 7f944be00640 10 client.26987 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:55 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:55.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:55 smithi139 ceph-mon[32999]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-04-26T20:30:55.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:55 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:55.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:55 smithi135 ceph-mon[32816]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-04-26T20:30:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:55 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:30:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:55 smithi082 ceph-mon[28105]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-04-26T20:30:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:56 smithi139 ceph-mon[32999]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 379 op/s 2024-04-26T20:30:57.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:56 smithi135 ceph-mon[32816]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 379 op/s 2024-04-26T20:30:57.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:56 smithi082 ceph-mon[28105]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 379 op/s 2024-04-26T20:30:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.599+0000 7f944be00640 1 -- 172.21.15.82:0/1195815567 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e66fe2e00 con 0x559e670f36e0 2024-04-26T20:30:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.599+0000 7f944be00640 10 client.26987 handle_command_reply: tid=0 2024-04-26T20:30:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.599+0000 7f946fddc740 1 client.26987 shutdown 2024-04-26T20:30:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 msgr2=0x559e67085d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e67085d50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9450000c00 tx=0x7f94500055c0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 shutdown_connections 2024-04-26T20:30:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x559e670f36e0 0x559e670f5b00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e6707c940 0x559e67086d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e67076de0 0x559e67085d50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 --2- 172.21.15.82:0/1195815567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e6706d810 0x559e67085810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f944be00640 0 client.26987 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:30:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.600+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 >> 172.21.15.82:0/1195815567 conn(0x559e67072450 msgr2=0x559e67078a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.601+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 shutdown_connections 2024-04-26T20:30:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.601+0000 7f946fddc740 1 -- 172.21.15.82:0/1195815567 wait complete. 2024-04-26T20:30:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.601+0000 7f946fddc740 20 client.26987 trim_cache size 0 max 16384 2024-04-26T20:30:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:30:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:30:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:30:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:30:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f944c0a3cb0 msgr2=0x7f944c0a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f944c0a3cb0 0x7f944c0a6170 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x559e67077bd0 tx=0x7f9458005b70 comp rx=0 tx=0).stop 2024-04-26T20:30:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 msgr2=0x7f946819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:30:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f946819ef40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9458031500 tx=0x7f9458003c80 comp rx=0 tx=0).stop 2024-04-26T20:30:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 shutdown_connections 2024-04-26T20:30:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f944c0a3cb0 0x7f944c0a6170 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f946810a990 0x7f94681a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9468109fd0 0x7f946819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 --2- 172.21.15.82:0/955876561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9468108de0 0x7f946819ef40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:30:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.602+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 >> 172.21.15.82:0/955876561 conn(0x7f9468077dc0 msgr2=0x7f946810d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:30:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.603+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 shutdown_connections 2024-04-26T20:30:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:30:57.603+0000 7f9467200640 1 -- 172.21.15.82:0/955876561 wait complete. 2024-04-26T20:30:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:30:58 smithi082 ceph-mon[28105]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 384 op/s 2024-04-26T20:30:59.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:30:58 smithi139 ceph-mon[32999]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 384 op/s 2024-04-26T20:30:59.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:30:58 smithi135 ceph-mon[32816]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 384 op/s 2024-04-26T20:31:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:00 smithi139 ceph-mon[32999]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 461 op/s 2024-04-26T20:31:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:00 smithi135 ceph-mon[32816]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 461 op/s 2024-04-26T20:31:01.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:00 smithi082 ceph-mon[28105]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 461 op/s 2024-04-26T20:31:03.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:02 smithi139 ceph-mon[32999]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 452 op/s 2024-04-26T20:31:03.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:02 smithi135 ceph-mon[32816]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 452 op/s 2024-04-26T20:31:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:02 smithi082 ceph-mon[28105]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 452 op/s 2024-04-26T20:31:05.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:04 smithi139 ceph-mon[32999]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 427 op/s 2024-04-26T20:31:05.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:04 smithi135 ceph-mon[32816]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 427 op/s 2024-04-26T20:31:05.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:04 smithi082 ceph-mon[28105]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 427 op/s 2024-04-26T20:31:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:06 smithi139 ceph-mon[32999]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 428 op/s 2024-04-26T20:31:07.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:06 smithi135 ceph-mon[32816]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 428 op/s 2024-04-26T20:31:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:06 smithi082 ceph-mon[28105]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 428 op/s 2024-04-26T20:31:09.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:08 smithi139 ceph-mon[32999]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.2 MiB/s wr, 389 op/s 2024-04-26T20:31:09.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:08 smithi135 ceph-mon[32816]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.2 MiB/s wr, 389 op/s 2024-04-26T20:31:09.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:08 smithi082 ceph-mon[28105]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.2 MiB/s wr, 389 op/s 2024-04-26T20:31:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 -- 172.21.15.82:0/3318197976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0106e30 msgr2=0x7f63f0109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 --2- 172.21.15.82:0/3318197976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0106e30 0x7f63f0109220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009ca0 tx=0x7f63e802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 -- 172.21.15.82:0/3318197976 shutdown_connections 2024-04-26T20:31:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 --2- 172.21.15.82:0/3318197976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0106e30 0x7f63f0109220 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 --2- 172.21.15.82:0/3318197976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 0x7f63f01025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 --2- 172.21.15.82:0/3318197976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0069300 0x7f63f0101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 -- 172.21.15.82:0/3318197976 >> 172.21.15.82:0/3318197976 conn(0x7f63f00fbf90 msgr2=0x7f63f00fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 -- 172.21.15.82:0/3318197976 shutdown_connections 2024-04-26T20:31:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.744+0000 7f63f5c00640 1 -- 172.21.15.82:0/3318197976 wait complete. 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.745+0000 7f63f5c00640 1 Processor -- start 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.745+0000 7f63f5c00640 1 -- start start 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0069300 0x7f63f019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 0x7f63f019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 0x7f63f01a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63f010e340 con 0x7f63f0102130 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63f010e1c0 con 0x7f63f0069300 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63f010e4c0 con 0x7f63f0106e30 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63efe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0069300 0x7f63f019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 0x7f63f01a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63ef400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 0x7f63f019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63efe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0069300 0x7f63f019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44954/0 (socket says 172.21.15.82:44954) 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63efe00640 1 -- 172.21.15.82:0/1016081637 learned_addr learned my addr 172.21.15.82:0/1016081637 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 0x7f63f01a2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49900/0 (socket says 172.21.15.82:49900) 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63ef400640 1 -- 172.21.15.82:0/1016081637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 msgr2=0x7f63f01a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63ef400640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 0x7f63f01a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63ef400640 1 -- 172.21.15.82:0/1016081637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0069300 msgr2=0x7f63f019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63ef400640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0069300 0x7f63f019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63ef400640 1 -- 172.21.15.82:0/1016081637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f01a27d0 con 0x7f63f0102130 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.746+0000 7f63f5200640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 0x7f63f01a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.747+0000 7f63ef400640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 0x7f63f019b0f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00e9c0 tx=0x7f63dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.747+0000 7f63ecc00640 1 -- 172.21.15.82:0/1016081637 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00ccc0 con 0x7f63f0102130 2024-04-26T20:31:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.747+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f01a2ac0 con 0x7f63f0102130 2024-04-26T20:31:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.747+0000 7f63ecc00640 1 -- 172.21.15.82:0/1016081637 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63dc0035f0 con 0x7f63f0102130 2024-04-26T20:31:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.747+0000 7f63ecc00640 1 -- 172.21.15.82:0/1016081637 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00ce60 con 0x7f63f0102130 2024-04-26T20:31:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.747+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f01a3010 con 0x7f63f0102130 2024-04-26T20:31:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.750+0000 7f63fa1c5740 1 Processor -- start 2024-04-26T20:31:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.750+0000 7f63fa1c5740 1 -- start start 2024-04-26T20:31:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 0x55f4973f1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f6940 0x55f4973f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f497355380 con 0x55f4973f6940 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f4972f1c30 con 0x55f4973f17d0 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f497351340 con 0x55f4973f0de0 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 0x55f4973f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 0x55f4973f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49906/0 (socket says 172.21.15.82:49906) 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 -- 172.21.15.82:0/1813312590 learned_addr learned my addr 172.21.15.82:0/1813312590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63ecc00640 1 -- 172.21.15.82:0/1016081637 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f63dc004000 con 0x7f63f0102130 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63efe00640 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 -- 172.21.15.82:0/1813312590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 msgr2=0x55f4973f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 -- 172.21.15.82:0/1813312590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f6940 msgr2=0x55f4973f8dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f6940 0x55f4973f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63f5200640 1 -- 172.21.15.82:0/1813312590 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f497313940 con 0x55f4973f0de0 2024-04-26T20:31:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.751+0000 7f63efe00640 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:31:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.752+0000 7f63f5200640 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 0x55f4973f1200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f63e802ade0 tx=0x7f63e80093a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f82a4e516258d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.752+0000 7f63e5600640 1 -- 172.21.15.82:0/1813312590 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8031650 con 0x55f4973f0de0 2024-04-26T20:31:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.752+0000 7f63e5600640 1 -- 172.21.15.82:0/1813312590 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63e8036040 con 0x55f4973f0de0 2024-04-26T20:31:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.752+0000 7f63e5600640 1 -- 172.21.15.82:0/1813312590 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8004650 con 0x55f4973f0de0 2024-04-26T20:31:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.752+0000 7f63ecc00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f63d40a3c30 0x7f63d40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 -- 172.21.15.82:0/1813312590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 msgr2=0x55f4973f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 0x55f4973f1200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f63e802ade0 tx=0x7f63e80093a0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63ecc00640 1 -- 172.21.15.82:0/1016081637 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f63dc0d0d00 con 0x7f63f0102130 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63efe00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f63d40a3c30 0x7f63d40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 -- 172.21.15.82:0/1813312590 shutdown_connections 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f6940 0x55f4973f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/1813312590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f0de0 0x55f4973f1200 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 -- 172.21.15.82:0/1813312590 >> 172.21.15.82:0/1813312590 conn(0x55f4973ec450 msgr2=0x55f4973ec850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 -- 172.21.15.82:0/1813312590 shutdown_connections 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 -- 172.21.15.82:0/1813312590 wait complete. 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63efe00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f63d40a3c30 0x7f63d40a60f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55f4973ed3c0 tx=0x7f63e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.753+0000 7f63fa1c5740 1 -- start start 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 Processor -- start 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973fb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 0x55f4974023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4973f9710 con 0x55f4973f0de0 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f4972dcc60 con 0x55f4973f17d0 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f4973f9890 con 0x55f4973f6940 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63fa1c5740 10 client.0 _ll_register_callbacks cb 0x55f497308e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 0x55f4974023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63ef400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973fb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 0x55f4974023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49918/0 (socket says 172.21.15.82:49918) 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63efe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.754+0000 7f63f5200640 1 -- 172.21.15.82:0/3027167695 learned_addr learned my addr 172.21.15.82:0/3027167695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63f5200640 1 -- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 msgr2=0x55f4973fb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63f5200640 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973fb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63f5200640 1 -- 172.21.15.82:0/3027167695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 msgr2=0x55f4973faed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63f5200640 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973faed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63f5200640 1 -- 172.21.15.82:0/3027167695 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4972eb510 con 0x55f4973f6940 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63f5200640 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 0x55f4974023e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009bf0 tx=0x7f63e80046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e47cf159fba8f7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63da000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63da000640 1 -- 172.21.15.82:0/3027167695 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8003b80 con 0x55f4973f6940 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63e8036040 con 0x55f4973f6940 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63da000640 1 -- 172.21.15.82:0/3027167695 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f63e8003d20 con 0x55f4973f6940 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.755+0000 7f63da000640 1 -- 172.21.15.82:0/3027167695 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f63e805e050 con 0x55f4973f6940 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 10 client.27082 fetch_fsmap learned FSMap version 50 2024-04-26T20:31:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f497067210 con 0x55f4973f6940 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63da000640 1 -- 172.21.15.82:0/3027167695 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63e8036040 con 0x55f4973f6940 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63da000640 1 -- 172.21.15.82:0/3027167695 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7f63e804f070 con 0x55f4973f6940 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 10 client.27082 fetch_fsmap finished waiting for FSMap version 50 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 10 client.27082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 20 client.27082 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f4974066e0 0x55f497408ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 4 client.27082 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f497362f90 con 0x55f4974066e0 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.756+0000 7f63efe00640 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f4974066e0 0x55f497408ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.757+0000 7f63efe00640 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f4974066e0 0x55f497408ad0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30258dfda2847876 server_cookie=3a2afdb55041f5ee in_seq=0 out_seq=0 2024-04-26T20:31:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.757+0000 7f63da000640 10 client.27082 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63da000640 1 -- 172.21.15.82:0/3027167695 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f497362f90 con 0x55f4974066e0 2024-04-26T20:31:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63da000640 10 client.27082 handle_command_reply: tid=0 2024-04-26T20:31:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 client.27082 shutdown 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 msgr2=0x55f4974023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 0x55f4974023e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009bf0 tx=0x7f63e80046e0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 shutdown_connections 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f4974066e0 0x55f497408ad0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f6940 0x55f4974023e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f17d0 0x55f4973fb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/3027167695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973faed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63da000640 0 client.27082 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 >> 172.21.15.82:0/3027167695 conn(0x55f4973ec450 msgr2=0x55f4973eb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 shutdown_connections 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 1 -- 172.21.15.82:0/3027167695 wait complete. 2024-04-26T20:31:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.758+0000 7f63fa1c5740 20 client.27082 trim_cache size 0 max 16384 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.774+0000 7f63fa1c5740 1 Processor -- start 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 -- start start 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973efb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 0x55f497402300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f49740d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63f01ad3f0 con 0x55f4973f0de0 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63f01af170 con 0x55f4973f6940 2024-04-26T20:31:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63f01adb80 con 0x55f4973f17d0 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 0x55f497402300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63efe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 0x55f497402300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49930/0 (socket says 172.21.15.82:49930) 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 -- 172.21.15.82:0/966823678 learned_addr learned my addr 172.21.15.82:0/966823678 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63f5200640 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f49740d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 -- 172.21.15.82:0/966823678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 msgr2=0x55f49740d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f49740d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 -- 172.21.15.82:0/966823678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 msgr2=0x55f4973efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.775+0000 7f63ef400640 1 -- 172.21.15.82:0/966823678 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f497133620 con 0x55f4973f17d0 2024-04-26T20:31:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.776+0000 7f63ef400640 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 0x55f497402300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0ce380 tx=0x7f63dc098dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71466f3ac949147e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:10.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.776+0000 7f63e4c00640 1 -- 172.21.15.82:0/966823678 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0b5020 con 0x55f4973f17d0 2024-04-26T20:31:10.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.776+0000 7f63e4c00640 1 -- 172.21.15.82:0/966823678 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63dc09de50 con 0x55f4973f17d0 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.776+0000 7f63e4c00640 1 -- 172.21.15.82:0/966823678 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0d2040 con 0x55f4973f17d0 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.776+0000 7f63fa1c5740 1 -- 172.21.15.82:0/966823678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 msgr2=0x55f497402300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.776+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 0x55f497402300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0ce380 tx=0x7f63dc098dc0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 -- 172.21.15.82:0/966823678 shutdown_connections 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f49740d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4973f17d0 0x55f497402300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/966823678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 -- 172.21.15.82:0/966823678 >> 172.21.15.82:0/966823678 conn(0x55f4973ec450 msgr2=0x55f4973ef400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 -- 172.21.15.82:0/966823678 shutdown_connections 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 -- 172.21.15.82:0/966823678 wait complete. 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 -- start start 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.777+0000 7f63fa1c5740 1 Processor -- start 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f497400320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 0x55f4974017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63f01aeaa0 con 0x55f4973f0de0 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63f01ae310 con 0x55f4973f6940 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63f01ab3d0 con 0x55f497401330 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63fa1c5740 10 client.0 _ll_register_callbacks cb 0x7f63e8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 0x55f4974017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63efe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 0x55f4974017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:49946/0 (socket says 172.21.15.82:49946) 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 -- 172.21.15.82:0/306021899 learned_addr learned my addr 172.21.15.82:0/306021899 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63ef400640 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f497400320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 -- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 msgr2=0x55f497400320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f497400320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 -- 172.21.15.82:0/306021899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 msgr2=0x55f4973ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 -- 172.21.15.82:0/306021899 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f49730fcb0 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63f5200640 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 0x55f4974017b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f63e802f590 tx=0x7f63e802f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9c00ebf99363fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.778+0000 7f63da000640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63da000640 1 -- 172.21.15.82:0/306021899 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e802fc10 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63da000640 1 -- 172.21.15.82:0/306021899 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f63e804b040 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63dc09de50 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63da000640 1 -- 172.21.15.82:0/306021899 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f63e806a050 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 10 client.27088 fetch_fsmap learned FSMap version 50 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f49746d0a0 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63da000640 1 -- 172.21.15.82:0/306021899 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63dc09de50 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63da000640 1 -- 172.21.15.82:0/306021899 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 50) ==== 8442+0+0 (secure 0 0 0) 0x7f63e8044070 con 0x55f497401330 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 10 client.27088 fetch_fsmap finished waiting for FSMap version 50 2024-04-26T20:31:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 10 client.27088 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 20 client.27088 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f49746da90 0x55f49746feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 4 client.27088 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.779+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f49735ce00 con 0x55f49746da90 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.780+0000 7f63efe00640 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f49746da90 0x55f49746feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.780+0000 7f63efe00640 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f49746da90 0x55f49746feb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16fc28072d5fc1e6 server_cookie=2a50e3fda00d4e7b in_seq=0 out_seq=0 2024-04-26T20:31:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:10.780+0000 7f63da000640 10 client.27088 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:11 smithi139 ceph-mon[32999]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.6 MiB/s wr, 389 op/s 2024-04-26T20:31:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.345+0000 7f63da000640 1 -- 172.21.15.82:0/306021899 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f49735ce00 con 0x55f49746da90 2024-04-26T20:31:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.345+0000 7f63da000640 10 client.27088 handle_command_reply: tid=0 2024-04-26T20:31:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 client.27088 shutdown 2024-04-26T20:31:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 msgr2=0x55f4974017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 0x55f4974017b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f63e802f590 tx=0x7f63e802f890 comp rx=0 tx=0).stop 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 shutdown_connections 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f49746da90 0x55f49746feb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f497401330 0x55f4974017b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4973f6940 0x55f497400320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 --2- 172.21.15.82:0/306021899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4973f0de0 0x55f4973ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63da000640 0 client.27088 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 >> 172.21.15.82:0/306021899 conn(0x55f4973ec450 msgr2=0x55f4973eadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 shutdown_connections 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.346+0000 7f63fa1c5740 1 -- 172.21.15.82:0/306021899 wait complete. 2024-04-26T20:31:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.347+0000 7f63fa1c5740 20 client.27088 trim_cache size 0 max 16384 2024-04-26T20:31:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:31:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:31:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:31:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f63d40a3c30 msgr2=0x7f63d40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f63d40a3c30 0x7f63d40a60f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55f4973ed3c0 tx=0x7f63e0005f90 comp rx=0 tx=0).stop 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 msgr2=0x7f63f019b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 0x7f63f019b0f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00e9c0 tx=0x7f63dc00ee80 comp rx=0 tx=0).stop 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 shutdown_connections 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f63d40a3c30 0x7f63d40a60f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63f0106e30 0x7f63f01a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f0102130 0x7f63f019b0f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 --2- 172.21.15.82:0/1016081637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63f0069300 0x7f63f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 >> 172.21.15.82:0/1016081637 conn(0x7f63f00fbf90 msgr2=0x7f63f00fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 shutdown_connections 2024-04-26T20:31:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:11.348+0000 7f63f5c00640 1 -- 172.21.15.82:0/1016081637 wait complete. 2024-04-26T20:31:11.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:11 smithi135 ceph-mon[32816]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.6 MiB/s wr, 389 op/s 2024-04-26T20:31:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:11 smithi082 ceph-mon[28105]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.6 MiB/s wr, 389 op/s 2024-04-26T20:31:13.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:12 smithi139 ceph-mon[32999]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 387 op/s 2024-04-26T20:31:13.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:12 smithi135 ceph-mon[32816]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 387 op/s 2024-04-26T20:31:13.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:12 smithi082 ceph-mon[28105]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 387 op/s 2024-04-26T20:31:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:14 smithi139 ceph-mon[32999]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-04-26T20:31:15.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:14 smithi135 ceph-mon[32816]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-04-26T20:31:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:14 smithi082 ceph-mon[28105]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-04-26T20:31:17.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:17 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:17.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:17 smithi139 ceph-mon[32999]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 545 op/s 2024-04-26T20:31:17.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:17 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:17.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:17 smithi135 ceph-mon[32816]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 545 op/s 2024-04-26T20:31:17.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:17 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:17.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:17 smithi082 ceph-mon[28105]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 545 op/s 2024-04-26T20:31:19.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:18 smithi139 ceph-mon[32999]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 514 op/s 2024-04-26T20:31:19.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:18 smithi135 ceph-mon[32816]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 514 op/s 2024-04-26T20:31:19.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:18 smithi082 ceph-mon[28105]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 514 op/s 2024-04-26T20:31:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:20 smithi139 ceph-mon[32999]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 543 op/s 2024-04-26T20:31:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:20 smithi135 ceph-mon[32816]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 543 op/s 2024-04-26T20:31:21.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:20 smithi082 ceph-mon[28105]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 543 op/s 2024-04-26T20:31:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:22 smithi139 ceph-mon[32999]: pgmap v670: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 547 op/s 2024-04-26T20:31:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:22 smithi135 ceph-mon[32816]: pgmap v670: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 547 op/s 2024-04-26T20:31:23.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:22 smithi082 ceph-mon[28105]: pgmap v670: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 547 op/s 2024-04-26T20:31:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 -- 172.21.15.82:0/2876329235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4102520 msgr2=0x7fbda41029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 --2- 172.21.15.82:0/2876329235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4102520 0x7fbda41029a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009ca0 tx=0x7fbd9c02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 -- 172.21.15.82:0/2876329235 shutdown_connections 2024-04-26T20:31:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 --2- 172.21.15.82:0/2876329235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4102520 0x7fbda41029a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 --2- 172.21.15.82:0/2876329235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda4101b80 0x7fbda4101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 --2- 172.21.15.82:0/2876329235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbda4101220 0x7fbda4101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 -- 172.21.15.82:0/2876329235 >> 172.21.15.82:0/2876329235 conn(0x7fbda40fce20 msgr2=0x7fbda40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 -- 172.21.15.82:0/2876329235 shutdown_connections 2024-04-26T20:31:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.496+0000 7fbda9400640 1 -- 172.21.15.82:0/2876329235 wait complete. 2024-04-26T20:31:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.497+0000 7fbda9400640 1 Processor -- start 2024-04-26T20:31:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.497+0000 7fbda9400640 1 -- start start 2024-04-26T20:31:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda9400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 0x7fbda419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbda4101b80 0x7fbda419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda4102520 0x7fbda41a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda9400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41106d0 con 0x7fbda4101b80 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda9400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4110550 con 0x7fbda4102520 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda9400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4110850 con 0x7fbda4101220 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 0x7fbda419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 0x7fbda419acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43026/0 (socket says 172.21.15.82:43026) 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 -- 172.21.15.82:0/2232330521 learned_addr learned my addr 172.21.15.82:0/2232330521 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbd9be00640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbda4101b80 0x7fbda419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda3200640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda4102520 0x7fbda41a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 -- 172.21.15.82:0/2232330521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda4102520 msgr2=0x7fbda41a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda4102520 0x7fbda41a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 -- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbda4101b80 msgr2=0x7fbda419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbda4101b80 0x7fbda419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.498+0000 7fbda2800640 1 -- 172.21.15.82:0/2232330521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda41a28f0 con 0x7fbda4101220 2024-04-26T20:31:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.499+0000 7fbda2800640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 0x7fbda419acb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400ea60 tx=0x7fbd9400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:24.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.499+0000 7fbd9b400640 1 -- 172.21.15.82:0/2232330521 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400cde0 con 0x7fbda4101220 2024-04-26T20:31:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.499+0000 7fbd9b400640 1 -- 172.21.15.82:0/2232330521 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd940035f0 con 0x7fbda4101220 2024-04-26T20:31:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.499+0000 7fbd9b400640 1 -- 172.21.15.82:0/2232330521 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94010690 con 0x7fbda4101220 2024-04-26T20:31:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.499+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda41a2be0 con 0x7fbda4101220 2024-04-26T20:31:24.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.499+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda41a3180 con 0x7fbda4101220 2024-04-26T20:31:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.502+0000 7fbd9b400640 1 -- 172.21.15.82:0/2232330521 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbd940037a0 con 0x7fbda4101220 2024-04-26T20:31:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.503+0000 7fbdac23a740 1 Processor -- start 2024-04-26T20:31:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.503+0000 7fbdac23a740 1 -- start start 2024-04-26T20:31:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5781ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d57870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5789bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbdac23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5619d56e6380 con 0x5619d5781bd0 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbdac23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619d5682c30 con 0x5619d57825c0 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbdac23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5619d56e2340 con 0x5619d5787730 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbda2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d57870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbda3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5781ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbda2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d57870c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60674/0 (socket says 172.21.15.82:60674) 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbda2800640 1 -- 172.21.15.82:0/3068377662 learned_addr learned my addr 172.21.15.82:0/3068377662 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.504+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5789bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda2800640 1 -- 172.21.15.82:0/3068377662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 msgr2=0x5619d5789bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda2800640 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5789bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda2800640 1 -- 172.21.15.82:0/3068377662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 msgr2=0x5619d5781ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda2800640 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5781ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda2800640 1 -- 172.21.15.82:0/3068377662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619d56a4940 con 0x5619d57825c0 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5789bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda3200640 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5781ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda2800640 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d57870c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd940d4ca0 tx=0x7fbd940d9780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fc53c58fd09b8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbd9b400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd880a3d70 0x7fbd880a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.505+0000 7fbda3200640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd880a3d70 0x7fbd880a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.506+0000 7fbd9b400640 1 -- 172.21.15.82:0/2232330521 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fbd940d0cc0 con 0x7fbda4101220 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.506+0000 7fbd93400640 1 -- 172.21.15.82:0/3068377662 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94098d20 con 0x5619d57825c0 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.506+0000 7fbd93400640 1 -- 172.21.15.82:0/3068377662 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd940de070 con 0x5619d57825c0 2024-04-26T20:31:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.506+0000 7fbd93400640 1 -- 172.21.15.82:0/3068377662 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9409c3e0 con 0x5619d57825c0 2024-04-26T20:31:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 -- 172.21.15.82:0/3068377662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 msgr2=0x5619d57870c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbda3200640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd880a3d70 0x7fbd880a6230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x5619d5782e20 tx=0x7fbd9c031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d57870c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd940d4ca0 tx=0x7fbd940d9780 comp rx=0 tx=0).stop 2024-04-26T20:31:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 -- 172.21.15.82:0/3068377662 shutdown_connections 2024-04-26T20:31:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5789bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d57870c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3068377662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5781ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 -- 172.21.15.82:0/3068377662 >> 172.21.15.82:0/3068377662 conn(0x5619d577d240 msgr2=0x5619d577d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 -- 172.21.15.82:0/3068377662 shutdown_connections 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.507+0000 7fbdac23a740 1 -- 172.21.15.82:0/3068377662 wait complete. 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.508+0000 7fbdac23a740 1 -- start start 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.508+0000 7fbdac23a740 1 Processor -- start 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5781bd0 0x5619d578be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d578c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5787730 0x5619d5793390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5619d578a6e0 con 0x5619d5787730 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619d566dc60 con 0x5619d5781bd0 2024-04-26T20:31:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5619d578a860 con 0x5619d57825c0 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbdac23a740 10 client.0 _ll_register_callbacks cb 0x5619d5699e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d578c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d578c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43040/0 (socket says 172.21.15.82:43040) 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 -- 172.21.15.82:0/3007211801 learned_addr learned my addr 172.21.15.82:0/3007211801 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbda2800640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5781bd0 0x5619d578be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 -- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5781bd0 msgr2=0x5619d578be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5781bd0 0x5619d578be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 -- 172.21.15.82:0/3007211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5787730 msgr2=0x5619d5793390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5787730 0x5619d5793390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.509+0000 7fbd9be00640 1 -- 172.21.15.82:0/3007211801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619d567c510 con 0x5619d57825c0 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbda2800640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5781bd0 0x5619d578be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:31:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d578c350 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0126d0 tx=0x7fbd8c012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac5c2e497e57bbbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbd87e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbd87e00640 1 -- 172.21.15.82:0/3007211801 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c011b50 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd940de070 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbd87e00640 1 -- 172.21.15.82:0/3007211801 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fbd8c011cf0 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbd87e00640 1 -- 172.21.15.82:0/3007211801 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbd8c025050 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbdac23a740 10 client.27100 fetch_fsmap learned FSMap version 51 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.510+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5619d53f8210 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbd87e00640 1 -- 172.21.15.82:0/3007211801 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd940de070 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbd87e00640 1 -- 172.21.15.82:0/3007211801 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 51) ==== 8438+0+0 (secure 0 0 0) 0x7fbd8c003bf0 con 0x5619d57825c0 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbdac23a740 10 client.27100 fetch_fsmap finished waiting for FSMap version 51 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbdac23a740 10 client.27100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbdac23a740 20 client.27100 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d5797a70 0x5619d5799ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbdac23a740 4 client.27100 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:31:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.511+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619d56f3f90 con 0x5619d5797a70 2024-04-26T20:31:24.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.512+0000 7fbda2800640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d5797a70 0x5619d5799ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.512+0000 7fbda2800640 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d5797a70 0x5619d5799ec0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b59248ba578a296 server_cookie=c2a7247dcc001cee in_seq=0 out_seq=0 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.512+0000 7fbd87e00640 10 client.27100 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbd87e00640 1 -- 172.21.15.82:0/3007211801 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5619d56f3f90 con 0x5619d5797a70 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbd87e00640 10 client.27100 handle_command_reply: tid=0 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 client.27100 shutdown 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 msgr2=0x5619d578c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d578c350 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0126d0 tx=0x7fbd8c012b90 comp rx=0 tx=0).stop 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 shutdown_connections 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d5797a70 0x5619d5799ec0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5787730 0x5619d5793390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d578c350 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3007211801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5781bd0 0x5619d578be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbd87e00640 0 client.27100 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.513+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 >> 172.21.15.82:0/3007211801 conn(0x5619d577d240 msgr2=0x5619d577c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.514+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 shutdown_connections 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.514+0000 7fbdac23a740 1 -- 172.21.15.82:0/3007211801 wait complete. 2024-04-26T20:31:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.514+0000 7fbdac23a740 20 client.27100 trim_cache size 0 max 16384 2024-04-26T20:31:24.551 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.550+0000 7fbdac23a740 1 Processor -- start 2024-04-26T20:31:24.551 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.550+0000 7fbdac23a740 1 -- start start 2024-04-26T20:31:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.550+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d57800b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.551+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d5793350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.551+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 0x5619d57805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.551+0000 7fbdac23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41ad560 con 0x5619d5781bd0 2024-04-26T20:31:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.551+0000 7fbdac23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41af2b0 con 0x5619d5787730 2024-04-26T20:31:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.551+0000 7fbdac23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41adcf0 con 0x5619d57825c0 2024-04-26T20:31:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.551+0000 7fbda2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d57800b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.552+0000 7fbda3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 0x5619d57805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.552+0000 7fbda3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 0x5619d57805f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:60682/0 (socket says 172.21.15.82:60682) 2024-04-26T20:31:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.552+0000 7fbda3200640 1 -- 172.21.15.82:0/3824431845 learned_addr learned my addr 172.21.15.82:0/3824431845 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.552+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d5793350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbda3200640 1 -- 172.21.15.82:0/3824431845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 msgr2=0x5619d5793350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbda3200640 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d5793350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbda3200640 1 -- 172.21.15.82:0/3824431845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 msgr2=0x5619d57800b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbda3200640 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d57800b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbda3200640 1 -- 172.21.15.82:0/3824431845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619d54c4620 con 0x5619d5787730 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbd9be00640 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d5793350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.553+0000 7fbda2800640 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d57800b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.554+0000 7fbda3200640 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 0x5619d57805f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c035000 tx=0x7fbd9c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93c6703f430a4f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.555+0000 7fbd92a00640 1 -- 172.21.15.82:0/3824431845 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c02f660 con 0x5619d5787730 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.555+0000 7fbd92a00640 1 -- 172.21.15.82:0/3824431845 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9c036040 con 0x5619d5787730 2024-04-26T20:31:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.555+0000 7fbd92a00640 1 -- 172.21.15.82:0/3824431845 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c030dd0 con 0x5619d5787730 2024-04-26T20:31:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.556+0000 7fbdac23a740 1 -- 172.21.15.82:0/3824431845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 msgr2=0x5619d57805f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.556+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 0x5619d57805f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c035000 tx=0x7fbd9c0095c0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.556+0000 7fbdac23a740 1 -- 172.21.15.82:0/3824431845 shutdown_connections 2024-04-26T20:31:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.557+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d5787730 0x5619d57805f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.557+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d57825c0 0x5619d5793350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.557+0000 7fbdac23a740 1 --2- 172.21.15.82:0/3824431845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d57800b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.557+0000 7fbdac23a740 1 -- 172.21.15.82:0/3824431845 >> 172.21.15.82:0/3824431845 conn(0x5619d577d240 msgr2=0x5619d57837a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.559+0000 7fbdac23a740 1 -- 172.21.15.82:0/3824431845 shutdown_connections 2024-04-26T20:31:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.560+0000 7fbdac23a740 1 -- 172.21.15.82:0/3824431845 wait complete. 2024-04-26T20:31:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.561+0000 7fbdac23a740 1 -- start start 2024-04-26T20:31:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.561+0000 7fbdac23a740 1 Processor -- start 2024-04-26T20:31:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.563+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5790b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.563+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d5791080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.563+0000 7fbdac23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5792090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.563+0000 7fbdac23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41aebe0 con 0x5619d5781bd0 2024-04-26T20:31:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.563+0000 7fbdac23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41ae480 con 0x5619d57825c0 2024-04-26T20:31:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.563+0000 7fbdac23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbda41ab540 con 0x5619d5787730 2024-04-26T20:31:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.564+0000 7fbdac23a740 10 client.0 _ll_register_callbacks cb 0x7fbd8c0093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.564+0000 7fbda3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5792090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda3200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5792090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43060/0 (socket says 172.21.15.82:43060) 2024-04-26T20:31:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda3200640 1 -- 172.21.15.82:0/2549824178 learned_addr learned my addr 172.21.15.82:0/2549824178 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbd9be00640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d5791080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda2800640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5790b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda3200640 1 -- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 msgr2=0x5619d5791080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda3200640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d5791080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda3200640 1 -- 172.21.15.82:0/2549824178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 msgr2=0x5619d5790b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.565+0000 7fbda3200640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5790b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.566+0000 7fbda3200640 1 -- 172.21.15.82:0/2549824178 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619d56a0cb0 con 0x5619d5787730 2024-04-26T20:31:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.566+0000 7fbd9be00640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d5791080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:31:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.566+0000 7fbda2800640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5790b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:31:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.566+0000 7fbd87e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:31:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.567+0000 7fbda3200640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5792090 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0096c0 tx=0x7fbd9c030fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ba25cae1262184 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.567+0000 7fbd87e00640 1 -- 172.21.15.82:0/2549824178 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c02f870 con 0x5619d5787730 2024-04-26T20:31:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.568+0000 7fbd87e00640 1 -- 172.21.15.82:0/2549824178 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fbd9c02fa10 con 0x5619d5787730 2024-04-26T20:31:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.568+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9c036040 con 0x5619d5787730 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.569+0000 7fbd87e00640 1 -- 172.21.15.82:0/2549824178 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbd9c02fc10 con 0x5619d5787730 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.569+0000 7fbdac23a740 10 client.27106 fetch_fsmap learned FSMap version 51 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.569+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5619d57fe040 con 0x5619d5787730 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbd87e00640 1 -- 172.21.15.82:0/2549824178 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9c036040 con 0x5619d5787730 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbd87e00640 1 -- 172.21.15.82:0/2549824178 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 51) ==== 8438+0+0 (secure 0 0 0) 0x7fbd9c051070 con 0x5619d5787730 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbdac23a740 10 client.27106 fetch_fsmap finished waiting for FSMap version 51 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbdac23a740 10 client.27106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbdac23a740 20 client.27106 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbdac23a740 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d57feab0 0x5619d57feec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbdac23a740 4 client.27106 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:31:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.570+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619d56ede00 con 0x5619d57feab0 2024-04-26T20:31:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.571+0000 7fbda2800640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d57feab0 0x5619d57feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.572+0000 7fbd87e00640 10 client.27106 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.572+0000 7fbda2800640 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d57feab0 0x5619d57feec0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944ef078c3e1d1a6 server_cookie=a893cdcd5d0c1e5d in_seq=0 out_seq=0 2024-04-26T20:31:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.591+0000 7fbd87e00640 1 -- 172.21.15.82:0/2549824178 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619d56ede00 con 0x5619d57feab0 2024-04-26T20:31:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.591+0000 7fbd87e00640 10 client.27106 handle_command_reply: tid=0 2024-04-26T20:31:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.592+0000 7fbdac23a740 1 client.27106 shutdown 2024-04-26T20:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.592+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 msgr2=0x5619d5792090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.592+0000 7fbdac23a740 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5792090 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0096c0 tx=0x7fbd9c030fe0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 shutdown_connections 2024-04-26T20:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5619d57feab0 0x5619d57feec0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619d5787730 0x5619d5792090 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d57825c0 0x5619d5791080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 --2- 172.21.15.82:0/2549824178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5619d5781bd0 0x5619d5790b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 >> 172.21.15.82:0/2549824178 conn(0x5619d577d240 msgr2=0x5619d57837a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbd87e00640 0 client.27106 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.593+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 shutdown_connections 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.594+0000 7fbdac23a740 1 -- 172.21.15.82:0/2549824178 wait complete. 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.594+0000 7fbdac23a740 20 client.27106 trim_cache size 0 max 16384 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:31:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:31:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd880a3d70 msgr2=0x7fbd880a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd880a3d70 0x7fbd880a6230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x5619d5782e20 tx=0x7fbd9c031af0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 msgr2=0x7fbda419acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 0x7fbda419acb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400ea60 tx=0x7fbd9400ef20 comp rx=0 tx=0).stop 2024-04-26T20:31:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 shutdown_connections 2024-04-26T20:31:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd880a3d70 0x7fbd880a6230 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda4102520 0x7fbda41a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbda4101b80 0x7fbda419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 --2- 172.21.15.82:0/2232330521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda4101220 0x7fbda419acb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 >> 172.21.15.82:0/2232330521 conn(0x7fbda40fce20 msgr2=0x7fbda40fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.595+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 shutdown_connections 2024-04-26T20:31:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:24.596+0000 7fbda9400640 1 -- 172.21.15.82:0/2232330521 wait complete. 2024-04-26T20:31:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:24 smithi139 ceph-mon[32999]: pgmap v671: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 468 op/s 2024-04-26T20:31:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:24 smithi135 ceph-mon[32816]: pgmap v671: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 468 op/s 2024-04-26T20:31:25.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:24 smithi082 ceph-mon[28105]: pgmap v671: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 468 op/s 2024-04-26T20:31:27.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:27 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:27.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:27 smithi139 ceph-mon[32999]: pgmap v672: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 394 op/s 2024-04-26T20:31:27.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:27 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:27.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:27 smithi135 ceph-mon[32816]: pgmap v672: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 394 op/s 2024-04-26T20:31:27.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:27 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:27 smithi082 ceph-mon[28105]: pgmap v672: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 394 op/s 2024-04-26T20:31:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:28 smithi139 ceph-mon[32999]: pgmap v673: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2024-04-26T20:31:29.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:28 smithi135 ceph-mon[32816]: pgmap v673: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2024-04-26T20:31:29.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:28 smithi082 ceph-mon[28105]: pgmap v673: 129 pgs: 129 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2024-04-26T20:31:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:30 smithi139 ceph-mon[32999]: pgmap v674: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 343 op/s 2024-04-26T20:31:31.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:31 smithi135 ceph-mon[32816]: pgmap v674: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 343 op/s 2024-04-26T20:31:31.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:30 smithi082 ceph-mon[28105]: pgmap v674: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 343 op/s 2024-04-26T20:31:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:33 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:33 smithi139 ceph-mon[32999]: pgmap v675: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 346 op/s 2024-04-26T20:31:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:33 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:33 smithi135 ceph-mon[32816]: pgmap v675: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 346 op/s 2024-04-26T20:31:33.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:33 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:33.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:33 smithi082 ceph-mon[28105]: pgmap v675: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 346 op/s 2024-04-26T20:31:35.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:35 smithi139 ceph-mon[32999]: pgmap v676: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-26T20:31:35.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:35 smithi135 ceph-mon[32816]: pgmap v676: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-26T20:31:35.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:35 smithi082 ceph-mon[28105]: pgmap v676: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-26T20:31:37.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:37 smithi139 ceph-mon[32999]: pgmap v677: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 323 op/s 2024-04-26T20:31:37.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:37 smithi135 ceph-mon[32816]: pgmap v677: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 323 op/s 2024-04-26T20:31:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:37 smithi082 ceph-mon[28105]: pgmap v677: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 323 op/s 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 -- 172.21.15.82:0/1859477716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281049f0 msgr2=0x7fea28104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 --2- 172.21.15.82:0/1859477716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281049f0 0x7fea28104e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fea18009900 tx=0x7fea1802a410 comp rx=0 tx=0).stop 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 -- 172.21.15.82:0/1859477716 shutdown_connections 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 --2- 172.21.15.82:0/1859477716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea281065a0 0x7fea2810ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 --2- 172.21.15.82:0/1859477716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea28105be0 0x7fea28106060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 --2- 172.21.15.82:0/1859477716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281049f0 0x7fea28104e10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 -- 172.21.15.82:0/1859477716 >> 172.21.15.82:0/1859477716 conn(0x7fea280fff60 msgr2=0x7fea281023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 -- 172.21.15.82:0/1859477716 shutdown_connections 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.732+0000 7fea2d600640 1 -- 172.21.15.82:0/1859477716 wait complete. 2024-04-26T20:31:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 Processor -- start 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 -- start start 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 0x7fea2819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea28105be0 0x7fea2819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281065a0 0x7fea281a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea28110540 con 0x7fea281049f0 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea281103c0 con 0x7fea28105be0 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea2d600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea281106c0 con 0x7fea281065a0 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.733+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 0x7fea2819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 0x7fea2819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38732/0 (socket says 172.21.15.82:38732) 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 -- 172.21.15.82:0/2580102496 learned_addr learned my addr 172.21.15.82:0/2580102496 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea2cc00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281065a0 0x7fea281a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27400640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea28105be0 0x7fea2819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 -- 172.21.15.82:0/2580102496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281065a0 msgr2=0x7fea281a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281065a0 0x7fea281a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 -- 172.21.15.82:0/2580102496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea28105be0 msgr2=0x7fea2819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea28105be0 0x7fea2819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27e00640 1 -- 172.21.15.82:0/2580102496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea281a2840 con 0x7fea281049f0 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.734+0000 7fea27400640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea28105be0 0x7fea2819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.735+0000 7fea27e00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 0x7fea2819ac30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fea18031500 tx=0x7fea18003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.735+0000 7fea24c00640 1 -- 172.21.15.82:0/2580102496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1803f070 con 0x7fea281049f0 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.735+0000 7fea24c00640 1 -- 172.21.15.82:0/2580102496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18031c50 con 0x7fea281049f0 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.735+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea281a2ad0 con 0x7fea281049f0 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.735+0000 7fea24c00640 1 -- 172.21.15.82:0/2580102496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18035030 con 0x7fea281049f0 2024-04-26T20:31:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.735+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea281a2fc0 con 0x7fea281049f0 2024-04-26T20:31:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.738+0000 7fea24c00640 1 -- 172.21.15.82:0/2580102496 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fea18042070 con 0x7fea281049f0 2024-04-26T20:31:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 Processor -- start 2024-04-26T20:31:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 -- start start 2024-04-26T20:31:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8569200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f85697d0 0x5635f856e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f8570dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5635f84cd380 con 0x5635f85697d0 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5635f8469c30 con 0x5635f8568de0 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.739+0000 7fea31a25740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5635f84c9340 con 0x5635f856e940 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f85697d0 0x5635f856e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f8570dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f85697d0 0x5635f856e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38734/0 (socket says 172.21.15.82:38734) 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27e00640 1 -- 172.21.15.82:0/2292443330 learned_addr learned my addr 172.21.15.82:0/2292443330 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8569200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea24c00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea0c0a3d80 0x7fea0c0a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27400640 1 -- 172.21.15.82:0/2292443330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 msgr2=0x5635f8569200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27400640 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8569200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27400640 1 -- 172.21.15.82:0/2292443330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f85697d0 msgr2=0x5635f856e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27400640 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f85697d0 0x5635f856e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.740+0000 7fea27400640 1 -- 172.21.15.82:0/2292443330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f848b940 con 0x5635f856e940 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.741+0000 7fea24c00640 1 -- 172.21.15.82:0/2580102496 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fea180f0fc0 con 0x7fea281049f0 2024-04-26T20:31:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.741+0000 7fea27400640 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f8570dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fea14009fd0 tx=0x7fea140118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd6d9b3d184da0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.741+0000 7fea2cc00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea0c0a3d80 0x7fea0c0a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.741+0000 7fea1d200640 1 -- 172.21.15.82:0/2292443330 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14004030 con 0x5635f856e940 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.741+0000 7fea1d200640 1 -- 172.21.15.82:0/2292443330 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea14005020 con 0x5635f856e940 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.741+0000 7fea1d200640 1 -- 172.21.15.82:0/2292443330 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14004c40 con 0x5635f856e940 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea2cc00640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea0c0a3d80 0x7fea0c0a6240 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea20009fd0 tx=0x7fea20004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 -- 172.21.15.82:0/2292443330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 msgr2=0x5635f8570dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f8570dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fea14009fd0 tx=0x7fea140118d0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 -- 172.21.15.82:0/2292443330 shutdown_connections 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f8570dd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f85697d0 0x5635f856e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 --2- 172.21.15.82:0/2292443330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8569200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 -- 172.21.15.82:0/2292443330 >> 172.21.15.82:0/2292443330 conn(0x5635f8564450 msgr2=0x5635f8564850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 -- 172.21.15.82:0/2292443330 shutdown_connections 2024-04-26T20:31:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.742+0000 7fea31a25740 1 -- 172.21.15.82:0/2292443330 wait complete. 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 -- start start 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 Processor -- start 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8573050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f8573590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f856e940 0x5635f857a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5635f85718f0 con 0x5635f856e940 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5635f8454c60 con 0x5635f8568de0 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5635f8571a70 con 0x5635f85697d0 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea31a25740 10 client.0 _ll_register_callbacks cb 0x5635f8480e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.743+0000 7fea27400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f8573590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f8573590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39136/0 (socket says 172.21.15.82:39136) 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 -- 172.21.15.82:0/1528340318 learned_addr learned my addr 172.21.15.82:0/1528340318 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27e00640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8573050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea2cc00640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f856e940 0x5635f857a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 -- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 msgr2=0x5635f8573050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8573050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 -- 172.21.15.82:0/1528340318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f856e940 msgr2=0x5635f857a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f856e940 0x5635f857a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 -- 172.21.15.82:0/1528340318 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f8463510 con 0x5635f85697d0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea2cc00640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f856e940 0x5635f857a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea27400640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f8573590 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fea1401b040 tx=0x7fea14004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa921f199429c606 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea11600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.744+0000 7fea11600640 1 -- 172.21.15.82:0/1528340318 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14028020 con 0x5635f85697d0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea11600640 1 -- 172.21.15.82:0/1528340318 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fea14016040 con 0x5635f85697d0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea14005020 con 0x5635f85697d0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea11600640 1 -- 172.21.15.82:0/1528340318 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fea14033050 con 0x5635f85697d0 2024-04-26T20:31:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 10 client.27118 fetch_fsmap learned FSMap version 53 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5635f81df210 con 0x5635f85697d0 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea11600640 1 -- 172.21.15.82:0/1528340318 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea14005020 con 0x5635f85697d0 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea11600640 1 -- 172.21.15.82:0/1528340318 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 53) ==== 8438+0+0 (secure 0 0 0) 0x7fea14003b00 con 0x5635f85697d0 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 10 client.27118 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 10 client.27118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 20 client.27118 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f857e970 0x5635f8580df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 4 client.27118 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:31:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.745+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635f84daf90 con 0x5635f857e970 2024-04-26T20:31:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.746+0000 7fea27e00640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f857e970 0x5635f8580df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.746+0000 7fea27e00640 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f857e970 0x5635f8580df0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799275f596b47e69 server_cookie=b359a375b6916745 in_seq=0 out_seq=0 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.746+0000 7fea11600640 10 client.27118 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea11600640 1 -- 172.21.15.82:0/1528340318 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5635f84daf90 con 0x5635f857e970 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea11600640 10 client.27118 handle_command_reply: tid=0 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 client.27118 shutdown 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 msgr2=0x5635f8573590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f8573590 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fea1401b040 tx=0x7fea14004270 comp rx=0 tx=0).stop 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 shutdown_connections 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f857e970 0x5635f8580df0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f856e940 0x5635f857a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f8573590 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea11600640 0 client.27118 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 --2- 172.21.15.82:0/1528340318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f8568de0 0x5635f8573050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.747+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 >> 172.21.15.82:0/1528340318 conn(0x5635f8564450 msgr2=0x5635f8563650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:37.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.748+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 shutdown_connections 2024-04-26T20:31:37.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.748+0000 7fea31a25740 1 -- 172.21.15.82:0/1528340318 wait complete. 2024-04-26T20:31:37.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.748+0000 7fea31a25740 20 client.27118 trim_cache size 0 max 16384 2024-04-26T20:31:37.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 Processor -- start 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 -- start start 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f85673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f857a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f856e940 0x5635f8567910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea281ad4b0 con 0x5635f8568de0 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea281af200 con 0x5635f856e940 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea31a25740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea281adc40 con 0x5635f85697d0 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f856e940 0x5635f8567910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea27400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f857a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f85673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea27400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f857a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39142/0 (socket says 172.21.15.82:39142) 2024-04-26T20:31:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f856e940 0x5635f8567910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:56244/0 (socket says 172.21.15.82:56244) 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.767+0000 7fea27400640 1 -- 172.21.15.82:0/2406302937 learned_addr learned my addr 172.21.15.82:0/2406302937 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea27400640 1 -- 172.21.15.82:0/2406302937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f856e940 msgr2=0x5635f8567910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea27400640 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f856e940 0x5635f8567910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea27400640 1 -- 172.21.15.82:0/2406302937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 msgr2=0x5635f85673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea27400640 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f85673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea27400640 1 -- 172.21.15.82:0/2406302937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f82ab620 con 0x5635f85697d0 2024-04-26T20:31:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea27400640 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f857a520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fea14011dd0 tx=0x7fea14009fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5241cc67729f6764 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea13e00640 1 -- 172.21.15.82:0/2406302937 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14028070 con 0x5635f85697d0 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea13e00640 1 -- 172.21.15.82:0/2406302937 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea14005000 con 0x5635f85697d0 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.768+0000 7fea13e00640 1 -- 172.21.15.82:0/2406302937 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1400fbd0 con 0x5635f85697d0 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 -- 172.21.15.82:0/2406302937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 msgr2=0x5635f857a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f857a520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fea14011dd0 tx=0x7fea14009fa0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 -- 172.21.15.82:0/2406302937 shutdown_connections 2024-04-26T20:31:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f856e940 0x5635f8567910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f85697d0 0x5635f857a520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 --2- 172.21.15.82:0/2406302937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f85673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 -- 172.21.15.82:0/2406302937 >> 172.21.15.82:0/2406302937 conn(0x5635f8564450 msgr2=0x5635f856aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 -- 172.21.15.82:0/2406302937 shutdown_connections 2024-04-26T20:31:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.769+0000 7fea31a25740 1 -- 172.21.15.82:0/2406302937 wait complete. 2024-04-26T20:31:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 -- start start 2024-04-26T20:31:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 Processor -- start 2024-04-26T20:31:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f8577240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f85697d0 0x5635f8577780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f85e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea281aeb30 con 0x5635f8568de0 2024-04-26T20:31:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea281ae3d0 con 0x5635f85697d0 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea281ab490 con 0x5635f856e940 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.770+0000 7fea31a25740 10 client.0 _ll_register_callbacks cb 0x7fea180f4940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f85e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f8577240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f85697d0 0x5635f8577780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f85e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:39148/0 (socket says 172.21.15.82:39148) 2024-04-26T20:31:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea2cc00640 1 -- 172.21.15.82:0/1424936480 learned_addr learned my addr 172.21.15.82:0/1424936480 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f8577240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38760/0 (socket says 172.21.15.82:38760) 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 -- 172.21.15.82:0/1424936480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 msgr2=0x5635f85e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f85e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 -- 172.21.15.82:0/1424936480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 msgr2=0x5635f8577240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f8577240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 -- 172.21.15.82:0/1424936480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f8487cb0 con 0x5635f85697d0 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea27400640 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f85697d0 0x5635f8577780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fea1400f660 tx=0x7fea140054e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1f555cbfbd4f4b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.771+0000 7fea11600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea11600640 1 -- 172.21.15.82:0/1424936480 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14028040 con 0x5635f85697d0 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea14005000 con 0x5635f85697d0 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea11600640 1 -- 172.21.15.82:0/1424936480 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fea14004b50 con 0x5635f85697d0 2024-04-26T20:31:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea11600640 1 -- 172.21.15.82:0/1424936480 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fea14005c10 con 0x5635f85697d0 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 10 client.27041 fetch_fsmap learned FSMap version 53 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5635f85e42c0 con 0x5635f85697d0 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea11600640 1 -- 172.21.15.82:0/1424936480 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea14005000 con 0x5635f85697d0 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea11600640 1 -- 172.21.15.82:0/1424936480 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) ==== 8438+0+0 (secure 0 0 0) 0x7fea14003880 con 0x5635f85697d0 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 10 client.27041 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 10 client.27041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 20 client.27041 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f85e4c90 0x5635f85e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 4 client.27041 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.772+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635f84d4e00 con 0x5635f85e4c90 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.773+0000 7fea27e00640 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f85e4c90 0x5635f85e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.773+0000 7fea11600640 10 client.27041 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.773+0000 7fea27e00640 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f85e4c90 0x5635f85e70b0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1fac81406e379a8 server_cookie=248c215dc5952650 in_seq=0 out_seq=0 2024-04-26T20:31:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea11600640 1 -- 172.21.15.82:0/1424936480 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635f84d4e00 con 0x5635f85e4c90 2024-04-26T20:31:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea11600640 10 client.27041 handle_command_reply: tid=0 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 client.27041 shutdown 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f85697d0 msgr2=0x5635f8577780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f85697d0 0x5635f8577780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fea1400f660 tx=0x7fea140054e0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 shutdown_connections 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5635f85e4c90 0x5635f85e70b0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635f856e940 0x5635f85e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635f85697d0 0x5635f8577780 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 --2- 172.21.15.82:0/1424936480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635f8568de0 0x5635f8577240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 >> 172.21.15.82:0/1424936480 conn(0x5635f8564450 msgr2=0x5635f85673d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.786+0000 7fea11600640 0 client.27041 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.787+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 shutdown_connections 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.787+0000 7fea31a25740 1 -- 172.21.15.82:0/1424936480 wait complete. 2024-04-26T20:31:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.787+0000 7fea31a25740 20 client.27041 trim_cache size 0 max 16384 2024-04-26T20:31:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:31:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:31:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:31:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea0c0a3d80 msgr2=0x7fea0c0a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea0c0a3d80 0x7fea0c0a6240 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea20009fd0 tx=0x7fea20004a40 comp rx=0 tx=0).stop 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 msgr2=0x7fea2819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 0x7fea2819ac30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fea18031500 tx=0x7fea18003c10 comp rx=0 tx=0).stop 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 shutdown_connections 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fea0c0a3d80 0x7fea0c0a6240 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea281065a0 0x7fea281a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea28105be0 0x7fea2819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 --2- 172.21.15.82:0/2580102496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea281049f0 0x7fea2819ac30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 >> 172.21.15.82:0/2580102496 conn(0x7fea280fff60 msgr2=0x7fea28108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.788+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 shutdown_connections 2024-04-26T20:31:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:37.789+0000 7fea2d600640 1 -- 172.21.15.82:0/2580102496 wait complete. 2024-04-26T20:31:39.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:38 smithi139 ceph-mon[32999]: pgmap v678: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 951 KiB/s wr, 287 op/s 2024-04-26T20:31:39.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:38 smithi135 ceph-mon[32816]: pgmap v678: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 951 KiB/s wr, 287 op/s 2024-04-26T20:31:39.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:38 smithi082 ceph-mon[28105]: pgmap v678: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 951 KiB/s wr, 287 op/s 2024-04-26T20:31:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:41 smithi139 ceph-mon[32999]: pgmap v679: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 324 op/s 2024-04-26T20:31:41.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:41 smithi135 ceph-mon[32816]: pgmap v679: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 324 op/s 2024-04-26T20:31:41.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:41 smithi082 ceph-mon[28105]: pgmap v679: 129 pgs: 129 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 324 op/s 2024-04-26T20:31:43.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:43 smithi139 ceph-mon[32999]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 319 op/s 2024-04-26T20:31:43.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:43 smithi135 ceph-mon[32816]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 319 op/s 2024-04-26T20:31:43.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:43 smithi082 ceph-mon[28105]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 319 op/s 2024-04-26T20:31:45.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:45 smithi139 ceph-mon[32999]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 301 op/s 2024-04-26T20:31:45.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:45 smithi135 ceph-mon[32816]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 301 op/s 2024-04-26T20:31:45.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:45 smithi082 ceph-mon[28105]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 301 op/s 2024-04-26T20:31:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:47 smithi139 ceph-mon[32999]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2024-04-26T20:31:47.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:47 smithi135 ceph-mon[32816]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2024-04-26T20:31:47.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:47 smithi082 ceph-mon[28105]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2024-04-26T20:31:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:49 smithi139 ceph-mon[32999]: pgmap v683: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 285 op/s 2024-04-26T20:31:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:49 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:49 smithi135 ceph-mon[32816]: pgmap v683: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 285 op/s 2024-04-26T20:31:49.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:49 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:49.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:49 smithi082 ceph-mon[28105]: pgmap v683: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 285 op/s 2024-04-26T20:31:49.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:49 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:50.822 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:31:50.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:50.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:50.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:31:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:50.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:31:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 -- 172.21.15.82:0/4121760630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d010a6a0 msgr2=0x7fd3d010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 --2- 172.21.15.82:0/4121760630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d010a6a0 0x7fd3d010cb30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009ca0 tx=0x7fd3c802a950 comp rx=0 tx=0).stop 2024-04-26T20:31:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 -- 172.21.15.82:0/4121760630 shutdown_connections 2024-04-26T20:31:50.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 --2- 172.21.15.82:0/4121760630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d010a6a0 0x7fd3d010cb30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 --2- 172.21.15.82:0/4121760630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d0075310 0x7fd3d0075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 --2- 172.21.15.82:0/4121760630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3d00768f0 0x7fd3d0074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 -- 172.21.15.82:0/4121760630 >> 172.21.15.82:0/4121760630 conn(0x7fd3d00fdd60 msgr2=0x7fd3d01001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.940+0000 7fd3d5200640 1 -- 172.21.15.82:0/4121760630 shutdown_connections 2024-04-26T20:31:50.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.941+0000 7fd3d5200640 1 -- 172.21.15.82:0/4121760630 wait complete. 2024-04-26T20:31:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.941+0000 7fd3d5200640 1 Processor -- start 2024-04-26T20:31:50.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 -- start start 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d0075310 0x7fd3d019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3d00768f0 0x7fd3d019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 0x7fd3d01a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0110580 con 0x7fd3d00768f0 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0110400 con 0x7fd3d0075310 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3d5200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0110700 con 0x7fd3d010a6a0 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3cfe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 0x7fd3d01a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3d00768f0 0x7fd3d019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3cfe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 0x7fd3d01a2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:38920/0 (socket says 172.21.15.82:38920) 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3cfe00640 1 -- 172.21.15.82:0/2857747750 learned_addr learned my addr 172.21.15.82:0/2857747750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.942+0000 7fd3cf400640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d0075310 0x7fd3d019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3cfe00640 1 -- 172.21.15.82:0/2857747750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d0075310 msgr2=0x7fd3d019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:50.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3cfe00640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d0075310 0x7fd3d019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3cfe00640 1 -- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3d00768f0 msgr2=0x7fd3d019b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3cfe00640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3d00768f0 0x7fd3d019b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3cfe00640 1 -- 172.21.15.82:0/2857747750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d01a27e0 con 0x7fd3d010a6a0 2024-04-26T20:31:50.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3cfe00640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 0x7fd3d01a2170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd3c802af40 tx=0x7fd3c802f5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.943+0000 7fd3ccc00640 1 -- 172.21.15.82:0/2857747750 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8034040 con 0x7fd3d010a6a0 2024-04-26T20:31:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.944+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d01a2a70 con 0x7fd3d010a6a0 2024-04-26T20:31:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.944+0000 7fd3ccc00640 1 -- 172.21.15.82:0/2857747750 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3c802fe20 con 0x7fd3d010a6a0 2024-04-26T20:31:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.944+0000 7fd3ccc00640 1 -- 172.21.15.82:0/2857747750 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80047c0 con 0x7fd3d010a6a0 2024-04-26T20:31:50.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.944+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d01a2fb0 con 0x7fd3d010a6a0 2024-04-26T20:31:50.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.947+0000 7fd3d95f4740 1 Processor -- start 2024-04-26T20:31:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.948+0000 7fd3ccc00640 1 -- 172.21.15.82:0/2857747750 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd3c8037020 con 0x7fd3d010a6a0 2024-04-26T20:31:50.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.948+0000 7fd3d95f4740 1 -- start start 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bacd9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacdeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacdf150 0x55a6bace15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a6bac35380 con 0x55a6bacdf150 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a6babd1c30 con 0x55a6bacd95f0 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a6bac31340 con 0x55a6bacd9fe0 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacdeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacdeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:38932/0 (socket says 172.21.15.82:38932) 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3cf400640 1 -- 172.21.15.82:0/4114231637 learned_addr learned my addr 172.21.15.82:0/4114231637 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bacd9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.949+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacdf150 0x55a6bace15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3cf400640 1 -- 172.21.15.82:0/4114231637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 msgr2=0x55a6bacd9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:50.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3cf400640 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bacd9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3cf400640 1 -- 172.21.15.82:0/4114231637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacdf150 msgr2=0x55a6bace15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:50.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3cf400640 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacdf150 0x55a6bace15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3cf400640 1 -- 172.21.15.82:0/4114231637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6babf3940 con 0x55a6bacd9fe0 2024-04-26T20:31:50.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bacd9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:31:50.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3cf400640 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacdeae0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009cf0 tx=0x7fd3c0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee49724076ee396 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3ccc00640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3b40a3cb0 0x7fd3b40a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.950+0000 7fd3c4c00640 1 -- 172.21.15.82:0/4114231637 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c001e070 con 0x55a6bacd9fe0 2024-04-26T20:31:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.951+0000 7fd3c4c00640 1 -- 172.21.15.82:0/4114231637 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3c0019ae0 con 0x55a6bacd9fe0 2024-04-26T20:31:50.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.951+0000 7fd3c4c00640 1 -- 172.21.15.82:0/4114231637 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000ea10 con 0x55a6bacd9fe0 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.951+0000 7fd3ccc00640 1 -- 172.21.15.82:0/2857747750 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd3c80f16d0 con 0x7fd3d010a6a0 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.951+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3b40a3cb0 0x7fd3b40a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.951+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4114231637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 msgr2=0x55a6bacdeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.951+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacdeae0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009cf0 tx=0x7fd3c0011810 comp rx=0 tx=0).stop 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4114231637 shutdown_connections 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacdf150 0x55a6bace15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacdeae0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3b40a3cb0 0x7fd3b40a6170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55a6bacda840 tx=0x7fd3b8004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4114231637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bacd9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4114231637 >> 172.21.15.82:0/4114231637 conn(0x55a6baccc450 msgr2=0x55a6baccc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4114231637 shutdown_connections 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4114231637 wait complete. 2024-04-26T20:31:50.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.952+0000 7fd3d95f4740 1 -- start start 2024-04-26T20:31:50.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 Processor -- start 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bace3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bace3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacdf150 0x55a6baceadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a6bace2100 con 0x55a6bacd9fe0 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a6babbcc60 con 0x55a6bacd95f0 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a6bace2280 con 0x55a6bacdf150 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.953+0000 7fd3d95f4740 10 client.0 _ll_register_callbacks cb 0x55a6babe8e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bace3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bace3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bace3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:44556/0 (socket says 172.21.15.82:44556) 2024-04-26T20:31:50.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 -- 172.21.15.82:0/2155654973 learned_addr learned my addr 172.21.15.82:0/2155654973 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cfe00640 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacdf150 0x55a6baceadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 -- 172.21.15.82:0/2155654973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacdf150 msgr2=0x55a6baceadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacdf150 0x55a6baceadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 -- 172.21.15.82:0/2155654973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 msgr2=0x55a6bace3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bace3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.954+0000 7fd3cf400640 1 -- 172.21.15.82:0/2155654973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6babcb510 con 0x55a6bacd95f0 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.955+0000 7fd3cf400640 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bace3840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00097b0 tx=0x7fd3c0009a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4973b80572d5f33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.955+0000 7fd3bd600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.955+0000 7fd3bd600640 1 -- 172.21.15.82:0/2155654973 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0027070 con 0x55a6bacd95f0 2024-04-26T20:31:50.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.955+0000 7fd3bd600640 1 -- 172.21.15.82:0/2155654973 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd3c0005040 con 0x55a6bacd95f0 2024-04-26T20:31:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.956+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3c0019ae0 con 0x55a6bacd95f0 2024-04-26T20:31:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.956+0000 7fd3bd600640 1 -- 172.21.15.82:0/2155654973 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd3c0031050 con 0x55a6bacd95f0 2024-04-26T20:31:50.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.956+0000 7fd3d95f4740 10 client.27053 fetch_fsmap learned FSMap version 53 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.956+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55a6ba947210 con 0x55a6bacd95f0 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3bd600640 1 -- 172.21.15.82:0/2155654973 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3c0019ae0 con 0x55a6bacd95f0 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3bd600640 1 -- 172.21.15.82:0/2155654973 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) ==== 8438+0+0 (secure 0 0 0) 0x7fd3c000ecf0 con 0x55a6bacd95f0 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3d95f4740 10 client.27053 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3d95f4740 10 client.27053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3d95f4740 20 client.27053 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacef150 0x55a6bacf1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3d95f4740 4 client.27053 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.957+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6bac42f90 con 0x55a6bacef150 2024-04-26T20:31:50.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.958+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacef150 0x55a6bacf1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.958+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacef150 0x55a6bacf1560 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f9ff7b8a002bf93 server_cookie=8b92a33ce1edc158 in_seq=0 out_seq=0 2024-04-26T20:31:50.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.958+0000 7fd3bd600640 10 client.27053 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:50.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.959+0000 7fd3bd600640 1 -- 172.21.15.82:0/2155654973 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a6bac42f90 con 0x55a6bacef150 2024-04-26T20:31:50.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.959+0000 7fd3bd600640 10 client.27053 handle_command_reply: tid=0 2024-04-26T20:31:50.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.959+0000 7fd3d95f4740 1 client.27053 shutdown 2024-04-26T20:31:50.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 msgr2=0x55a6bace3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:50.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bace3840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00097b0 tx=0x7fd3c0009a70 comp rx=0 tx=0).stop 2024-04-26T20:31:50.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 shutdown_connections 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacef150 0x55a6bacf1560 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacdf150 0x55a6baceadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bace3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/2155654973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacd95f0 0x55a6bace3840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3bd600640 0 client.27053 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.960+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 >> 172.21.15.82:0/2155654973 conn(0x55a6baccc450 msgr2=0x55a6baccb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.961+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 shutdown_connections 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.961+0000 7fd3d95f4740 1 -- 172.21.15.82:0/2155654973 wait complete. 2024-04-26T20:31:50.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.961+0000 7fd3d95f4740 20 client.27053 trim_cache size 0 max 16384 2024-04-26T20:31:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.992+0000 7fd3d95f4740 1 Processor -- start 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 -- start start 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd95f0 0x55a6baccf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01a90a0 con 0x55a6bacd9fe0 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01aadf0 con 0x55a6bacdf150 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.993+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01a9830 con 0x55a6bacd95f0 2024-04-26T20:31:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.994+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.994+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd95f0 0x55a6baccf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.994+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52216/0 (socket says 172.21.15.82:52216) 2024-04-26T20:31:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.994+0000 7fd3c7e00640 1 -- 172.21.15.82:0/4040187089 learned_addr learned my addr 172.21.15.82:0/4040187089 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.995+0000 7fd3cfe00640 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.995+0000 7fd3cf400640 1 -- 172.21.15.82:0/4040187089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 msgr2=0x55a6bace2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.995+0000 7fd3cf400640 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.995+0000 7fd3cf400640 1 -- 172.21.15.82:0/4040187089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 msgr2=0x55a6bacead50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.995+0000 7fd3cf400640 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.995+0000 7fd3cf400640 1 -- 172.21.15.82:0/4040187089 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6baa13620 con 0x55a6bacd95f0 2024-04-26T20:31:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.996+0000 7fd3cf400640 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd95f0 0x55a6baccf980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0001eb0 tx=0x7fd3c0011d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c83a6c17c65941c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.997+0000 7fd3bfe00640 1 -- 172.21.15.82:0/4040187089 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0027040 con 0x55a6bacd95f0 2024-04-26T20:31:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.997+0000 7fd3bfe00640 1 -- 172.21.15.82:0/4040187089 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3c00044f0 con 0x55a6bacd95f0 2024-04-26T20:31:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.997+0000 7fd3bfe00640 1 -- 172.21.15.82:0/4040187089 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c001e040 con 0x55a6bacd95f0 2024-04-26T20:31:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.999+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4040187089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd95f0 msgr2=0x55a6baccf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:50.999+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd95f0 0x55a6baccf980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0001eb0 tx=0x7fd3c0011d10 comp rx=0 tx=0).stop 2024-04-26T20:31:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.000+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4040187089 shutdown_connections 2024-04-26T20:31:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.000+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.000+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.000+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/4040187089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd95f0 0x55a6baccf980 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.000+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4040187089 >> 172.21.15.82:0/4040187089 conn(0x55a6baccc450 msgr2=0x55a6baccf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.001+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4040187089 shutdown_connections 2024-04-26T20:31:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.001+0000 7fd3d95f4740 1 -- 172.21.15.82:0/4040187089 wait complete. 2024-04-26T20:31:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.002+0000 7fd3d95f4740 1 -- start start 2024-04-26T20:31:51.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.003+0000 7fd3d95f4740 1 Processor -- start 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd95f0 0x55a6bace58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01aa720 con 0x55a6bacd95f0 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01a9fc0 con 0x55a6bacdf150 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d01a7080 con 0x55a6bacd9fe0 2024-04-26T20:31:51.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.004+0000 7fd3d95f4740 10 client.0 _ll_register_callbacks cb 0x7fd3c001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:31:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.005+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:51.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.005+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:38972/0 (socket says 172.21.15.82:38972) 2024-04-26T20:31:51.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.005+0000 7fd3cfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:51.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.007+0000 7fd3c7e00640 1 -- 172.21.15.82:0/3947591271 learned_addr learned my addr 172.21.15.82:0/3947591271 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:31:51.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.005+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd95f0 0x55a6bace58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:51.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.007+0000 7fd3c7e00640 1 -- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 msgr2=0x55a6bace5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:51.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.007+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.007+0000 7fd3c7e00640 1 -- 172.21.15.82:0/3947591271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd95f0 msgr2=0x55a6bace58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:31:51.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.007+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd95f0 0x55a6bace58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.007+0000 7fd3c7e00640 1 -- 172.21.15.82:0/3947591271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6babefcb0 con 0x55a6bacd9fe0 2024-04-26T20:31:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.009+0000 7fd3c7e00640 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8004530 tx=0x7fd3b8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59adb847d1857f66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:31:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.009+0000 7fd3bd600640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:31:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.012+0000 7fd3bd600640 1 -- 172.21.15.82:0/3947591271 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8030030 con 0x55a6bacd9fe0 2024-04-26T20:31:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.012+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3c00044f0 con 0x55a6bacd9fe0 2024-04-26T20:31:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.013+0000 7fd3bd600640 1 -- 172.21.15.82:0/3947591271 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd3b802c5c0 con 0x55a6bacd9fe0 2024-04-26T20:31:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.013+0000 7fd3bd600640 1 -- 172.21.15.82:0/3947591271 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd3b803d050 con 0x55a6bacd9fe0 2024-04-26T20:31:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.013+0000 7fd3d95f4740 10 client.27142 fetch_fsmap learned FSMap version 53 2024-04-26T20:31:51.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.013+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55a6bacd3da0 con 0x55a6bacd9fe0 2024-04-26T20:31:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.013+0000 7fd3bd600640 1 -- 172.21.15.82:0/3947591271 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3c00044f0 con 0x55a6bacd9fe0 2024-04-26T20:31:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.014+0000 7fd3bd600640 1 -- 172.21.15.82:0/3947591271 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 53) ==== 8438+0+0 (secure 0 0 0) 0x7fd3b8035410 con 0x55a6bacd9fe0 2024-04-26T20:31:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.015+0000 7fd3d95f4740 10 client.27142 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T20:31:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.015+0000 7fd3d95f4740 10 client.27142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:31:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.015+0000 7fd3d95f4740 20 client.27142 populate_metadata read hostname 'smithi082' 2024-04-26T20:31:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.015+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacd4830 0x55a6bacd6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:31:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.015+0000 7fd3d95f4740 4 client.27142 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:31:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.015+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a6bac3ce00 con 0x55a6bacd4830 2024-04-26T20:31:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.017+0000 7fd3cf400640 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacd4830 0x55a6bacd6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:31:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.017+0000 7fd3cf400640 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacd4830 0x55a6bacd6c50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a4180247bb9eba server_cookie=e18d7a3598726d76 in_seq=0 out_seq=0 2024-04-26T20:31:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.017+0000 7fd3bd600640 10 client.27142 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:51.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.056+0000 7fd3bd600640 1 -- 172.21.15.82:0/3947591271 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a6bac3ce00 con 0x55a6bacd4830 2024-04-26T20:31:51.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.056+0000 7fd3bd600640 10 client.27142 handle_command_reply: tid=0 2024-04-26T20:31:51.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.056+0000 7fd3d95f4740 1 client.27142 shutdown 2024-04-26T20:31:51.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.056+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 msgr2=0x55a6bacead90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:51.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.056+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8004530 tx=0x7fd3b8005f90 comp rx=0 tx=0).stop 2024-04-26T20:31:51.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 shutdown_connections 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55a6bacd4830 0x55a6bacd6c50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6bacdf150 0x55a6bace5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6bacd9fe0 0x55a6bacead90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3d95f4740 1 --2- 172.21.15.82:0/3947591271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6bacd95f0 0x55a6bace58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3bd600640 0 client.27142 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.057+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 >> 172.21.15.82:0/3947591271 conn(0x55a6baccc450 msgr2=0x55a6baccfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.058+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 shutdown_connections 2024-04-26T20:31:51.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.058+0000 7fd3d95f4740 1 -- 172.21.15.82:0/3947591271 wait complete. 2024-04-26T20:31:51.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.058+0000 7fd3d95f4740 20 client.27142 trim_cache size 0 max 16384 2024-04-26T20:31:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:31:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:31:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:31:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:31:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3b40a3cb0 msgr2=0x7fd3b40a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3b40a3cb0 0x7fd3b40a6170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55a6bacda840 tx=0x7fd3b8004730 comp rx=0 tx=0).stop 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 msgr2=0x7fd3d01a2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 0x7fd3d01a2170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd3c802af40 tx=0x7fd3c802f5d0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 shutdown_connections 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fd3b40a3cb0 0x7fd3b40a6170 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3d010a6a0 0x7fd3d01a2170 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3d00768f0 0x7fd3d019b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 --2- 172.21.15.82:0/2857747750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3d0075310 0x7fd3d019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.061+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 >> 172.21.15.82:0/2857747750 conn(0x7fd3d00fdd60 msgr2=0x7fd3d0106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:31:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.062+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 shutdown_connections 2024-04-26T20:31:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:31:51.063+0000 7fd3d5200640 1 -- 172.21.15.82:0/2857747750 wait complete. 2024-04-26T20:31:51.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:51 smithi139 ceph-mon[32999]: pgmap v684: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-04-26T20:31:51.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:51 smithi135 ceph-mon[32816]: pgmap v684: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-04-26T20:31:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:51 smithi082 ceph-mon[28105]: pgmap v684: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-04-26T20:31:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:52 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:52.868 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:52 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:52.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:52 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:31:53.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:53 smithi139 ceph-mon[32999]: pgmap v685: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 735 KiB/s wr, 291 op/s 2024-04-26T20:31:53.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:53 smithi135 ceph-mon[32816]: pgmap v685: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 735 KiB/s wr, 291 op/s 2024-04-26T20:31:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:53 smithi082 ceph-mon[28105]: pgmap v685: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 735 KiB/s wr, 291 op/s 2024-04-26T20:31:55.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:55 smithi139 ceph-mon[32999]: pgmap v686: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 282 op/s 2024-04-26T20:31:55.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:55 smithi135 ceph-mon[32816]: pgmap v686: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 282 op/s 2024-04-26T20:31:55.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:55 smithi082 ceph-mon[28105]: pgmap v686: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 282 op/s 2024-04-26T20:31:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:57 smithi139 ceph-mon[32999]: pgmap v687: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-04-26T20:31:57.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:57 smithi135 ceph-mon[32816]: pgmap v687: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-04-26T20:31:57.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:57 smithi082 ceph-mon[28105]: pgmap v687: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-04-26T20:31:59.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:31:59 smithi139 ceph-mon[32999]: pgmap v688: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 817 KiB/s wr, 247 op/s 2024-04-26T20:31:59.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:31:59 smithi135 ceph-mon[32816]: pgmap v688: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 817 KiB/s wr, 247 op/s 2024-04-26T20:31:59.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:31:59 smithi082 ceph-mon[28105]: pgmap v688: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 817 KiB/s wr, 247 op/s 2024-04-26T20:32:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:01 smithi139 ceph-mon[32999]: pgmap v689: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 286 op/s 2024-04-26T20:32:01.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:01 smithi135 ceph-mon[32816]: pgmap v689: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 286 op/s 2024-04-26T20:32:01.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:01 smithi082 ceph-mon[28105]: pgmap v689: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 286 op/s 2024-04-26T20:32:03.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:03 smithi139 ceph-mon[32999]: pgmap v690: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 284 op/s 2024-04-26T20:32:03.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:03 smithi135 ceph-mon[32816]: pgmap v690: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 284 op/s 2024-04-26T20:32:03.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:03 smithi082 ceph-mon[28105]: pgmap v690: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 284 op/s 2024-04-26T20:32:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 -- 172.21.15.82:0/1893958490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c10a680 msgr2=0x7f100c10cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 --2- 172.21.15.82:0/1893958490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c10a680 0x7f100c10cb20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1004009ca0 tx=0x7f100402a950 comp rx=0 tx=0).stop 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 -- 172.21.15.82:0/1893958490 shutdown_connections 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 --2- 172.21.15.82:0/1893958490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c10a680 0x7f100c10cb20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 --2- 172.21.15.82:0/1893958490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c075790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 --2- 172.21.15.82:0/1893958490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c076910 0x7f100c074d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 -- 172.21.15.82:0/1893958490 >> 172.21.15.82:0/1893958490 conn(0x7f100c0fdd60 msgr2=0x7f100c1001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.218+0000 7f100be00640 1 -- 172.21.15.82:0/1893958490 shutdown_connections 2024-04-26T20:32:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.219+0000 7f100be00640 1 -- 172.21.15.82:0/1893958490 wait complete. 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 Processor -- start 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 -- start start 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c076910 0x7f100c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c10a680 0x7f100c1a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f100c110550 con 0x7f100c10a680 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1103d0 con 0x7f100c075330 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1106d0 con 0x7f100c076910 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100a000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c076910 0x7f100c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52676/0 (socket says 172.21.15.82:52676) 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100a000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c076910 0x7f100c19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48826/0 (socket says 172.21.15.82:48826) 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.220+0000 7f100aa00640 1 -- 172.21.15.82:0/1083223825 learned_addr learned my addr 172.21.15.82:0/1083223825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100b400640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c10a680 0x7f100c1a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100aa00640 1 -- 172.21.15.82:0/1083223825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c076910 msgr2=0x7f100c19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100aa00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c076910 0x7f100c19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100aa00640 1 -- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c10a680 msgr2=0x7f100c1a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100aa00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c10a680 0x7f100c1a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100aa00640 1 -- 172.21.15.82:0/1083223825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c1a27b0 con 0x7f100c075330 2024-04-26T20:32:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.221+0000 7f100aa00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c19ab90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e9f0 tx=0x7f0ffc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.222+0000 7f1010a00640 1 -- 172.21.15.82:0/1083223825 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00cd80 con 0x7f100c075330 2024-04-26T20:32:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.222+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c1a2aa0 con 0x7f100c075330 2024-04-26T20:32:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.222+0000 7f1010a00640 1 -- 172.21.15.82:0/1083223825 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc0108e0 con 0x7f100c075330 2024-04-26T20:32:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.222+0000 7f1010a00640 1 -- 172.21.15.82:0/1083223825 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc018980 con 0x7f100c075330 2024-04-26T20:32:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.222+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c1a3040 con 0x7f100c075330 2024-04-26T20:32:04.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 Processor -- start 2024-04-26T20:32:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 -- start start 2024-04-26T20:32:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf74de0 0x55fcfaf75200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1010a00640 1 -- 172.21.15.82:0/1083223825 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0ffc010430 con 0x7f100c075330 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf7cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fcfaed9380 con 0x55fcfaf74de0 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fcfae75c30 con 0x55fcfaf757d0 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.227+0000 7f1014c72740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fcfaed5340 con 0x55fcfaf7a940 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52690/0 (socket says 172.21.15.82:52690) 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 -- 172.21.15.82:0/3554777519 learned_addr learned my addr 172.21.15.82:0/3554777519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100a000640 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf7cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 -- 172.21.15.82:0/3554777519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 msgr2=0x55fcfaf7cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf7cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 -- 172.21.15.82:0/3554777519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf74de0 msgr2=0x55fcfaf75200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf74de0 0x55fcfaf75200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100aa00640 1 -- 172.21.15.82:0/3554777519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcfae97940 con 0x55fcfaf757d0 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.228+0000 7f100a000640 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf7cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f100aa00640 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7a2d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0d4d80 tx=0x7f0ffc0d96d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1906c0e0b0a73f5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f0ff7e00640 1 -- 172.21.15.82:0/3554777519 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0e0020 con 0x55fcfaf757d0 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f0ff7e00640 1 -- 172.21.15.82:0/3554777519 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc0dcb30 con 0x55fcfaf757d0 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f0ff7e00640 1 -- 172.21.15.82:0/3554777519 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0dbb30 con 0x55fcfaf757d0 2024-04-26T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f1010a00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ff00a3cb0 0x7f0ff00a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f1010a00640 1 -- 172.21.15.82:0/1083223825 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f0ffc0d0c10 con 0x7f100c075330 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.229+0000 7f100b400640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ff00a3cb0 0x7f0ff00a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 -- 172.21.15.82:0/3554777519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 msgr2=0x55fcfaf7a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7a2d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0d4d80 tx=0x7f0ffc0d96d0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 -- 172.21.15.82:0/3554777519 shutdown_connections 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf7cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7a2d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 --2- 172.21.15.82:0/3554777519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf74de0 0x55fcfaf75200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.230+0000 7f1014c72740 1 -- 172.21.15.82:0/3554777519 >> 172.21.15.82:0/3554777519 conn(0x55fcfaf70450 msgr2=0x55fcfaf70850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.231+0000 7f1014c72740 1 -- 172.21.15.82:0/3554777519 shutdown_connections 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.231+0000 7f100b400640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ff00a3cb0 0x7f0ff00a6170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1004006010 tx=0x7f1004009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.231+0000 7f1014c72740 1 -- 172.21.15.82:0/3554777519 wait complete. 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.231+0000 7f1014c72740 1 -- start start 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 Processor -- start 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf7f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf865a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fcfaf7d8f0 con 0x55fcfaf757d0 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fcfae60c60 con 0x55fcfaf74de0 2024-04-26T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fcfaf7da70 con 0x55fcfaf7a940 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.232+0000 7f1014c72740 10 client.0 _ll_register_callbacks cb 0x55fcfae8ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf7f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf7f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52704/0 (socket says 172.21.15.82:52704) 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 -- 172.21.15.82:0/4288914281 learned_addr learned my addr 172.21.15.82:0/4288914281 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100b400640 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf865a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 -- 172.21.15.82:0/4288914281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 msgr2=0x55fcfaf865a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf865a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 -- 172.21.15.82:0/4288914281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 msgr2=0x55fcfaf7f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 -- 172.21.15.82:0/4288914281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcfae6f510 con 0x55fcfaf74de0 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f100aa00640 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf7f020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c6a0 tx=0x7f0ffc018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c24a886ecd5f5339 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.233+0000 7f0ff4c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f0ff4c00640 1 -- 172.21.15.82:0/4288914281 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0e0070 con 0x55fcfaf74de0 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f0ff4c00640 1 -- 172.21.15.82:0/4288914281 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f0ffc0990f0 con 0x55fcfaf74de0 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc0dcb30 con 0x55fcfaf74de0 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f0ff4c00640 1 -- 172.21.15.82:0/4288914281 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc098d20 con 0x55fcfaf74de0 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f1014c72740 10 client.27071 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55fcfabeb210 con 0x55fcfaf74de0 2024-04-26T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.234+0000 7f0ff4c00640 1 -- 172.21.15.82:0/4288914281 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc0dcb30 con 0x55fcfaf74de0 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f0ff4c00640 1 -- 172.21.15.82:0/4288914281 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f0ffc0ce450 con 0x55fcfaf74de0 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f1014c72740 10 client.27071 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f1014c72740 10 client.27071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f1014c72740 20 client.27071 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f1014c72740 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaf8a700 0x55fcfaf8caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f1014c72740 4 client.27071 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcfaee6f90 con 0x55fcfaf8a700 2024-04-26T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.235+0000 7f100a000640 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaf8a700 0x55fcfaf8caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.236+0000 7f100a000640 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaf8a700 0x55fcfaf8caf0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f98540ab50b653f server_cookie=a9a704848199d703 in_seq=0 out_seq=0 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.236+0000 7f0ff4c00640 10 client.27071 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.236+0000 7f0ff4c00640 1 -- 172.21.15.82:0/4288914281 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fcfaee6f90 con 0x55fcfaf8a700 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.236+0000 7f0ff4c00640 10 client.27071 handle_command_reply: tid=0 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 client.27071 shutdown 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 msgr2=0x55fcfaf7f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf7f020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c6a0 tx=0x7f0ffc018420 comp rx=0 tx=0).stop 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 shutdown_connections 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaf8a700 0x55fcfaf8caf0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf865a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf7f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 --2- 172.21.15.82:0/4288914281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf7f020 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f0ff4c00640 0 client.27071 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 >> 172.21.15.82:0/4288914281 conn(0x55fcfaf70450 msgr2=0x55fcfaf6f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 shutdown_connections 2024-04-26T20:32:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.237+0000 7f1014c72740 1 -- 172.21.15.82:0/4288914281 wait complete. 2024-04-26T20:32:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.238+0000 7f1014c72740 20 client.27071 trim_cache size 0 max 16384 2024-04-26T20:32:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 Processor -- start 2024-04-26T20:32:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 -- start start 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf92280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf927c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf86530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1ad4d0 con 0x55fcfaf757d0 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1af250 con 0x55fcfaf74de0 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.256+0000 7f1014c72740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1adc60 con 0x55fcfaf7a940 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf86530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf86530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48864/0 (socket says 172.21.15.82:48864) 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 -- 172.21.15.82:0/155046435 learned_addr learned my addr 172.21.15.82:0/155046435 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100a000640 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100aa00640 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf92280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 -- 172.21.15.82:0/155046435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 msgr2=0x55fcfaf92280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf92280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 -- 172.21.15.82:0/155046435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 msgr2=0x55fcfaf927c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf927c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 -- 172.21.15.82:0/155046435 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcfacb7620 con 0x55fcfaf7a940 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100aa00640 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf92280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.257+0000 7f100b400640 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf86530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f100402f7a0 tx=0x7f100403f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69f596814d37cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.258+0000 7f0ff7400640 1 -- 172.21.15.82:0/155046435 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004034040 con 0x55fcfaf7a940 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.258+0000 7f0ff7400640 1 -- 172.21.15.82:0/155046435 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1004004040 con 0x55fcfaf7a940 2024-04-26T20:32:04.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.258+0000 7f0ff7400640 1 -- 172.21.15.82:0/155046435 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10040306a0 con 0x55fcfaf7a940 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 -- 172.21.15.82:0/155046435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 msgr2=0x55fcfaf86530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf86530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f100402f7a0 tx=0x7f100403f000 comp rx=0 tx=0).stop 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 -- 172.21.15.82:0/155046435 shutdown_connections 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf7a940 0x55fcfaf86530 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf927c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 --2- 172.21.15.82:0/155046435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf74de0 0x55fcfaf92280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 -- 172.21.15.82:0/155046435 >> 172.21.15.82:0/155046435 conn(0x55fcfaf70450 msgr2=0x55fcfaf73400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:04.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 -- 172.21.15.82:0/155046435 shutdown_connections 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 -- 172.21.15.82:0/155046435 wait complete. 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 -- start start 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.259+0000 7f1014c72740 1 Processor -- start 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 0x55fcfaf84140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf84680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf7a940 0x55fcfaf85640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1aeb80 con 0x55fcfaf757d0 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1ae3f0 con 0x55fcfaf7a940 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1ab4b0 con 0x55fcfaf74de0 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f1014c72740 10 client.0 _ll_register_callbacks cb 0x7f0ff80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 0x55fcfaf84140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf84680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 0x55fcfaf84140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:48874/0 (socket says 172.21.15.82:48874) 2024-04-26T20:32:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 -- 172.21.15.82:0/1493230563 learned_addr learned my addr 172.21.15.82:0/1493230563 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100b400640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf7a940 0x55fcfaf85640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 -- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf7a940 msgr2=0x55fcfaf85640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf7a940 0x55fcfaf85640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 -- 172.21.15.82:0/1493230563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 msgr2=0x55fcfaf84680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf84680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100aa00640 1 -- 172.21.15.82:0/1493230563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcfae93cb0 con 0x55fcfaf74de0 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100b400640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf7a940 0x55fcfaf85640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.260+0000 7f100a000640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf84680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f100aa00640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 0x55fcfaf84140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc09cbc0 tx=0x7f0ffc0d96d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81acaaa6573e968a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f0ff4c00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f0ff4c00640 1 -- 172.21.15.82:0/1493230563 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0e0070 con 0x55fcfaf74de0 2024-04-26T20:32:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1004004040 con 0x55fcfaf74de0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f0ff4c00640 1 -- 172.21.15.82:0/1493230563 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f0ffc0a51b0 con 0x55fcfaf74de0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f0ff4c00640 1 -- 172.21.15.82:0/1493230563 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc09c3e0 con 0x55fcfaf74de0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f1014c72740 10 client.27160 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.261+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55fcfaff0d90 con 0x55fcfaf74de0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f0ff4c00640 1 -- 172.21.15.82:0/1493230563 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1004004040 con 0x55fcfaf74de0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f0ff4c00640 1 -- 172.21.15.82:0/1493230563 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f0ffc09cce0 con 0x55fcfaf74de0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f1014c72740 10 client.27160 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f1014c72740 10 client.27160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f1014c72740 20 client.27160 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f1014c72740 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaff15c0 0x55fcfaff39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f1014c72740 4 client.27160 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fcfaee0e00 con 0x55fcfaff15c0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.262+0000 7f100a000640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaff15c0 0x55fcfaff39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:04.267 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.263+0000 7f100a000640 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaff15c0 0x55fcfaff39e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de71bf3d81c134f0 server_cookie=45910060cf1ccb59 in_seq=0 out_seq=0 2024-04-26T20:32:04.268 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:04.263+0000 7f0ff4c00640 10 client.27160 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:05.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:05 smithi139 ceph-mon[32999]: pgmap v691: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 273 op/s 2024-04-26T20:32:05.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:05 smithi135 ceph-mon[32816]: pgmap v691: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 273 op/s 2024-04-26T20:32:05.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:05 smithi082 ceph-mon[28105]: pgmap v691: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 273 op/s 2024-04-26T20:32:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:07 smithi139 ceph-mon[32999]: pgmap v692: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 839 KiB/s wr, 475 op/s 2024-04-26T20:32:07.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:07 smithi135 ceph-mon[32816]: pgmap v692: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 839 KiB/s wr, 475 op/s 2024-04-26T20:32:07.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:07 smithi082 ceph-mon[28105]: pgmap v692: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 839 KiB/s wr, 475 op/s 2024-04-26T20:32:09.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:09 smithi139 ceph-mon[32999]: pgmap v693: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 871 KiB/s wr, 809 op/s 2024-04-26T20:32:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.330+0000 7f0ff4c00640 1 -- 172.21.15.82:0/1493230563 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fcfaee0e00 con 0x55fcfaff15c0 2024-04-26T20:32:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.330+0000 7f0ff4c00640 10 client.27160 handle_command_reply: tid=0 2024-04-26T20:32:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.330+0000 7f1014c72740 1 client.27160 shutdown 2024-04-26T20:32:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.330+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 msgr2=0x55fcfaf84140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.330+0000 7f1014c72740 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 0x55fcfaf84140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc09cbc0 tx=0x7f0ffc0d96d0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 shutdown_connections 2024-04-26T20:32:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55fcfaff15c0 0x55fcfaff39e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fcfaf7a940 0x55fcfaf85640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcfaf757d0 0x55fcfaf84680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 --2- 172.21.15.82:0/1493230563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fcfaf74de0 0x55fcfaf84140 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f0ff4c00640 0 client.27160 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 >> 172.21.15.82:0/1493230563 conn(0x55fcfaf70450 msgr2=0x55fcfaf7ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.331+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 shutdown_connections 2024-04-26T20:32:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.332+0000 7f1014c72740 1 -- 172.21.15.82:0/1493230563 wait complete. 2024-04-26T20:32:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.332+0000 7f1014c72740 20 client.27160 trim_cache size 0 max 16384 2024-04-26T20:32:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:32:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:32:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:32:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:32:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.333+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ff00a3cb0 msgr2=0x7f0ff00a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.333+0000 7f100be00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ff00a3cb0 0x7f0ff00a6170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1004006010 tx=0x7f1004009800 comp rx=0 tx=0).stop 2024-04-26T20:32:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.333+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 msgr2=0x7f100c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.333+0000 7f100be00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c19ab90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e9f0 tx=0x7f0ffc00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.334+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 shutdown_connections 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.334+0000 7f100be00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ff00a3cb0 0x7f0ff00a6170 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.334+0000 7f100be00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c10a680 0x7f100c1a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.334+0000 7f100be00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f100c076910 0x7f100c19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.334+0000 7f100be00640 1 --2- 172.21.15.82:0/1083223825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100c075330 0x7f100c19ab90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.334+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 >> 172.21.15.82:0/1083223825 conn(0x7f100c0fdd60 msgr2=0x7f100c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.335+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 shutdown_connections 2024-04-26T20:32:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:09.335+0000 7f100be00640 1 -- 172.21.15.82:0/1083223825 wait complete. 2024-04-26T20:32:09.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:09 smithi135 ceph-mon[32816]: pgmap v693: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 871 KiB/s wr, 809 op/s 2024-04-26T20:32:09.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:09 smithi082 ceph-mon[28105]: pgmap v693: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 871 KiB/s wr, 809 op/s 2024-04-26T20:32:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:11 smithi139 ceph-mon[32999]: pgmap v694: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.0 MiB/s wr, 1.63k op/s 2024-04-26T20:32:11.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:11 smithi135 ceph-mon[32816]: pgmap v694: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.0 MiB/s wr, 1.63k op/s 2024-04-26T20:32:11.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:11 smithi082 ceph-mon[28105]: pgmap v694: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.0 MiB/s wr, 1.63k op/s 2024-04-26T20:32:13.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:13 smithi139 ceph-mon[32999]: pgmap v695: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 776 KiB/s wr, 1.91k op/s 2024-04-26T20:32:13.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:13 smithi135 ceph-mon[32816]: pgmap v695: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 776 KiB/s wr, 1.91k op/s 2024-04-26T20:32:13.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:13 smithi082 ceph-mon[28105]: pgmap v695: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 776 KiB/s wr, 1.91k op/s 2024-04-26T20:32:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:15 smithi139 ceph-mon[32999]: pgmap v696: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 624 KiB/s wr, 1.90k op/s 2024-04-26T20:32:15.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:15 smithi135 ceph-mon[32816]: pgmap v696: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 624 KiB/s wr, 1.90k op/s 2024-04-26T20:32:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:15 smithi082 ceph-mon[28105]: pgmap v696: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 624 KiB/s wr, 1.90k op/s 2024-04-26T20:32:17.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:17 smithi139 ceph-mon[32999]: pgmap v697: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.2 MiB/s wr, 1.92k op/s 2024-04-26T20:32:17.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:17 smithi135 ceph-mon[32816]: pgmap v697: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.2 MiB/s wr, 1.92k op/s 2024-04-26T20:32:17.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:17 smithi082 ceph-mon[28105]: pgmap v697: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.2 MiB/s wr, 1.92k op/s 2024-04-26T20:32:19.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:19 smithi139 ceph-mon[32999]: pgmap v698: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 1.0 MiB/s wr, 1.70k op/s 2024-04-26T20:32:19.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:19 smithi135 ceph-mon[32816]: pgmap v698: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 1.0 MiB/s wr, 1.70k op/s 2024-04-26T20:32:19.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:19 smithi082 ceph-mon[28105]: pgmap v698: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 1.0 MiB/s wr, 1.70k op/s 2024-04-26T20:32:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:21 smithi139 ceph-mon[32999]: pgmap v699: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 888 KiB/s wr, 1.38k op/s 2024-04-26T20:32:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:21 smithi135 ceph-mon[32816]: pgmap v699: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 888 KiB/s wr, 1.38k op/s 2024-04-26T20:32:21.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:21 smithi082 ceph-mon[28105]: pgmap v699: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 888 KiB/s wr, 1.38k op/s 2024-04-26T20:32:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 -- 172.21.15.82:0/1147093887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 msgr2=0x7f8dc410add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/1147093887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc410add0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009ca0 tx=0x7f8dbc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 -- 172.21.15.82:0/1147093887 shutdown_connections 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/1147093887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc410add0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/1147093887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4103b80 0x7f8dc4104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/1147093887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102990 0x7f8dc4102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.484+0000 7f8dc9c00640 1 -- 172.21.15.82:0/1147093887 >> 172.21.15.82:0/1147093887 conn(0x7f8dc40fdf20 msgr2=0x7f8dc4100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.485+0000 7f8dc9c00640 1 -- 172.21.15.82:0/1147093887 shutdown_connections 2024-04-26T20:32:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.485+0000 7f8dc9c00640 1 -- 172.21.15.82:0/1147093887 wait complete. 2024-04-26T20:32:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.485+0000 7f8dc9c00640 1 Processor -- start 2024-04-26T20:32:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 -- start start 2024-04-26T20:32:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 0x7f8dc419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 0x7f8dc419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc41a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4075030 con 0x7f8dc4103b80 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4074eb0 con 0x7f8dc4102990 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc9c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40751b0 con 0x7f8dc4104540 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 0x7f8dc419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 0x7f8dc419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 0x7f8dc419b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43800/0 (socket says 172.21.15.82:43800) 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dbbe00640 1 -- 172.21.15.82:0/3309178047 learned_addr learned my addr 172.21.15.82:0/3309178047 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.486+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 0x7f8dc419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55162/0 (socket says 172.21.15.82:55162) 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dc3400640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc41a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbbe00640 1 -- 172.21.15.82:0/3309178047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 msgr2=0x7f8dc41a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc41a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbbe00640 1 -- 172.21.15.82:0/3309178047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 msgr2=0x7f8dc419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 0x7f8dc419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbbe00640 1 -- 172.21.15.82:0/3309178047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc41a28c0 con 0x7f8dc4103b80 2024-04-26T20:32:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dc3400640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc41a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 0x7f8dc419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 0x7f8dc419b1c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00e9f0 tx=0x7f8dac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbb400640 1 -- 172.21.15.82:0/3309178047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00cd80 con 0x7f8dc4103b80 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbb400640 1 -- 172.21.15.82:0/3309178047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dac0108e0 con 0x7f8dc4103b80 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc41a2bb0 con 0x7f8dc4103b80 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dbb400640 1 -- 172.21.15.82:0/3309178047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac018980 con 0x7f8dc4103b80 2024-04-26T20:32:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.487+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc41a3100 con 0x7f8dc4103b80 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 Processor -- start 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dbb400640 1 -- 172.21.15.82:0/3309178047 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8dac010430 con 0x7f8dc4103b80 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 -- start start 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dc9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4dcf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dcf730 0x5618b4dd1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5618b4d2e380 con 0x5618b4dca5c0 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5618b4ccac30 con 0x5618b4dcf730 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5618b4d2a340 con 0x5618b4dc9bd0 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dc3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dc9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dcf730 0x5618b4dd1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.491+0000 7f8dc3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dc9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:54178/0 (socket says 172.21.15.82:54178) 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc3400640 1 -- 172.21.15.82:0/3022849729 learned_addr learned my addr 172.21.15.82:0/3022849729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4dcf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc3400640 1 -- 172.21.15.82:0/3022849729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dcf730 msgr2=0x5618b4dd1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc3400640 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dcf730 0x5618b4dd1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc3400640 1 -- 172.21.15.82:0/3022849729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 msgr2=0x5618b4dcf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc3400640 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4dcf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.492+0000 7f8dc3400640 1 -- 172.21.15.82:0/3022849729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b4cec940 con 0x5618b4dc9bd0 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8dbb400640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8da80a3cf0 0x7f8da80a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8dc3400640 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dc9ff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc005ef0 tx=0x7f8dbc005f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fad53f1da118949 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8dbb400640 1 -- 172.21.15.82:0/3309178047 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8dac0d0cb0 con 0x7f8dc4103b80 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8da80a3cf0 0x7f8da80a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8db3e00640 1 -- 172.21.15.82:0/3022849729 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc031650 con 0x5618b4dc9bd0 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8db3e00640 1 -- 172.21.15.82:0/3022849729 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc036070 con 0x5618b4dc9bd0 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.493+0000 7f8db3e00640 1 -- 172.21.15.82:0/3022849729 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc004740 con 0x5618b4dc9bd0 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 -- 172.21.15.82:0/3022849729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 msgr2=0x5618b4dc9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dc9ff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc005ef0 tx=0x7f8dbc005f20 comp rx=0 tx=0).stop 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8da80a3cf0 0x7f8da80a61b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5618b4dca9c0 tx=0x7f8db4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 -- 172.21.15.82:0/3022849729 shutdown_connections 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dcf730 0x5618b4dd1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4dcf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/3022849729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dc9ff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 -- 172.21.15.82:0/3022849729 >> 172.21.15.82:0/3022849729 conn(0x5618b4dc5240 msgr2=0x5618b4dc5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 -- 172.21.15.82:0/3022849729 shutdown_connections 2024-04-26T20:32:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 -- 172.21.15.82:0/3022849729 wait complete. 2024-04-26T20:32:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.494+0000 7f8dcc9af740 1 -- start start 2024-04-26T20:32:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 Processor -- start 2024-04-26T20:32:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 0x5618b4dd4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4ddb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5618b4dd2680 con 0x5618b4dcf730 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5618b4cb5c60 con 0x5618b4dca5c0 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5618b4dd2800 con 0x5618b4dc9bd0 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dcc9af740 10 client.0 _ll_register_callbacks cb 0x5618b4ce1e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 0x5618b4dd4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 0x5618b4dd4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55176/0 (socket says 172.21.15.82:55176) 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dbbe00640 1 -- 172.21.15.82:0/2397784318 learned_addr learned my addr 172.21.15.82:0/2397784318 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.495+0000 7f8dc3400640 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4ddb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dbbe00640 1 -- 172.21.15.82:0/2397784318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 msgr2=0x5618b4dd3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dbbe00640 1 -- 172.21.15.82:0/2397784318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 msgr2=0x5618b4ddb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4ddb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dbbe00640 1 -- 172.21.15.82:0/2397784318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b4cc4510 con 0x5618b4dca5c0 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 0x5618b4dd4320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8dac09ca00 tx=0x7f8dac09c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca54187b84e9ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8db0c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8db0c00640 1 -- 172.21.15.82:0/2397784318 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac09d170 con 0x5618b4dca5c0 2024-04-26T20:32:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dbc036070 con 0x5618b4dca5c0 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.496+0000 7f8db0c00640 1 -- 172.21.15.82:0/2397784318 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8dac09ccd0 con 0x5618b4dca5c0 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8db0c00640 1 -- 172.21.15.82:0/2397784318 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8dac0bd0b0 con 0x5618b4dca5c0 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 10 client.27089 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5618b4a40210 con 0x5618b4dca5c0 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8db0c00640 1 -- 172.21.15.82:0/2397784318 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc036070 con 0x5618b4dca5c0 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8db0c00640 1 -- 172.21.15.82:0/2397784318 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f8dac0a5250 con 0x5618b4dca5c0 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 10 client.27089 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 10 client.27089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 20 client.27089 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4ddf8c0 0x5618b4de1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 4 client.27089 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.497+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618b4d3bf90 con 0x5618b4ddf8c0 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.498+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4ddf8c0 0x5618b4de1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.498+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4ddf8c0 0x5618b4de1d00 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad942fde8157710e server_cookie=8f2595039c203be3 in_seq=0 out_seq=0 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.498+0000 7f8db0c00640 10 client.27089 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8db0c00640 1 -- 172.21.15.82:0/2397784318 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5618b4d3bf90 con 0x5618b4ddf8c0 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8db0c00640 10 client.27089 handle_command_reply: tid=0 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 client.27089 shutdown 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 msgr2=0x5618b4dd4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 0x5618b4dd4320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8dac09ca00 tx=0x7f8dac09c900 comp rx=0 tx=0).stop 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 shutdown_connections 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4ddf8c0 0x5618b4de1d00 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4ddb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dca5c0 0x5618b4dd4320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8db0c00640 0 client.27089 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2397784318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 >> 172.21.15.82:0/2397784318 conn(0x5618b4dc5240 msgr2=0x5618b4dc4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.499+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 shutdown_connections 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.500+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2397784318 wait complete. 2024-04-26T20:32:22.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.500+0000 7f8dcc9af740 20 client.27089 trim_cache size 0 max 16384 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.515+0000 7f8dcc9af740 1 Processor -- start 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 -- start start 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dcb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4ddb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dcf730 0x5618b4dcbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41ad560 con 0x5618b4dca5c0 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41af2e0 con 0x5618b4dc9bd0 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41adcf0 con 0x5618b4dcf730 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dcb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4ddb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dc3400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dcf730 0x5618b4dcbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4ddb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43812/0 (socket says 172.21.15.82:43812) 2024-04-26T20:32:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dcb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55182/0 (socket says 172.21.15.82:55182) 2024-04-26T20:32:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.516+0000 7f8dbbe00640 1 -- 172.21.15.82:0/4178032055 learned_addr learned my addr 172.21.15.82:0/4178032055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dc2a00640 1 -- 172.21.15.82:0/4178032055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dcf730 msgr2=0x5618b4dcbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dcf730 0x5618b4dcbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dc2a00640 1 -- 172.21.15.82:0/4178032055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 msgr2=0x5618b4ddb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4ddb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dc2a00640 1 -- 172.21.15.82:0/4178032055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b4b0c620 con 0x5618b4dc9bd0 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4ddb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dcb7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5618b4de25b0 tx=0x7f8db401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17dd000efcea0b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8db3400640 1 -- 172.21.15.82:0/4178032055 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db402b4e0 con 0x5618b4dc9bd0 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8db3400640 1 -- 172.21.15.82:0/4178032055 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db4030070 con 0x5618b4dc9bd0 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.517+0000 7f8db3400640 1 -- 172.21.15.82:0/4178032055 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db401f400 con 0x5618b4dc9bd0 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 -- 172.21.15.82:0/4178032055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 msgr2=0x5618b4dcb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dcb7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5618b4de25b0 tx=0x7f8db401b000 comp rx=0 tx=0).stop 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 -- 172.21.15.82:0/4178032055 shutdown_connections 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dcf730 0x5618b4dcbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dca5c0 0x5618b4ddb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/4178032055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dcb7a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 -- 172.21.15.82:0/4178032055 >> 172.21.15.82:0/4178032055 conn(0x5618b4dc5240 msgr2=0x5618b4dc5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 -- 172.21.15.82:0/4178032055 shutdown_connections 2024-04-26T20:32:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 -- 172.21.15.82:0/4178032055 wait complete. 2024-04-26T20:32:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.518+0000 7f8dcc9af740 1 -- start start 2024-04-26T20:32:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 Processor -- start 2024-04-26T20:32:22.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dca5c0 0x5618b4dd8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4dd9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41aec10 con 0x5618b4dcf730 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41ae480 con 0x5618b4dc9bd0 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41ab540 con 0x5618b4dca5c0 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dcc9af740 10 client.0 _ll_register_callbacks cb 0x7f8dac0d4450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dc3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4dd9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55192/0 (socket says 172.21.15.82:55192) 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dc2a00640 1 -- 172.21.15.82:0/2498675695 learned_addr learned my addr 172.21.15.82:0/2498675695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.519+0000 7f8dbbe00640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dca5c0 0x5618b4dd8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc3400640 1 -- 172.21.15.82:0/2498675695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dca5c0 msgr2=0x5618b4dd8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc3400640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dca5c0 0x5618b4dd8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc3400640 1 -- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 msgr2=0x5618b4dd8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc3400640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc3400640 1 -- 172.21.15.82:0/2498675695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b4ce8cb0 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dc3400640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4dd9a50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc02a900 tx=0x7f8dbc005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa9e30f244cedfc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8db0c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8db0c00640 1 -- 172.21.15.82:0/2498675695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc053030 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8db4030070 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.520+0000 7f8db0c00640 1 -- 172.21.15.82:0/2498675695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8dbc031450 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8db0c00640 1 -- 172.21.15.82:0/2498675695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8dbc05d050 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 10 client.17013 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5618b4ddb180 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8db0c00640 1 -- 172.21.15.82:0/2498675695 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db4030070 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8db0c00640 1 -- 172.21.15.82:0/2498675695 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f8dbc004340 con 0x5618b4dcf730 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 10 client.17013 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 10 client.17013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 20 client.17013 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4e45e80 0x5618b4e48270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 4 client.17013 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.521+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618b4d35e00 con 0x5618b4e45e80 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.522+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4e45e80 0x5618b4e48270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.522+0000 7f8dc2a00640 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4e45e80 0x5618b4e48270 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4bde4474ab9d9e server_cookie=ab269fb83ce80fef in_seq=0 out_seq=0 2024-04-26T20:32:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.522+0000 7f8db0c00640 10 client.17013 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8db0c00640 1 -- 172.21.15.82:0/2498675695 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618b4d35e00 con 0x5618b4e45e80 2024-04-26T20:32:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8db0c00640 10 client.17013 handle_command_reply: tid=0 2024-04-26T20:32:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 client.17013 shutdown 2024-04-26T20:32:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 msgr2=0x5618b4dd9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4dd9a50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc02a900 tx=0x7f8dbc005c10 comp rx=0 tx=0).stop 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 shutdown_connections 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5618b4e45e80 0x5618b4e48270 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5618b4dcf730 0x5618b4dd9a50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5618b4dca5c0 0x5618b4dd8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 --2- 172.21.15.82:0/2498675695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618b4dc9bd0 0x5618b4dd8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8db0c00640 0 client.17013 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 >> 172.21.15.82:0/2498675695 conn(0x5618b4dc5240 msgr2=0x5618b4dd3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 shutdown_connections 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.532+0000 7f8dcc9af740 1 -- 172.21.15.82:0/2498675695 wait complete. 2024-04-26T20:32:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dcc9af740 20 client.17013 trim_cache size 0 max 16384 2024-04-26T20:32:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:32:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:32:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:32:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:32:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8da80a3cf0 msgr2=0x7f8da80a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8da80a3cf0 0x7f8da80a61b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5618b4dca9c0 tx=0x7f8db4005f90 comp rx=0 tx=0).stop 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 msgr2=0x7f8dc419b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 0x7f8dc419b1c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00e9f0 tx=0x7f8dac00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 shutdown_connections 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8da80a3cf0 0x7f8da80a61b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc4104540 0x7f8dc41a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4103b80 0x7f8dc419b1c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 --2- 172.21.15.82:0/3309178047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc4102990 0x7f8dc419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.533+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 >> 172.21.15.82:0/3309178047 conn(0x7f8dc40fdf20 msgr2=0x7f8dc40feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.534+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 shutdown_connections 2024-04-26T20:32:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:22.534+0000 7f8dc9c00640 1 -- 172.21.15.82:0/3309178047 wait complete. 2024-04-26T20:32:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:23 smithi139 ceph-mon[32999]: pgmap v700: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 989 KiB/s wr, 606 op/s 2024-04-26T20:32:23.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:23 smithi135 ceph-mon[32816]: pgmap v700: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 989 KiB/s wr, 606 op/s 2024-04-26T20:32:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:23 smithi082 ceph-mon[28105]: pgmap v700: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 989 KiB/s wr, 606 op/s 2024-04-26T20:32:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:25 smithi139 ceph-mon[32999]: pgmap v701: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-04-26T20:32:25.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:25 smithi135 ceph-mon[32816]: pgmap v701: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-04-26T20:32:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:25 smithi082 ceph-mon[28105]: pgmap v701: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-04-26T20:32:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:27 smithi139 ceph-mon[32999]: pgmap v702: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-04-26T20:32:27.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:27 smithi135 ceph-mon[32816]: pgmap v702: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-04-26T20:32:27.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:27 smithi082 ceph-mon[28105]: pgmap v702: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-04-26T20:32:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:29 smithi139 ceph-mon[32999]: pgmap v703: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 974 KiB/s wr, 284 op/s 2024-04-26T20:32:29.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:29 smithi135 ceph-mon[32816]: pgmap v703: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 974 KiB/s wr, 284 op/s 2024-04-26T20:32:29.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:29 smithi082 ceph-mon[28105]: pgmap v703: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 974 KiB/s wr, 284 op/s 2024-04-26T20:32:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:31 smithi139 ceph-mon[32999]: pgmap v704: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2024-04-26T20:32:31.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:31 smithi135 ceph-mon[32816]: pgmap v704: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2024-04-26T20:32:31.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:31 smithi082 ceph-mon[28105]: pgmap v704: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 320 op/s 2024-04-26T20:32:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:33 smithi139 ceph-mon[32999]: pgmap v705: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 331 op/s 2024-04-26T20:32:33.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:33 smithi135 ceph-mon[32816]: pgmap v705: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 331 op/s 2024-04-26T20:32:33.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:33 smithi082 ceph-mon[28105]: pgmap v705: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 331 op/s 2024-04-26T20:32:35.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:35 smithi139 ceph-mon[32999]: pgmap v706: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 365 op/s 2024-04-26T20:32:35.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:35 smithi135 ceph-mon[32816]: pgmap v706: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 365 op/s 2024-04-26T20:32:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:35 smithi082 ceph-mon[28105]: pgmap v706: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 365 op/s 2024-04-26T20:32:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 -- 172.21.15.82:0/2843779457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 msgr2=0x7fb304077710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 --2- 172.21.15.82:0/2843779457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb304077710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009ca0 tx=0x7fb2fc02a8c0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 -- 172.21.15.82:0/2843779457 shutdown_connections 2024-04-26T20:32:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 --2- 172.21.15.82:0/2843779457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078ed0 0x7fb304079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 --2- 172.21.15.82:0/2843779457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078530 0x7fb304078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 --2- 172.21.15.82:0/2843779457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb304077710 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.721+0000 7fb309600640 1 -- 172.21.15.82:0/2843779457 >> 172.21.15.82:0/2843779457 conn(0x7fb304100150 msgr2=0x7fb304102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.722+0000 7fb309600640 1 -- 172.21.15.82:0/2843779457 shutdown_connections 2024-04-26T20:32:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.722+0000 7fb309600640 1 -- 172.21.15.82:0/2843779457 wait complete. 2024-04-26T20:32:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.723+0000 7fb309600640 1 Processor -- start 2024-04-26T20:32:35.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.724+0000 7fb309600640 1 -- start start 2024-04-26T20:32:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.725+0000 7fb309600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb30419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.725+0000 7fb309600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078530 0x7fb30419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.725+0000 7fb309600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078ed0 0x7fb3041a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.725+0000 7fb309600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb304114b00 con 0x7fb304078530 2024-04-26T20:32:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.725+0000 7fb309600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb304114980 con 0x7fb3040772f0 2024-04-26T20:32:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.725+0000 7fb309600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb304114c80 con 0x7fb304078ed0 2024-04-26T20:32:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.726+0000 7fb302a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb30419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.726+0000 7fb302a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb30419eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55416/0 (socket says 172.21.15.82:55416) 2024-04-26T20:32:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.726+0000 7fb302a00640 1 -- 172.21.15.82:0/2796127693 learned_addr learned my addr 172.21.15.82:0/2796127693 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.726+0000 7fb302000640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078530 0x7fb30419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb302000640 1 -- 172.21.15.82:0/2796127693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078ed0 msgr2=0x7fb3041a6470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb303400640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078ed0 0x7fb3041a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb302000640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078ed0 0x7fb3041a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb302000640 1 -- 172.21.15.82:0/2796127693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 msgr2=0x7fb30419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb302000640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb30419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb302000640 1 -- 172.21.15.82:0/2796127693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3041a6ae0 con 0x7fb304078530 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb302a00640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb30419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.727+0000 7fb303400640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078ed0 0x7fb3041a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:32:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.728+0000 7fb302000640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078530 0x7fb30419f400 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c970 tx=0x7fb2f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:35.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.729+0000 7fb2fb400640 1 -- 172.21.15.82:0/2796127693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4007bb0 con 0x7fb304078530 2024-04-26T20:32:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.729+0000 7fb2fb400640 1 -- 172.21.15.82:0/2796127693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f4007d50 con 0x7fb304078530 2024-04-26T20:32:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.729+0000 7fb2fb400640 1 -- 172.21.15.82:0/2796127693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4018780 con 0x7fb304078530 2024-04-26T20:32:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.729+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041a6dd0 con 0x7fb304078530 2024-04-26T20:32:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.729+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041a7240 con 0x7fb304078530 2024-04-26T20:32:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.734+0000 7fb2fb400640 1 -- 172.21.15.82:0/2796127693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb2f400f450 con 0x7fb304078530 2024-04-26T20:32:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.737+0000 7fb2fb400640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb2e80a3d70 0x7fb2e80a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.737+0000 7fb2fb400640 1 -- 172.21.15.82:0/2796127693 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb2f40d0920 con 0x7fb304078530 2024-04-26T20:32:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.738+0000 7fb30c3b8740 1 Processor -- start 2024-04-26T20:32:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.738+0000 7fb302a00640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb2e80a3d70 0x7fb2e80a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.738+0000 7fb30c3b8740 1 -- start start 2024-04-26T20:32:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x557833930000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 0x5578339350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x557833937bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557833883380 con 0x557833935740 2024-04-26T20:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55783381fc30 con 0x55783392fbe0 2024-04-26T20:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55783387f340 con 0x5578339305d0 2024-04-26T20:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb302000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 0x5578339350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.739+0000 7fb302000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 0x5578339350d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41930/0 (socket says 172.21.15.82:41930) 2024-04-26T20:32:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.740+0000 7fb302000640 1 -- 172.21.15.82:0/3348653538 learned_addr learned my addr 172.21.15.82:0/3348653538 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.740+0000 7fb302a00640 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x557833930000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.740+0000 7fb303400640 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x557833937bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.741+0000 7fb302000640 1 -- 172.21.15.82:0/3348653538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 msgr2=0x557833930000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.741+0000 7fb302000640 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x557833930000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.741+0000 7fb302000640 1 -- 172.21.15.82:0/3348653538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 msgr2=0x557833937bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.741+0000 7fb302000640 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x557833937bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.741+0000 7fb302000640 1 -- 172.21.15.82:0/3348653538 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557833841940 con 0x5578339305d0 2024-04-26T20:32:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.741+0000 7fb302a00640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb2e80a3d70 0x7fb2e80a6230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009a60 tx=0x7fb2fc02f380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:35.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.742+0000 7fb302000640 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 0x5578339350d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4098b80 tx=0x7fb2f409cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b18de0f2ed22228f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:35.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.743+0000 7fb2ef400640 1 -- 172.21.15.82:0/3348653538 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40a5390 con 0x5578339305d0 2024-04-26T20:32:35.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.743+0000 7fb2ef400640 1 -- 172.21.15.82:0/3348653538 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f409aa20 con 0x5578339305d0 2024-04-26T20:32:35.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.743+0000 7fb2ef400640 1 -- 172.21.15.82:0/3348653538 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40a4f00 con 0x5578339305d0 2024-04-26T20:32:35.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.744+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3348653538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 msgr2=0x5578339350d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:35.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.744+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 0x5578339350d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4098b80 tx=0x7fb2f409cf60 comp rx=0 tx=0).stop 2024-04-26T20:32:35.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.744+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3348653538 shutdown_connections 2024-04-26T20:32:35.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.744+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x557833937bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.744+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578339305d0 0x5578339350d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.744+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3348653538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x557833930000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.745+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3348653538 >> 172.21.15.82:0/3348653538 conn(0x55783391a240 msgr2=0x55783391a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.745+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3348653538 shutdown_connections 2024-04-26T20:32:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.745+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3348653538 wait complete. 2024-04-26T20:32:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.745+0000 7fb30c3b8740 1 -- start start 2024-04-26T20:32:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.746+0000 7fb30c3b8740 1 Processor -- start 2024-04-26T20:32:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.746+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x557833939eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.746+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 0x55783393a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.746+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x557833941430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.746+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5578339386f0 con 0x55783392fbe0 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55783380ac60 con 0x5578339305d0 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557833938870 con 0x557833935740 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb30c3b8740 10 client.0 _ll_register_callbacks cb 0x557833836e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb302000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 0x55783393a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb302a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x557833939eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb302000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 0x55783393a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55438/0 (socket says 172.21.15.82:55438) 2024-04-26T20:32:35.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb302000640 1 -- 172.21.15.82:0/3124986778 learned_addr learned my addr 172.21.15.82:0/3124986778 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.747+0000 7fb303400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x557833941430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.748+0000 7fb302000640 1 -- 172.21.15.82:0/3124986778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 msgr2=0x557833941430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.748+0000 7fb302000640 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x557833941430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.748+0000 7fb302000640 1 -- 172.21.15.82:0/3124986778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 msgr2=0x557833939eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.748+0000 7fb302000640 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x557833939eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.748+0000 7fb302000640 1 -- 172.21.15.82:0/3124986778 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557833819510 con 0x5578339305d0 2024-04-26T20:32:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.749+0000 7fb302000640 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 0x55783393a3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4098b80 tx=0x7fb2f400fdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b914a24a8f05d412 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.750+0000 7fb2e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:32:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.750+0000 7fb2e3e00640 1 -- 172.21.15.82:0/3124986778 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4080060 con 0x5578339305d0 2024-04-26T20:32:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.750+0000 7fb2e3e00640 1 -- 172.21.15.82:0/3124986778 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb2f40a5100 con 0x5578339305d0 2024-04-26T20:32:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.750+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2f409aa20 con 0x5578339305d0 2024-04-26T20:32:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.751+0000 7fb2e3e00640 1 -- 172.21.15.82:0/3124986778 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb2f40ce1a0 con 0x5578339305d0 2024-04-26T20:32:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.751+0000 7fb30c3b8740 10 client.27107 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.751+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x557833595210 con 0x5578339305d0 2024-04-26T20:32:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.751+0000 7fb2e3e00640 1 -- 172.21.15.82:0/3124986778 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f409aa20 con 0x5578339305d0 2024-04-26T20:32:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb2e3e00640 1 -- 172.21.15.82:0/3124986778 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7fb2f409b700 con 0x5578339305d0 2024-04-26T20:32:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb30c3b8740 10 client.27107 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb30c3b8740 10 client.27107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb30c3b8740 20 client.27107 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x557833945590 0x557833947980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb30c3b8740 4 client.27107 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:32:35.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.752+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557833890f90 con 0x557833945590 2024-04-26T20:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.753+0000 7fb302a00640 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x557833945590 0x557833947980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.753+0000 7fb302a00640 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x557833945590 0x557833947980 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db53d320cb485c01 server_cookie=63ea4c9bc6ef662e in_seq=0 out_seq=0 2024-04-26T20:32:35.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.753+0000 7fb2e3e00640 10 client.27107 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.756+0000 7fb2e3e00640 1 -- 172.21.15.82:0/3124986778 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557833890f90 con 0x557833945590 2024-04-26T20:32:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.756+0000 7fb2e3e00640 10 client.27107 handle_command_reply: tid=0 2024-04-26T20:32:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.756+0000 7fb30c3b8740 1 client.27107 shutdown 2024-04-26T20:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 msgr2=0x55783393a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 0x55783393a3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4098b80 tx=0x7fb2f400fdf0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 shutdown_connections 2024-04-26T20:32:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x557833945590 0x557833947980 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x557833941430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5578339305d0 0x55783393a3f0 secure :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4098b80 tx=0x7fb2f400fdf0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/3124986778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x557833939eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb2e3e00640 0 client.27107 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.757+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 >> 172.21.15.82:0/3124986778 conn(0x55783391a240 msgr2=0x557833919440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.758+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 shutdown_connections 2024-04-26T20:32:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.758+0000 7fb30c3b8740 1 -- 172.21.15.82:0/3124986778 wait complete. 2024-04-26T20:32:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.759+0000 7fb30c3b8740 20 client.27107 trim_cache size 0 max 16384 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.789+0000 7fb30c3b8740 1 Processor -- start 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 -- start start 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 0x55783391d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x5578339413f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x55783394c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041a8fe0 con 0x55783392fbe0 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041aad60 con 0x55783391a240 2024-04-26T20:32:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041a9770 con 0x557833935740 2024-04-26T20:32:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.790+0000 7fb303400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x55783394c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.791+0000 7fb303400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x55783394c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:41954/0 (socket says 172.21.15.82:41954) 2024-04-26T20:32:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.791+0000 7fb302a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 0x55783391d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.791+0000 7fb302a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 0x55783391d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55440/0 (socket says 172.21.15.82:55440) 2024-04-26T20:32:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.791+0000 7fb302a00640 1 -- 172.21.15.82:0/479935718 learned_addr learned my addr 172.21.15.82:0/479935718 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.791+0000 7fb302000640 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x5578339413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302a00640 1 -- 172.21.15.82:0/479935718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 msgr2=0x55783394c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302a00640 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x55783394c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302a00640 1 -- 172.21.15.82:0/479935718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 msgr2=0x5578339413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302a00640 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x5578339413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302a00640 1 -- 172.21.15.82:0/479935718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557833661620 con 0x55783391a240 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302000640 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x5578339413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.792+0000 7fb302a00640 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 0x55783391d900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc033040 tx=0x7fb2fc04b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42dc137ff1992c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.793+0000 7fb2eea00640 1 -- 172.21.15.82:0/479935718 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc058070 con 0x55783391a240 2024-04-26T20:32:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.793+0000 7fb2eea00640 1 -- 172.21.15.82:0/479935718 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2fc045070 con 0x55783391a240 2024-04-26T20:32:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.793+0000 7fb2eea00640 1 -- 172.21.15.82:0/479935718 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc043040 con 0x55783391a240 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 -- 172.21.15.82:0/479935718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 msgr2=0x55783391d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 0x55783391d900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc033040 tx=0x7fb2fc04b000 comp rx=0 tx=0).stop 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 -- 172.21.15.82:0/479935718 shutdown_connections 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557833935740 0x55783394c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55783392fbe0 0x5578339413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/479935718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783391a240 0x55783391d900 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 -- 172.21.15.82:0/479935718 >> 172.21.15.82:0/479935718 conn(0x557833935210 msgr2=0x55783391d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 -- 172.21.15.82:0/479935718 shutdown_connections 2024-04-26T20:32:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.794+0000 7fb30c3b8740 1 -- 172.21.15.82:0/479935718 wait complete. 2024-04-26T20:32:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.795+0000 7fb30c3b8740 1 -- start start 2024-04-26T20:32:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.795+0000 7fb30c3b8740 1 Processor -- start 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55783391a240 0x55783393ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x55783393f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x5578339403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041aa690 con 0x557833935740 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041a9f00 con 0x55783392fbe0 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3040746a0 con 0x55783391a240 2024-04-26T20:32:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb30c3b8740 10 client.0 _ll_register_callbacks cb 0x7fb2fc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.796+0000 7fb302000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x55783393f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x55783393f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55456/0 (socket says 172.21.15.82:55456) 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302000640 1 -- 172.21.15.82:0/689522566 learned_addr learned my addr 172.21.15.82:0/689522566 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302a00640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55783391a240 0x55783393ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb303400640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x5578339403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302a00640 1 -- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 msgr2=0x55783393f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302a00640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x55783393f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302a00640 1 -- 172.21.15.82:0/689522566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 msgr2=0x5578339403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302a00640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x5578339403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.797+0000 7fb302a00640 1 -- 172.21.15.82:0/689522566 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783383dcb0 con 0x55783391a240 2024-04-26T20:32:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.799+0000 7fb302a00640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55783391a240 0x55783393ef30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc033040 tx=0x7fb2fc02b060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f445e803e1f2e9db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.799+0000 7fb2e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:32:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.799+0000 7fb2e3e00640 1 -- 172.21.15.82:0/689522566 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc043070 con 0x55783391a240 2024-04-26T20:32:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.799+0000 7fb2e3e00640 1 -- 172.21.15.82:0/689522566 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb2fc004410 con 0x55783391a240 2024-04-26T20:32:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.799+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2fc045070 con 0x55783391a240 2024-04-26T20:32:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.800+0000 7fb2e3e00640 1 -- 172.21.15.82:0/689522566 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb2fc058040 con 0x55783391a240 2024-04-26T20:32:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.800+0000 7fb30c3b8740 10 client.27187 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.800+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5578339bcb40 con 0x55783391a240 2024-04-26T20:32:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.800+0000 7fb2e3e00640 1 -- 172.21.15.82:0/689522566 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2fc045070 con 0x55783391a240 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb2e3e00640 1 -- 172.21.15.82:0/689522566 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7fb2fc064030 con 0x55783391a240 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb30c3b8740 10 client.27187 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb30c3b8740 10 client.27187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb30c3b8740 20 client.27187 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5578339bd580 0x5578339bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb30c3b8740 4 client.27187 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:32:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.801+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55783388ae00 con 0x5578339bd580 2024-04-26T20:32:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.802+0000 7fb302000640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5578339bd580 0x5578339bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.805+0000 7fb302000640 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5578339bd580 0x5578339bf9a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e76fe294a74d3bf5 server_cookie=ad863345550a21c6 in_seq=0 out_seq=0 2024-04-26T20:32:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:35.806+0000 7fb2e3e00640 10 client.27187 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.279+0000 7fb2e3e00640 1 -- 172.21.15.82:0/689522566 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55783388ae00 con 0x5578339bd580 2024-04-26T20:32:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.279+0000 7fb2e3e00640 10 client.27187 handle_command_reply: tid=0 2024-04-26T20:32:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.279+0000 7fb30c3b8740 1 client.27187 shutdown 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55783391a240 msgr2=0x55783393ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55783391a240 0x55783393ef30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc033040 tx=0x7fb2fc02b060 comp rx=0 tx=0).stop 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 shutdown_connections 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5578339bd580 0x5578339bf9a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557833935740 0x5578339403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55783392fbe0 0x55783393f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 --2- 172.21.15.82:0/689522566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55783391a240 0x55783393ef30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb2e3e00640 0 client.27187 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 >> 172.21.15.82:0/689522566 conn(0x557833935210 msgr2=0x55783391d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 shutdown_connections 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 1 -- 172.21.15.82:0/689522566 wait complete. 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.281+0000 7fb30c3b8740 20 client.27187 trim_cache size 0 max 16384 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:32:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb2e80a3d70 msgr2=0x7fb2e80a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb2e80a3d70 0x7fb2e80a6230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009a60 tx=0x7fb2fc02f380 comp rx=0 tx=0).stop 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078530 msgr2=0x7fb30419f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078530 0x7fb30419f400 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c970 tx=0x7fb2f400ce30 comp rx=0 tx=0).stop 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 shutdown_connections 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb2e80a3d70 0x7fb2e80a6230 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb304078ed0 0x7fb3041a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb304078530 0x7fb30419f400 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 --2- 172.21.15.82:0/2796127693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3040772f0 0x7fb30419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 >> 172.21.15.82:0/2796127693 conn(0x7fb304100150 msgr2=0x7fb304101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 shutdown_connections 2024-04-26T20:32:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:36.282+0000 7fb309600640 1 -- 172.21.15.82:0/2796127693 wait complete. 2024-04-26T20:32:37.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:37 smithi139 ceph-mon[32999]: pgmap v707: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-04-26T20:32:37.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:37 smithi135 ceph-mon[32816]: pgmap v707: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-04-26T20:32:37.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:37 smithi082 ceph-mon[28105]: pgmap v707: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-04-26T20:32:39.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:39 smithi139 ceph-mon[32999]: pgmap v708: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-04-26T20:32:39.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:39 smithi135 ceph-mon[32816]: pgmap v708: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-04-26T20:32:39.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:39 smithi082 ceph-mon[28105]: pgmap v708: 129 pgs: 129 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-04-26T20:32:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:41 smithi139 ceph-mon[32999]: pgmap v709: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 569 op/s 2024-04-26T20:32:41.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:41 smithi135 ceph-mon[32816]: pgmap v709: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 569 op/s 2024-04-26T20:32:41.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:41 smithi082 ceph-mon[28105]: pgmap v709: 129 pgs: 129 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 569 op/s 2024-04-26T20:32:43.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:43 smithi139 ceph-mon[32999]: pgmap v710: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 600 op/s 2024-04-26T20:32:43.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:43 smithi135 ceph-mon[32816]: pgmap v710: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 600 op/s 2024-04-26T20:32:43.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:43 smithi082 ceph-mon[28105]: pgmap v710: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 600 op/s 2024-04-26T20:32:45.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:45 smithi139 ceph-mon[32999]: pgmap v711: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-04-26T20:32:45.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:45 smithi135 ceph-mon[32816]: pgmap v711: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-04-26T20:32:45.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:45 smithi082 ceph-mon[28105]: pgmap v711: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-04-26T20:32:47.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:47 smithi139 ceph-mon[32999]: pgmap v712: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 616 op/s 2024-04-26T20:32:47.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:47 smithi135 ceph-mon[32816]: pgmap v712: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 616 op/s 2024-04-26T20:32:47.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:47 smithi082 ceph-mon[28105]: pgmap v712: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 616 op/s 2024-04-26T20:32:49.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:49 smithi139 ceph-mon[32999]: pgmap v713: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 1.1 MiB/s wr, 567 op/s 2024-04-26T20:32:49.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:49 smithi135 ceph-mon[32816]: pgmap v713: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 1.1 MiB/s wr, 567 op/s 2024-04-26T20:32:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 -- 172.21.15.82:0/1724136416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4108de0 msgr2=0x7f02e4109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1724136416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4108de0 0x7f02e4109200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009900 tx=0x7f02cc02a420 comp rx=0 tx=0).stop 2024-04-26T20:32:49.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:49 smithi082 ceph-mon[28105]: pgmap v713: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 1.1 MiB/s wr, 567 op/s 2024-04-26T20:32:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 -- 172.21.15.82:0/1724136416 shutdown_connections 2024-04-26T20:32:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1724136416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 0x7f02e4111220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1724136416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e4109fd0 0x7f02e410a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1724136416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4108de0 0x7f02e4109200 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.437+0000 7f02e3e00640 1 -- 172.21.15.82:0/1724136416 >> 172.21.15.82:0/1724136416 conn(0x7f02e4077dc0 msgr2=0x7f02e407a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.439+0000 7f02e3e00640 1 -- 172.21.15.82:0/1724136416 shutdown_connections 2024-04-26T20:32:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.439+0000 7f02e3e00640 1 -- 172.21.15.82:0/1724136416 wait complete. 2024-04-26T20:32:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.440+0000 7f02e3e00640 1 Processor -- start 2024-04-26T20:32:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 -- start start 2024-04-26T20:32:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e4108de0 0x7f02e4071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4109fd0 0x7f02e4071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 0x7f02e41af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41149d0 con 0x7f02e410a990 2024-04-26T20:32:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4114850 con 0x7f02e4108de0 2024-04-26T20:32:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e3e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4114b50 con 0x7f02e4109fd0 2024-04-26T20:32:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.441+0000 7f02e2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4109fd0 0x7f02e4071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.442+0000 7f02e2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4109fd0 0x7f02e4071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60100/0 (socket says 172.21.15.82:60100) 2024-04-26T20:32:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.442+0000 7f02e2000640 1 -- 172.21.15.82:0/1687471199 learned_addr learned my addr 172.21.15.82:0/1687471199 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.442+0000 7f02e3400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 0x7f02e41af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.443+0000 7f02e2a00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e4108de0 0x7f02e4071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.443+0000 7f02e3400640 1 -- 172.21.15.82:0/1687471199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4109fd0 msgr2=0x7f02e4071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.443+0000 7f02e3400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4109fd0 0x7f02e4071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.443+0000 7f02e3400640 1 -- 172.21.15.82:0/1687471199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e4108de0 msgr2=0x7f02e4071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.443+0000 7f02e3400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e4108de0 0x7f02e4071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.443+0000 7f02e3400640 1 -- 172.21.15.82:0/1687471199 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4074810 con 0x7f02e410a990 2024-04-26T20:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.444+0000 7f02e3400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 0x7f02e41af0e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c710 tx=0x7f02dc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.444+0000 7f02db400640 1 -- 172.21.15.82:0/1687471199 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc004220 con 0x7f02e410a990 2024-04-26T20:32:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.444+0000 7f02db400640 1 -- 172.21.15.82:0/1687471199 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02dc00ce20 con 0x7f02e410a990 2024-04-26T20:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.444+0000 7f02db400640 1 -- 172.21.15.82:0/1687471199 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003d50 con 0x7f02e410a990 2024-04-26T20:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.445+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e41af620 con 0x7f02e410a990 2024-04-26T20:32:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.445+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e41afb40 con 0x7f02e410a990 2024-04-26T20:32:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.450+0000 7f02db400640 1 -- 172.21.15.82:0/1687471199 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f02dc0079b0 con 0x7f02e410a990 2024-04-26T20:32:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.453+0000 7f02ec3ad740 1 Processor -- start 2024-04-26T20:32:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.453+0000 7f02ec3ad740 1 -- start start 2024-04-26T20:32:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635230200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x5636352352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635237dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563635194380 con 0x563635235940 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563635130c30 con 0x56363522fde0 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563635190340 con 0x5636352307d0 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x5636352352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x5636352352d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60102/0 (socket says 172.21.15.82:60102) 2024-04-26T20:32:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02e2a00640 1 -- 172.21.15.82:0/2837369969 learned_addr learned my addr 172.21.15.82:0/2837369969 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.454+0000 7f02db400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02c80a3dc0 0x7f02c80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.455+0000 7f02db400640 1 -- 172.21.15.82:0/1687471199 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f02dc0d0380 con 0x7f02e410a990 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.455+0000 7f02e2a00640 1 -- 172.21.15.82:0/2837369969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 msgr2=0x563635230200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.455+0000 7f02e2000640 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635237dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.455+0000 7f02e3400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02c80a3dc0 0x7f02c80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.456+0000 7f02e2a00640 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635230200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.456+0000 7f02e2a00640 1 -- 172.21.15.82:0/2837369969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 msgr2=0x563635237dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.456+0000 7f02e2a00640 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635237dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.456+0000 7f02e2a00640 1 -- 172.21.15.82:0/2837369969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563635152940 con 0x5636352307d0 2024-04-26T20:32:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.457+0000 7f02e2000640 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635237dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:32:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.457+0000 7f02e3400640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02c80a3dc0 0x7f02c80a6280 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f02dc003ff0 tx=0x7f02dc0043c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.457+0000 7f02e2a00640 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x5636352352d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f02e4109e30 tx=0x7f02cc004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c84249984ed56bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.458+0000 7f02d3400640 1 -- 172.21.15.82:0/2837369969 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc040070 con 0x5636352307d0 2024-04-26T20:32:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.458+0000 7f02d3400640 1 -- 172.21.15.82:0/2837369969 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc0047a0 con 0x5636352307d0 2024-04-26T20:32:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.458+0000 7f02d3400640 1 -- 172.21.15.82:0/2837369969 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc035040 con 0x5636352307d0 2024-04-26T20:32:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.459+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2837369969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 msgr2=0x5636352352d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.459+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x5636352352d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f02e4109e30 tx=0x7f02cc004390 comp rx=0 tx=0).stop 2024-04-26T20:32:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.459+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2837369969 shutdown_connections 2024-04-26T20:32:49.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.460+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635237dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.460+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x5636352352d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.460+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2837369969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635230200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.460+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2837369969 >> 172.21.15.82:0/2837369969 conn(0x56363522b450 msgr2=0x56363522b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:49.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.460+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2837369969 shutdown_connections 2024-04-26T20:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.460+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2837369969 wait complete. 2024-04-26T20:32:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.461+0000 7f02ec3ad740 1 -- start start 2024-04-26T20:32:49.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.463+0000 7f02ec3ad740 1 Processor -- start 2024-04-26T20:32:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x56363523a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x56363523a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x5636352415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563635238890 con 0x563635235940 2024-04-26T20:32:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56363511bc60 con 0x56363522fde0 2024-04-26T20:32:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563635238a10 con 0x5636352307d0 2024-04-26T20:32:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.464+0000 7f02ec3ad740 10 client.0 _ll_register_callbacks cb 0x563635147e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.465+0000 7f02e2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x5636352415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.465+0000 7f02e2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x5636352415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39882/0 (socket says 172.21.15.82:39882) 2024-04-26T20:32:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.465+0000 7f02e2000640 1 -- 172.21.15.82:0/3720778749 learned_addr learned my addr 172.21.15.82:0/3720778749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.465+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x56363523a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.466+0000 7f02e2000640 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x56363523a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.466+0000 7f02e2a00640 1 -- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 msgr2=0x56363523a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.466+0000 7f02e2a00640 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x56363523a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.466+0000 7f02e2a00640 1 -- 172.21.15.82:0/3720778749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 msgr2=0x5636352415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.466+0000 7f02e2a00640 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x5636352415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.466+0000 7f02e2a00640 1 -- 172.21.15.82:0/3720778749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363512a510 con 0x5636352307d0 2024-04-26T20:32:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.467+0000 7f02e2a00640 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x56363523a5f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x56363522c3c0 tx=0x7f02cc0041e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5bf6e715edc76de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.467+0000 7f02c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:32:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.467+0000 7f02c7e00640 1 -- 172.21.15.82:0/3720778749 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc035070 con 0x5636352307d0 2024-04-26T20:32:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.467+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02cc0047a0 con 0x5636352307d0 2024-04-26T20:32:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.467+0000 7f02c7e00640 1 -- 172.21.15.82:0/3720778749 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f02cc005430 con 0x5636352307d0 2024-04-26T20:32:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.468+0000 7f02c7e00640 1 -- 172.21.15.82:0/3720778749 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f02cc040040 con 0x5636352307d0 2024-04-26T20:32:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.468+0000 7f02ec3ad740 10 client.27199 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.468+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x563634ea6210 con 0x5636352307d0 2024-04-26T20:32:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02c7e00640 1 -- 172.21.15.82:0/3720778749 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc0047a0 con 0x5636352307d0 2024-04-26T20:32:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02c7e00640 1 -- 172.21.15.82:0/3720778749 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f02cc031830 con 0x5636352307d0 2024-04-26T20:32:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02ec3ad740 10 client.27199 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02ec3ad740 10 client.27199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02ec3ad740 20 client.27199 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x563635247a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02ec3ad740 4 client.27199 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:32:49.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.469+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636351a1f90 con 0x563635245690 2024-04-26T20:32:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.472+0000 7f02e2000640 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x563635247a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.472+0000 7f02e2000640 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x563635247a80 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfc2a8f6aabe605a server_cookie=7ddf01f200772f4f in_seq=0 out_seq=0 2024-04-26T20:32:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.472+0000 7f02c7e00640 10 client.27199 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.475+0000 7f02c7e00640 1 -- 172.21.15.82:0/3720778749 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5636351a1f90 con 0x563635245690 2024-04-26T20:32:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.475+0000 7f02c7e00640 10 client.27199 handle_command_reply: tid=0 2024-04-26T20:32:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.475+0000 7f02ec3ad740 1 client.27199 shutdown 2024-04-26T20:32:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.476+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 msgr2=0x56363523a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.476+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x56363523a5f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x56363522c3c0 tx=0x7f02cc0041e0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.477+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 shutdown_connections 2024-04-26T20:32:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.477+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x563635247a80 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.477+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x5636352415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.477+0000 7f02c7e00640 0 client.27199 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.477+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x56363523a5f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.478+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/3720778749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x56363523a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.478+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 >> 172.21.15.82:0/3720778749 conn(0x56363522b450 msgr2=0x56363522a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.478+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 shutdown_connections 2024-04-26T20:32:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.478+0000 7f02ec3ad740 1 -- 172.21.15.82:0/3720778749 wait complete. 2024-04-26T20:32:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.478+0000 7f02ec3ad740 20 client.27199 trim_cache size 0 max 16384 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 Processor -- start 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 -- start start 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635241c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x563635241580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635242190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41b9e70 con 0x563635235940 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41bbbf0 con 0x56363522fde0 2024-04-26T20:32:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.507+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41ba600 con 0x5636352307d0 2024-04-26T20:32:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.508+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x563635241580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.508+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x563635241580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60120/0 (socket says 172.21.15.82:60120) 2024-04-26T20:32:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.508+0000 7f02e2a00640 1 -- 172.21.15.82:0/4077050199 learned_addr learned my addr 172.21.15.82:0/4077050199 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.508+0000 7f02e2000640 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635242190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.508+0000 7f02e2000640 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635241c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.509+0000 7f02e2a00640 1 -- 172.21.15.82:0/4077050199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 msgr2=0x563635241c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.509+0000 7f02e2a00640 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635241c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.509+0000 7f02e2a00640 1 -- 172.21.15.82:0/4077050199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 msgr2=0x563635242190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.509+0000 7f02e2a00640 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635242190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.509+0000 7f02e2a00640 1 -- 172.21.15.82:0/4077050199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563634f72620 con 0x5636352307d0 2024-04-26T20:32:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.509+0000 7f02e2000640 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635242190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.510+0000 7f02e2a00640 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x563635241580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009850 tx=0x7f02cc004f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a6add5cb23d155 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.510+0000 7f02d2a00640 1 -- 172.21.15.82:0/4077050199 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc035070 con 0x5636352307d0 2024-04-26T20:32:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.510+0000 7f02d2a00640 1 -- 172.21.15.82:0/4077050199 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc0047a0 con 0x5636352307d0 2024-04-26T20:32:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.510+0000 7f02d2a00640 1 -- 172.21.15.82:0/4077050199 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc005430 con 0x5636352307d0 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 -- 172.21.15.82:0/4077050199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 msgr2=0x563635241580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x563635241580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009850 tx=0x7f02cc004f30 comp rx=0 tx=0).stop 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 -- 172.21.15.82:0/4077050199 shutdown_connections 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x563635242190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636352307d0 0x563635241580 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/4077050199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56363522fde0 0x563635241c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 -- 172.21.15.82:0/4077050199 >> 172.21.15.82:0/4077050199 conn(0x56363522b450 msgr2=0x563635231af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 -- 172.21.15.82:0/4077050199 shutdown_connections 2024-04-26T20:32:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.511+0000 7f02ec3ad740 1 -- 172.21.15.82:0/4077050199 wait complete. 2024-04-26T20:32:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.512+0000 7f02ec3ad740 1 -- start start 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.512+0000 7f02ec3ad740 1 Processor -- start 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56363522fde0 0x56363523e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 0x56363523eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x56363523fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41bb520 con 0x563635235940 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41bad90 con 0x5636352307d0 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41b7e50 con 0x56363522fde0 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02ec3ad740 10 client.0 _ll_register_callbacks cb 0x7f02cc0042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02e2000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56363522fde0 0x56363523e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 0x56363523eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02e2000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x56363523fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02e2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 0x56363523eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:55934/0 (socket says 172.21.15.82:55934) 2024-04-26T20:32:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.513+0000 7f02e2a00640 1 -- 172.21.15.82:0/2573325466 learned_addr learned my addr 172.21.15.82:0/2573325466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.514+0000 7f02e2a00640 1 -- 172.21.15.82:0/2573325466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56363522fde0 msgr2=0x56363523e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.514+0000 7f02e2a00640 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56363522fde0 0x56363523e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.514+0000 7f02e2a00640 1 -- 172.21.15.82:0/2573325466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 msgr2=0x56363523fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.515+0000 7f02e2a00640 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x56363523fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.515+0000 7f02e2a00640 1 -- 172.21.15.82:0/2573325466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363514ecb0 con 0x5636352307d0 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.515+0000 7f02e2000640 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x56363523fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.516+0000 7f02e2a00640 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 0x56363523eb90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009230 tx=0x7f02cc005460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9934afe2bf3e6950 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:32:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.516+0000 7f02c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:32:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.516+0000 7f02c7e00640 1 -- 172.21.15.82:0/2573325466 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc063020 con 0x5636352307d0 2024-04-26T20:32:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.516+0000 7f02c7e00640 1 -- 172.21.15.82:0/2573325466 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f02cc031920 con 0x5636352307d0 2024-04-26T20:32:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.517+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02cc0047a0 con 0x5636352307d0 2024-04-26T20:32:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.517+0000 7f02c7e00640 1 -- 172.21.15.82:0/2573325466 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f02cc035070 con 0x5636352307d0 2024-04-26T20:32:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.517+0000 7f02ec3ad740 10 client.27122 fetch_fsmap learned FSMap version 54 2024-04-26T20:32:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.517+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5636352412d0 con 0x5636352307d0 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.518+0000 7f02c7e00640 1 -- 172.21.15.82:0/2573325466 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc0047a0 con 0x5636352307d0 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.518+0000 7f02c7e00640 1 -- 172.21.15.82:0/2573325466 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f02cc003cb0 con 0x5636352307d0 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.518+0000 7f02ec3ad740 10 client.27122 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.518+0000 7f02ec3ad740 10 client.27122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.518+0000 7f02ec3ad740 20 client.27122 populate_metadata read hostname 'smithi082' 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.518+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x5636352adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.519+0000 7f02ec3ad740 4 client.27122 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.519+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56363519be00 con 0x563635245690 2024-04-26T20:32:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.519+0000 7f02e2000640 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x5636352adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.521+0000 7f02e2000640 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x5636352adb90 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2008505f83beda2 server_cookie=3c3c4e84c59d8288 in_seq=0 out_seq=0 2024-04-26T20:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:49.521+0000 7f02c7e00640 10 client.27122 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:51.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:50 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:51.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:50 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:50 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.296+0000 7f02c7e00640 1 -- 172.21.15.82:0/2573325466 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56363519be00 con 0x563635245690 2024-04-26T20:32:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.296+0000 7f02c7e00640 10 client.27122 handle_command_reply: tid=0 2024-04-26T20:32:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 client.27122 shutdown 2024-04-26T20:32:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 msgr2=0x56363523eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 0x56363523eb90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009230 tx=0x7f02cc005460 comp rx=0 tx=0).stop 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 shutdown_connections 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x563635245690 0x5636352adb90 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563635235940 0x56363523fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636352307d0 0x56363523eb90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 --2- 172.21.15.82:0/2573325466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56363522fde0 0x56363523e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.297+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 >> 172.21.15.82:0/2573325466 conn(0x56363522b450 msgr2=0x563635241c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.298+0000 7f02c7e00640 0 client.27122 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.298+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 shutdown_connections 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.298+0000 7f02ec3ad740 1 -- 172.21.15.82:0/2573325466 wait complete. 2024-04-26T20:32:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.298+0000 7f02ec3ad740 20 client.27122 trim_cache size 0 max 16384 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.299+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02c80a3dc0 msgr2=0x7f02c80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.299+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02c80a3dc0 0x7f02c80a6280 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f02dc003ff0 tx=0x7f02dc0043c0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.299+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 msgr2=0x7f02e41af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.299+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 0x7f02e41af0e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c710 tx=0x7f02dc00cbd0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.300+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 shutdown_connections 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.300+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f02c80a3dc0 0x7f02c80a6280 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.300+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e410a990 0x7f02e41af0e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.300+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02e4109fd0 0x7f02e4071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.300+0000 7f02e3e00640 1 --2- 172.21.15.82:0/1687471199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e4108de0 0x7f02e4071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.300+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 >> 172.21.15.82:0/1687471199 conn(0x7f02e4077dc0 msgr2=0x7f02e410d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:32:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.301+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 shutdown_connections 2024-04-26T20:32:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:32:51.301+0000 7f02e3e00640 1 -- 172.21.15.82:0/1687471199 wait complete. 2024-04-26T20:32:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: pgmap v714: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 865 KiB/s wr, 606 op/s 2024-04-26T20:32:52.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:51 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: pgmap v714: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 865 KiB/s wr, 606 op/s 2024-04-26T20:32:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:51 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: pgmap v714: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 865 KiB/s wr, 606 op/s 2024-04-26T20:32:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:51 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:53.164 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:53 smithi082 ceph-mon[28105]: pgmap v715: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 548 op/s 2024-04-26T20:32:53.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:53 smithi139 ceph-mon[32999]: pgmap v715: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 548 op/s 2024-04-26T20:32:53.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:53 smithi135 ceph-mon[32816]: pgmap v715: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 548 op/s 2024-04-26T20:32:54.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:54 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:54 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:54.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:54 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:55 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:55 smithi135 ceph-mon[32816]: pgmap v716: 129 pgs: 129 active+clean; 1018 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 518 op/s 2024-04-26T20:32:56.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:55 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:55 smithi082 ceph-mon[28105]: pgmap v716: 129 pgs: 129 active+clean; 1018 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 518 op/s 2024-04-26T20:32:56.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:55 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:56.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:55 smithi139 ceph-mon[32999]: pgmap v716: 129 pgs: 129 active+clean; 1018 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 518 op/s 2024-04-26T20:32:57.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:57.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:56 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:56 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:56 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:32:58.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:57 smithi135 ceph-mon[32816]: pgmap v717: 129 pgs: 129 active+clean; 1011 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 469 op/s 2024-04-26T20:32:58.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:57 smithi082 ceph-mon[28105]: pgmap v717: 129 pgs: 129 active+clean; 1011 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 469 op/s 2024-04-26T20:32:58.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:57 smithi139 ceph-mon[32999]: pgmap v717: 129 pgs: 129 active+clean; 1011 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 469 op/s 2024-04-26T20:32:59.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:32:59 smithi139 ceph-mon[32999]: pgmap v718: 129 pgs: 129 active+clean; 1007 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 440 op/s 2024-04-26T20:32:59.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:32:59 smithi135 ceph-mon[32816]: pgmap v718: 129 pgs: 129 active+clean; 1007 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 440 op/s 2024-04-26T20:32:59.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:32:59 smithi082 ceph-mon[28105]: pgmap v718: 129 pgs: 129 active+clean; 1007 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 440 op/s 2024-04-26T20:33:01.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:01 smithi139 ceph-mon[32999]: pgmap v719: 129 pgs: 129 active+clean; 999 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 496 op/s 2024-04-26T20:33:01.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:01 smithi135 ceph-mon[32816]: pgmap v719: 129 pgs: 129 active+clean; 999 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 496 op/s 2024-04-26T20:33:01.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:01 smithi082 ceph-mon[28105]: pgmap v719: 129 pgs: 129 active+clean; 999 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 496 op/s 2024-04-26T20:33:03.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:03 smithi139 ceph-mon[32999]: pgmap v720: 129 pgs: 129 active+clean; 989 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 460 op/s 2024-04-26T20:33:03.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:03 smithi135 ceph-mon[32816]: pgmap v720: 129 pgs: 129 active+clean; 989 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 460 op/s 2024-04-26T20:33:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:03 smithi082 ceph-mon[28105]: pgmap v720: 129 pgs: 129 active+clean; 989 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 460 op/s 2024-04-26T20:33:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 -- 172.21.15.82:0/3740617290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 msgr2=0x7f8b981093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 --2- 172.21.15.82:0/3740617290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b981093d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009900 tx=0x7f8b8802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 -- 172.21.15.82:0/3740617290 shutdown_connections 2024-04-26T20:33:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 --2- 172.21.15.82:0/3740617290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b9810ab60 0x7f8b981113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 --2- 172.21.15.82:0/3740617290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 0x7f8b9810a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 --2- 172.21.15.82:0/3740617290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b981093d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 -- 172.21.15.82:0/3740617290 >> 172.21.15.82:0/3740617290 conn(0x7f8b98077f50 msgr2=0x7f8b9807a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 -- 172.21.15.82:0/3740617290 shutdown_connections 2024-04-26T20:33:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.429+0000 7f8b9d000640 1 -- 172.21.15.82:0/3740617290 wait complete. 2024-04-26T20:33:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.430+0000 7f8b9d000640 1 Processor -- start 2024-04-26T20:33:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.430+0000 7f8b9d000640 1 -- start start 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.430+0000 7f8b9d000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b9819f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.430+0000 7f8b9d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 0x7f8b9819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.430+0000 7f8b9d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b9810ab60 0x7f8b981a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b9d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98114b40 con 0x7f8b9810a1a0 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b9d000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981149c0 con 0x7f8b9810ab60 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b9d000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b98114cc0 con 0x7f8b98108fb0 2024-04-26T20:33:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b9819f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b9819f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58406/0 (socket says 172.21.15.82:58406) 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 -- 172.21.15.82:0/2903282095 learned_addr learned my addr 172.21.15.82:0/2903282095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b96800640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b9810ab60 0x7f8b981a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b8d400640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 0x7f8b9819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 -- 172.21.15.82:0/2903282095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b9810ab60 msgr2=0x7f8b981a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b9810ab60 0x7f8b981a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 -- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 msgr2=0x7f8b9819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 0x7f8b9819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 -- 172.21.15.82:0/2903282095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b981a6d40 con 0x7f8b98108fb0 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b8d400640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 0x7f8b9819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.431+0000 7f8b95e00640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b9819f120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8b88031500 tx=0x7f8b88003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.432+0000 7f8b8f400640 1 -- 172.21.15.82:0/2903282095 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8803f070 con 0x7f8b98108fb0 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.432+0000 7f8b8f400640 1 -- 172.21.15.82:0/2903282095 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b88031c50 con 0x7f8b98108fb0 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.432+0000 7f8b8f400640 1 -- 172.21.15.82:0/2903282095 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88035030 con 0x7f8b98108fb0 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.432+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b981a6fd0 con 0x7f8b98108fb0 2024-04-26T20:33:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.432+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b981a73e0 con 0x7f8b98108fb0 2024-04-26T20:33:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 Processor -- start 2024-04-26T20:33:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b8f400640 1 -- 172.21.15.82:0/2903282095 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8b88042070 con 0x7f8b98108fb0 2024-04-26T20:33:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 -- start start 2024-04-26T20:33:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad0323ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad03290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad032bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cad0288380 con 0x55cad03245c0 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cad0224c30 con 0x55cad0329730 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cad0284340 con 0x55cad0323bd0 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b96800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad0323ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b8d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad032bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b96800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad0323ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58410/0 (socket says 172.21.15.82:58410) 2024-04-26T20:33:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b8d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad032bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:59520/0 (socket says 172.21.15.82:59520) 2024-04-26T20:33:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad03290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.435+0000 7f8b96800640 1 -- 172.21.15.82:0/695385770 learned_addr learned my addr 172.21.15.82:0/695385770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b8d400640 1 -- 172.21.15.82:0/695385770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 msgr2=0x55cad0323ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b8d400640 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad0323ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b8d400640 1 -- 172.21.15.82:0/695385770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 msgr2=0x55cad03290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b8d400640 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad03290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b8d400640 1 -- 172.21.15.82:0/695385770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad0246940 con 0x55cad0329730 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b96800640 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad0323ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b8d400640 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad032bbc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009c00 tx=0x7f8b800117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256c9adce4a442ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b87400640 1 -- 172.21.15.82:0/695385770 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80012450 con 0x55cad0329730 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b87400640 1 -- 172.21.15.82:0/695385770 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b80012aa0 con 0x55cad0329730 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.436+0000 7f8b87400640 1 -- 172.21.15.82:0/695385770 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000f9c0 con 0x55cad0329730 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b8f400640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b7c0a3d70 0x7f8b7c0a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b8f400640 1 -- 172.21.15.82:0/2903282095 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8b880f0ff0 con 0x7f8b98108fb0 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b96800640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b7c0a3d70 0x7f8b7c0a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 -- 172.21.15.82:0/695385770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 msgr2=0x55cad032bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad032bbc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009c00 tx=0x7f8b800117b0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 -- 172.21.15.82:0/695385770 shutdown_connections 2024-04-26T20:33:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad032bbc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad03290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/695385770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad0323ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 -- 172.21.15.82:0/695385770 >> 172.21.15.82:0/695385770 conn(0x55cad031f240 msgr2=0x55cad031f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b9fde4740 1 -- 172.21.15.82:0/695385770 shutdown_connections 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.437+0000 7f8b96800640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b7c0a3d70 0x7f8b7c0a6230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55cad0324e20 tx=0x7f8b90009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.438+0000 7f8b9fde4740 1 -- 172.21.15.82:0/695385770 wait complete. 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.438+0000 7f8b9fde4740 1 -- start start 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.438+0000 7f8b9fde4740 1 Processor -- start 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.438+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad032dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad032e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad0335300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cad032c6e0 con 0x55cad0329730 2024-04-26T20:33:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cad020fc60 con 0x55cad0323bd0 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cad032c860 con 0x55cad03245c0 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b9fde4740 10 client.0 _ll_register_callbacks cb 0x55cad023be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad032dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b8d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad032e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b8d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad032e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58426/0 (socket says 172.21.15.82:58426) 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b8d400640 1 -- 172.21.15.82:0/503881384 learned_addr learned my addr 172.21.15.82:0/503881384 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b96800640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad0335300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 -- 172.21.15.82:0/503881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 msgr2=0x55cad032e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad032e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 -- 172.21.15.82:0/503881384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 msgr2=0x55cad0335300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad0335300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 -- 172.21.15.82:0/503881384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad021e510 con 0x55cad0323bd0 2024-04-26T20:33:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b96800640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad0335300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b8d400640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad032e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b95e00640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad032dd80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b880ee620 tx=0x7f8b8803b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=806cdd0854954b96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.439+0000 7f8b7be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b7be00640 1 -- 172.21.15.82:0/503881384 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88049050 con 0x55cad0323bd0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b80012aa0 con 0x55cad0323bd0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b7be00640 1 -- 172.21.15.82:0/503881384 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8b880f4c90 con 0x55cad0323bd0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b7be00640 1 -- 172.21.15.82:0/503881384 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8b880bcbc0 con 0x55cad0323bd0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 10 client.27134 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55cacff9a210 con 0x55cad0323bd0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b7be00640 1 -- 172.21.15.82:0/503881384 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b80012aa0 con 0x55cad0323bd0 2024-04-26T20:33:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b7be00640 1 -- 172.21.15.82:0/503881384 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f8b8803b460 con 0x55cad0323bd0 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 10 client.27134 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 10 client.27134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 20 client.27134 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad03398d0 0x55cad033bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 4 client.27134 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.440+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad0295f90 con 0x55cad03398d0 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.441+0000 7f8b8d400640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad03398d0 0x55cad033bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.441+0000 7f8b7be00640 10 client.27134 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.441+0000 7f8b8d400640 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad03398d0 0x55cad033bd90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1c5ef424ce0272 server_cookie=e32e4203572a5908 in_seq=0 out_seq=0 2024-04-26T20:33:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b7be00640 1 -- 172.21.15.82:0/503881384 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cad0295f90 con 0x55cad03398d0 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b7be00640 10 client.27134 handle_command_reply: tid=0 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 client.27134 shutdown 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 msgr2=0x55cad032dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad032dd80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b880ee620 tx=0x7f8b8803b800 comp rx=0 tx=0).stop 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 shutdown_connections 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad03398d0 0x55cad033bd90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad0335300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad032e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/503881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad032dd80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 >> 172.21.15.82:0/503881384 conn(0x55cad031f240 msgr2=0x55cad031e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b7be00640 0 client.27134 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 shutdown_connections 2024-04-26T20:33:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.442+0000 7f8b9fde4740 1 -- 172.21.15.82:0/503881384 wait complete. 2024-04-26T20:33:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.443+0000 7f8b9fde4740 20 client.27134 trim_cache size 0 max 16384 2024-04-26T20:33:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.461+0000 7f8b9fde4740 1 Processor -- start 2024-04-26T20:33:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.461+0000 7f8b9fde4740 1 -- start start 2024-04-26T20:33:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad03257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad0335290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad0325ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981b1800 con 0x55cad03245c0 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981b3580 con 0x55cad0329730 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981b1f90 con 0x55cad0323bd0 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad03257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad03257a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58434/0 (socket says 172.21.15.82:58434) 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 -- 172.21.15.82:0/2563538682 learned_addr learned my addr 172.21.15.82:0/2563538682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b8d400640 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad0335290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b96800640 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad0325ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 -- 172.21.15.82:0/2563538682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 msgr2=0x55cad0325ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad0325ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 -- 172.21.15.82:0/2563538682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 msgr2=0x55cad0335290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad0335290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.462+0000 7f8b95e00640 1 -- 172.21.15.82:0/2563538682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad0066620 con 0x55cad0323bd0 2024-04-26T20:33:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.463+0000 7f8b95e00640 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad03257a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8b8802a9b0 tx=0x7f8b88005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ac2cec5ec56d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.463+0000 7f8b86a00640 1 -- 172.21.15.82:0/2563538682 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88049040 con 0x55cad0323bd0 2024-04-26T20:33:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.463+0000 7f8b86a00640 1 -- 172.21.15.82:0/2563538682 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b880c0070 con 0x55cad0323bd0 2024-04-26T20:33:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.463+0000 7f8b86a00640 1 -- 172.21.15.82:0/2563538682 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880bc750 con 0x55cad0323bd0 2024-04-26T20:33:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 -- 172.21.15.82:0/2563538682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 msgr2=0x55cad03257a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad03257a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8b8802a9b0 tx=0x7f8b88005fd0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 -- 172.21.15.82:0/2563538682 shutdown_connections 2024-04-26T20:33:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0329730 0x55cad0325ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad03245c0 0x55cad0335290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/2563538682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad0323bd0 0x55cad03257a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 -- 172.21.15.82:0/2563538682 >> 172.21.15.82:0/2563538682 conn(0x55cad031f240 msgr2=0x55cad0328da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 -- 172.21.15.82:0/2563538682 shutdown_connections 2024-04-26T20:33:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 -- 172.21.15.82:0/2563538682 wait complete. 2024-04-26T20:33:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 -- start start 2024-04-26T20:33:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.464+0000 7f8b9fde4740 1 Processor -- start 2024-04-26T20:33:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad0331f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad0332470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad039dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981b2eb0 con 0x55cad0329730 2024-04-26T20:33:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981b2720 con 0x55cad0323bd0 2024-04-26T20:33:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b981af7e0 con 0x55cad03245c0 2024-04-26T20:33:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b9fde4740 10 client.0 _ll_register_callbacks cb 0x7f8b880f4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad0332470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad0332470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:58450/0 (socket says 172.21.15.82:58450) 2024-04-26T20:33:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 -- 172.21.15.82:0/3087997728 learned_addr learned my addr 172.21.15.82:0/3087997728 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b96800640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad039dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b95e00640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad0331f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 -- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 msgr2=0x55cad0331f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad0331f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 -- 172.21.15.82:0/3087997728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 msgr2=0x55cad039dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad039dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b8d400640 1 -- 172.21.15.82:0/3087997728 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad0242cb0 con 0x55cad03245c0 2024-04-26T20:33:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.465+0000 7f8b95e00640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad0331f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b8d400640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad0332470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8b80005860 tx=0x7f8b80009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8973fc6e15b8efd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b7be00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b7be00640 1 -- 172.21.15.82:0/3087997728 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80012760 con 0x55cad03245c0 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b7be00640 1 -- 172.21.15.82:0/3087997728 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8b80020040 con 0x55cad03245c0 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b880c0070 con 0x55cad03245c0 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b7be00640 1 -- 172.21.15.82:0/3087997728 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8b8003b050 con 0x55cad03245c0 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b9fde4740 10 client.27223 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55cad039f1b0 con 0x55cad03245c0 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.466+0000 7f8b7be00640 1 -- 172.21.15.82:0/3087997728 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b880c0070 con 0x55cad03245c0 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b7be00640 1 -- 172.21.15.82:0/3087997728 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f8b80003760 con 0x55cad03245c0 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b9fde4740 10 client.27223 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b9fde4740 10 client.27223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b9fde4740 20 client.27223 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad039f950 0x55cad03a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b9fde4740 4 client.27223 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:33:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cad028fe00 con 0x55cad039f950 2024-04-26T20:33:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b95e00640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad039f950 0x55cad03a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b95e00640 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad039f950 0x55cad03a1d70 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3a9916834a7b1e server_cookie=f64fdf9e92888e1b in_seq=0 out_seq=0 2024-04-26T20:33:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.467+0000 7f8b7be00640 10 client.27223 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b7be00640 1 -- 172.21.15.82:0/3087997728 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cad028fe00 con 0x55cad039f950 2024-04-26T20:33:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b7be00640 10 client.27223 handle_command_reply: tid=0 2024-04-26T20:33:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 client.27223 shutdown 2024-04-26T20:33:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 msgr2=0x55cad0332470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad0332470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8b80005860 tx=0x7f8b80009b30 comp rx=0 tx=0).stop 2024-04-26T20:33:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 shutdown_connections 2024-04-26T20:33:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55cad039f950 0x55cad03a1d70 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cad0329730 0x55cad039dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cad03245c0 0x55cad0332470 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.479+0000 7f8b9fde4740 1 --2- 172.21.15.82:0/3087997728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cad0323bd0 0x55cad0331f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.480+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 >> 172.21.15.82:0/3087997728 conn(0x55cad031f240 msgr2=0x55cad03257a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.480+0000 7f8b7be00640 0 client.27223 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.480+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 shutdown_connections 2024-04-26T20:33:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.481+0000 7f8b9fde4740 1 -- 172.21.15.82:0/3087997728 wait complete. 2024-04-26T20:33:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.481+0000 7f8b9fde4740 20 client.27223 trim_cache size 0 max 16384 2024-04-26T20:33:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:33:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:33:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:33:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:33:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.481+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b7c0a3d70 msgr2=0x7f8b7c0a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.481+0000 7f8b9d000640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b7c0a3d70 0x7f8b7c0a6230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55cad0324e20 tx=0x7f8b90009500 comp rx=0 tx=0).stop 2024-04-26T20:33:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.481+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 msgr2=0x7f8b9819f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.481+0000 7f8b9d000640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b9819f120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8b88031500 tx=0x7f8b88003c10 comp rx=0 tx=0).stop 2024-04-26T20:33:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 shutdown_connections 2024-04-26T20:33:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f8b7c0a3d70 0x7f8b7c0a6230 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b9810ab60 0x7f8b981a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b9810a1a0 0x7f8b9819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 --2- 172.21.15.82:0/2903282095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b98108fb0 0x7f8b9819f120 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 >> 172.21.15.82:0/2903282095 conn(0x7f8b98077f50 msgr2=0x7f8b9810d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 shutdown_connections 2024-04-26T20:33:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:04.482+0000 7f8b9d000640 1 -- 172.21.15.82:0/2903282095 wait complete. 2024-04-26T20:33:05.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:05 smithi139 ceph-mon[32999]: pgmap v721: 129 pgs: 129 active+clean; 982 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 446 op/s 2024-04-26T20:33:05.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:05 smithi135 ceph-mon[32816]: pgmap v721: 129 pgs: 129 active+clean; 982 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 446 op/s 2024-04-26T20:33:05.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:05 smithi082 ceph-mon[28105]: pgmap v721: 129 pgs: 129 active+clean; 982 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 446 op/s 2024-04-26T20:33:07.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:07 smithi139 ceph-mon[32999]: pgmap v722: 129 pgs: 129 active+clean; 977 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 443 op/s 2024-04-26T20:33:07.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:07 smithi135 ceph-mon[32816]: pgmap v722: 129 pgs: 129 active+clean; 977 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 443 op/s 2024-04-26T20:33:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:07 smithi082 ceph-mon[28105]: pgmap v722: 129 pgs: 129 active+clean; 977 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 443 op/s 2024-04-26T20:33:09.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:09 smithi139 ceph-mon[32999]: pgmap v723: 129 pgs: 129 active+clean; 973 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 443 op/s 2024-04-26T20:33:09.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:09 smithi135 ceph-mon[32816]: pgmap v723: 129 pgs: 129 active+clean; 973 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 443 op/s 2024-04-26T20:33:09.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:09 smithi082 ceph-mon[28105]: pgmap v723: 129 pgs: 129 active+clean; 973 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 443 op/s 2024-04-26T20:33:11.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:11 smithi139 ceph-mon[32999]: pgmap v724: 129 pgs: 129 active+clean; 958 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 470 op/s 2024-04-26T20:33:11.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:11 smithi135 ceph-mon[32816]: pgmap v724: 129 pgs: 129 active+clean; 958 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 470 op/s 2024-04-26T20:33:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:11 smithi082 ceph-mon[28105]: pgmap v724: 129 pgs: 129 active+clean; 958 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 470 op/s 2024-04-26T20:33:13.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:13 smithi139 ceph-mon[32999]: pgmap v725: 129 pgs: 129 active+clean; 949 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 442 op/s 2024-04-26T20:33:13.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:13 smithi135 ceph-mon[32816]: pgmap v725: 129 pgs: 129 active+clean; 949 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 442 op/s 2024-04-26T20:33:13.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:13 smithi082 ceph-mon[28105]: pgmap v725: 129 pgs: 129 active+clean; 949 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 442 op/s 2024-04-26T20:33:15.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:15 smithi139 ceph-mon[32999]: pgmap v726: 129 pgs: 129 active+clean; 941 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 953 KiB/s wr, 415 op/s 2024-04-26T20:33:15.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:15 smithi135 ceph-mon[32816]: pgmap v726: 129 pgs: 129 active+clean; 941 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 953 KiB/s wr, 415 op/s 2024-04-26T20:33:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:15 smithi082 ceph-mon[28105]: pgmap v726: 129 pgs: 129 active+clean; 941 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 953 KiB/s wr, 415 op/s 2024-04-26T20:33:17.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:17 smithi139 ceph-mon[32999]: pgmap v727: 129 pgs: 129 active+clean; 929 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 418 op/s 2024-04-26T20:33:17.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:17 smithi135 ceph-mon[32816]: pgmap v727: 129 pgs: 129 active+clean; 929 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 418 op/s 2024-04-26T20:33:17.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:17 smithi082 ceph-mon[28105]: pgmap v727: 129 pgs: 129 active+clean; 929 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 418 op/s 2024-04-26T20:33:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.608+0000 7fb77fe00640 1 -- 172.21.15.82:0/4210923517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 msgr2=0x7fb780111220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.608+0000 7fb77fe00640 1 --2- 172.21.15.82:0/4210923517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb780111220 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb778009ca0 tx=0x7fb77802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 -- 172.21.15.82:0/4210923517 shutdown_connections 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 --2- 172.21.15.82:0/4210923517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb780111220 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 --2- 172.21.15.82:0/4210923517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780109fd0 0x7fb78010a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 --2- 172.21.15.82:0/4210923517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780108de0 0x7fb780109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 -- 172.21.15.82:0/4210923517 >> 172.21.15.82:0/4210923517 conn(0x7fb780077dc0 msgr2=0x7fb78007a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 -- 172.21.15.82:0/4210923517 shutdown_connections 2024-04-26T20:33:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.609+0000 7fb77fe00640 1 -- 172.21.15.82:0/4210923517 wait complete. 2024-04-26T20:33:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 Processor -- start 2024-04-26T20:33:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 -- start start 2024-04-26T20:33:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780108de0 0x7fb78019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 0x7fb78019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb7801a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb780114960 con 0x7fb780108de0 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801147e0 con 0x7fb780109fd0 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb780114ae0 con 0x7fb78010a990 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.610+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780108de0 0x7fb78019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb7801a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 0x7fb78019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb7801a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60832/0 (socket says 172.21.15.82:60832) 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780108de0 0x7fb78019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57372/0 (socket says 172.21.15.82:57372) 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77ea00640 1 -- 172.21.15.82:0/3295553133 learned_addr learned my addr 172.21.15.82:0/3295553133 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 0x7fb78019f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:35576/0 (socket says 172.21.15.82:35576) 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 -- 172.21.15.82:0/3295553133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 msgr2=0x7fb7801a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb7801a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 -- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780108de0 msgr2=0x7fb78019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780108de0 0x7fb78019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 -- 172.21.15.82:0/3295553133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801a6ba0 con 0x7fb780109fd0 2024-04-26T20:33:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.611+0000 7fb77e000640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 0x7fb78019f4c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00e9f0 tx=0x7fb76c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.612+0000 7fb784a00640 1 -- 172.21.15.82:0/3295553133 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00cd80 con 0x7fb780109fd0 2024-04-26T20:33:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.612+0000 7fb784a00640 1 -- 172.21.15.82:0/3295553133 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb76c0035f0 con 0x7fb780109fd0 2024-04-26T20:33:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.612+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7801a6e90 con 0x7fb780109fd0 2024-04-26T20:33:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.612+0000 7fb784a00640 1 -- 172.21.15.82:0/3295553133 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c010690 con 0x7fb780109fd0 2024-04-26T20:33:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.612+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7801a7350 con 0x7fb780109fd0 2024-04-26T20:33:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 Processor -- start 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 -- start start 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18243de0 0x561b18244200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b182492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b1824bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b181a8380 con 0x561b182447d0 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b18144c30 con 0x561b18243de0 2024-04-26T20:33:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb788c62740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561b181a4340 con 0x561b18249940 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b182492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb784a00640 1 -- 172.21.15.82:0/3295553133 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb76c0037a0 con 0x7fb780109fd0 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b182492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57378/0 (socket says 172.21.15.82:57378) 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb77ea00640 1 -- 172.21.15.82:0/3745197628 learned_addr learned my addr 172.21.15.82:0/3745197628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.615+0000 7fb77f400640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18243de0 0x561b18244200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77e000640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b1824bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77ea00640 1 -- 172.21.15.82:0/3745197628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 msgr2=0x561b1824bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77ea00640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b1824bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77ea00640 1 -- 172.21.15.82:0/3745197628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18243de0 msgr2=0x561b18244200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77ea00640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18243de0 0x561b18244200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77ea00640 1 -- 172.21.15.82:0/3745197628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b18166940 con 0x561b182447d0 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77f400640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18243de0 0x561b18244200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77e000640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b1824bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb77ea00640 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b182492d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb770009d70 tx=0x7fb770011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b18b5c81a35589 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb76be00640 1 -- 172.21.15.82:0/3745197628 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770004220 con 0x561b182447d0 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb76be00640 1 -- 172.21.15.82:0/3745197628 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7700043c0 con 0x561b182447d0 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.616+0000 7fb76be00640 1 -- 172.21.15.82:0/3745197628 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700197f0 con 0x561b182447d0 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb784a00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb7640a3c30 0x7fb7640a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 -- 172.21.15.82:0/3745197628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 msgr2=0x561b182492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b182492d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb770009d70 tx=0x7fb770011810 comp rx=0 tx=0).stop 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 -- 172.21.15.82:0/3745197628 shutdown_connections 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b1824bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb784a00640 1 -- 172.21.15.82:0/3295553133 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb76c0d0bd0 con 0x7fb780109fd0 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b182492d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 --2- 172.21.15.82:0/3745197628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18243de0 0x561b18244200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 -- 172.21.15.82:0/3745197628 >> 172.21.15.82:0/3745197628 conn(0x561b1823f450 msgr2=0x561b1823f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb77f400640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb7640a3c30 0x7fb7640a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 -- 172.21.15.82:0/3745197628 shutdown_connections 2024-04-26T20:33:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.617+0000 7fb788c62740 1 -- 172.21.15.82:0/3745197628 wait complete. 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb788c62740 1 -- start start 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb77f400640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb7640a3c30 0x7fb7640a60f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb778005e30 tx=0x7fb778031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb788c62740 1 Processor -- start 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb788c62740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b1824df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb788c62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b1824e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb788c62740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18249940 0x561b18255430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.618+0000 7fb788c62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b1824c8f0 con 0x561b182447d0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb788c62740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b1812fc60 con 0x561b18249940 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb788c62740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561b1824ca70 con 0x561b18243de0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb788c62740 10 client.0 _ll_register_callbacks cb 0x561b1815be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b1824df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b1824e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b1824df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60860/0 (socket says 172.21.15.82:60860) 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77ea00640 1 -- 172.21.15.82:0/117970647 learned_addr learned my addr 172.21.15.82:0/117970647 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77f400640 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18249940 0x561b18255430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 -- 172.21.15.82:0/117970647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 msgr2=0x561b1824df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b1824df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 -- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18249940 msgr2=0x561b18255430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18249940 0x561b18255430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 -- 172.21.15.82:0/117970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1813e510 con 0x561b182447d0 2024-04-26T20:33:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb77e000640 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b1824e4d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0ce1c0 tx=0x7fb76c09c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2422022358ed2f7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb768c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.619+0000 7fb768c00640 1 -- 172.21.15.82:0/117970647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0a0d40 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb768c00640 1 -- 172.21.15.82:0/117970647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb76c099000 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7700043c0 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb768c00640 1 -- 172.21.15.82:0/117970647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb76c0a5600 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 10 client.17067 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x561b17eba210 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb768c00640 1 -- 172.21.15.82:0/117970647 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7700043c0 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb768c00640 1 -- 172.21.15.82:0/117970647 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7fb76c09bde0 con 0x561b182447d0 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 10 client.17067 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 20 client.17067 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b18259a20 0x561b1825be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 4 client.17067 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.620+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b181b5f90 con 0x561b18259a20 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.621+0000 7fb77ea00640 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b18259a20 0x561b1825be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.621+0000 7fb77ea00640 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b18259a20 0x561b1825be50 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ad0d8007eebddc server_cookie=4c501c8c8dc57afd in_seq=0 out_seq=0 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.621+0000 7fb768c00640 10 client.17067 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb768c00640 1 -- 172.21.15.82:0/117970647 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561b181b5f90 con 0x561b18259a20 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb768c00640 10 client.17067 handle_command_reply: tid=0 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 client.17067 shutdown 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 msgr2=0x561b1824e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b1824e4d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0ce1c0 tx=0x7fb76c09c5c0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 shutdown_connections 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b18259a20 0x561b1825be50 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b18249940 0x561b18255430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b182447d0 0x561b1824e4d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 --2- 172.21.15.82:0/117970647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b1824df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 >> 172.21.15.82:0/117970647 conn(0x561b1823f450 msgr2=0x561b1823e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb768c00640 0 client.17067 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 shutdown_connections 2024-04-26T20:33:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 1 -- 172.21.15.82:0/117970647 wait complete. 2024-04-26T20:33:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.622+0000 7fb788c62740 20 client.17067 trim_cache size 0 max 16384 2024-04-26T20:33:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 Processor -- start 2024-04-26T20:33:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 -- start start 2024-04-26T20:33:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18243de0 0x561b18245950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b182553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b18245e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b1810 con 0x561b18243de0 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b3590 con 0x561b182447d0 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb788c62740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b1fa0 con 0x561b18249940 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb77f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b18245e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb77f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b18245e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60864/0 (socket says 172.21.15.82:60864) 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb77f400640 1 -- 172.21.15.82:0/4252847011 learned_addr learned my addr 172.21.15.82:0/4252847011 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.640+0000 7fb77ea00640 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18243de0 0x561b18245950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77e000640 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b182553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77f400640 1 -- 172.21.15.82:0/4252847011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 msgr2=0x561b182553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77f400640 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b182553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77f400640 1 -- 172.21.15.82:0/4252847011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18243de0 msgr2=0x561b18245950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77f400640 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18243de0 0x561b18245950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77f400640 1 -- 172.21.15.82:0/4252847011 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b17f86620 con 0x561b18249940 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77e000640 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b182553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.641+0000 7fb77f400640 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b18245e90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb778035000 tx=0x7fb778041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dc14eb6c529288b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb76b400640 1 -- 172.21.15.82:0/4252847011 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778009880 con 0x561b18249940 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb76b400640 1 -- 172.21.15.82:0/4252847011 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb778036050 con 0x561b18249940 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb76b400640 1 -- 172.21.15.82:0/4252847011 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77802f810 con 0x561b18249940 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 -- 172.21.15.82:0/4252847011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 msgr2=0x561b18245e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b18245e90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb778035000 tx=0x7fb778041000 comp rx=0 tx=0).stop 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 -- 172.21.15.82:0/4252847011 shutdown_connections 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18249940 0x561b18245e90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b182553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 --2- 172.21.15.82:0/4252847011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18243de0 0x561b18245950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.642+0000 7fb788c62740 1 -- 172.21.15.82:0/4252847011 >> 172.21.15.82:0/4252847011 conn(0x561b1823f450 msgr2=0x561b1824df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 -- 172.21.15.82:0/4252847011 shutdown_connections 2024-04-26T20:33:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 -- 172.21.15.82:0/4252847011 wait complete. 2024-04-26T20:33:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 -- start start 2024-04-26T20:33:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 Processor -- start 2024-04-26T20:33:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b18252a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b18252f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18249940 0x561b18253f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b2ec0 con 0x561b18249940 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801b2730 con 0x561b182447d0 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.643+0000 7fb788c62740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801af7f0 con 0x561b18243de0 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb788c62740 10 client.0 _ll_register_callbacks cb 0x7fb76c09c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18249940 0x561b18253f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b18252a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b18252a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:60868/0 (socket says 172.21.15.82:60868) 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77ea00640 1 -- 172.21.15.82:0/3562158230 learned_addr learned my addr 172.21.15.82:0/3562158230 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77e000640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b18252f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77e000640 1 -- 172.21.15.82:0/3562158230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 msgr2=0x561b18252a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77e000640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b18252a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77e000640 1 -- 172.21.15.82:0/3562158230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18249940 msgr2=0x561b18253f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77e000640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18249940 0x561b18253f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77e000640 1 -- 172.21.15.82:0/3562158230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b18162cb0 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.644+0000 7fb77ea00640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b18252a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb77e000640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b18252f70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb76c000c00 tx=0x7fb76c0bd140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3da23629d2c67a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb768c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb768c00640 1 -- 172.21.15.82:0/3562158230 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c098760 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb768c00640 1 -- 172.21.15.82:0/3562158230 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb76c098900 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb778036050 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb768c00640 1 -- 172.21.15.82:0/3562158230 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb76c0bbb50 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb788c62740 10 client.27158 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x561b182556b0 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb768c00640 1 -- 172.21.15.82:0/3562158230 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb778036050 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.645+0000 7fb768c00640 1 -- 172.21.15.82:0/3562158230 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7fb76c09b8e0 con 0x561b182447d0 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb788c62740 10 client.27158 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb788c62740 10 client.27158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb788c62740 20 client.27158 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb788c62740 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b182c0600 0x561b182c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb788c62740 4 client.27158 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b181afe00 con 0x561b182c0600 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb77ea00640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b182c0600 0x561b182c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb77ea00640 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b182c0600 0x561b182c2a20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f355482cfa9d888 server_cookie=569f09c8ebfc0e8d in_seq=0 out_seq=0 2024-04-26T20:33:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.646+0000 7fb768c00640 10 client.27158 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.653+0000 7fb768c00640 1 -- 172.21.15.82:0/3562158230 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b181afe00 con 0x561b182c0600 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.653+0000 7fb768c00640 10 client.27158 handle_command_reply: tid=0 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.653+0000 7fb788c62740 1 client.27158 shutdown 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 msgr2=0x561b18252f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b18252f70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb76c000c00 tx=0x7fb76c0bd140 comp rx=0 tx=0).stop 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 shutdown_connections 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x561b182c0600 0x561b182c2a20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b18249940 0x561b18253f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b182447d0 0x561b18252f70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 --2- 172.21.15.82:0/3562158230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561b18243de0 0x561b18252a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 >> 172.21.15.82:0/3562158230 conn(0x561b1823f450 msgr2=0x561b18245950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb768c00640 0 client.27158 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 shutdown_connections 2024-04-26T20:33:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 1 -- 172.21.15.82:0/3562158230 wait complete. 2024-04-26T20:33:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.654+0000 7fb788c62740 20 client.27158 trim_cache size 0 max 16384 2024-04-26T20:33:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:33:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:33:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:33:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb7640a3c30 msgr2=0x7fb7640a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb7640a3c30 0x7fb7640a60f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb778005e30 tx=0x7fb778031af0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 msgr2=0x7fb78019f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 0x7fb78019f4c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00e9f0 tx=0x7fb76c00eeb0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 shutdown_connections 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fb7640a3c30 0x7fb7640a60f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb78010a990 0x7fb7801a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb780109fd0 0x7fb78019f4c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 --2- 172.21.15.82:0/3295553133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb780108de0 0x7fb78019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 >> 172.21.15.82:0/3295553133 conn(0x7fb780077dc0 msgr2=0x7fb78010d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 shutdown_connections 2024-04-26T20:33:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:17.655+0000 7fb77fe00640 1 -- 172.21.15.82:0/3295553133 wait complete. 2024-04-26T20:33:19.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:19 smithi139 ceph-mon[32999]: pgmap v728: 129 pgs: 129 active+clean; 926 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 746 KiB/s wr, 395 op/s 2024-04-26T20:33:19.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:19 smithi135 ceph-mon[32816]: pgmap v728: 129 pgs: 129 active+clean; 926 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 746 KiB/s wr, 395 op/s 2024-04-26T20:33:19.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:19 smithi082 ceph-mon[28105]: pgmap v728: 129 pgs: 129 active+clean; 926 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 746 KiB/s wr, 395 op/s 2024-04-26T20:33:21.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:21 smithi139 ceph-mon[32999]: pgmap v729: 129 pgs: 129 active+clean; 920 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 433 op/s 2024-04-26T20:33:21.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:21 smithi135 ceph-mon[32816]: pgmap v729: 129 pgs: 129 active+clean; 920 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 433 op/s 2024-04-26T20:33:21.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:21 smithi082 ceph-mon[28105]: pgmap v729: 129 pgs: 129 active+clean; 920 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 433 op/s 2024-04-26T20:33:23.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:23 smithi139 ceph-mon[32999]: pgmap v730: 129 pgs: 129 active+clean; 907 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1019 KiB/s wr, 435 op/s 2024-04-26T20:33:23.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:23 smithi135 ceph-mon[32816]: pgmap v730: 129 pgs: 129 active+clean; 907 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1019 KiB/s wr, 435 op/s 2024-04-26T20:33:23.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:23 smithi082 ceph-mon[28105]: pgmap v730: 129 pgs: 129 active+clean; 907 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1019 KiB/s wr, 435 op/s 2024-04-26T20:33:25.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:25 smithi139 ceph-mon[32999]: pgmap v731: 129 pgs: 129 active+clean; 900 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 888 KiB/s wr, 412 op/s 2024-04-26T20:33:25.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:25 smithi135 ceph-mon[32816]: pgmap v731: 129 pgs: 129 active+clean; 900 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 888 KiB/s wr, 412 op/s 2024-04-26T20:33:25.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:25 smithi082 ceph-mon[28105]: pgmap v731: 129 pgs: 129 active+clean; 900 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 888 KiB/s wr, 412 op/s 2024-04-26T20:33:27.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:27 smithi139 ceph-mon[32999]: pgmap v732: 129 pgs: 129 active+clean; 891 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 417 op/s 2024-04-26T20:33:27.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:27 smithi135 ceph-mon[32816]: pgmap v732: 129 pgs: 129 active+clean; 891 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 417 op/s 2024-04-26T20:33:27.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:27 smithi082 ceph-mon[28105]: pgmap v732: 129 pgs: 129 active+clean; 891 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 417 op/s 2024-04-26T20:33:29.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:29 smithi139 ceph-mon[32999]: pgmap v733: 129 pgs: 129 active+clean; 887 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 980 KiB/s wr, 400 op/s 2024-04-26T20:33:29.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:29 smithi135 ceph-mon[32816]: pgmap v733: 129 pgs: 129 active+clean; 887 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 980 KiB/s wr, 400 op/s 2024-04-26T20:33:29.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:29 smithi082 ceph-mon[28105]: pgmap v733: 129 pgs: 129 active+clean; 887 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 980 KiB/s wr, 400 op/s 2024-04-26T20:33:30.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 -- 172.21.15.82:0/1326838523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 msgr2=0x7f8060103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 --2- 172.21.15.82:0/1326838523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060103e30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f804c009900 tx=0x7f804c02a3f0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 -- 172.21.15.82:0/1326838523 shutdown_connections 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 --2- 172.21.15.82:0/1326838523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8060104370 0x7f806010ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 --2- 172.21.15.82:0/1326838523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060103e30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 --2- 172.21.15.82:0/1326838523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f8060102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.791+0000 7f805f200640 1 -- 172.21.15.82:0/1326838523 >> 172.21.15.82:0/1326838523 conn(0x7f80600fdd30 msgr2=0x7f8060100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.792+0000 7f805f200640 1 -- 172.21.15.82:0/1326838523 shutdown_connections 2024-04-26T20:33:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.792+0000 7f805f200640 1 -- 172.21.15.82:0/1326838523 wait complete. 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 Processor -- start 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 -- start start 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f80600766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8060104370 0x7f8060075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f806010e2f0 con 0x7f80601027c0 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f806010e170 con 0x7f8060104370 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805f200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f806010e470 con 0x7f80601039b0 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f80600766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f80600766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33134/0 (socket says 172.21.15.82:33134) 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.793+0000 7f805de00640 1 -- 172.21.15.82:0/3989993943 learned_addr learned my addr 172.21.15.82:0/3989993943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805d400640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805e800640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8060104370 0x7f8060075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805de00640 1 -- 172.21.15.82:0/3989993943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 msgr2=0x7f8060074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805de00640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805de00640 1 -- 172.21.15.82:0/3989993943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8060104370 msgr2=0x7f8060075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805de00640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8060104370 0x7f8060075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805de00640 1 -- 172.21.15.82:0/3989993943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8060075af0 con 0x7f80601027c0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805d400640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.794+0000 7f805de00640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f80600766e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f805000ea80 tx=0x7f805000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.795+0000 7f8056a00640 1 -- 172.21.15.82:0/3989993943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805000ce40 con 0x7f80601027c0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.795+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80601a2ae0 con 0x7f80601027c0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.795+0000 7f8056a00640 1 -- 172.21.15.82:0/3989993943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8050011920 con 0x7f80601027c0 2024-04-26T20:33:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.795+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80601a3050 con 0x7f80601027c0 2024-04-26T20:33:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.795+0000 7f8056a00640 1 -- 172.21.15.82:0/3989993943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805001aa70 con 0x7f80601027c0 2024-04-26T20:33:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.798+0000 7f806805f740 1 Processor -- start 2024-04-26T20:33:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.798+0000 7f8056a00640 1 -- 172.21.15.82:0/3989993943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f805001ac10 con 0x7f80601027c0 2024-04-26T20:33:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 -- start start 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 0x55b5e9bac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9bb1940 0x55b5e9bb3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b5e9b10380 con 0x55b5e9babde0 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b5e9aacc30 con 0x55b5e9bac7d0 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f806805f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b5e9b0c340 con 0x55b5e9bb1940 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f805e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 0x55b5e9bac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f805e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 0x55b5e9bac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33148/0 (socket says 172.21.15.82:33148) 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f805e800640 1 -- 172.21.15.82:0/1945271672 learned_addr learned my addr 172.21.15.82:0/1945271672 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f805d400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9bb1940 0x55b5e9bb3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.799+0000 7f805de00640 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805e800640 1 -- 172.21.15.82:0/1945271672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9bb1940 msgr2=0x55b5e9bb3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805e800640 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9bb1940 0x55b5e9bb3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805e800640 1 -- 172.21.15.82:0/1945271672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 msgr2=0x55b5e9bb12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805e800640 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805e800640 1 -- 172.21.15.82:0/1945271672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5e9ace940 con 0x55b5e9babde0 2024-04-26T20:33:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805d400640 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9bb1940 0x55b5e9bb3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.800+0000 7f805e800640 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 0x55b5e9bac200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8058009ca0 tx=0x7f8058011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8ead8f580efafa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.801+0000 7f8056a00640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f80440a3cb0 0x7f80440a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.801+0000 7f804b400640 1 -- 172.21.15.82:0/1945271672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805801e070 con 0x55b5e9babde0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.801+0000 7f8056a00640 1 -- 172.21.15.82:0/3989993943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f80500d0da0 con 0x7f80601027c0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.801+0000 7f804b400640 1 -- 172.21.15.82:0/1945271672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8058009e50 con 0x55b5e9babde0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.801+0000 7f804b400640 1 -- 172.21.15.82:0/1945271672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805800ea50 con 0x55b5e9babde0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.801+0000 7f805de00640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f80440a3cb0 0x7f80440a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 -- 172.21.15.82:0/1945271672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 msgr2=0x55b5e9bac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f805de00640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f80440a3cb0 0x7f80440a6170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55b5e9bacbd0 tx=0x7f80500d4850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 0x55b5e9bac200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8058009ca0 tx=0x7f8058011810 comp rx=0 tx=0).stop 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 -- 172.21.15.82:0/1945271672 shutdown_connections 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9bb1940 0x55b5e9bb3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 --2- 172.21.15.82:0/1945271672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9babde0 0x55b5e9bac200 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 -- 172.21.15.82:0/1945271672 >> 172.21.15.82:0/1945271672 conn(0x55b5e9ba7450 msgr2=0x55b5e9ba7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 -- 172.21.15.82:0/1945271672 shutdown_connections 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.802+0000 7f806805f740 1 -- 172.21.15.82:0/1945271672 wait complete. 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.803+0000 7f806805f740 1 -- start start 2024-04-26T20:33:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.803+0000 7f806805f740 1 Processor -- start 2024-04-26T20:33:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bb6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b5e9bb48f0 con 0x55b5e9bac7d0 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b5e9a97c60 con 0x55b5e9bb1940 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b5e9bb4a70 con 0x55b5e9babde0 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f806805f740 10 client.0 _ll_register_callbacks cb 0x55b5e9ac3e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f805d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f805d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33164/0 (socket says 172.21.15.82:33164) 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f805d400640 1 -- 172.21.15.82:0/1980791192 learned_addr learned my addr 172.21.15.82:0/1980791192 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f805e800640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bb6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.804+0000 7f805e800640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f805d400640 1 -- 172.21.15.82:0/1980791192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 msgr2=0x55b5e9bb6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f805d400640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bb6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f805d400640 1 -- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 msgr2=0x55b5e9bbd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f805d400640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f805d400640 1 -- 172.21.15.82:0/1980791192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5e9aa6510 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f805d400640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb6540 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f804c02a910 tx=0x7f804c031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166ca50793dae352 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f803fe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f803fe00640 1 -- 172.21.15.82:0/1980791192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c035040 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f803fe00640 1 -- 172.21.15.82:0/1980791192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f804c004240 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.805+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8058009e50 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f803fe00640 1 -- 172.21.15.82:0/1980791192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f804c004440 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 10 client.17085 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55b5e9822210 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f803fe00640 1 -- 172.21.15.82:0/1980791192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8058009e50 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f803fe00640 1 -- 172.21.15.82:0/1980791192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f804c004cd0 con 0x55b5e9bac7d0 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 10 client.17085 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 10 client.17085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 20 client.17085 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9bc1c10 0x55b5e9bc4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 4 client.17085 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.806+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5e9b1df90 con 0x55b5e9bc1c10 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.807+0000 7f805e800640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9bc1c10 0x55b5e9bc4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.807+0000 7f803fe00640 10 client.17085 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.807+0000 7f805e800640 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9bc1c10 0x55b5e9bc4030 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a6c771ba45653a server_cookie=84a9149a5e6d1622 in_seq=0 out_seq=0 2024-04-26T20:33:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.808+0000 7f803fe00640 1 -- 172.21.15.82:0/1980791192 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b5e9b1df90 con 0x55b5e9bc1c10 2024-04-26T20:33:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.808+0000 7f803fe00640 10 client.17085 handle_command_reply: tid=0 2024-04-26T20:33:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.808+0000 7f806805f740 1 client.17085 shutdown 2024-04-26T20:33:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 msgr2=0x55b5e9bb6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb6540 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f804c02a910 tx=0x7f804c031910 comp rx=0 tx=0).stop 2024-04-26T20:33:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 shutdown_connections 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9bc1c10 0x55b5e9bc4030 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bb6540 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 --2- 172.21.15.82:0/1980791192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bb6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 >> 172.21.15.82:0/1980791192 conn(0x55b5e9ba7450 msgr2=0x55b5e9ba6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f803fe00640 0 client.17085 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 shutdown_connections 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 1 -- 172.21.15.82:0/1980791192 wait complete. 2024-04-26T20:33:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.809+0000 7f806805f740 20 client.17085 trim_cache size 0 max 16384 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 Processor -- start 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 -- start start 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bc9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bc9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f804000fb90 con 0x55b5e9bb1940 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8040011910 con 0x55b5e9bac7d0 2024-04-26T20:33:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.826+0000 7f806805f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8040010320 con 0x55b5e9babde0 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bc9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bc9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:33580/0 (socket says 172.21.15.82:33580) 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 -- 172.21.15.82:0/641264371 learned_addr learned my addr 172.21.15.82:0/641264371 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805e800640 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805e800640 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bc9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 -- 172.21.15.82:0/641264371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 msgr2=0x55b5e9bc9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bc9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 -- 172.21.15.82:0/641264371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bb1940 msgr2=0x55b5e9bbd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805d400640 1 -- 172.21.15.82:0/641264371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5e98ee620 con 0x55b5e9bac7d0 2024-04-26T20:33:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.827+0000 7f805e800640 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.828+0000 7f805d400640 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bc9e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f804c009850 tx=0x7f804c0315a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c82b5c300cca872 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.828+0000 7f804aa00640 1 -- 172.21.15.82:0/641264371 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c035030 con 0x55b5e9bac7d0 2024-04-26T20:33:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.828+0000 7f804aa00640 1 -- 172.21.15.82:0/641264371 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f804c031e30 con 0x55b5e9bac7d0 2024-04-26T20:33:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.828+0000 7f804aa00640 1 -- 172.21.15.82:0/641264371 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c005030 con 0x55b5e9bac7d0 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 -- 172.21.15.82:0/641264371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 msgr2=0x55b5e9bc9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bc9e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f804c009850 tx=0x7f804c0315a0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 -- 172.21.15.82:0/641264371 shutdown_connections 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bc9e40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 --2- 172.21.15.82:0/641264371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bc9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 -- 172.21.15.82:0/641264371 >> 172.21.15.82:0/641264371 conn(0x55b5e9ba7450 msgr2=0x55b5e9bb6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 -- 172.21.15.82:0/641264371 shutdown_connections 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 -- 172.21.15.82:0/641264371 wait complete. 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.829+0000 7f806805f740 1 -- start start 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 Processor -- start 2024-04-26T20:33:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bba6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bbac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8040011240 con 0x55b5e9bac7d0 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8040010ab0 con 0x55b5e9bb1940 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f804000db70 con 0x55b5e9babde0 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.830+0000 7f806805f740 10 client.0 _ll_register_callbacks cb 0x7f804c005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bbac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bba6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bba6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:44144/0 (socket says 172.21.15.82:44144) 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bbac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34994/0 (socket says 172.21.15.82:34994) 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805e800640 1 -- 172.21.15.82:0/2947234619 learned_addr learned my addr 172.21.15.82:0/2947234619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805e800640 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 -- 172.21.15.82:0/2947234619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 msgr2=0x55b5e9bba6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bba6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 -- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 msgr2=0x55b5e9bbbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 -- 172.21.15.82:0/2947234619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5e9acacb0 con 0x55b5e9bac7d0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f805d400640 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bbac10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f804c02a430 tx=0x7f804c02ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7446748eaa045c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.831+0000 7f803fe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f803fe00640 1 -- 172.21.15.82:0/2947234619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c031af0 con 0x55b5e9bac7d0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f803fe00640 1 -- 172.21.15.82:0/2947234619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f804c005050 con 0x55b5e9bac7d0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f804c031e30 con 0x55b5e9bac7d0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f803fe00640 1 -- 172.21.15.82:0/2947234619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f804c064050 con 0x55b5e9bac7d0 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f806805f740 10 client.17091 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55b5e9bbd2e0 con 0x55b5e9bac7d0 2024-04-26T20:33:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.832+0000 7f803fe00640 1 -- 172.21.15.82:0/2947234619 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f804c031e30 con 0x55b5e9bac7d0 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f803fe00640 1 -- 172.21.15.82:0/2947234619 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f804c004cc0 con 0x55b5e9bac7d0 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f806805f740 10 client.17091 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f806805f740 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f806805f740 20 client.17091 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f806805f740 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9c28460 0x55b5e9c2a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f806805f740 4 client.17091 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5e9b17e00 con 0x55b5e9c28460 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.833+0000 7f805e800640 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9c28460 0x55b5e9c2a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.834+0000 7f805e800640 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9c28460 0x55b5e9c2a850 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59764233e0112165 server_cookie=7dfff7d467d12a6a in_seq=0 out_seq=0 2024-04-26T20:33:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.834+0000 7f803fe00640 10 client.17091 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.842+0000 7f803fe00640 1 -- 172.21.15.82:0/2947234619 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5e9b17e00 con 0x55b5e9c28460 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.842+0000 7f803fe00640 10 client.17091 handle_command_reply: tid=0 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.842+0000 7f806805f740 1 client.17091 shutdown 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.842+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 msgr2=0x55b5e9bbac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.842+0000 7f806805f740 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bbac10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f804c02a430 tx=0x7f804c02ab80 comp rx=0 tx=0).stop 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 shutdown_connections 2024-04-26T20:33:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55b5e9c28460 0x55b5e9c2a850 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b5e9bb1940 0x55b5e9bbbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5e9bac7d0 0x55b5e9bbac10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 --2- 172.21.15.82:0/2947234619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5e9babde0 0x55b5e9bba6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f803fe00640 0 client.17091 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 >> 172.21.15.82:0/2947234619 conn(0x55b5e9ba7450 msgr2=0x55b5e9bad950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 shutdown_connections 2024-04-26T20:33:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 1 -- 172.21.15.82:0/2947234619 wait complete. 2024-04-26T20:33:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.843+0000 7f806805f740 20 client.17091 trim_cache size 0 max 16384 2024-04-26T20:33:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:33:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:33:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:33:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f80440a3cb0 msgr2=0x7f80440a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f80440a3cb0 0x7f80440a6170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55b5e9bacbd0 tx=0x7f80500d4850 comp rx=0 tx=0).stop 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 msgr2=0x7f80600766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f80600766e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f805000ea80 tx=0x7f805000ef40 comp rx=0 tx=0).stop 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 shutdown_connections 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f80440a3cb0 0x7f80440a6170 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8060104370 0x7f8060075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80601039b0 0x7f8060074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 --2- 172.21.15.82:0/3989993943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80601027c0 0x7f80600766e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 >> 172.21.15.82:0/3989993943 conn(0x7f80600fdd30 msgr2=0x7f8060106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 shutdown_connections 2024-04-26T20:33:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:30.844+0000 7f805f200640 1 -- 172.21.15.82:0/3989993943 wait complete. 2024-04-26T20:33:31.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:31 smithi139 ceph-mon[32999]: pgmap v734: 129 pgs: 129 active+clean; 877 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 448 op/s 2024-04-26T20:33:31.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:31 smithi135 ceph-mon[32816]: pgmap v734: 129 pgs: 129 active+clean; 877 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 448 op/s 2024-04-26T20:33:31.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:31 smithi082 ceph-mon[28105]: pgmap v734: 129 pgs: 129 active+clean; 877 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 448 op/s 2024-04-26T20:33:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:33 smithi139 ceph-mon[32999]: pgmap v735: 129 pgs: 129 active+clean; 868 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 812 KiB/s wr, 439 op/s 2024-04-26T20:33:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:33 smithi135 ceph-mon[32816]: pgmap v735: 129 pgs: 129 active+clean; 868 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 812 KiB/s wr, 439 op/s 2024-04-26T20:33:33.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:33 smithi082 ceph-mon[28105]: pgmap v735: 129 pgs: 129 active+clean; 868 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 812 KiB/s wr, 439 op/s 2024-04-26T20:33:35.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:35 smithi139 ceph-mon[32999]: pgmap v736: 129 pgs: 129 active+clean; 866 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 440 op/s 2024-04-26T20:33:35.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:35 smithi135 ceph-mon[32816]: pgmap v736: 129 pgs: 129 active+clean; 866 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 440 op/s 2024-04-26T20:33:35.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:35 smithi082 ceph-mon[28105]: pgmap v736: 129 pgs: 129 active+clean; 866 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 440 op/s 2024-04-26T20:33:37.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:37 smithi139 ceph-mon[32999]: pgmap v737: 129 pgs: 129 active+clean; 857 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 454 op/s 2024-04-26T20:33:37.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:37 smithi135 ceph-mon[32816]: pgmap v737: 129 pgs: 129 active+clean; 857 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 454 op/s 2024-04-26T20:33:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:37 smithi082 ceph-mon[28105]: pgmap v737: 129 pgs: 129 active+clean; 857 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 454 op/s 2024-04-26T20:33:39.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:39 smithi139 ceph-mon[32999]: pgmap v738: 129 pgs: 129 active+clean; 852 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.1 MiB/s wr, 443 op/s 2024-04-26T20:33:39.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:39 smithi135 ceph-mon[32816]: pgmap v738: 129 pgs: 129 active+clean; 852 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.1 MiB/s wr, 443 op/s 2024-04-26T20:33:39.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:39 smithi082 ceph-mon[28105]: pgmap v738: 129 pgs: 129 active+clean; 852 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.1 MiB/s wr, 443 op/s 2024-04-26T20:33:41.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:41 smithi139 ceph-mon[32999]: pgmap v739: 129 pgs: 129 active+clean; 839 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.0 MiB/s wr, 492 op/s 2024-04-26T20:33:41.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:41 smithi135 ceph-mon[32816]: pgmap v739: 129 pgs: 129 active+clean; 839 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.0 MiB/s wr, 492 op/s 2024-04-26T20:33:41.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:41 smithi082 ceph-mon[28105]: pgmap v739: 129 pgs: 129 active+clean; 839 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.0 MiB/s wr, 492 op/s 2024-04-26T20:33:43.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:43 smithi139 ceph-mon[32999]: pgmap v740: 129 pgs: 129 active+clean; 833 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 486 op/s 2024-04-26T20:33:43.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:43 smithi135 ceph-mon[32816]: pgmap v740: 129 pgs: 129 active+clean; 833 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 486 op/s 2024-04-26T20:33:43.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:43 smithi082 ceph-mon[28105]: pgmap v740: 129 pgs: 129 active+clean; 833 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 486 op/s 2024-04-26T20:33:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 -- 172.21.15.82:0/1848716202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 msgr2=0x7f1df810ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 --2- 172.21.15.82:0/1848716202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 0x7f1df810ac30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009be0 tx=0x7f1df002a6c0 comp rx=0 tx=0).stop 2024-04-26T20:33:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 -- 172.21.15.82:0/1848716202 shutdown_connections 2024-04-26T20:33:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 --2- 172.21.15.82:0/1848716202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 0x7f1df810ac30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 --2- 172.21.15.82:0/1848716202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df81039e0 0x7f1df8103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 --2- 172.21.15.82:0/1848716202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 -- 172.21.15.82:0/1848716202 >> 172.21.15.82:0/1848716202 conn(0x7f1df80fdd60 msgr2=0x7f1df81001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 -- 172.21.15.82:0/1848716202 shutdown_connections 2024-04-26T20:33:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.992+0000 7f1dff000640 1 -- 172.21.15.82:0/1848716202 wait complete. 2024-04-26T20:33:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.993+0000 7f1dff000640 1 Processor -- start 2024-04-26T20:33:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.993+0000 7f1dff000640 1 -- start start 2024-04-26T20:33:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dff000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dff000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df81039e0 0x7f1df819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dff000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 0x7f1df81a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dff000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1df810e320 con 0x7f1df81039e0 2024-04-26T20:33:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dff000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1df810e1a0 con 0x7f1df81027f0 2024-04-26T20:33:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dff000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1df810e4a0 con 0x7f1df81043a0 2024-04-26T20:33:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:40056/0 (socket says 172.21.15.82:40056) 2024-04-26T20:33:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 -- 172.21.15.82:0/2036195653 learned_addr learned my addr 172.21.15.82:0/2036195653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfd200640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df81039e0 0x7f1df819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfe600640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 0x7f1df81a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 -- 172.21.15.82:0/2036195653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 msgr2=0x7f1df81a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 0x7f1df81a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 -- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df81039e0 msgr2=0x7f1df819b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df81039e0 0x7f1df819b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.994+0000 7f1dfdc00640 1 -- 172.21.15.82:0/2036195653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df81a27d0 con 0x7f1df81027f0 2024-04-26T20:33:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.995+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df819abb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e9c0 tx=0x7f1dec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.995+0000 7f1df6000640 1 -- 172.21.15.82:0/2036195653 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00cd80 con 0x7f1df81027f0 2024-04-26T20:33:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.995+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df81a2ac0 con 0x7f1df81027f0 2024-04-26T20:33:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.995+0000 7f1df6000640 1 -- 172.21.15.82:0/2036195653 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dec0035f0 con 0x7f1df81027f0 2024-04-26T20:33:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.995+0000 7f1df6000640 1 -- 172.21.15.82:0/2036195653 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec010690 con 0x7f1df81027f0 2024-04-26T20:33:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.995+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df81a2fc0 con 0x7f1df81027f0 2024-04-26T20:33:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.998+0000 7f1e0345a740 1 Processor -- start 2024-04-26T20:33:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 -- start start 2024-04-26T20:33:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abffa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651abfff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac001dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5651abf5e380 con 0x5651abffa7d0 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5651abefac30 con 0x5651abfff940 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1e0345a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5651abf5a340 con 0x5651abff9de0 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1df6000640 1 -- 172.21.15.82:0/2036195653 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1dec004000 con 0x7f1df81027f0 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abffa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abffa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43578/0 (socket says 172.21.15.82:43578) 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1dfe600640 1 -- 172.21.15.82:0/3173091150 learned_addr learned my addr 172.21.15.82:0/3173091150 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:43.999+0000 7f1dfd200640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac001dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651abfff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfe600640 1 -- 172.21.15.82:0/3173091150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 msgr2=0x5651ac001dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac001dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfe600640 1 -- 172.21.15.82:0/3173091150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 msgr2=0x5651abfff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651abfff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfe600640 1 -- 172.21.15.82:0/3173091150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651abf1c940 con 0x5651abff9de0 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfd200640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac001dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651abfff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:33:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abffa200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1df002acb0 tx=0x7f1df0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaf4eb013f11346e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.000+0000 7f1deaa00640 1 -- 172.21.15.82:0/3173091150 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0041030 con 0x5651abff9de0 2024-04-26T20:33:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1deaa00640 1 -- 172.21.15.82:0/3173091150 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1df0030570 con 0x5651abff9de0 2024-04-26T20:33:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1deaa00640 1 -- 172.21.15.82:0/3173091150 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0036040 con 0x5651abff9de0 2024-04-26T20:33:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1df6000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1de00a3cb0 0x7f1de00a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1df6000640 1 -- 172.21.15.82:0/2036195653 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1dec0d0e40 con 0x7f1df81027f0 2024-04-26T20:33:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1de00a3cb0 0x7f1de00a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1e0345a740 1 -- 172.21.15.82:0/3173091150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 msgr2=0x5651abffa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.001+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abffa200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1df002acb0 tx=0x7f1df0005fd0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 -- 172.21.15.82:0/3173091150 shutdown_connections 2024-04-26T20:33:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac001dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651abfff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3173091150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abffa200 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 -- 172.21.15.82:0/3173091150 >> 172.21.15.82:0/3173091150 conn(0x5651abff5450 msgr2=0x5651abff5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 -- 172.21.15.82:0/3173091150 shutdown_connections 2024-04-26T20:33:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 -- 172.21.15.82:0/3173091150 wait complete. 2024-04-26T20:33:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1dfdc00640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1de00a3cb0 0x7f1de00a6170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x5651abffabd0 tx=0x7f1dec005a70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 -- start start 2024-04-26T20:33:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.002+0000 7f1e0345a740 1 Processor -- start 2024-04-26T20:33:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abff9de0 0x5651ac003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 0x5651ac004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac00b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5651ac002890 con 0x5651abff9de0 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5651abee5c60 con 0x5651abfff940 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5651ac002a10 con 0x5651abffa7d0 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1dfd200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 0x5651ac004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1e0345a740 10 client.0 _ll_register_callbacks cb 0x5651abf11e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abff9de0 0x5651ac003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1dfd200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 0x5651ac004530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43592/0 (socket says 172.21.15.82:43592) 2024-04-26T20:33:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1dfd200640 1 -- 172.21.15.82:0/3040576310 learned_addr learned my addr 172.21.15.82:0/3040576310 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.003+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac00b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfd200640 1 -- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 msgr2=0x5651ac00b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfd200640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac00b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfd200640 1 -- 172.21.15.82:0/3040576310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abff9de0 msgr2=0x5651ac003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfd200640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abff9de0 0x5651ac003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfd200640 1 -- 172.21.15.82:0/3040576310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651abef4510 con 0x5651abffa7d0 2024-04-26T20:33:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac00b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:33:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1dfd200640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 0x5651ac004530 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1de4012700 tx=0x7f1de4012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=276fe94aaabb3ac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1ddf400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:33:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1ddf400640 1 -- 172.21.15.82:0/3040576310 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de400f940 con 0x5651abffa7d0 2024-04-26T20:33:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1df0030570 con 0x5651abffa7d0 2024-04-26T20:33:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.004+0000 7f1ddf400640 1 -- 172.21.15.82:0/3040576310 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1de400fae0 con 0x5651abffa7d0 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1ddf400640 1 -- 172.21.15.82:0/3040576310 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f1de400fce0 con 0x5651abffa7d0 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 10 client.27268 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5651abc70210 con 0x5651abffa7d0 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1ddf400640 1 -- 172.21.15.82:0/3040576310 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1df0030570 con 0x5651abffa7d0 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1ddf400640 1 -- 172.21.15.82:0/3040576310 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f1de401c4b0 con 0x5651abffa7d0 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 10 client.27268 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 10 client.27268 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 20 client.27268 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac00fbd0 0x5651ac012030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 4 client.27268 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.005+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651abf6bf90 con 0x5651ac00fbd0 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.006+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac00fbd0 0x5651ac012030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.006+0000 7f1dfe600640 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac00fbd0 0x5651ac012030 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b144e8e9812f44d server_cookie=3263513963469e1b in_seq=0 out_seq=0 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.006+0000 7f1ddf400640 10 client.27268 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1ddf400640 1 -- 172.21.15.82:0/3040576310 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5651abf6bf90 con 0x5651ac00fbd0 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1ddf400640 10 client.27268 handle_command_reply: tid=0 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 client.27268 shutdown 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 msgr2=0x5651ac004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 0x5651ac004530 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1de4012700 tx=0x7f1de4012bc0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 shutdown_connections 2024-04-26T20:33:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac00fbd0 0x5651ac012030 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651ac00b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abffa7d0 0x5651ac004530 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 --2- 172.21.15.82:0/3040576310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abff9de0 0x5651ac003ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1ddf400640 0 client.27268 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 >> 172.21.15.82:0/3040576310 conn(0x5651abff5450 msgr2=0x5651abff4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.007+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 shutdown_connections 2024-04-26T20:33:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.008+0000 7f1e0345a740 1 -- 172.21.15.82:0/3040576310 wait complete. 2024-04-26T20:33:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.008+0000 7f1e0345a740 20 client.27268 trim_cache size 0 max 16384 2024-04-26T20:33:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 Processor -- start 2024-04-26T20:33:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 -- start start 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abff3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651ac00b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651abff4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81ad390 con 0x5651abffa7d0 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81af110 con 0x5651abfff940 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.025+0000 7f1e0345a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81adb20 con 0x5651abff9de0 2024-04-26T20:33:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abff3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651ac00b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abff3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43600/0 (socket says 172.21.15.82:43600) 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfe600640 1 -- 172.21.15.82:0/4207237923 learned_addr learned my addr 172.21.15.82:0/4207237923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651ac00b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49530/0 (socket says 172.21.15.82:49530) 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfe600640 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651abff4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 -- 172.21.15.82:0/4207237923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 msgr2=0x5651abff3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abff3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 -- 172.21.15.82:0/4207237923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 msgr2=0x5651abff4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651abff4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 -- 172.21.15.82:0/4207237923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651abd3c620 con 0x5651abffa7d0 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfe600640 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abff3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.026+0000 7f1dfd200640 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651ac00b4c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1de4006010 tx=0x7f1de40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88c626baef5884e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1dea000640 1 -- 172.21.15.82:0/4207237923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de401cbb0 con 0x5651abffa7d0 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1dea000640 1 -- 172.21.15.82:0/4207237923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1de401cd50 con 0x5651abffa7d0 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1dea000640 1 -- 172.21.15.82:0/4207237923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4004460 con 0x5651abffa7d0 2024-04-26T20:33:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 -- 172.21.15.82:0/4207237923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 msgr2=0x5651ac00b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651ac00b4c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1de4006010 tx=0x7f1de40093f0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 -- 172.21.15.82:0/4207237923 shutdown_connections 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abfff940 0x5651abff4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abffa7d0 0x5651ac00b4c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 --2- 172.21.15.82:0/4207237923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651abff3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.027+0000 7f1e0345a740 1 -- 172.21.15.82:0/4207237923 >> 172.21.15.82:0/4207237923 conn(0x5651abff5450 msgr2=0x5651abffba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.028+0000 7f1e0345a740 1 -- 172.21.15.82:0/4207237923 shutdown_connections 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.028+0000 7f1e0345a740 1 -- 172.21.15.82:0/4207237923 wait complete. 2024-04-26T20:33:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.028+0000 7f1e0345a740 1 -- start start 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.028+0000 7f1e0345a740 1 Processor -- start 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651ac008740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abffa7d0 0x5651ac008c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abfff940 0x5651ac009c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81aea40 con 0x5651abfff940 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81ae2b0 con 0x5651abffa7d0 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1df81ab370 con 0x5651abff9de0 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1e0345a740 10 client.0 _ll_register_callbacks cb 0x7f1de4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651ac008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfe600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651ac008740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:43612/0 (socket says 172.21.15.82:43612) 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfe600640 1 -- 172.21.15.82:0/2871520880 learned_addr learned my addr 172.21.15.82:0/2871520880 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfe600640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abfff940 0x5651ac009c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfd200640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abffa7d0 0x5651ac008c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfe600640 1 -- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abffa7d0 msgr2=0x5651ac008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.029+0000 7f1dfe600640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abffa7d0 0x5651ac008c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1dfe600640 1 -- 172.21.15.82:0/2871520880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abfff940 msgr2=0x5651ac009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1dfe600640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abfff940 0x5651ac009c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1dfe600640 1 -- 172.21.15.82:0/2871520880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651abf18cb0 con 0x5651abff9de0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1dfd200640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abffa7d0 0x5651ac008c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1dfe600640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651ac008740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1df0030800 tx=0x7f1df003f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6428edefe59804b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1ddf400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1ddf400640 1 -- 172.21.15.82:0/2871520880 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0041040 con 0x5651abff9de0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1de401cd50 con 0x5651abff9de0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1ddf400640 1 -- 172.21.15.82:0/2871520880 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1df0030d90 con 0x5651abff9de0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1ddf400640 1 -- 172.21.15.82:0/2871520880 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f1df0036040 con 0x5651abff9de0 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1e0345a740 10 client.27274 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.030+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5651ac00b3c0 con 0x5651abff9de0 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1ddf400640 1 -- 172.21.15.82:0/2871520880 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1de401cd50 con 0x5651abff9de0 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1ddf400640 1 -- 172.21.15.82:0/2871520880 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f1df003d460 con 0x5651abff9de0 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1e0345a740 10 client.27274 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1e0345a740 10 client.27274 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1e0345a740 20 client.27274 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1e0345a740 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac076170 0x5651ac078560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1e0345a740 4 client.27274 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5651abf65e00 con 0x5651ac076170 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.031+0000 7f1dfd200640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac076170 0x5651ac078560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.032+0000 7f1dfd200640 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac076170 0x5651ac078560 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6896949a4993760a server_cookie=17a7738b0687e118 in_seq=0 out_seq=0 2024-04-26T20:33:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.032+0000 7f1ddf400640 10 client.27274 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.039+0000 7f1ddf400640 1 -- 172.21.15.82:0/2871520880 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651abf65e00 con 0x5651ac076170 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.039+0000 7f1ddf400640 10 client.27274 handle_command_reply: tid=0 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.039+0000 7f1e0345a740 1 client.27274 shutdown 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 msgr2=0x5651ac008740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651ac008740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1df0030800 tx=0x7f1df003f040 comp rx=0 tx=0).stop 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 shutdown_connections 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5651ac076170 0x5651ac078560 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5651abfff940 0x5651ac009c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5651abffa7d0 0x5651ac008c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 --2- 172.21.15.82:0/2871520880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651abff9de0 0x5651ac008740 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1ddf400640 0 client.27274 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 >> 172.21.15.82:0/2871520880 conn(0x5651abff5450 msgr2=0x5651ac003fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 shutdown_connections 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 1 -- 172.21.15.82:0/2871520880 wait complete. 2024-04-26T20:33:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.040+0000 7f1e0345a740 20 client.27274 trim_cache size 0 max 16384 2024-04-26T20:33:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:33:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:33:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:33:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1de00a3cb0 msgr2=0x7f1de00a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1de00a3cb0 0x7f1de00a6170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x5651abffabd0 tx=0x7f1dec005a70 comp rx=0 tx=0).stop 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 msgr2=0x7f1df819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df819abb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e9c0 tx=0x7f1dec00ee80 comp rx=0 tx=0).stop 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 shutdown_connections 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1de00a3cb0 0x7f1de00a6170 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1df81043a0 0x7f1df81a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1df81039e0 0x7f1df819b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 --2- 172.21.15.82:0/2036195653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df81027f0 0x7f1df819abb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 >> 172.21.15.82:0/2036195653 conn(0x7f1df80fdd60 msgr2=0x7f1df8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 shutdown_connections 2024-04-26T20:33:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:44.041+0000 7f1dff000640 1 -- 172.21.15.82:0/2036195653 wait complete. 2024-04-26T20:33:46.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:46 smithi139 ceph-mon[32999]: pgmap v741: 129 pgs: 129 active+clean; 828 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 474 op/s 2024-04-26T20:33:46.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:46 smithi135 ceph-mon[32816]: pgmap v741: 129 pgs: 129 active+clean; 828 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 474 op/s 2024-04-26T20:33:46.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:46 smithi082 ceph-mon[28105]: pgmap v741: 129 pgs: 129 active+clean; 828 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 474 op/s 2024-04-26T20:33:48.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:48 smithi139 ceph-mon[32999]: pgmap v742: 129 pgs: 129 active+clean; 822 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 977 KiB/s wr, 460 op/s 2024-04-26T20:33:48.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:48 smithi135 ceph-mon[32816]: pgmap v742: 129 pgs: 129 active+clean; 822 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 977 KiB/s wr, 460 op/s 2024-04-26T20:33:48.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:48 smithi082 ceph-mon[28105]: pgmap v742: 129 pgs: 129 active+clean; 822 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 977 KiB/s wr, 460 op/s 2024-04-26T20:33:50.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:50 smithi139 ceph-mon[32999]: pgmap v743: 129 pgs: 129 active+clean; 818 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 728 KiB/s wr, 436 op/s 2024-04-26T20:33:50.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:50 smithi135 ceph-mon[32816]: pgmap v743: 129 pgs: 129 active+clean; 818 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 728 KiB/s wr, 436 op/s 2024-04-26T20:33:50.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:50 smithi082 ceph-mon[28105]: pgmap v743: 129 pgs: 129 active+clean; 818 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 728 KiB/s wr, 436 op/s 2024-04-26T20:33:52.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:52 smithi139 ceph-mon[32999]: pgmap v744: 129 pgs: 129 active+clean; 813 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 493 op/s 2024-04-26T20:33:52.370 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:52 smithi135 ceph-mon[32816]: pgmap v744: 129 pgs: 129 active+clean; 813 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 493 op/s 2024-04-26T20:33:52.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:52 smithi082 ceph-mon[28105]: pgmap v744: 129 pgs: 129 active+clean; 813 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 493 op/s 2024-04-26T20:33:54.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:54 smithi139 ceph-mon[32999]: pgmap v745: 129 pgs: 129 active+clean; 806 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 454 op/s 2024-04-26T20:33:54.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:54 smithi135 ceph-mon[32816]: pgmap v745: 129 pgs: 129 active+clean; 806 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 454 op/s 2024-04-26T20:33:54.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:54 smithi082 ceph-mon[28105]: pgmap v745: 129 pgs: 129 active+clean; 806 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 454 op/s 2024-04-26T20:33:56.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:56 smithi139 ceph-mon[32999]: pgmap v746: 129 pgs: 129 active+clean; 801 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 709 KiB/s wr, 442 op/s 2024-04-26T20:33:56.368 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:56 smithi135 ceph-mon[32816]: pgmap v746: 129 pgs: 129 active+clean; 801 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 709 KiB/s wr, 442 op/s 2024-04-26T20:33:56.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:56 smithi082 ceph-mon[28105]: pgmap v746: 129 pgs: 129 active+clean; 801 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 709 KiB/s wr, 442 op/s 2024-04-26T20:33:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 -- 172.21.15.82:0/2133249574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1010a0 msgr2=0x7f81cc1014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 --2- 172.21.15.82:0/2133249574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1010a0 0x7f81cc1014c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009900 tx=0x7f81bc02a480 comp rx=0 tx=0).stop 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 -- 172.21.15.82:0/2133249574 shutdown_connections 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 --2- 172.21.15.82:0/2133249574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1023a0 0x7f81cc102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 --2- 172.21.15.82:0/2133249574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc101a00 0x7f81cc101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 --2- 172.21.15.82:0/2133249574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1010a0 0x7f81cc1014c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 -- 172.21.15.82:0/2133249574 >> 172.21.15.82:0/2133249574 conn(0x7f81cc0fcc20 msgr2=0x7f81cc0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 -- 172.21.15.82:0/2133249574 shutdown_connections 2024-04-26T20:33:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.174+0000 7f81cb200640 1 -- 172.21.15.82:0/2133249574 wait complete. 2024-04-26T20:33:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 Processor -- start 2024-04-26T20:33:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 -- start start 2024-04-26T20:33:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 0x7f81cc19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc101a00 0x7f81cc19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1023a0 0x7f81cc1a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc110500 con 0x7f81cc101a00 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc110380 con 0x7f81cc1010a0 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.176+0000 7f81cb200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc110680 con 0x7f81cc1023a0 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 0x7f81cc19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc101a00 0x7f81cc19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 0x7f81cc19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52866/0 (socket says 172.21.15.82:52866) 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 -- 172.21.15.82:0/2471872745 learned_addr learned my addr 172.21.15.82:0/2471872745 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81ca800640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1023a0 0x7f81cc1a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 -- 172.21.15.82:0/2471872745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1023a0 msgr2=0x7f81cc1a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1023a0 0x7f81cc1a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 -- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc101a00 msgr2=0x7f81cc19b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc101a00 0x7f81cc19b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.177+0000 7f81c9e00640 1 -- 172.21.15.82:0/2471872745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc1a2830 con 0x7f81cc1010a0 2024-04-26T20:33:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.178+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 0x7f81cc19ac20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005ab0 tx=0x7f81bc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.178+0000 7f81c2a00640 1 -- 172.21.15.82:0/2471872745 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc03f070 con 0x7f81cc1010a0 2024-04-26T20:33:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.178+0000 7f81c2a00640 1 -- 172.21.15.82:0/2471872745 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc031c50 con 0x7f81cc1010a0 2024-04-26T20:33:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.178+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc1a2ac0 con 0x7f81cc1010a0 2024-04-26T20:33:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.178+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc1a3000 con 0x7f81cc1010a0 2024-04-26T20:33:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.178+0000 7f81c2a00640 1 -- 172.21.15.82:0/2471872745 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc035030 con 0x7f81cc1010a0 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 Processor -- start 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 -- start start 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81c2a00640 1 -- 172.21.15.82:0/2471872745 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f81bc042070 con 0x7f81cc1010a0 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e103de0 0x56534e104200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 0x56534e1092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e10bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56534e068380 con 0x56534e103de0 2024-04-26T20:33:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56534e004c30 con 0x56534e109940 2024-04-26T20:33:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.183+0000 7f81d3b77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56534e064340 con 0x56534e1047d0 2024-04-26T20:33:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 0x56534e1092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 0x56534e1092d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47754/0 (socket says 172.21.15.82:47754) 2024-04-26T20:33:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 -- 172.21.15.82:0/2442580922 learned_addr learned my addr 172.21.15.82:0/2442580922 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81ca800640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e103de0 0x56534e104200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9400640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e10bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 -- 172.21.15.82:0/2442580922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 msgr2=0x56534e10bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e10bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 -- 172.21.15.82:0/2442580922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e103de0 msgr2=0x56534e104200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e103de0 0x56534e104200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9e00640 1 -- 172.21.15.82:0/2442580922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56534e026940 con 0x56534e1047d0 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81ca800640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e103de0 0x56534e104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.184+0000 7f81c9400640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e10bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 0x56534e1092d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0f92f0 tx=0x7f81bc0f93e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5701f61f27b9357 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81c2a00640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81b00a3cb0 0x7f81b00a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81b7000640 1 -- 172.21.15.82:0/2442580922 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0b90e0 con 0x56534e1047d0 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81b7000640 1 -- 172.21.15.82:0/2442580922 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc0fe030 con 0x56534e1047d0 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81b7000640 1 -- 172.21.15.82:0/2442580922 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0bc650 con 0x56534e1047d0 2024-04-26T20:33:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81c2a00640 1 -- 172.21.15.82:0/2471872745 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f81bc0f1110 con 0x7f81cc1010a0 2024-04-26T20:33:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.185+0000 7f81ca800640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81b00a3cb0 0x7f81b00a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 -- 172.21.15.82:0/2442580922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 msgr2=0x56534e1092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 0x56534e1092d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0f92f0 tx=0x7f81bc0f93e0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81ca800640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81b00a3cb0 0x7f81b00a6170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f81c40099a0 tx=0x7f81c4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 -- 172.21.15.82:0/2442580922 shutdown_connections 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e10bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e1047d0 0x56534e1092d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2442580922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e103de0 0x56534e104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 -- 172.21.15.82:0/2442580922 >> 172.21.15.82:0/2442580922 conn(0x56534e0ff450 msgr2=0x56534e0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 -- 172.21.15.82:0/2442580922 shutdown_connections 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.186+0000 7f81d3b77740 1 -- 172.21.15.82:0/2442580922 wait complete. 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.187+0000 7f81d3b77740 1 -- start start 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.187+0000 7f81d3b77740 1 Processor -- start 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.187+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e116520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.187+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 0x56534e116a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.187+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e109940 0x56534e11daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81d3b77740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56534e10c6b0 con 0x56534e109940 2024-04-26T20:33:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81d3b77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56534dfefc60 con 0x56534e1047d0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81d3b77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56534e10c830 con 0x56534e103de0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81d3b77740 10 client.0 _ll_register_callbacks cb 0x56534e01be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 0x56534e116a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e116520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 0x56534e116a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52888/0 (socket says 172.21.15.82:52888) 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 -- 172.21.15.82:0/2718744524 learned_addr learned my addr 172.21.15.82:0/2718744524 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 -- 172.21.15.82:0/2718744524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 msgr2=0x56534e116520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e116520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 -- 172.21.15.82:0/2718744524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e109940 msgr2=0x56534e11daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81ca800640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e109940 0x56534e11daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e109940 0x56534e11daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81c9400640 1 -- 172.21.15.82:0/2718744524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56534dffe510 con 0x56534e1047d0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.188+0000 7f81ca800640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e109940 0x56534e11daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81c9400640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 0x56534e116a60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f81b8012700 tx=0x7f81b8012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f19e29a7c9ba43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81ab400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81ab400640 1 -- 172.21.15.82:0/2718744524 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8004050 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81bc0fe030 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81ab400640 1 -- 172.21.15.82:0/2718744524 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f81b80041f0 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81ab400640 1 -- 172.21.15.82:0/2718744524 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f81b8025050 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81d3b77740 10 client.27203 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56534dd7a210 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.189+0000 7f81ab400640 1 -- 172.21.15.82:0/2718744524 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc0fe030 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81ab400640 1 -- 172.21.15.82:0/2718744524 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f81b8003940 con 0x56534e1047d0 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81d3b77740 10 client.27203 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81d3b77740 10 client.27203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81d3b77740 20 client.27203 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e122150 0x56534e124590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81d3b77740 4 client.27203 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:33:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56534e075f90 con 0x56534e122150 2024-04-26T20:33:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.190+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e122150 0x56534e124590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.191+0000 7f81c9e00640 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e122150 0x56534e124590 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5fb580898b789ff server_cookie=92ab3400011db8e in_seq=0 out_seq=0 2024-04-26T20:33:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.191+0000 7f81ab400640 10 client.27203 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.191+0000 7f81ab400640 1 -- 172.21.15.82:0/2718744524 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56534e075f90 con 0x56534e122150 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.191+0000 7f81ab400640 10 client.27203 handle_command_reply: tid=0 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 client.27203 shutdown 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 msgr2=0x56534e116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 0x56534e116a60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f81b8012700 tx=0x7f81b8012bc0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 shutdown_connections 2024-04-26T20:33:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e122150 0x56534e124590 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e109940 0x56534e11daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e1047d0 0x56534e116a60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 --2- 172.21.15.82:0/2718744524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e116520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81ab400640 0 client.27203 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 >> 172.21.15.82:0/2718744524 conn(0x56534e0ff450 msgr2=0x56534e0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 shutdown_connections 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 1 -- 172.21.15.82:0/2718744524 wait complete. 2024-04-26T20:33:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.192+0000 7f81d3b77740 20 client.27203 trim_cache size 0 max 16384 2024-04-26T20:33:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.219+0000 7f81d3b77740 1 Processor -- start 2024-04-26T20:33:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.219+0000 7f81d3b77740 1 -- start start 2024-04-26T20:33:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e105990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81d3b77740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc1a8f60 con 0x56534e1047d0 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81d3b77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc1aace0 con 0x56534e109940 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81d3b77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc1a96f0 con 0x56534e103de0 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47770/0 (socket says 172.21.15.82:47770) 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81c9e00640 1 -- 172.21.15.82:0/3626933275 learned_addr learned my addr 172.21.15.82:0/3626933275 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81c9400640 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.220+0000 7f81ca800640 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81c9e00640 1 -- 172.21.15.82:0/3626933275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 msgr2=0x56534e105990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81c9e00640 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e105990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81c9e00640 1 -- 172.21.15.82:0/3626933275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 msgr2=0x56534e11da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81c9e00640 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81c9e00640 1 -- 172.21.15.82:0/3626933275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56534de46620 con 0x56534e103de0 2024-04-26T20:33:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81ca800640 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81c9e00640 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e108fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f81bc000c00 tx=0x7f81bc003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=803129be39c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81b6600640 1 -- 172.21.15.82:0/3626933275 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc049040 con 0x56534e103de0 2024-04-26T20:33:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81b6600640 1 -- 172.21.15.82:0/3626933275 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc0fe040 con 0x56534e103de0 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.221+0000 7f81b6600640 1 -- 172.21.15.82:0/3626933275 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0bc830 con 0x56534e103de0 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 -- 172.21.15.82:0/3626933275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 msgr2=0x56534e108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e108fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f81bc000c00 tx=0x7f81bc003f90 comp rx=0 tx=0).stop 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 -- 172.21.15.82:0/3626933275 shutdown_connections 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e109940 0x56534e105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 --2- 172.21.15.82:0/3626933275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e103de0 0x56534e108fb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 -- 172.21.15.82:0/3626933275 >> 172.21.15.82:0/3626933275 conn(0x56534e0ff450 msgr2=0x56534e0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 -- 172.21.15.82:0/3626933275 shutdown_connections 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.222+0000 7f81d3b77740 1 -- 172.21.15.82:0/3626933275 wait complete. 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 -- start start 2024-04-26T20:33:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 Processor -- start 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 0x56534e11acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e109940 0x56534e11c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc1aa610 con 0x56534e1047d0 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc1a9e80 con 0x56534e103de0 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc1a6f60 con 0x56534e109940 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.223+0000 7f81d3b77740 10 client.0 _ll_register_callbacks cb 0x7f81b8009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 0x56534e11acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 0x56534e11acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52904/0 (socket says 172.21.15.82:52904) 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 -- 172.21.15.82:0/729246424 learned_addr learned my addr 172.21.15.82:0/729246424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81ca800640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e109940 0x56534e11c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9400640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 -- 172.21.15.82:0/729246424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e109940 msgr2=0x56534e11c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e109940 0x56534e11c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 -- 172.21.15.82:0/729246424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 msgr2=0x56534e11b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9e00640 1 -- 172.21.15.82:0/729246424 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56534e022cb0 con 0x56534e103de0 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81ca800640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e109940 0x56534e11c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.224+0000 7f81c9400640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81c9e00640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 0x56534e11acb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0b92a0 tx=0x7f81bc0f93e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf5455ec765bad4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81ab400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81ab400640 1 -- 172.21.15.82:0/729246424 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc049040 con 0x56534e103de0 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81bc0fe040 con 0x56534e103de0 2024-04-26T20:33:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81ab400640 1 -- 172.21.15.82:0/729246424 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f81bc0f9e20 con 0x56534e103de0 2024-04-26T20:33:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81ab400640 1 -- 172.21.15.82:0/729246424 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f81bc0bca10 con 0x56534e103de0 2024-04-26T20:33:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81d3b77740 10 client.27209 fetch_fsmap learned FSMap version 54 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56534e11d930 con 0x56534e103de0 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.225+0000 7f81ab400640 1 -- 172.21.15.82:0/729246424 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc0fe040 con 0x56534e103de0 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81ab400640 1 -- 172.21.15.82:0/729246424 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f81bc0f4810 con 0x56534e103de0 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81d3b77740 10 client.27209 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81d3b77740 10 client.27209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81d3b77740 20 client.27209 populate_metadata read hostname 'smithi082' 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81d3b77740 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e188710 0x56534e18ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81d3b77740 4 client.27209 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56534e06fe00 con 0x56534e188710 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.226+0000 7f81c9400640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e188710 0x56534e18ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.227+0000 7f81c9400640 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e188710 0x56534e18ab30 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bedd006e4336dfa server_cookie=cfa9f5837fc6a803 in_seq=0 out_seq=0 2024-04-26T20:33:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.227+0000 7f81ab400640 10 client.27209 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.236+0000 7f81ab400640 1 -- 172.21.15.82:0/729246424 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56534e06fe00 con 0x56534e188710 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.236+0000 7f81ab400640 10 client.27209 handle_command_reply: tid=0 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.236+0000 7f81d3b77740 1 client.27209 shutdown 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.236+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 msgr2=0x56534e11acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.236+0000 7f81d3b77740 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 0x56534e11acb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0b92a0 tx=0x7f81bc0f93e0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 shutdown_connections 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x56534e188710 0x56534e18ab30 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56534e109940 0x56534e11c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56534e1047d0 0x56534e11b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 --2- 172.21.15.82:0/729246424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56534e103de0 0x56534e11acb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 >> 172.21.15.82:0/729246424 conn(0x56534e0ff450 msgr2=0x56534e1164c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81ab400640 0 client.27209 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:33:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 shutdown_connections 2024-04-26T20:33:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 1 -- 172.21.15.82:0/729246424 wait complete. 2024-04-26T20:33:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.237+0000 7f81d3b77740 20 client.27209 trim_cache size 0 max 16384 2024-04-26T20:33:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:33:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:33:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:33:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:33:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81b00a3cb0 msgr2=0x7f81b00a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81b00a3cb0 0x7f81b00a6170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f81c40099a0 tx=0x7f81c4009500 comp rx=0 tx=0).stop 2024-04-26T20:33:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 msgr2=0x7f81cc19ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:33:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 0x7f81cc19ac20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005ab0 tx=0x7f81bc003b90 comp rx=0 tx=0).stop 2024-04-26T20:33:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 shutdown_connections 2024-04-26T20:33:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f81b00a3cb0 0x7f81b00a6170 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81cc1023a0 0x7f81cc1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc101a00 0x7f81cc19b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 --2- 172.21.15.82:0/2471872745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81cc1010a0 0x7f81cc19ac20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.238+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 >> 172.21.15.82:0/2471872745 conn(0x7f81cc0fcc20 msgr2=0x7f81cc0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:33:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.239+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 shutdown_connections 2024-04-26T20:33:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:33:57.239+0000 7f81cb200640 1 -- 172.21.15.82:0/2471872745 wait complete. 2024-04-26T20:33:57.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:57 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:57.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:57 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:57.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:57 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:58.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:58 smithi135 ceph-mon[32816]: pgmap v747: 129 pgs: 129 active+clean; 797 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 439 op/s 2024-04-26T20:33:58.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:58.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:58.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:33:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:33:58.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:58 smithi082 ceph-mon[28105]: pgmap v747: 129 pgs: 129 active+clean; 797 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 439 op/s 2024-04-26T20:33:58.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:58.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:58.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:33:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:33:58.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:58 smithi139 ceph-mon[32999]: pgmap v747: 129 pgs: 129 active+clean; 797 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 439 op/s 2024-04-26T20:33:58.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:58.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:58.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:33:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:34:00.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:00 smithi135 ceph-mon[32816]: pgmap v748: 129 pgs: 129 active+clean; 793 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 841 KiB/s wr, 424 op/s 2024-04-26T20:34:00.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:00 smithi082 ceph-mon[28105]: pgmap v748: 129 pgs: 129 active+clean; 793 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 841 KiB/s wr, 424 op/s 2024-04-26T20:34:00.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:00 smithi139 ceph-mon[32999]: pgmap v748: 129 pgs: 129 active+clean; 793 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 841 KiB/s wr, 424 op/s 2024-04-26T20:34:02.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:02 smithi135 ceph-mon[32816]: pgmap v749: 129 pgs: 129 active+clean; 784 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 857 KiB/s wr, 472 op/s 2024-04-26T20:34:02.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:02 smithi082 ceph-mon[28105]: pgmap v749: 129 pgs: 129 active+clean; 784 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 857 KiB/s wr, 472 op/s 2024-04-26T20:34:02.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:02 smithi139 ceph-mon[32999]: pgmap v749: 129 pgs: 129 active+clean; 784 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 857 KiB/s wr, 472 op/s 2024-04-26T20:34:04.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:04 smithi135 ceph-mon[32816]: pgmap v750: 129 pgs: 129 active+clean; 778 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 944 KiB/s wr, 451 op/s 2024-04-26T20:34:04.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:04 smithi082 ceph-mon[28105]: pgmap v750: 129 pgs: 129 active+clean; 778 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 944 KiB/s wr, 451 op/s 2024-04-26T20:34:04.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:04 smithi139 ceph-mon[32999]: pgmap v750: 129 pgs: 129 active+clean; 778 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 944 KiB/s wr, 451 op/s 2024-04-26T20:34:06.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:06 smithi135 ceph-mon[32816]: pgmap v751: 129 pgs: 129 active+clean; 771 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 954 KiB/s wr, 452 op/s 2024-04-26T20:34:06.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:06 smithi082 ceph-mon[28105]: pgmap v751: 129 pgs: 129 active+clean; 771 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 954 KiB/s wr, 452 op/s 2024-04-26T20:34:06.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:06 smithi139 ceph-mon[32999]: pgmap v751: 129 pgs: 129 active+clean; 771 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 954 KiB/s wr, 452 op/s 2024-04-26T20:34:08.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:08 smithi135 ceph-mon[32816]: pgmap v752: 129 pgs: 129 active+clean; 762 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 434 op/s 2024-04-26T20:34:08.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:08 smithi082 ceph-mon[28105]: pgmap v752: 129 pgs: 129 active+clean; 762 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 434 op/s 2024-04-26T20:34:08.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:08 smithi139 ceph-mon[32999]: pgmap v752: 129 pgs: 129 active+clean; 762 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 434 op/s 2024-04-26T20:34:10.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:10 smithi135 ceph-mon[32816]: pgmap v753: 129 pgs: 129 active+clean; 758 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 715 KiB/s wr, 392 op/s 2024-04-26T20:34:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 -- 172.21.15.82:0/776237582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7601027c0 msgr2=0x7fc760102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 --2- 172.21.15.82:0/776237582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7601027c0 0x7fc760102be0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc750009ca0 tx=0x7fc75002a8c0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 -- 172.21.15.82:0/776237582 shutdown_connections 2024-04-26T20:34:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 --2- 172.21.15.82:0/776237582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc760104370 0x7fc76010ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 --2- 172.21.15.82:0/776237582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601039b0 0x7fc760103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 --2- 172.21.15.82:0/776237582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7601027c0 0x7fc760102be0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 -- 172.21.15.82:0/776237582 >> 172.21.15.82:0/776237582 conn(0x7fc7600fdd30 msgr2=0x7fc760100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 -- 172.21.15.82:0/776237582 shutdown_connections 2024-04-26T20:34:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.373+0000 7fc75fe00640 1 -- 172.21.15.82:0/776237582 wait complete. 2024-04-26T20:34:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.374+0000 7fc75fe00640 1 Processor -- start 2024-04-26T20:34:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 -- start start 2024-04-26T20:34:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 0x7fc7600766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7601039b0 0x7fc760074d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc760104370 0x7fc760075260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc76010e330 con 0x7fc760104370 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc76010e1b0 con 0x7fc7601039b0 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc76010e4b0 con 0x7fc7601027c0 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 0x7fc7600766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 0x7fc7600766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:57022/0 (socket says 172.21.15.82:57022) 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75ea00640 1 -- 172.21.15.82:0/3679437486 learned_addr learned my addr 172.21.15.82:0/3679437486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc75f400640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc760104370 0x7fc760075260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.375+0000 7fc756000640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7601039b0 0x7fc760074d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75ea00640 1 -- 172.21.15.82:0/3679437486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7601039b0 msgr2=0x7fc760074d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75ea00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7601039b0 0x7fc760074d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75ea00640 1 -- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc760104370 msgr2=0x7fc760075260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75ea00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc760104370 0x7fc760075260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75ea00640 1 -- 172.21.15.82:0/3679437486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760075af0 con 0x7fc7601027c0 2024-04-26T20:34:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75ea00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 0x7fc7600766e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc750005e30 tx=0x7fc7500317e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc757e00640 1 -- 172.21.15.82:0/3679437486 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750003bf0 con 0x7fc7601027c0 2024-04-26T20:34:10.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7601a2b40 con 0x7fc7601027c0 2024-04-26T20:34:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc757e00640 1 -- 172.21.15.82:0/3679437486 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc750003d90 con 0x7fc7601027c0 2024-04-26T20:34:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc757e00640 1 -- 172.21.15.82:0/3679437486 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75002fbe0 con 0x7fc7601027c0 2024-04-26T20:34:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.376+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7601a30e0 con 0x7fc7601027c0 2024-04-26T20:34:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.380+0000 7fc768857740 1 Processor -- start 2024-04-26T20:34:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 -- start start 2024-04-26T20:34:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc757e00640 1 -- 172.21.15.82:0/3679437486 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc75002fd80 con 0x7fc7601027c0 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a6de0 0x5570a97a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a77d0 0x5570a97ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5570a970b380 con 0x5570a97a6de0 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5570a96a7c30 con 0x5570a97ac940 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc768857740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5570a9707340 con 0x5570a97a77d0 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a77d0 0x5570a97ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc756000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a77d0 0x5570a97ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:57034/0 (socket says 172.21.15.82:57034) 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.381+0000 7fc75ea00640 1 -- 172.21.15.82:0/3498661335 learned_addr learned my addr 172.21.15.82:0/3498661335 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc75f400640 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a6de0 0x5570a97a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc756000640 1 -- 172.21.15.82:0/3498661335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a77d0 msgr2=0x5570a97ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc756000640 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a77d0 0x5570a97ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc756000640 1 -- 172.21.15.82:0/3498661335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a6de0 msgr2=0x5570a97a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc756000640 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a6de0 0x5570a97a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc756000640 1 -- 172.21.15.82:0/3498661335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a96c9940 con 0x5570a97ac940 2024-04-26T20:34:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.382+0000 7fc756000640 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97aedd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc748009b40 tx=0x7fc7480113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59bbc65786c77e6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc74fe00640 1 -- 172.21.15.82:0/3498661335 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748011e10 con 0x5570a97ac940 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc757e00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7440a3c30 0x7fc7440a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc74fe00640 1 -- 172.21.15.82:0/3498661335 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc748012900 con 0x5570a97ac940 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc74fe00640 1 -- 172.21.15.82:0/3498661335 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74800f990 con 0x5570a97ac940 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc757e00640 1 -- 172.21.15.82:0/3679437486 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc7500f2080 con 0x7fc7601027c0 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc75f400640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7440a3c30 0x7fc7440a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc768857740 1 -- 172.21.15.82:0/3498661335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 msgr2=0x5570a97aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.383+0000 7fc768857740 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97aedd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc748009b40 tx=0x7fc7480113e0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 -- 172.21.15.82:0/3498661335 shutdown_connections 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97aedd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a77d0 0x5570a97ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 --2- 172.21.15.82:0/3498661335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a6de0 0x5570a97a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 -- 172.21.15.82:0/3498661335 >> 172.21.15.82:0/3498661335 conn(0x5570a97a2450 msgr2=0x5570a97a2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 -- 172.21.15.82:0/3498661335 shutdown_connections 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 -- 172.21.15.82:0/3498661335 wait complete. 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc75f400640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7440a3c30 0x7fc7440a60f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5570a97a8030 tx=0x7fc758005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.384+0000 7fc768857740 1 -- start start 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 Processor -- start 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5570a97af8f0 con 0x5570a97a77d0 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5570a9692c60 con 0x5570a97ac940 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5570a97afa70 con 0x5570a97a6de0 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc768857740 10 client.0 _ll_register_callbacks cb 0x5570a96bee50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.385+0000 7fc756000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:52854/0 (socket says 172.21.15.82:52854) 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 -- 172.21.15.82:0/1248457266 learned_addr learned my addr 172.21.15.82:0/1248457266 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 -- 172.21.15.82:0/1248457266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 msgr2=0x5570a97b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 -- 172.21.15.82:0/1248457266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 msgr2=0x5570a97b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 -- 172.21.15.82:0/1248457266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a96a1510 con 0x5570a97ac940 2024-04-26T20:34:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.386+0000 7fc75f400640 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b8540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc758004600 tx=0x7fc758004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67bc1a66bde3c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc74cc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:34:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc74cc00640 1 -- 172.21.15.82:0/1248457266 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75801e470 con 0x5570a97ac940 2024-04-26T20:34:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc74cc00640 1 -- 172.21.15.82:0/1248457266 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc75801e610 con 0x5570a97ac940 2024-04-26T20:34:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc748012900 con 0x5570a97ac940 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc74cc00640 1 -- 172.21.15.82:0/1248457266 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc75801e810 con 0x5570a97ac940 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc768857740 10 client.27221 fetch_fsmap learned FSMap version 54 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.387+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5570a941d210 con 0x5570a97ac940 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc74cc00640 1 -- 172.21.15.82:0/1248457266 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc748012900 con 0x5570a97ac940 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc74cc00640 1 -- 172.21.15.82:0/1248457266 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7fc758027070 con 0x5570a97ac940 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc768857740 10 client.27221 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc768857740 10 client.27221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc768857740 20 client.27221 populate_metadata read hostname 'smithi082' 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc768857740 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a97bcc20 0x5570a97bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc768857740 4 client.27221 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.388+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570a9718f90 con 0x5570a97bcc20 2024-04-26T20:34:10.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.389+0000 7fc75ea00640 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a97bcc20 0x5570a97bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.389+0000 7fc75ea00640 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a97bcc20 0x5570a97bf0a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2730453b0761df8d server_cookie=8985cc413834a665 in_seq=0 out_seq=0 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.389+0000 7fc74cc00640 10 client.27221 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc74cc00640 1 -- 172.21.15.82:0/1248457266 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5570a9718f90 con 0x5570a97bcc20 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc74cc00640 10 client.27221 handle_command_reply: tid=0 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 client.27221 shutdown 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 msgr2=0x5570a97b8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b8540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc758004600 tx=0x7fc758004730 comp rx=0 tx=0).stop 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 shutdown_connections 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a97bcc20 0x5570a97bf0a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b8540 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc74cc00640 0 client.27221 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 --2- 172.21.15.82:0/1248457266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.390+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 >> 172.21.15.82:0/1248457266 conn(0x5570a97a2450 msgr2=0x5570a97a1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.391+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 shutdown_connections 2024-04-26T20:34:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.391+0000 7fc768857740 1 -- 172.21.15.82:0/1248457266 wait complete. 2024-04-26T20:34:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.391+0000 7fc768857740 20 client.27221 trim_cache size 0 max 16384 2024-04-26T20:34:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.407+0000 7fc768857740 1 Processor -- start 2024-04-26T20:34:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 -- start start 2024-04-26T20:34:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97a6de0 0x5570a97c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 0x5570a97b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601ad3f0 con 0x5570a97a77d0 2024-04-26T20:34:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601af170 con 0x5570a97a6de0 2024-04-26T20:34:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc768857740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601adb80 con 0x5570a97ac940 2024-04-26T20:34:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc75f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 0x5570a97b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc756000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc75f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 0x5570a97b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:57052/0 (socket says 172.21.15.82:57052) 2024-04-26T20:34:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc75f400640 1 -- 172.21.15.82:0/2981953860 learned_addr learned my addr 172.21.15.82:0/2981953860 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.408+0000 7fc75ea00640 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97a6de0 0x5570a97c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc75f400640 1 -- 172.21.15.82:0/2981953860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97a6de0 msgr2=0x5570a97c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc75f400640 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97a6de0 0x5570a97c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc75f400640 1 -- 172.21.15.82:0/2981953860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 msgr2=0x5570a97c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc75f400640 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc75f400640 1 -- 172.21.15.82:0/2981953860 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a94e9620 con 0x5570a97ac940 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc75f400640 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 0x5570a97b8500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc758012cb0 tx=0x7fc7580043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f37629d9d7b2669 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc74f400640 1 -- 172.21.15.82:0/2981953860 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75801e530 con 0x5570a97ac940 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc74f400640 1 -- 172.21.15.82:0/2981953860 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc758029440 con 0x5570a97ac940 2024-04-26T20:34:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.409+0000 7fc74f400640 1 -- 172.21.15.82:0/2981953860 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75801ee60 con 0x5570a97ac940 2024-04-26T20:34:10.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 -- 172.21.15.82:0/2981953860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 msgr2=0x5570a97b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 0x5570a97b8500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc758012cb0 tx=0x7fc7580043d0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 -- 172.21.15.82:0/2981953860 shutdown_connections 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97ac940 0x5570a97b8500 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 --2- 172.21.15.82:0/2981953860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97a6de0 0x5570a97c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 -- 172.21.15.82:0/2981953860 >> 172.21.15.82:0/2981953860 conn(0x5570a97a2450 msgr2=0x5570a97abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 -- 172.21.15.82:0/2981953860 shutdown_connections 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.410+0000 7fc768857740 1 -- 172.21.15.82:0/2981953860 wait complete. 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.411+0000 7fc768857740 1 -- start start 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.411+0000 7fc768857740 1 Processor -- start 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601aeaa0 con 0x5570a97a77d0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601ae310 con 0x5570a97ac940 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601ab3d0 con 0x5570a97a6de0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc768857740 10 client.0 _ll_register_callbacks cb 0x7fc758009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:57060/0 (socket says 172.21.15.82:57060) 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 -- 172.21.15.82:0/3960742525 learned_addr learned my addr 172.21.15.82:0/3960742525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc756000640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75f400640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 -- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 msgr2=0x5570a97b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 -- 172.21.15.82:0/3960742525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 msgr2=0x5570a97b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc75ea00640 1 -- 172.21.15.82:0/3960742525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a96c5cb0 con 0x5570a97a6de0 2024-04-26T20:34:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.412+0000 7fc756000640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc75ea00640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b5770 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc750006010 tx=0x7fc75002f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf4211da1876f31 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc74cc00640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc74cc00640 1 -- 172.21.15.82:0/3960742525 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500de040 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc74cc00640 1 -- 172.21.15.82:0/3960742525 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc7500ef920 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc758029440 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc74cc00640 1 -- 172.21.15.82:0/3960742525 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc7500bdb80 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc768857740 10 client.27310 fetch_fsmap learned FSMap version 54 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5570a97b8460 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.413+0000 7fc74cc00640 1 -- 172.21.15.82:0/3960742525 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc758029440 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc74cc00640 1 -- 172.21.15.82:0/3960742525 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7fc7500efce0 con 0x5570a97a6de0 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc768857740 10 client.27310 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc768857740 10 client.27310 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc768857740 20 client.27310 populate_metadata read hostname 'smithi082' 2024-04-26T20:34:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc768857740 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a98235f0 0x5570a9825a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc768857740 4 client.27310 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:34:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570a9712e00 con 0x5570a98235f0 2024-04-26T20:34:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.414+0000 7fc756000640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a98235f0 0x5570a9825a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.415+0000 7fc756000640 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a98235f0 0x5570a9825a10 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeb7039e27c3a613 server_cookie=94895c3eb9eb4b1e in_seq=0 out_seq=0 2024-04-26T20:34:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.415+0000 7fc74cc00640 10 client.27310 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc74cc00640 1 -- 172.21.15.82:0/3960742525 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570a9712e00 con 0x5570a98235f0 2024-04-26T20:34:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc74cc00640 10 client.27310 handle_command_reply: tid=0 2024-04-26T20:34:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 client.27310 shutdown 2024-04-26T20:34:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 msgr2=0x5570a97b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b5770 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc750006010 tx=0x7fc75002f710 comp rx=0 tx=0).stop 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 shutdown_connections 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5570a98235f0 0x5570a9825a10 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570a97ac940 0x5570a97b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc74cc00640 0 client.27310 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570a97a77d0 0x5570a97b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 --2- 172.21.15.82:0/3960742525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570a97a6de0 0x5570a97b5770 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 >> 172.21.15.82:0/3960742525 conn(0x5570a97a2450 msgr2=0x5570a97abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 shutdown_connections 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.421+0000 7fc768857740 1 -- 172.21.15.82:0/3960742525 wait complete. 2024-04-26T20:34:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc768857740 20 client.27310 trim_cache size 0 max 16384 2024-04-26T20:34:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:34:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:34:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:34:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:34:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7440a3c30 msgr2=0x7fc7440a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7440a3c30 0x7fc7440a60f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5570a97a8030 tx=0x7fc758005f90 comp rx=0 tx=0).stop 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 msgr2=0x7fc7600766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 0x7fc7600766e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc750005e30 tx=0x7fc7500317e0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 shutdown_connections 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc7440a3c30 0x7fc7440a60f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc760104370 0x7fc760075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7601039b0 0x7fc760074d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 --2- 172.21.15.82:0/3679437486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7601027c0 0x7fc7600766e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.422+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 >> 172.21.15.82:0/3679437486 conn(0x7fc7600fdd30 msgr2=0x7fc760106d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.423+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 shutdown_connections 2024-04-26T20:34:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:10.423+0000 7fc75fe00640 1 -- 172.21.15.82:0/3679437486 wait complete. 2024-04-26T20:34:10.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:10 smithi082 ceph-mon[28105]: pgmap v753: 129 pgs: 129 active+clean; 758 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 715 KiB/s wr, 392 op/s 2024-04-26T20:34:10.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:10 smithi139 ceph-mon[32999]: pgmap v753: 129 pgs: 129 active+clean; 758 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 715 KiB/s wr, 392 op/s 2024-04-26T20:34:12.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:12 smithi135 ceph-mon[32816]: pgmap v754: 129 pgs: 129 active+clean; 745 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1018 KiB/s wr, 393 op/s 2024-04-26T20:34:12.372 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:12 smithi139 ceph-mon[32999]: pgmap v754: 129 pgs: 129 active+clean; 745 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1018 KiB/s wr, 393 op/s 2024-04-26T20:34:12.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:12 smithi082 ceph-mon[28105]: pgmap v754: 129 pgs: 129 active+clean; 745 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1018 KiB/s wr, 393 op/s 2024-04-26T20:34:14.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:14 smithi135 ceph-mon[32816]: pgmap v755: 129 pgs: 129 active+clean; 707 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 995 KiB/s wr, 340 op/s 2024-04-26T20:34:14.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:14 smithi082 ceph-mon[28105]: pgmap v755: 129 pgs: 129 active+clean; 707 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 995 KiB/s wr, 340 op/s 2024-04-26T20:34:14.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:14 smithi139 ceph-mon[32999]: pgmap v755: 129 pgs: 129 active+clean; 707 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 995 KiB/s wr, 340 op/s 2024-04-26T20:34:16.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:16 smithi135 ceph-mon[32816]: pgmap v756: 129 pgs: 129 active+clean; 705 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 847 KiB/s wr, 287 op/s 2024-04-26T20:34:16.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:16 smithi082 ceph-mon[28105]: pgmap v756: 129 pgs: 129 active+clean; 705 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 847 KiB/s wr, 287 op/s 2024-04-26T20:34:16.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:16 smithi139 ceph-mon[32999]: pgmap v756: 129 pgs: 129 active+clean; 705 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 847 KiB/s wr, 287 op/s 2024-04-26T20:34:18.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:18 smithi082 ceph-mon[28105]: pgmap v757: 129 pgs: 129 active+clean; 696 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 972 KiB/s wr, 272 op/s 2024-04-26T20:34:18.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:18 smithi139 ceph-mon[32999]: pgmap v757: 129 pgs: 129 active+clean; 696 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 972 KiB/s wr, 272 op/s 2024-04-26T20:34:18.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:18 smithi135 ceph-mon[32816]: pgmap v757: 129 pgs: 129 active+clean; 696 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 972 KiB/s wr, 272 op/s 2024-04-26T20:34:20.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:20 smithi082 ceph-mon[28105]: pgmap v758: 129 pgs: 129 active+clean; 693 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 800 KiB/s wr, 239 op/s 2024-04-26T20:34:20.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:20 smithi139 ceph-mon[32999]: pgmap v758: 129 pgs: 129 active+clean; 693 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 800 KiB/s wr, 239 op/s 2024-04-26T20:34:20.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:20 smithi135 ceph-mon[32816]: pgmap v758: 129 pgs: 129 active+clean; 693 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 800 KiB/s wr, 239 op/s 2024-04-26T20:34:22.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:22 smithi135 ceph-mon[32816]: pgmap v759: 129 pgs: 129 active+clean; 688 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 266 op/s 2024-04-26T20:34:22.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:22 smithi082 ceph-mon[28105]: pgmap v759: 129 pgs: 129 active+clean; 688 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 266 op/s 2024-04-26T20:34:22.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:22 smithi139 ceph-mon[32999]: pgmap v759: 129 pgs: 129 active+clean; 688 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 266 op/s 2024-04-26T20:34:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 -- 172.21.15.82:0/3067774575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c1039b0 msgr2=0x7f580c103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 --2- 172.21.15.82:0/3067774575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c1039b0 0x7f580c103e30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009860 tx=0x7f57f802a340 comp rx=0 tx=0).stop 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 -- 172.21.15.82:0/3067774575 shutdown_connections 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 --2- 172.21.15.82:0/3067774575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c104370 0x7f580c10ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 --2- 172.21.15.82:0/3067774575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c1039b0 0x7f580c103e30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 --2- 172.21.15.82:0/3067774575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1027c0 0x7f580c102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.557+0000 7f5812c00640 1 -- 172.21.15.82:0/3067774575 >> 172.21.15.82:0/3067774575 conn(0x7f580c0fdd30 msgr2=0x7f580c100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.558+0000 7f5812c00640 1 -- 172.21.15.82:0/3067774575 shutdown_connections 2024-04-26T20:34:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.558+0000 7f5812c00640 1 -- 172.21.15.82:0/3067774575 wait complete. 2024-04-26T20:34:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.558+0000 7f5812c00640 1 Processor -- start 2024-04-26T20:34:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 -- start start 2024-04-26T20:34:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 0x7f580c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 0x7f580c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c104370 0x7f580c1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f580c10e2f0 con 0x7f580c1039b0 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f580c10e170 con 0x7f580c104370 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f580c10e470 con 0x7f580c1027c0 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5810e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 0x7f580c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5811800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 0x7f580c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c104370 0x7f580c1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5810e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 0x7f580c19b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43666/0 (socket says 172.21.15.82:43666) 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5811800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 0x7f580c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:55996/0 (socket says 172.21.15.82:55996) 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5812200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c104370 0x7f580c1a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45384/0 (socket says 172.21.15.82:45384) 2024-04-26T20:34:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.559+0000 7f5810e00640 1 -- 172.21.15.82:0/3710293021 learned_addr learned my addr 172.21.15.82:0/3710293021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5810e00640 1 -- 172.21.15.82:0/3710293021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 msgr2=0x7f580c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5810e00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 0x7f580c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5810e00640 1 -- 172.21.15.82:0/3710293021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c104370 msgr2=0x7f580c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5810e00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c104370 0x7f580c1a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5810e00640 1 -- 172.21.15.82:0/3710293021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c1a27f0 con 0x7f580c1039b0 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5811800640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 0x7f580c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.560+0000 7f5810e00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 0x7f580c19b110 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f57f80057c0 tx=0x7f57f8032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.561+0000 7f580a000640 1 -- 172.21.15.82:0/3710293021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8037040 con 0x7f580c1039b0 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.561+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c1a2a80 con 0x7f580c1039b0 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.561+0000 7f580a000640 1 -- 172.21.15.82:0/3710293021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f8030bd0 con 0x7f580c1039b0 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.561+0000 7f580a000640 1 -- 172.21.15.82:0/3710293021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8005280 con 0x7f580c1039b0 2024-04-26T20:34:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.561+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c1a2f10 con 0x7f580c1039b0 2024-04-26T20:34:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.565+0000 7f580a000640 1 -- 172.21.15.82:0/3710293021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f57f8043020 con 0x7f580c1039b0 2024-04-26T20:34:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.565+0000 7f581701b740 1 Processor -- start 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 -- start start 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 0x56552485f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485f7d0 0x5655248642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524864940 0x565524866dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5655247c3380 con 0x56552485f7d0 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56552475fc30 con 0x56552485ede0 2024-04-26T20:34:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f581701b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5655247bf340 con 0x565524864940 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f5812200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 0x56552485f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f5811800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485f7d0 0x5655248642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f5812200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 0x56552485f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45388/0 (socket says 172.21.15.82:45388) 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.566+0000 7f5812200640 1 -- 172.21.15.82:0/521748480 learned_addr learned my addr 172.21.15.82:0/521748480 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5810e00640 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524864940 0x565524866dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5812200640 1 -- 172.21.15.82:0/521748480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524864940 msgr2=0x565524866dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5812200640 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524864940 0x565524866dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5812200640 1 -- 172.21.15.82:0/521748480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485f7d0 msgr2=0x5655248642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5812200640 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485f7d0 0x5655248642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5812200640 1 -- 172.21.15.82:0/521748480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565524781940 con 0x56552485ede0 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5810e00640 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524864940 0x565524866dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f580a000640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57f40a3c30 0x7f57f40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f580a000640 1 -- 172.21.15.82:0/3710293021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f57f80efe30 con 0x7f580c1039b0 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5812200640 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 0x56552485f200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5804009fd0 tx=0x7f58040118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202bda89bd822c8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.567+0000 7f5811800640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57f40a3c30 0x7f57f40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.568+0000 7f57fea00640 1 -- 172.21.15.82:0/521748480 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804004d20 con 0x56552485ede0 2024-04-26T20:34:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.568+0000 7f57fea00640 1 -- 172.21.15.82:0/521748480 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5804004050 con 0x56552485ede0 2024-04-26T20:34:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.568+0000 7f57fea00640 1 -- 172.21.15.82:0/521748480 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804005280 con 0x56552485ede0 2024-04-26T20:34:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 -- 172.21.15.82:0/521748480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 msgr2=0x56552485f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 0x56552485f200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5804009fd0 tx=0x7f58040118d0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f5811800640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57f40a3c30 0x7f57f40a60f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x56552485fbd0 tx=0x7f5800009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 -- 172.21.15.82:0/521748480 shutdown_connections 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524864940 0x565524866dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485f7d0 0x5655248642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 --2- 172.21.15.82:0/521748480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485ede0 0x56552485f200 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 -- 172.21.15.82:0/521748480 >> 172.21.15.82:0/521748480 conn(0x56552485a450 msgr2=0x56552485a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 -- 172.21.15.82:0/521748480 shutdown_connections 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 -- 172.21.15.82:0/521748480 wait complete. 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.569+0000 7f581701b740 1 -- start start 2024-04-26T20:34:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 Processor -- start 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x565524868ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 0x565524869530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524864940 0x565524870570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5655248678f0 con 0x565524864940 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56552474ac60 con 0x56552485f7d0 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x565524867a70 con 0x56552485ede0 2024-04-26T20:34:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.570+0000 7f581701b740 10 client.0 _ll_register_callbacks cb 0x565524776e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 0x565524869530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5812200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524864940 0x565524870570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 0x565524869530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45390/0 (socket says 172.21.15.82:45390) 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 -- 172.21.15.82:0/3916920426 learned_addr learned my addr 172.21.15.82:0/3916920426 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5811800640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x565524868ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 -- 172.21.15.82:0/3916920426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 msgr2=0x565524868ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x565524868ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 -- 172.21.15.82:0/3916920426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524864940 msgr2=0x565524870570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524864940 0x565524870570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5810e00640 1 -- 172.21.15.82:0/3916920426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565524759510 con 0x56552485f7d0 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.571+0000 7f5811800640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x565524868ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f5810e00640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 0x565524869530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000c00 tx=0x7f57f8032f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae146690c27792b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f57f3400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-26T20:34:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f57f3400640 1 -- 172.21.15.82:0/3916920426 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80bb840 con 0x56552485f7d0 2024-04-26T20:34:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5804004050 con 0x56552485f7d0 2024-04-26T20:34:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f57f3400640 1 -- 172.21.15.82:0/3916920426 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f57f8005420 con 0x56552485f7d0 2024-04-26T20:34:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f57f3400640 1 -- 172.21.15.82:0/3916920426 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f57f80bb660 con 0x56552485f7d0 2024-04-26T20:34:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f581701b740 10 client.27239 fetch_fsmap learned FSMap version 54 2024-04-26T20:34:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.572+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5655244d5210 con 0x56552485f7d0 2024-04-26T20:34:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f57f3400640 1 -- 172.21.15.82:0/3916920426 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5804004050 con 0x56552485f7d0 2024-04-26T20:34:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f57f3400640 1 -- 172.21.15.82:0/3916920426 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f57f80ed670 con 0x56552485f7d0 2024-04-26T20:34:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f581701b740 10 client.27239 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f581701b740 10 client.27239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f581701b740 20 client.27239 populate_metadata read hostname 'smithi082' 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f581701b740 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x565524874950 0x565524876d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f581701b740 4 client.27239 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.573+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5655247d0f90 con 0x565524874950 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.574+0000 7f5811800640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x565524874950 0x565524876d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.574+0000 7f5811800640 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x565524874950 0x565524876d90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6597c75609090a4 server_cookie=46318c85253bfc0b in_seq=0 out_seq=0 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.574+0000 7f57f3400640 10 client.27239 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f57f3400640 1 -- 172.21.15.82:0/3916920426 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5655247d0f90 con 0x565524874950 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f57f3400640 10 client.27239 handle_command_reply: tid=0 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 client.27239 shutdown 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 msgr2=0x565524869530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 0x565524869530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000c00 tx=0x7f57f8032f10 comp rx=0 tx=0).stop 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 shutdown_connections 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x565524874950 0x565524876d90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524864940 0x565524870570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56552485f7d0 0x565524869530 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 --2- 172.21.15.82:0/3916920426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x565524868ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.575+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 >> 172.21.15.82:0/3916920426 conn(0x56552485a450 msgr2=0x565524859650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.576+0000 7f57f3400640 0 client.27239 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.576+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 shutdown_connections 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.576+0000 7f581701b740 1 -- 172.21.15.82:0/3916920426 wait complete. 2024-04-26T20:34:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.576+0000 7f581701b740 20 client.27239 trim_cache size 0 max 16384 2024-04-26T20:34:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 Processor -- start 2024-04-26T20:34:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 -- start start 2024-04-26T20:34:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485ede0 0x5655248609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x565524860ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524870530 0x565524858dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1ad340 con 0x56552485ede0 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1af0c0 con 0x565524864940 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.598+0000 7f581701b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1adad0 con 0x565524870530 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x565524860ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5811800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485ede0 0x5655248609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x565524860ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45402/0 (socket says 172.21.15.82:45402) 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 -- 172.21.15.82:0/3852470437 learned_addr learned my addr 172.21.15.82:0/3852470437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5812200640 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524870530 0x565524858dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 -- 172.21.15.82:0/3852470437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524870530 msgr2=0x565524858dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524870530 0x565524858dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 -- 172.21.15.82:0/3852470437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485ede0 msgr2=0x5655248609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485ede0 0x5655248609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 -- 172.21.15.82:0/3852470437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655245a1620 con 0x565524864940 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5811800640 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485ede0 0x5655248609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.599+0000 7f5810e00640 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x565524860ef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f57f802c040 tx=0x7f57f80ba210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e46e40187700a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f57fe000640 1 -- 172.21.15.82:0/3852470437 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80bb840 con 0x565524864940 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f57fe000640 1 -- 172.21.15.82:0/3852470437 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f80bc400 con 0x565524864940 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f57fe000640 1 -- 172.21.15.82:0/3852470437 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80b7fa0 con 0x565524864940 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 -- 172.21.15.82:0/3852470437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 msgr2=0x565524860ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x565524860ef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f57f802c040 tx=0x7f57f80ba210 comp rx=0 tx=0).stop 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 -- 172.21.15.82:0/3852470437 shutdown_connections 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565524870530 0x565524858dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x565524860ef0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 --2- 172.21.15.82:0/3852470437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56552485ede0 0x5655248609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.600+0000 7f581701b740 1 -- 172.21.15.82:0/3852470437 >> 172.21.15.82:0/3852470437 conn(0x56552485a450 msgr2=0x565524868ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.601+0000 7f581701b740 1 -- 172.21.15.82:0/3852470437 shutdown_connections 2024-04-26T20:34:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.601+0000 7f581701b740 1 -- 172.21.15.82:0/3852470437 wait complete. 2024-04-26T20:34:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.601+0000 7f581701b740 1 -- start start 2024-04-26T20:34:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.601+0000 7f581701b740 1 Processor -- start 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.601+0000 7f581701b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x56552486d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.601+0000 7f581701b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x56552486d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f581701b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524870530 0x56552486e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f581701b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1ae9f0 con 0x565524870530 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f581701b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1ae260 con 0x565524864940 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f581701b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f580c1ab320 con 0x56552485ede0 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f581701b740 10 client.0 _ll_register_callbacks cb 0x7f57f8004050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5812200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524870530 0x56552486e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5810e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x56552486d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5811800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x56552486d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5812200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524870530 0x56552486e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43706/0 (socket says 172.21.15.82:43706) 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5812200640 1 -- 172.21.15.82:0/2663249604 learned_addr learned my addr 172.21.15.82:0/2663249604 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5811800640 1 -- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 msgr2=0x56552486d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5811800640 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x56552486d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5811800640 1 -- 172.21.15.82:0/2663249604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524870530 msgr2=0x56552486e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5811800640 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524870530 0x56552486e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5811800640 1 -- 172.21.15.82:0/2663249604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552477dcb0 con 0x56552485ede0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.602+0000 7f5810e00640 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x56552486d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f5811800640 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x56552486d450 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x5655248775d0 tx=0x7f58000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b520f595b9358658 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f57f3400640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f57f3400640 1 -- 172.21.15.82:0/2663249604 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580002e070 con 0x56552485ede0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f80bc400 con 0x56552485ede0 2024-04-26T20:34:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f57f3400640 1 -- 172.21.15.82:0/2663249604 <== mon.1 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f580002a500 con 0x56552485ede0 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f57f3400640 1 -- 172.21.15.82:0/2663249604 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f580003c050 con 0x56552485ede0 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f581701b740 10 client.27328 fetch_fsmap learned FSMap version 54 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.603+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5655248701a0 con 0x56552485ede0 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f57f3400640 1 -- 172.21.15.82:0/2663249604 <== mon.1 v2:172.21.15.139:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f80bc400 con 0x56552485ede0 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f57f3400640 1 -- 172.21.15.82:0/2663249604 <== mon.1 v2:172.21.15.139:3300/0 5 ==== fsmap(e 54) ==== 8442+0+0 (secure 0 0 0) 0x7f580001e420 con 0x56552485ede0 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f581701b740 10 client.27328 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f581701b740 10 client.27328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f581701b740 20 client.27328 populate_metadata read hostname 'smithi082' 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f581701b740 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5655248db570 0x5655248dd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f581701b740 4 client.27328 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5655247cae00 con 0x5655248db570 2024-04-26T20:34:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.604+0000 7f5810e00640 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5655248db570 0x5655248dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.605+0000 7f5810e00640 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5655248db570 0x5655248dd990 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a55d2e407bc0bc2 server_cookie=13f5b57480e1674d in_seq=0 out_seq=0 2024-04-26T20:34:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.605+0000 7f57f3400640 10 client.27328 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f57f3400640 1 -- 172.21.15.82:0/2663249604 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5655247cae00 con 0x5655248db570 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f57f3400640 10 client.27328 handle_command_reply: tid=0 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 client.27328 shutdown 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 msgr2=0x56552486d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x56552486d450 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x5655248775d0 tx=0x7f58000046c0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 shutdown_connections 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x5655248db570 0x5655248dd990 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565524870530 0x56552486e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565524864940 0x56552486d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f581701b740 1 --2- 172.21.15.82:0/2663249604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56552485ede0 0x56552486d450 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.612+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 >> 172.21.15.82:0/2663249604 conn(0x56552485a450 msgr2=0x565524868fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.611+0000 7f57f3400640 0 client.27328 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.612+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 shutdown_connections 2024-04-26T20:34:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.612+0000 7f581701b740 1 -- 172.21.15.82:0/2663249604 wait complete. 2024-04-26T20:34:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.612+0000 7f581701b740 20 client.27328 trim_cache size 0 max 16384 2024-04-26T20:34:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:34:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:34:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:34:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.612+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57f40a3c30 msgr2=0x7f57f40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.612+0000 7f5812c00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57f40a3c30 0x7f57f40a60f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x56552485fbd0 tx=0x7f5800009260 comp rx=0 tx=0).stop 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 msgr2=0x7f580c19b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 0x7f580c19b110 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f57f80057c0 tx=0x7f57f8032da0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 shutdown_connections 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f57f40a3c30 0x7f57f40a60f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f580c104370 0x7f580c1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f580c1039b0 0x7f580c19b110 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 --2- 172.21.15.82:0/3710293021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f580c1027c0 0x7f580c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 >> 172.21.15.82:0/3710293021 conn(0x7f580c0fdd30 msgr2=0x7f580c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 shutdown_connections 2024-04-26T20:34:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:23.613+0000 7f5812c00640 1 -- 172.21.15.82:0/3710293021 wait complete. 2024-04-26T20:34:24.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:24 smithi082 ceph-mon[28105]: pgmap v760: 129 pgs: 129 active+clean; 676 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 851 KiB/s wr, 262 op/s 2024-04-26T20:34:24.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:24 smithi139 ceph-mon[32999]: pgmap v760: 129 pgs: 129 active+clean; 676 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 851 KiB/s wr, 262 op/s 2024-04-26T20:34:24.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:24 smithi135 ceph-mon[32816]: pgmap v760: 129 pgs: 129 active+clean; 676 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 851 KiB/s wr, 262 op/s 2024-04-26T20:34:26.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:26 smithi082 ceph-mon[28105]: pgmap v761: 129 pgs: 129 active+clean; 673 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-04-26T20:34:26.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:26 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:34:26.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:26 smithi139 ceph-mon[32999]: pgmap v761: 129 pgs: 129 active+clean; 673 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-04-26T20:34:26.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:26 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:34:26.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:26 smithi135 ceph-mon[32816]: pgmap v761: 129 pgs: 129 active+clean; 673 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-04-26T20:34:26.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:26 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:34:28.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:28 smithi082 ceph-mon[28105]: pgmap v762: 129 pgs: 129 active+clean; 664 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1001 KiB/s wr, 258 op/s 2024-04-26T20:34:28.571 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:28 smithi139 ceph-mon[32999]: pgmap v762: 129 pgs: 129 active+clean; 664 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1001 KiB/s wr, 258 op/s 2024-04-26T20:34:28.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:28 smithi135 ceph-mon[32816]: pgmap v762: 129 pgs: 129 active+clean; 664 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1001 KiB/s wr, 258 op/s 2024-04-26T20:34:30.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:30 smithi139 ceph-mon[32999]: pgmap v763: 129 pgs: 129 active+clean; 660 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 866 KiB/s wr, 229 op/s 2024-04-26T20:34:30.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:30 smithi135 ceph-mon[32816]: pgmap v763: 129 pgs: 129 active+clean; 660 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 866 KiB/s wr, 229 op/s 2024-04-26T20:34:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:30 smithi082 ceph-mon[28105]: pgmap v763: 129 pgs: 129 active+clean; 660 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 866 KiB/s wr, 229 op/s 2024-04-26T20:34:32.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:32 smithi139 ceph-mon[32999]: pgmap v764: 129 pgs: 129 active+clean; 651 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 994 KiB/s wr, 254 op/s 2024-04-26T20:34:32.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:32 smithi135 ceph-mon[32816]: pgmap v764: 129 pgs: 129 active+clean; 651 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 994 KiB/s wr, 254 op/s 2024-04-26T20:34:32.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:32 smithi082 ceph-mon[28105]: pgmap v764: 129 pgs: 129 active+clean; 651 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 994 KiB/s wr, 254 op/s 2024-04-26T20:34:34.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:34 smithi139 ceph-mon[32999]: pgmap v765: 129 pgs: 129 active+clean; 644 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 965 KiB/s wr, 259 op/s 2024-04-26T20:34:34.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:34 smithi135 ceph-mon[32816]: pgmap v765: 129 pgs: 129 active+clean; 644 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 965 KiB/s wr, 259 op/s 2024-04-26T20:34:35.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:34 smithi082 ceph-mon[28105]: pgmap v765: 129 pgs: 129 active+clean; 644 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 965 KiB/s wr, 259 op/s 2024-04-26T20:34:36.052 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-04-26T20:34:36.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T20:34:36.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:36 smithi139 ceph-mon[32999]: pgmap v766: 129 pgs: 129 active+clean; 631 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-04-26T20:34:36.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:36 smithi135 ceph-mon[32816]: pgmap v766: 129 pgs: 129 active+clean; 631 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-04-26T20:34:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:36 smithi082 ceph-mon[28105]: pgmap v766: 129 pgs: 129 active+clean; 631 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-04-26T20:34:38.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:38 smithi139 ceph-mon[32999]: pgmap v767: 129 pgs: 129 active+clean; 609 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 869 KiB/s wr, 261 op/s 2024-04-26T20:34:38.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:38 smithi135 ceph-mon[32816]: pgmap v767: 129 pgs: 129 active+clean; 609 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 869 KiB/s wr, 261 op/s 2024-04-26T20:34:38.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:38 smithi082 ceph-mon[28105]: pgmap v767: 129 pgs: 129 active+clean; 609 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 869 KiB/s wr, 261 op/s 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 -- 172.21.15.82:0/2095963014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40106770 msgr2=0x7fdf4010d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 --2- 172.21.15.82:0/2095963014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40106770 0x7fdf4010d000 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009ca0 tx=0x7fdf3802a8b0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 -- 172.21.15.82:0/2095963014 shutdown_connections 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 --2- 172.21.15.82:0/2095963014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40106770 0x7fdf4010d000 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 --2- 172.21.15.82:0/2095963014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf40105db0 0x7fdf40106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 --2- 172.21.15.82:0/2095963014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf40104bc0 0x7fdf40104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.572+0000 7fdf45200640 1 -- 172.21.15.82:0/2095963014 >> 172.21.15.82:0/2095963014 conn(0x7fdf40100150 msgr2=0x7fdf40102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.573+0000 7fdf45200640 1 -- 172.21.15.82:0/2095963014 shutdown_connections 2024-04-26T20:34:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.573+0000 7fdf45200640 1 -- 172.21.15.82:0/2095963014 wait complete. 2024-04-26T20:34:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 Processor -- start 2024-04-26T20:34:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 -- start start 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 0x7fdf4019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf40105db0 0x7fdf4019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf40106770 0x7fdf401a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40110720 con 0x7fdf40106770 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401105a0 con 0x7fdf40104bc0 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.574+0000 7fdf45200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401108a0 con 0x7fdf40105db0 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 0x7fdf4019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 0x7fdf4019acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38536/0 (socket says 172.21.15.82:38536) 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf40106770 0x7fdf401a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 -- 172.21.15.82:0/2032141695 learned_addr learned my addr 172.21.15.82:0/2032141695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3d400640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf40105db0 0x7fdf4019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 -- 172.21.15.82:0/2032141695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf40105db0 msgr2=0x7fdf4019b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf40105db0 0x7fdf4019b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 -- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf40106770 msgr2=0x7fdf401a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf40106770 0x7fdf401a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.575+0000 7fdf3de00640 1 -- 172.21.15.82:0/2032141695 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401a28f0 con 0x7fdf40104bc0 2024-04-26T20:34:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.576+0000 7fdf3de00640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 0x7fdf4019acb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000e9c0 tx=0x7fdf3000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.576+0000 7fdf36a00640 1 -- 172.21.15.82:0/2032141695 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000cd80 con 0x7fdf40104bc0 2024-04-26T20:34:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.576+0000 7fdf36a00640 1 -- 172.21.15.82:0/2032141695 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf300035f0 con 0x7fdf40104bc0 2024-04-26T20:34:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.576+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf401a2be0 con 0x7fdf40104bc0 2024-04-26T20:34:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.576+0000 7fdf36a00640 1 -- 172.21.15.82:0/2032141695 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30010690 con 0x7fdf40104bc0 2024-04-26T20:34:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.576+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf401a3130 con 0x7fdf40104bc0 2024-04-26T20:34:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.579+0000 7fdf36a00640 1 -- 172.21.15.82:0/2032141695 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdf300037a0 con 0x7fdf40104bc0 2024-04-26T20:34:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 Processor -- start 2024-04-26T20:34:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 -- start start 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a49ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a4f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 0x55f1c3a51bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f1c39ae380 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1c394ac30 con 0x55f1c3a4f730 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.580+0000 7fdf481c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f1c39aa340 con 0x55f1c3a49bd0 2024-04-26T20:34:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 0x55f1c3a51bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a4f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 0x55f1c3a51bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:38546/0 (socket says 172.21.15.82:38546) 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 -- 172.21.15.82:0/1729081353 learned_addr learned my addr 172.21.15.82:0/1729081353 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3e800640 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a49ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 -- 172.21.15.82:0/1729081353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 msgr2=0x55f1c3a49ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a49ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 -- 172.21.15.82:0/1729081353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4a5c0 msgr2=0x55f1c3a4f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a4f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3d400640 1 -- 172.21.15.82:0/1729081353 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c396c940 con 0x55f1c3a4f730 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.581+0000 7fdf3de00640 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a4f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:34:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 0x55f1c3a51bc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009c90 tx=0x7fdf2c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb7421cd3d1c8be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf36a00640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdf240a3cf0 0x7fdf240a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf2b400640 1 -- 172.21.15.82:0/1729081353 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c01e070 con 0x55f1c3a4f730 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf2b400640 1 -- 172.21.15.82:0/1729081353 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c019ae0 con 0x55f1c3a4f730 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf2b400640 1 -- 172.21.15.82:0/1729081353 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00e9c0 con 0x55f1c3a4f730 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf36a00640 1 -- 172.21.15.82:0/2032141695 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fdf300d0cb0 con 0x7fdf40104bc0 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.582+0000 7fdf3e800640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdf240a3cf0 0x7fdf240a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 -- 172.21.15.82:0/1729081353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 msgr2=0x55f1c3a51bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 0x55f1c3a51bc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009c90 tx=0x7fdf2c011810 comp rx=0 tx=0).stop 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 -- 172.21.15.82:0/1729081353 shutdown_connections 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4f730 0x55f1c3a51bc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a4f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1729081353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a49ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 -- 172.21.15.82:0/1729081353 >> 172.21.15.82:0/1729081353 conn(0x55f1c3a45240 msgr2=0x55f1c3a45640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 -- 172.21.15.82:0/1729081353 shutdown_connections 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf3e800640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdf240a3cf0 0x7fdf240a61b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x55f1c3a4ae20 tx=0x7fdf38030800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.583+0000 7fdf481c0740 1 -- 172.21.15.82:0/1729081353 wait complete. 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.584+0000 7fdf481c0740 1 -- start start 2024-04-26T20:34:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.584+0000 7fdf481c0740 1 Processor -- start 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a53e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a54380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a5b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f1c3a526e0 con 0x55f1c3a49bd0 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1c3935c60 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f1c3a52860 con 0x55f1c3a4f730 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf481c0740 10 client.0 _ll_register_callbacks cb 0x55f1c3961e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:34:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a53e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a53e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59458/0 (socket says 172.21.15.82:59458) 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf3de00640 1 -- 172.21.15.82:0/515319740 learned_addr learned my addr 172.21.15.82:0/515319740 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf3e800640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a5b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.585+0000 7fdf3d400640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a54380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3de00640 1 -- 172.21.15.82:0/515319740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 msgr2=0x55f1c3a5b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3de00640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a5b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3de00640 1 -- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 msgr2=0x55f1c3a54380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3de00640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a54380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3de00640 1 -- 172.21.15.82:0/515319740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c3944510 con 0x55f1c3a49bd0 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3e800640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a5b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf3de00640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a53e40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000c6a0 tx=0x7fdf3009c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7d608e58a82bcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf1fe00640 1 -- 172.21.15.82:0/515319740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3009ca70 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.586+0000 7fdf1fe00640 1 -- 172.21.15.82:0/515319740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fdf300ce4f0 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf2c019ae0 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf1fe00640 1 -- 172.21.15.82:0/515319740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fdf300a0e20 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf481c0740 10 client.17169 fetch_fsmap learned FSMap version 55 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55f1c36c0210 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf1fe00640 1 -- 172.21.15.82:0/515319740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c019ae0 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf1fe00640 1 -- 172.21.15.82:0/515319740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) ==== 8438+0+0 (secure 0 0 0) 0x7fdf300a5250 con 0x55f1c3a49bd0 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.587+0000 7fdf481c0740 10 client.17169 fetch_fsmap finished waiting for FSMap version 55 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.588+0000 7fdf481c0740 10 client.17169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.588+0000 7fdf481c0740 20 client.17169 populate_metadata read hostname 'smithi082' 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.588+0000 7fdf481c0740 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3a5f910 0x55f1c3a61dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.588+0000 7fdf481c0740 4 client.17169 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:34:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.588+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1c39bbf90 con 0x55f1c3a5f910 2024-04-26T20:34:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.588+0000 7fdf3d400640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3a5f910 0x55f1c3a61dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.589+0000 7fdf3d400640 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3a5f910 0x55f1c3a61dd0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a92a8c13ac02958 server_cookie=a18411784520278d in_seq=0 out_seq=0 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.589+0000 7fdf1fe00640 10 client.17169 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf1fe00640 1 -- 172.21.15.82:0/515319740 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1c39bbf90 con 0x55f1c3a5f910 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf1fe00640 10 client.17169 handle_command_reply: tid=0 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 client.17169 shutdown 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 msgr2=0x55f1c3a53e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a53e40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000c6a0 tx=0x7fdf3009c5b0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 shutdown_connections 2024-04-26T20:34:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3a5f910 0x55f1c3a61dd0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a5b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a54380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 --2- 172.21.15.82:0/515319740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a53e40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf1fe00640 0 client.17169 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 >> 172.21.15.82:0/515319740 conn(0x55f1c3a45240 msgr2=0x55f1c3a44440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 shutdown_connections 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 1 -- 172.21.15.82:0/515319740 wait complete. 2024-04-26T20:34:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.590+0000 7fdf481c0740 20 client.17169 trim_cache size 0 max 16384 2024-04-26T20:34:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 Processor -- start 2024-04-26T20:34:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 -- start start 2024-04-26T20:34:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a5b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a48730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401ad410 con 0x55f1c3a49bd0 2024-04-26T20:34:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401af190 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.607+0000 7fdf481c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401adba0 con 0x55f1c3a4f730 2024-04-26T20:34:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a5b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a48730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59472/0 (socket says 172.21.15.82:59472) 2024-04-26T20:34:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3de00640 1 -- 172.21.15.82:0/1379820133 learned_addr learned my addr 172.21.15.82:0/1379820133 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3d400640 1 -- 172.21.15.82:0/1379820133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 msgr2=0x55f1c3a48730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a48730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3d400640 1 -- 172.21.15.82:0/1379820133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 msgr2=0x55f1c3a481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.608+0000 7fdf3d400640 1 -- 172.21.15.82:0/1379820133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c378c620 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.609+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a5b2e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c000c00 tx=0x7fdf2c009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b906584dbb083b87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.609+0000 7fdf2aa00640 1 -- 172.21.15.82:0/1379820133 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c01e040 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.609+0000 7fdf2aa00640 1 -- 172.21.15.82:0/1379820133 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c0055c0 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.609+0000 7fdf2aa00640 1 -- 172.21.15.82:0/1379820133 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c02c2a0 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 -- 172.21.15.82:0/1379820133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 msgr2=0x55f1c3a5b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a5b2e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c000c00 tx=0x7fdf2c009770 comp rx=0 tx=0).stop 2024-04-26T20:34:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 -- 172.21.15.82:0/1379820133 shutdown_connections 2024-04-26T20:34:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a4f730 0x55f1c3a48730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a5b2e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1379820133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 -- 172.21.15.82:0/1379820133 >> 172.21.15.82:0/1379820133 conn(0x55f1c3a45240 msgr2=0x55f1c3a45620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 -- 172.21.15.82:0/1379820133 shutdown_connections 2024-04-26T20:34:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 -- 172.21.15.82:0/1379820133 wait complete. 2024-04-26T20:34:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.610+0000 7fdf481c0740 1 -- start start 2024-04-26T20:34:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 Processor -- start 2024-04-26T20:34:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a58750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a58c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 0x55f1c3a59ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401aeac0 con 0x55f1c3a4f730 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401ae330 con 0x55f1c3a4a5c0 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401ab3f0 con 0x55f1c3a49bd0 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf481c0740 10 client.0 _ll_register_callbacks cb 0x7fdf300046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 0x55f1c3a59ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf3d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a58c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.611+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 0x55f1c3a59ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59480/0 (socket says 172.21.15.82:59480) 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 -- 172.21.15.82:0/1407563775 learned_addr learned my addr 172.21.15.82:0/1407563775 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3de00640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a58750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 -- 172.21.15.82:0/1407563775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 msgr2=0x55f1c3a58750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a58750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 -- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 msgr2=0x55f1c3a58c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a58c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 -- 172.21.15.82:0/1407563775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c3968cb0 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3d400640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a58c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf3e800640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 0x55f1c3a59ca0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009ca0 tx=0x7fdf3802a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc496b33bf180b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.612+0000 7fdf1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf1fe00640 1 -- 172.21.15.82:0/1407563775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38054a60 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf1fe00640 1 -- 172.21.15.82:0/1407563775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fdf38054c00 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf2c0055c0 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf1fe00640 1 -- 172.21.15.82:0/1407563775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fdf38067050 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf481c0740 10 client.17175 fetch_fsmap learned FSMap version 55 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55f1c3a5b440 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf1fe00640 1 -- 172.21.15.82:0/1407563775 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c0055c0 con 0x55f1c3a4f730 2024-04-26T20:34:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.613+0000 7fdf1fe00640 1 -- 172.21.15.82:0/1407563775 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 55) ==== 8438+0+0 (secure 0 0 0) 0x7fdf3805c020 con 0x55f1c3a4f730 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf481c0740 10 client.17175 fetch_fsmap finished waiting for FSMap version 55 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf481c0740 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf481c0740 20 client.17175 populate_metadata read hostname 'smithi082' 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3ac6640 0x55f1c3ac8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf481c0740 4 client.17175 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 --> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1c39b5e00 con 0x55f1c3ac6640 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf3de00640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3ac6640 0x55f1c3ac8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf3de00640 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3ac6640 0x55f1c3ac8a60 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f905a92be1383c4a server_cookie=de60f41f64f62433 in_seq=0 out_seq=0 2024-04-26T20:34:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.614+0000 7fdf1fe00640 10 client.17175 ms_handle_connect on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.622+0000 7fdf1fe00640 1 -- 172.21.15.82:0/1407563775 <== mds.0 v2:172.21.15.135:6838/1800754758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1c39b5e00 con 0x55f1c3ac6640 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.622+0000 7fdf1fe00640 10 client.17175 handle_command_reply: tid=0 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.622+0000 7fdf481c0740 1 client.17175 shutdown 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 msgr2=0x55f1c3a59ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 0x55f1c3a59ca0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009ca0 tx=0x7fdf3802a8b0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 shutdown_connections 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:6838/1800754758,v1:172.21.15.135:6839/1800754758] conn(0x55f1c3ac6640 0x55f1c3ac8a60 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1c3a4f730 0x55f1c3a59ca0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1c3a4a5c0 0x55f1c3a58c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 --2- 172.21.15.82:0/1407563775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1c3a49bd0 0x55f1c3a58750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 >> 172.21.15.82:0/1407563775 conn(0x55f1c3a45240 msgr2=0x55f1c3a481f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf1fe00640 0 client.17175 ms_handle_reset on v2:172.21.15.135:6838/1800754758 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 shutdown_connections 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 1 -- 172.21.15.82:0/1407563775 wait complete. 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.623+0000 7fdf481c0740 20 client.17175 trim_cache size 0 max 16384 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-04-26T20:34:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-04-26T20:34:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-04-26T20:34:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.624+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdf240a3cf0 msgr2=0x7fdf240a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.624+0000 7fdf45200640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdf240a3cf0 0x7fdf240a61b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x55f1c3a4ae20 tx=0x7fdf38030800 comp rx=0 tx=0).stop 2024-04-26T20:34:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.624+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 msgr2=0x7fdf4019acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.624+0000 7fdf45200640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 0x7fdf4019acb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000e9c0 tx=0x7fdf3000ee80 comp rx=0 tx=0).stop 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 shutdown_connections 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdf240a3cf0 0x7fdf240a61b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf40106770 0x7fdf401a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf40105db0 0x7fdf4019b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 --2- 172.21.15.82:0/2032141695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf40104bc0 0x7fdf4019acb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 >> 172.21.15.82:0/2032141695 conn(0x7fdf40100150 msgr2=0x7fdf40108fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 shutdown_connections 2024-04-26T20:34:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-04-26T20:34:39.625+0000 7fdf45200640 1 -- 172.21.15.82:0/2032141695 wait complete. 2024-04-26T20:34:40.629 DEBUG:teuthology.parallel:result is None 2024-04-26T20:34:40.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T20:34:40.726 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T20:34:40.726 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-26T20:34:40.736 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:34:40.758 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:40 smithi082 ceph-mon[28105]: pgmap v768: 129 pgs: 129 active+clean; 596 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 693 KiB/s wr, 240 op/s 2024-04-26T20:34:40.761 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-26T20:34:40.771 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-26T20:34:40.771 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-04-26T20:34:40.772 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-26T20:34:40.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:34:40.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:40 smithi139 ceph-mon[32999]: pgmap v768: 129 pgs: 129 active+clean; 596 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 693 KiB/s wr, 240 op/s 2024-04-26T20:34:40.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:40 smithi135 ceph-mon[32816]: pgmap v768: 129 pgs: 129 active+clean; 596 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 693 KiB/s wr, 240 op/s 2024-04-26T20:34:41.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.013+0000 7fa39fe00640 1 -- 172.21.15.82:0/2899117867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0102360 msgr2=0x7fa3a01027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.013+0000 7fa39fe00640 1 --2- 172.21.15.82:0/2899117867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0102360 0x7fa3a01027e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa398009ca0 tx=0x7fa39802a950 comp rx=0 tx=0).stop 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 -- 172.21.15.82:0/2899117867 shutdown_connections 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 --2- 172.21.15.82:0/2899117867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0102360 0x7fa3a01027e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 --2- 172.21.15.82:0/2899117867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 0x7fa3a0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 --2- 172.21.15.82:0/2899117867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0101060 0x7fa3a0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 -- 172.21.15.82:0/2899117867 >> 172.21.15.82:0/2899117867 conn(0x7fa3a00fcbc0 msgr2=0x7fa3a00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 -- 172.21.15.82:0/2899117867 shutdown_connections 2024-04-26T20:34:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.014+0000 7fa39fe00640 1 -- 172.21.15.82:0/2899117867 wait complete. 2024-04-26T20:34:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.015+0000 7fa39fe00640 1 Processor -- start 2024-04-26T20:34:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.015+0000 7fa39fe00640 1 -- start start 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0101060 0x7fa3a019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 0x7fa3a019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 0x7fa3a01a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01104d0 con 0x7fa3a01019c0 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0110350 con 0x7fa3a0101060 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0110650 con 0x7fa3a0102360 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 0x7fa3a01a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 0x7fa3a019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 0x7fa3a01a20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:38722/0 (socket says 172.21.15.82:38722) 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39f400640 1 -- 172.21.15.82:0/901640921 learned_addr learned my addr 172.21.15.82:0/901640921 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39ea00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0101060 0x7fa3a019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39ea00640 1 -- 172.21.15.82:0/901640921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 msgr2=0x7fa3a01a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39ea00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 0x7fa3a01a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39ea00640 1 -- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 msgr2=0x7fa3a019b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.016+0000 7fa39ea00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 0x7fa3a019b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa39ea00640 1 -- 172.21.15.82:0/901640921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01a2710 con 0x7fa3a0101060 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa39f400640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 0x7fa3a01a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa39e000640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 0x7fa3a019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa39ea00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0101060 0x7fa3a019ab40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e9f0 tx=0x7fa39000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39000cd80 con 0x7fa3a0101060 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3900035f0 con 0x7fa3a0101060 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390010670 con 0x7fa3a0101060 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01a2a00 con 0x7fa3a0101060 2024-04-26T20:34:41.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.017+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01a2f00 con 0x7fa3a0101060 2024-04-26T20:34:41.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.018+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a0069670 con 0x7fa3a0101060 2024-04-26T20:34:41.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.020+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa3900037a0 con 0x7fa3a0101060 2024-04-26T20:34:41.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.022+0000 7fa397400640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3840a3c40 0x7fa3840a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.022+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fa3900d0bc0 con 0x7fa3a0101060 2024-04-26T20:34:41.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.022+0000 7fa39e000640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3840a3c40 0x7fa3840a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.023+0000 7fa39e000640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3840a3c40 0x7fa3840a6100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0095f0 tx=0x7fa38c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:41.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.026+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa39009d080 con 0x7fa3a0101060 2024-04-26T20:34:41.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.232+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3a002dbf0 con 0x7fa3a0101060 2024-04-26T20:34:41.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.234+0000 7fa397400640 1 -- 172.21.15.82:0/901640921 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24669 (secure 0 0 0) 0x7fa39009c980 con 0x7fa3a0101060 2024-04-26T20:34:41.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:34:41.236 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:28:53.426105+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:34:41.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.236+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3840a3c40 msgr2=0x7fa3840a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.236+0000 7fa39fe00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3840a3c40 0x7fa3840a6100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0095f0 tx=0x7fa38c005f90 comp rx=0 tx=0).stop 2024-04-26T20:34:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.236+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0101060 msgr2=0x7fa3a019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.236+0000 7fa39fe00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0101060 0x7fa3a019ab40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e9f0 tx=0x7fa39000eeb0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 shutdown_connections 2024-04-26T20:34:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa3840a3c40 0x7fa3840a6100 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a0102360 0x7fa3a01a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a01019c0 0x7fa3a019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 --2- 172.21.15.82:0/901640921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0101060 0x7fa3a019ab40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 >> 172.21.15.82:0/901640921 conn(0x7fa3a00fcbc0 msgr2=0x7fa3a00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 shutdown_connections 2024-04-26T20:34:41.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.237+0000 7fa39fe00640 1 -- 172.21.15.82:0/901640921 wait complete. 2024-04-26T20:34:41.257 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:34:41.257 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.451+0000 7fc73b000640 1 -- 172.21.15.82:0/2584368054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 msgr2=0x7fc7341012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.451+0000 7fc73b000640 1 --2- 172.21.15.82:0/2584368054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc7341012a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc728009900 tx=0x7fc72802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 -- 172.21.15.82:0/2584368054 shutdown_connections 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 --2- 172.21.15.82:0/2584368054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc734102a20 0x7fc734109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 --2- 172.21.15.82:0/2584368054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 0x7fc7341024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 --2- 172.21.15.82:0/2584368054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc7341012a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 -- 172.21.15.82:0/2584368054 >> 172.21.15.82:0/2584368054 conn(0x7fc7340fc460 msgr2=0x7fc7340fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 -- 172.21.15.82:0/2584368054 shutdown_connections 2024-04-26T20:34:41.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.452+0000 7fc73b000640 1 -- 172.21.15.82:0/2584368054 wait complete. 2024-04-26T20:34:41.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 Processor -- start 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 -- start start 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc73419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 0x7fc73419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc734102a20 0x7fc7341a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc73410e3f0 con 0x7fc734100e80 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc73410e270 con 0x7fc734102060 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc73b000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc73410e570 con 0x7fc734102a20 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc739c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc73419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc739c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc73419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60498/0 (socket says 172.21.15.82:60498) 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.453+0000 7fc739c00640 1 -- 172.21.15.82:0/1148359408 learned_addr learned my addr 172.21.15.82:0/1148359408 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739200640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 0x7fc73419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc73a600640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc734102a20 0x7fc7341a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739c00640 1 -- 172.21.15.82:0/1148359408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc734102a20 msgr2=0x7fc7341a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739c00640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc734102a20 0x7fc7341a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739c00640 1 -- 172.21.15.82:0/1148359408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 msgr2=0x7fc73419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739c00640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 0x7fc73419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739c00640 1 -- 172.21.15.82:0/1148359408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7341a2890 con 0x7fc734100e80 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739200640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 0x7fc73419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.454+0000 7fc739c00640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc73419ac80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc728031500 tx=0x7fc728003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.455+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72803f070 con 0x7fc734100e80 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.455+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc728031c50 con 0x7fc734100e80 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.455+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7341a2b20 con 0x7fc734100e80 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.455+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc728035030 con 0x7fc734100e80 2024-04-26T20:34:41.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.455+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7341a3010 con 0x7fc734100e80 2024-04-26T20:34:41.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.456+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7341a31e0 con 0x7fc734100e80 2024-04-26T20:34:41.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.458+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc728042070 con 0x7fc734100e80 2024-04-26T20:34:41.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.459+0000 7fc732000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc71c0a3c40 0x7fc71c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.459+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc7280f1140 con 0x7fc734100e80 2024-04-26T20:34:41.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.459+0000 7fc739200640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc71c0a3c40 0x7fc71c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.460+0000 7fc739200640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc71c0a3c40 0x7fc71c0a6100 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc720009fc0 tx=0x7fc720005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:41.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.464+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fc7280bcfb0 con 0x7fc734100e80 2024-04-26T20:34:41.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.667+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc7341a33b0 con 0x7fc734100e80 2024-04-26T20:34:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.668+0000 7fc732000640 1 -- 172.21.15.82:0/1148359408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7fc7280c12b0 con 0x7fc734100e80 2024-04-26T20:34:41.669 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc71c0a3c40 msgr2=0x7fc71c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc71c0a3c40 0x7fc71c0a6100 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc720009fc0 tx=0x7fc720005f90 comp rx=0 tx=0).stop 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 msgr2=0x7fc73419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc73419ac80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc728031500 tx=0x7fc728003c10 comp rx=0 tx=0).stop 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 shutdown_connections 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fc71c0a3c40 0x7fc71c0a6100 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc734102a20 0x7fc7341a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc734102060 0x7fc73419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 --2- 172.21.15.82:0/1148359408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc734100e80 0x7fc73419ac80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 >> 172.21.15.82:0/1148359408 conn(0x7fc7340fc460 msgr2=0x7fc73410ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 shutdown_connections 2024-04-26T20:34:41.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.671+0000 7fc73b000640 1 -- 172.21.15.82:0/1148359408 wait complete. 2024-04-26T20:34:41.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:34:41.756 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:41 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/901640921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:34:41.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:41 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/901640921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:34:41.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:41 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/901640921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.887+0000 7f9d31800640 1 -- 172.21.15.82:0/2468288483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078530 msgr2=0x7f9d2c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.887+0000 7f9d31800640 1 --2- 172.21.15.82:0/2468288483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078530 0x7f9d2c078990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009900 tx=0x7f9d1402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 -- 172.21.15.82:0/2468288483 shutdown_connections 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 --2- 172.21.15.82:0/2468288483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 --2- 172.21.15.82:0/2468288483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078530 0x7f9d2c078990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 --2- 172.21.15.82:0/2468288483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 -- 172.21.15.82:0/2468288483 >> 172.21.15.82:0/2468288483 conn(0x7f9d2c0fffe0 msgr2=0x7f9d2c102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 -- 172.21.15.82:0/2468288483 shutdown_connections 2024-04-26T20:34:41.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.888+0000 7f9d31800640 1 -- 172.21.15.82:0/2468288483 wait complete. 2024-04-26T20:34:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 Processor -- start 2024-04-26T20:34:41.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 -- start start 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c19f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2c078530 0x7f9d2c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c1a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1149f0 con 0x7f9d2c078ed0 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c114870 con 0x7f9d2c078530 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d31800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c114b70 con 0x7f9d2c0772f0 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.889+0000 7f9d30e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c1a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c19f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c19f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:38764/0 (socket says 172.21.15.82:38764) 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d30e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c1a66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60514/0 (socket says 172.21.15.82:60514) 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 -- 172.21.15.82:0/2928618800 learned_addr learned my addr 172.21.15.82:0/2928618800 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d23400640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2c078530 0x7f9d2c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 -- 172.21.15.82:0/2928618800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2c078530 msgr2=0x7f9d2c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2c078530 0x7f9d2c19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 -- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 msgr2=0x7f9d2c1a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c1a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 -- 172.21.15.82:0/2928618800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c1a6d20 con 0x7f9d2c0772f0 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d30e00640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c1a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.890+0000 7f9d2be00640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c19f100 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00e9f0 tx=0x7f9d1c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.891+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00ccc0 con 0x7f9d2c0772f0 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.891+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c1a6fb0 con 0x7f9d2c0772f0 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.891+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d1c00ce60 con 0x7f9d2c0772f0 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.891+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c010430 con 0x7f9d2c0772f0 2024-04-26T20:34:41.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.891+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1a7420 con 0x7f9d2c0772f0 2024-04-26T20:34:41.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.892+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c111670 con 0x7f9d2c0772f0 2024-04-26T20:34:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.894+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9d1c0046c0 con 0x7f9d2c0772f0 2024-04-26T20:34:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.895+0000 7f9d29600640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9d100a3c40 0x7f9d100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.896+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9d1c0d0f30 con 0x7f9d2c0772f0 2024-04-26T20:34:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.896+0000 7f9d23400640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9d100a3c40 0x7f9d100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:41.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.896+0000 7f9d23400640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9d100a3c40 0x7f9d100a6100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9d14031500 tx=0x7f9d14005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:41.898+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9d1c054060 con 0x7f9d2c0772f0 2024-04-26T20:34:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.103+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9d2c063530 con 0x7f9d2c0772f0 2024-04-26T20:34:42.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.104+0000 7f9d29600640 1 -- 172.21.15.82:0/2928618800 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f9d1c09d3f0 con 0x7f9d2c0772f0 2024-04-26T20:34:42.105 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9d100a3c40 msgr2=0x7f9d100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9d100a3c40 0x7f9d100a6100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9d14031500 tx=0x7f9d14005a20 comp rx=0 tx=0).stop 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 msgr2=0x7f9d2c19f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c19f100 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00e9f0 tx=0x7f9d1c00edf0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 shutdown_connections 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9d100a3c40 0x7f9d100a6100 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c078ed0 0x7f9d2c1a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2c078530 0x7f9d2c19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 --2- 172.21.15.82:0/2928618800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c0772f0 0x7f9d2c19f100 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 >> 172.21.15.82:0/2928618800 conn(0x7f9d2c0fffe0 msgr2=0x7f9d2c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 shutdown_connections 2024-04-26T20:34:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.107+0000 7f9d31800640 1 -- 172.21.15.82:0/2928618800 wait complete. 2024-04-26T20:34:42.125 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:34:42.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 -- 172.21.15.82:0/420104321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 msgr2=0x7f0ef010a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 --2- 172.21.15.82:0/420104321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef010a600 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009900 tx=0x7f0ee002a3f0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 -- 172.21.15.82:0/420104321 shutdown_connections 2024-04-26T20:34:42.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 --2- 172.21.15.82:0/420104321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ef010ab40 0x7f0ef01113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 --2- 172.21.15.82:0/420104321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef010a600 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 --2- 172.21.15.82:0/420104321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 0x7f0ef01093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 -- 172.21.15.82:0/420104321 >> 172.21.15.82:0/420104321 conn(0x7f0ef0077f30 msgr2=0x7f0ef007a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:42.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 -- 172.21.15.82:0/420104321 shutdown_connections 2024-04-26T20:34:42.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.333+0000 7f0ef8800640 1 -- 172.21.15.82:0/420104321 wait complete. 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.334+0000 7f0ef8800640 1 Processor -- start 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.334+0000 7f0ef8800640 1 -- start start 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef8800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 0x7f0ef019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef8800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef8800640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ef010ab40 0x7f0ef01a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef8800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0114b20 con 0x7f0ef010a180 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef8800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01149a0 con 0x7f0ef0108f90 2024-04-26T20:34:42.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef8800640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0114ca0 con 0x7f0ef010ab40 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef019f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60536/0 (socket says 172.21.15.82:60536) 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef5400640 1 -- 172.21.15.82:0/100296194 learned_addr learned my addr 172.21.15.82:0/100296194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef5e00640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 0x7f0ef019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef6800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ef010ab40 0x7f0ef01a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.335+0000 7f0ef5400640 1 -- 172.21.15.82:0/100296194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ef010ab40 msgr2=0x7f0ef01a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef5400640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ef010ab40 0x7f0ef01a6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef5400640 1 -- 172.21.15.82:0/100296194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 msgr2=0x7f0ef019f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef5400640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 0x7f0ef019f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef5400640 1 -- 172.21.15.82:0/100296194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef01a6d90 con 0x7f0ef010a180 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef5e00640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 0x7f0ef019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef5400640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef019f6b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005ab0 tx=0x7f0ee0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:42.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee003f070 con 0x7f0ef010a180 2024-04-26T20:34:42.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0031c50 con 0x7f0ef010a180 2024-04-26T20:34:42.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef01a7020 con 0x7f0ef010a180 2024-04-26T20:34:42.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0035030 con 0x7f0ef010a180 2024-04-26T20:34:42.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.336+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef01a7510 con 0x7f0ef010a180 2024-04-26T20:34:42.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.338+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef0110300 con 0x7f0ef010a180 2024-04-26T20:34:42.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.340+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0ee0042070 con 0x7f0ef010a180 2024-04-26T20:34:42.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.342+0000 7f0eeaa00640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ed80a3c40 0x7f0ed80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.342+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f0ee00f1070 con 0x7f0ef010a180 2024-04-26T20:34:42.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.342+0000 7f0ef5e00640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ed80a3c40 0x7f0ed80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.343+0000 7f0ef5e00640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ed80a3c40 0x7f0ed80a6100 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0109fe0 tx=0x7f0ee4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:42.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.347+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0ee00bcee0 con 0x7f0ef010a180 2024-04-26T20:34:42.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.549+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ef002dd20 con 0x7f0ef010a180 2024-04-26T20:34:42.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.550+0000 7f0eeaa00640 1 -- 172.21.15.82:0/100296194 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f0ee00c11e0 con 0x7f0ef010a180 2024-04-26T20:34:42.551 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ed80a3c40 msgr2=0x7f0ed80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ed80a3c40 0x7f0ed80a6100 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0109fe0 tx=0x7f0ee4005f90 comp rx=0 tx=0).stop 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 msgr2=0x7f0ef019f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef019f6b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005ab0 tx=0x7f0ee0003b90 comp rx=0 tx=0).stop 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 shutdown_connections 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0ed80a3c40 0x7f0ed80a6100 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ef010ab40 0x7f0ef01a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef010a180 0x7f0ef019f6b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 --2- 172.21.15.82:0/100296194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef0108f90 0x7f0ef019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 >> 172.21.15.82:0/100296194 conn(0x7f0ef0077f30 msgr2=0x7f0ef010d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:42.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.553+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 shutdown_connections 2024-04-26T20:34:42.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.554+0000 7f0ef8800640 1 -- 172.21.15.82:0/100296194 wait complete. 2024-04-26T20:34:42.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:34:42.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.778+0000 7f1d31200640 1 -- 172.21.15.82:0/2373159784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 msgr2=0x7f1d2c1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.778+0000 7f1d31200640 1 --2- 172.21.15.82:0/2373159784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1028a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009ca0 tx=0x7f1d2402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 -- 172.21.15.82:0/2373159784 shutdown_connections 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 --2- 172.21.15.82:0/2373159784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1028a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 --2- 172.21.15.82:0/2373159784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2c101a80 0x7f1d2c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 --2- 172.21.15.82:0/2373159784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d2c101120 0x7f1d2c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 -- 172.21.15.82:0/2373159784 >> 172.21.15.82:0/2373159784 conn(0x7f1d2c0fcce0 msgr2=0x7f1d2c0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 -- 172.21.15.82:0/2373159784 shutdown_connections 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.779+0000 7f1d31200640 1 -- 172.21.15.82:0/2373159784 wait complete. 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 Processor -- start 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 -- start start 2024-04-26T20:34:42.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2c101120 0x7f1d2c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d2c101a80 0x7f1d2c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1105c0 con 0x7f1d2c102420 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c110440 con 0x7f1d2c101a80 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d31200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c110740 con 0x7f1d2c101120 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d2be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d2be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1a21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60554/0 (socket says 172.21.15.82:60554) 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.780+0000 7f1d2be00640 1 -- 172.21.15.82:0/1355364867 learned_addr learned my addr 172.21.15.82:0/1355364867 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2aa00640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d2c101a80 0x7f1d2c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2b400640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2c101120 0x7f1d2c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2be00640 1 -- 172.21.15.82:0/1355364867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2c101120 msgr2=0x7f1d2c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2be00640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2c101120 0x7f1d2c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2be00640 1 -- 172.21.15.82:0/1355364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d2c101a80 msgr2=0x7f1d2c19b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2be00640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d2c101a80 0x7f1d2c19b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2be00640 1 -- 172.21.15.82:0/1355364867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c1a2840 con 0x7f1d2c102420 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.781+0000 7f1d2be00640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1a21a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1d24033040 tx=0x7f1d240316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.782+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d24003b70 con 0x7f1d2c102420 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.782+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d24003d10 con 0x7f1d2c102420 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.782+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2402fb40 con 0x7f1d2c102420 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.782+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c1a2ad0 con 0x7f1d2c102420 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.782+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c1a3020 con 0x7f1d2c102420 2024-04-26T20:34:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.783+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c10c060 con 0x7f1d2c102420 2024-04-26T20:34:42.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.785+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1d24004610 con 0x7f1d2c102420 2024-04-26T20:34:42.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.786+0000 7f1d23e00640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d100a3c40 0x7f1d100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:42.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.786+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1d240f1c90 con 0x7f1d2c102420 2024-04-26T20:34:42.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.786+0000 7f1d2b400640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d100a3c40 0x7f1d100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:42.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.787+0000 7f1d2b400640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d100a3c40 0x7f1d100a6100 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c19c100 tx=0x7f1d1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:42.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.790+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f1d240be260 con 0x7f1d2c102420 2024-04-26T20:34:42.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:42 smithi139 ceph-mon[32999]: pgmap v769: 129 pgs: 129 active+clean; 591 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 818 KiB/s wr, 252 op/s 2024-04-26T20:34:42.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:42 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1148359408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:34:42.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:42 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2928618800' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:34:42.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:42 smithi135 ceph-mon[32816]: pgmap v769: 129 pgs: 129 active+clean; 591 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 818 KiB/s wr, 252 op/s 2024-04-26T20:34:42.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:42 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1148359408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:34:42.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:42 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2928618800' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:34:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:42 smithi082 ceph-mon[28105]: pgmap v769: 129 pgs: 129 active+clean; 591 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 818 KiB/s wr, 252 op/s 2024-04-26T20:34:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:42 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1148359408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:34:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:42 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2928618800' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:34:42.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.993+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1d2c02dd10 con 0x7f1d2c102420 2024-04-26T20:34:42.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.994+0000 7f1d23e00640 1 -- 172.21.15.82:0/1355364867 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7f1d240bdb60 con 0x7f1d2c102420 2024-04-26T20:34:42.994 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:34:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d100a3c40 msgr2=0x7f1d100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d100a3c40 0x7f1d100a6100 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c19c100 tx=0x7f1d1c005f90 comp rx=0 tx=0).stop 2024-04-26T20:34:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 msgr2=0x7f1d2c1a21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1a21a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1d24033040 tx=0x7f1d240316f0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 shutdown_connections 2024-04-26T20:34:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f1d100a3c40 0x7f1d100a6100 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d2c102420 0x7f1d2c1a21a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d2c101a80 0x7f1d2c19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 --2- 172.21.15.82:0/1355364867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2c101120 0x7f1d2c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 >> 172.21.15.82:0/1355364867 conn(0x7f1d2c0fcce0 msgr2=0x7f1d2c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 shutdown_connections 2024-04-26T20:34:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:42.997+0000 7f1d31200640 1 -- 172.21.15.82:0/1355364867 wait complete. 2024-04-26T20:34:43.018 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 -- 172.21.15.82:0/1164148154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 msgr2=0x7fa9cc079770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/1164148154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 0x7fa9cc079770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009ca0 tx=0x7fa9c402a8c0 comp rx=0 tx=0).stop 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 -- 172.21.15.82:0/1164148154 shutdown_connections 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/1164148154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 0x7fa9cc079770 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/1164148154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc078530 0x7fa9cc078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/1164148154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc077710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:43.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 -- 172.21.15.82:0/1164148154 >> 172.21.15.82:0/1164148154 conn(0x7fa9cc0fff40 msgr2=0x7fa9cc102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:43.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 -- 172.21.15.82:0/1164148154 shutdown_connections 2024-04-26T20:34:43.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.214+0000 7fa9cbe00640 1 -- 172.21.15.82:0/1164148154 wait complete. 2024-04-26T20:34:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.215+0000 7fa9cbe00640 1 Processor -- start 2024-04-26T20:34:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.215+0000 7fa9cbe00640 1 -- start start 2024-04-26T20:34:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cbe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc078530 0x7fa9cc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 0x7fa9cc1a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cbe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc114930 con 0x7fa9cc078ed0 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cbe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1147b0 con 0x7fa9cc078530 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cbe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc114ab0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9caa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9caa00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:38810/0 (socket says 172.21.15.82:38810) 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9caa00640 1 -- 172.21.15.82:0/3166921017 learned_addr learned my addr 172.21.15.82:0/3166921017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9cb400640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 0x7fa9cc1a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9ca000640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc078530 0x7fa9cc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.216+0000 7fa9caa00640 1 -- 172.21.15.82:0/3166921017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc078530 msgr2=0x7fa9cc19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9caa00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc078530 0x7fa9cc19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:43.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9caa00640 1 -- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 msgr2=0x7fa9cc1a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9caa00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 0x7fa9cc1a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9caa00640 1 -- 172.21.15.82:0/3166921017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc1a6ba0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9ca000640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc078530 0x7fa9cc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9caa00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc19ef80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00ea60 tx=0x7fa9bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00cde0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9bc0035f0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc1a6e90 con 0x7fa9cc0772f0 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc010690 con 0x7fa9cc0772f0 2024-04-26T20:34:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.217+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc1a7300 con 0x7fa9cc0772f0 2024-04-26T20:34:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.219+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9cc1114b0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.221+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa9bc0037a0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.222+0000 7fa9d0a00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa9b00a3c40 0x7fa9b00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:34:43.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.222+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fa9bc0d0f10 con 0x7fa9cc0772f0 2024-04-26T20:34:43.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.222+0000 7fa9ca000640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa9b00a3c40 0x7fa9b00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:34:43.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.223+0000 7fa9ca000640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa9b00a3c40 0x7fa9b00a6100 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc1a0490 tx=0x7fa9b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:34:43.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.225+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fa9bc09d3d0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.474+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fa9cc02dad0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.484+0000 7fa9d0a00640 1 -- 172.21.15.82:0/3166921017 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v17) ==== 81+0+745771 (secure 0 0 0) 0x7fa9bc09ccd0 con 0x7fa9cc0772f0 2024-04-26T20:34:43.488 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "epoch": 17, 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "active_gid": 14152, 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "active_name": "x", 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addrs": { 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6800", 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 893198693 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6801", 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 893198693 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.490 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addr": "172.21.15.82:6801/893198693", 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "active_change": "2024-04-26T20:11:46.422388+0000", 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "active_mgr_features": 4540701547738038271, 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "available": true, 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "standbys": [ 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 24109, 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "z", 2024-04-26T20:34:43.491 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.493 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.494 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.495 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.497 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.504 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-04-26T20:34:43.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-04-26T20:34:43.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T20:34:43.511 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:43.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-04-26T20:34:43.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-04-26T20:34:43.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.519 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.522 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-04-26T20:34:43.526 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-04-26T20:34:43.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:43.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T20:34:43.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-04-26T20:34:43.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.533 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T20:34:43.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T20:34:43.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T20:34:43.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-04-26T20:34:43.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.548 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-04-26T20:34:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-04-26T20:34:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T20:34:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-04-26T20:34:43.557 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.558 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-04-26T20:34:43.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T20:34:43.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-04-26T20:34:43.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.566 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-04-26T20:34:43.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.578 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-04-26T20:34:43.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.581 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.584 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-04-26T20:34:43.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-04-26T20:34:43.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-04-26T20:34:43.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T20:34:43.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.602 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-04-26T20:34:43.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.614 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.617 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.620 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-04-26T20:34:43.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.624 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T20:34:43.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.627 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T20:34:43.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.635 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.640 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.645 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T20:34:43.646 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.647 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.649 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T20:34:43.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T20:34:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T20:34:43.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-04-26T20:34:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T20:34:43.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T20:34:43.676 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-04-26T20:34:43.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.686 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.689 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.692 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.693 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:43.695 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.696 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.697 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-04-26T20:34:43.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-04-26T20:34:43.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.701 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-04-26T20:34:43.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.705 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.708 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-04-26T20:34:43.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.711 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.712 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-04-26T20:34:43.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.717 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.720 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.723 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.724 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-04-26T20:34:43.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-04-26T20:34:43.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T20:34:43.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-04-26T20:34:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.735 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.740 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.741 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.742 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-04-26T20:34:43.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.748 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.752 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-04-26T20:34:43.754 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.756 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.758 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.760 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-04-26T20:34:43.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.763 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.764 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.765 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.766 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.767 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-04-26T20:34:43.769 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-04-26T20:34:43.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.780 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.782 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.783 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.784 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.786 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.787 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.789 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.791 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.794 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.796 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.802 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.803 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.804 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.805 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.806 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.808 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.810 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.815 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.820 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.822 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.823 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.824 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.828 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.829 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.833 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.835 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.838 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.839 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.840 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.843 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-04-26T20:34:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.848 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.849 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.850 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.851 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.852 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.853 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-04-26T20:34:43.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.858 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-04-26T20:34:43.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.860 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-04-26T20:34:43.861 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.862 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-04-26T20:34:43.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.864 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.865 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.866 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.867 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.868 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.872 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.878 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.881 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.883 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:43.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.889 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.890 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.892 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.893 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.894 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.896 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.897 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.900 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.901 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.904 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.905 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.906 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-04-26T20:34:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.911 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-04-26T20:34:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-04-26T20:34:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.915 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.917 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.920 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.922 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.923 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T20:34:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-04-26T20:34:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.954 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-04-26T20:34:43.955 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-04-26T20:34:43.956 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.959 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-04-26T20:34:43.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.964 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-04-26T20:34:43.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-04-26T20:34:43.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.972 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.973 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.975 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.976 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.986 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:43.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.995 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-04-26T20:34:43.998 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:43.999 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.001 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.002 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.004 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.005 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.011 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 24113, 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "y", 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.012 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.014 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.016 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.017 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-04-26T20:34:44.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-04-26T20:34:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.022 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.024 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-04-26T20:34:44.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T20:34:44.027 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.028 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.029 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T20:34:44.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-04-26T20:34:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-04-26T20:34:44.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:34:44.037 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-04-26T20:34:44.038 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.041 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.042 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.043 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.044 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.045 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-04-26T20:34:44.046 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T20:34:44.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T20:34:44.049 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.050 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.051 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-04-26T20:34:44.053 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.055 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-04-26T20:34:44.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.059 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.060 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.064 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.065 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-04-26T20:34:44.066 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.068 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.069 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T20:34:44.070 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.072 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-04-26T20:34:44.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-04-26T20:34:44.075 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.076 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T20:34:44.077 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-04-26T20:34:44.079 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T20:34:44.083 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.084 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-04-26T20:34:44.085 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.086 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.087 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T20:34:44.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-04-26T20:34:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.093 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.094 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.096 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.098 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.099 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.100 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.102 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.103 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.104 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T20:34:44.105 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.106 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.108 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.109 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.110 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.111 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.116 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.117 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.118 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.119 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.122 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.123 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-04-26T20:34:44.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.126 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.128 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.129 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.131 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-04-26T20:34:44.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.136 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-04-26T20:34:44.137 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.140 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T20:34:44.142 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T20:34:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.144 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-04-26T20:34:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T20:34:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.146 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T20:34:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T20:34:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.149 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.150 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T20:34:44.155 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T20:34:44.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.157 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.158 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.159 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-04-26T20:34:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T20:34:44.166 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T20:34:44.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T20:34:44.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.173 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.181 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.183 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T20:34:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.189 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.190 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T20:34:44.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.192 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.194 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-04-26T20:34:44.198 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.206 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.207 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.208 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.214 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-04-26T20:34:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.226 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.228 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.229 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.231 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-04-26T20:34:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.235 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.237 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.240 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.243 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.245 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.246 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.247 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.248 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.249 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.251 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.252 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.254 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.255 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.257 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.258 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.260 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-04-26T20:34:44.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-04-26T20:34:44.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.271 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.273 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.274 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.275 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.278 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.280 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.282 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.284 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.287 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-04-26T20:34:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-04-26T20:34:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-04-26T20:34:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.344 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.345 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.348 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-04-26T20:34:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-04-26T20:34:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-04-26T20:34:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-04-26T20:34:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-04-26T20:34:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa9b00a3c40 msgr2=0x7fa9b00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa9b00a3c40 0x7fa9b00a6100 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc1a0490 tx=0x7fa9b8005f90 comp rx=0 tx=0).stop 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 msgr2=0x7fa9cc19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc19ef80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00ea60 tx=0x7fa9bc00ef20 comp rx=0 tx=0).stop 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 shutdown_connections 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fa9b00a3c40 0x7fa9b00a6100 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9cc078ed0 0x7fa9cc1a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9cc078530 0x7fa9cc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 --2- 172.21.15.82:0/3166921017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9cc0772f0 0x7fa9cc19ef80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:34:44.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 >> 172.21.15.82:0/3166921017 conn(0x7fa9cc0fff40 msgr2=0x7fa9cc1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:34:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-04-26T20:34:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-04-26T20:34:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-04-26T20:34:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-04-26T20:34:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-04-26T20:34:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T20:34:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-04-26T20:34:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-04-26T20:34:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.493 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:43 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/100296194' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:34:44.493 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:43 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1355364867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:34:44.493 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:43 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3166921017' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T20:34:44.493 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:43 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/100296194' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:34:44.493 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:43 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1355364867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:34:44.493 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:43 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3166921017' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T20:34:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 shutdown_connections 2024-04-26T20:34:44.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:34:43.496+0000 7fa9cbe00640 1 -- 172.21.15.82:0/3166921017 wait complete. 2024-04-26T20:34:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-04-26T20:34:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-04-26T20:34:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-04-26T20:34:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "modules": [ 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard", 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "iostat", 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "nfs", 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "restful" 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-04-26T20:34:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-04-26T20:34:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-04-26T20:34:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-04-26T20:34:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-04-26T20:34:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-04-26T20:34:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-04-26T20:34:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-04-26T20:34:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-04-26T20:34:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-26T20:34:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-26T20:34:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-04-26T20:34:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-26T20:34:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-04-26T20:34:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-26T20:34:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-04-26T20:34:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-04-26T20:34:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-04-26T20:34:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-26T20:34:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-04-26T20:34:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-04-26T20:34:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-26T20:34:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-04-26T20:34:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-04-26T20:34:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-04-26T20:34:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-04-26T20:34:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-04-26T20:34:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-04-26T20:34:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-04-26T20:34:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-04-26T20:34:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-04-26T20:34:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-26T20:34:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-04-26T20:34:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-04-26T20:34:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-04-26T20:34:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-04-26T20:34:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-26T20:34:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-26T20:34:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.685 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.686 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-26T20:34:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-26T20:34:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-04-26T20:34:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-26T20:34:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-26T20:34:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-04-26T20:34:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-04-26T20:34:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-04-26T20:34:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-04-26T20:34:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-04-26T20:34:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-04-26T20:34:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-04-26T20:34:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-04-26T20:34:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-04-26T20:34:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-04-26T20:34:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-04-26T20:34:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-26T20:34:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-04-26T20:34:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-04-26T20:34:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-04-26T20:34:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-04-26T20:34:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-04-26T20:34:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-04-26T20:34:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-04-26T20:34:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-04-26T20:34:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-04-26T20:34:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-04-26T20:34:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-04-26T20:34:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-04-26T20:34:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-04-26T20:34:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-04-26T20:34:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-26T20:34:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-04-26T20:34:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-04-26T20:34:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-04-26T20:34:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-04-26T20:34:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "services": { 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard": "https://172.21.15.82:8443/" 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "always_on_modules": { 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "octopus": [ 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-04-26T20:34:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "pacific": [ 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-04-26T20:34:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "quincy": [ 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-04-26T20:34:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "reef": [ 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T20:34:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "squid": [ 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "last_failure_osd_epoch": 3, 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "active_clients": [ 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2506235318 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "libcephsqlite", 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 701135180 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3121089520 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 393955402 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-04-26T20:34:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-04-26T20:34:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 99894044 2024-04-26T20:34:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T20:34:45.057 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:34:45.063 DEBUG:tasks.check_counter:Getting stats from a 2024-04-26T20:34:45.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-26T20:34:45.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:43 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/100296194' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:34:45.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:43 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1355364867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:34:45.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:43 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3166921017' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-26T20:34:45.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:44 smithi082 ceph-mon[28105]: pgmap v770: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 657 KiB/s wr, 209 op/s 2024-04-26T20:34:45.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:44 smithi135 ceph-mon[32816]: pgmap v770: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 657 KiB/s wr, 209 op/s 2024-04-26T20:34:45.065 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:44 smithi139 ceph-mon[32999]: pgmap v770: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 657 KiB/s wr, 209 op/s 2024-04-26T20:34:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:34:46.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:46 smithi139 ceph-mon[32999]: pgmap v771: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 341 KiB/s wr, 157 op/s 2024-04-26T20:34:46.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:46 smithi135 ceph-mon[32816]: pgmap v771: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 341 KiB/s wr, 157 op/s 2024-04-26T20:34:46.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:46 smithi082 ceph-mon[28105]: pgmap v771: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 341 KiB/s wr, 157 op/s 2024-04-26T20:34:48.354 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.004047926, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000525683, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 248, 2024-04-26T20:34:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 244, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 352528, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 149808, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.077569824, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.037332318, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.029678795, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.010860613, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 244, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.053402678, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000218863 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 352528, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 149808 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 185, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 320, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 189840, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-26T20:34:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.032052489, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.024676312, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.004017418, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 183, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.019808662, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000108244 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:34:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 189840 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:34:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:34:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148967, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 29, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:34:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T20:34:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 246, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 315065, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 246, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 246, 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 315065, 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:48.365 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:34:48.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:48 smithi139 ceph-mon[32999]: pgmap v772: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 200 KiB/s wr, 121 op/s 2024-04-26T20:34:48.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:48 smithi135 ceph-mon[32816]: pgmap v772: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 200 KiB/s wr, 121 op/s 2024-04-26T20:34:48.902 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:48 smithi082 ceph-mon[28105]: pgmap v772: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 200 KiB/s wr, 121 op/s 2024-04-26T20:34:49.372 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-04-26T20:34:49.373 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-04-26T20:34:49.373 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-04-26T20:34:49.373 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-04-26T20:34:49.373 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-04-26T20:34:49.373 DEBUG:tasks.check_counter:Getting stats from d 2024-04-26T20:34:49.373 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-26T20:34:49.822 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:34:50.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:50 smithi082 ceph-mon[28105]: pgmap v773: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 148 KiB/s wr, 73 op/s 2024-04-26T20:34:50.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:50 smithi139 ceph-mon[32999]: pgmap v773: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 148 KiB/s wr, 73 op/s 2024-04-26T20:34:50.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:50 smithi135 ceph-mon[32816]: pgmap v773: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 148 KiB/s wr, 73 op/s 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 250, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 248, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 351168, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 153200, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.087162579, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.036860433, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.030696320, 2024-04-26T20:34:52.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.013776885, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 247, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.036615216, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000148239 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 351168, 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 153200 2024-04-26T20:34:52.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 191, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 320, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 190896, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.038404156, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.029908288, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.005126318, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 189, 2024-04-26T20:34:52.147 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.031438071, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000166339 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 190896 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2992, 2024-04-26T20:34:52.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 448, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001428412, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000083121, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.001216771, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001457141, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000485713 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:52.149 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:34:52.150 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:34:52.151 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:34:52.152 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148951, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 28, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T20:34:52.153 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T20:34:52.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 252, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 315845, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 252, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 252, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 315845, 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:52.155 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:52.156 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:52.156 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:52.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:52.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:52.156 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:34:52.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:52 smithi139 ceph-mon[32999]: pgmap v774: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 135 KiB/s wr, 49 op/s 2024-04-26T20:34:52.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:52 smithi135 ceph-mon[32816]: pgmap v774: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 135 KiB/s wr, 49 op/s 2024-04-26T20:34:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:52 smithi082 ceph-mon[28105]: pgmap v774: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 135 KiB/s wr, 49 op/s 2024-04-26T20:34:53.139 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-26T20:34:53.139 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-26T20:34:53.139 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-26T20:34:53.139 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-26T20:34:53.139 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-04-26T20:34:53.140 DEBUG:tasks.check_counter:Getting stats from g 2024-04-26T20:34:53.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-26T20:34:53.593 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:34:54.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:54 smithi139 ceph-mon[32999]: pgmap v775: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 KiB/s wr, 17 op/s 2024-04-26T20:34:54.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:54 smithi135 ceph-mon[32816]: pgmap v775: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 KiB/s wr, 17 op/s 2024-04-26T20:34:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:54 smithi082 ceph-mon[28105]: pgmap v775: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 KiB/s wr, 17 op/s 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 76865, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 70620, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 32993166, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 122563979, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 10, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 9.894869594, 2024-04-26T20:34:55.896 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 4.400639114, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 5.566431298, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 1.062746241, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 70619, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 17.469938392, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000247382 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 118845, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.037091788, 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000312 2024-04-26T20:34:55.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 211791, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 354088, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 88380094, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 254412342, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 14, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 71.250886629, 2024-04-26T20:34:55.898 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 52.887449583, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 36.986156972, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 1.235998402, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 354089, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 277.547585808, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000783835 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 438131, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.282824553, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000645 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.899 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 69900464, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 169472112 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 32174, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 32362, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 10406363, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 147357764, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 27, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 7, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 6.032575445, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 2.622504758, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.974178464, 2024-04-26T20:34:55.900 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 1.896148982, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 32358, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 8.189183673, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000253080 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 16, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000001696, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000106 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 493824 2024-04-26T20:34:55.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10833, 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 182.941861022, 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.016887460 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 35072, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 15.345311865, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000437537 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 111463, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 105369, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 105369, 2024-04-26T20:34:55.903 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2056.975617559, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.019521639 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 6091, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 14, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 856, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 94, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 21, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 4, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 7, 2024-04-26T20:34:55.904 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 10, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 13, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 52187, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 1, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 1, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 4, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 172320, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 153264, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 6022, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 607, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 1, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-26T20:34:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 319, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 10472, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 348, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 39492, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 270, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 31687, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 15818, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 29706, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 569578261, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-04-26T20:34:55.906 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 15818, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 231, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 231, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 15587, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 140, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 16822, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 45245, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:34:55.907 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 43795, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 19377, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 918, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 47073 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 3522, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 3382, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 1863, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 2502, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 9480, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:34:55.908 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 19215, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 19215, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 350, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 94, 2024-04-26T20:34:55.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 2, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 125736, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 25605, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 24581, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 101155, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 1024, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 160, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 32, 2024-04-26T20:34:55.910 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 31, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 129, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 9, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 1, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 63586282, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 288352631, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3139, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 871.017366133, 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.277482435 2024-04-26T20:34:55.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 28, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 42350, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 42322, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 24, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 3623, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 3599, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 21, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 100237, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 100216, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 1, 2024-04-26T20:34:55.912 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 45122, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 45121, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 117984, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 223608 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 117619, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 11139, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 111463, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 338, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 22214, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 23968, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 202.335390733, 2024-04-26T20:34:55.913 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.008441897 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1181, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 137.233145951, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.116200800 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-26T20:34:55.914 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 31129, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1245.424860856, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.040008508 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000204263, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000204263 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.916 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.917 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-26T20:34:55.917 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.917 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.917 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 182, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 10.451266715, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.057424542 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.918 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6864, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 63.538495979, 2024-04-26T20:34:55.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.009256773 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 802, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2.130861580, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002656934 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 23975, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 336.327490210, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.014028258 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.920 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 148, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 21.095487735, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.142537079 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.921 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-26T20:34:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 17119, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 38.438413537, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002245365 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-04-26T20:34:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 1, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 0, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 1, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 18448, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 18448, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 726, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:34:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:34:55.927 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:34:55.928 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 308119, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 126, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 528, 2024-04-26T20:34:55.929 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 6, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8696, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 166, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T20:34:55.930 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 112853, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 605, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 61146, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 304144597, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 33, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 61146, 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-26T20:34:55.931 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 61146, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 859.263581260, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.014052653 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 61146, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 62880 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 61146, 2024-04-26T20:34:55.932 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 16443, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 44703, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 22, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 611, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 3751, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 308, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 94, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 39207, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-26T20:34:55.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 15823, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 44, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-26T20:34:55.934 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-26T20:34:55.935 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 92, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 3, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 12, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 12, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-26T20:34:55.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 2588, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 28, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 403 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 1 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.937 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 17, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 5, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 39114, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 19215, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 320826, 2024-04-26T20:34:55.938 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 94583901, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 320826, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 320826, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 94583901, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.939 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 61146, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 306238456, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 61146, 2024-04-26T20:34:55.940 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 306238456, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T20:34:55.941 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 61146, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 61146, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 61146, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 61146, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:55.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 19215, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 2094083, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 19215, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 612, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2094083, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.943 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x5642a79f4500": { 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 125736, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 284158327, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:55.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 125736, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 3139, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 284158327, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:55.945 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:34:56.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:56 smithi139 ceph-mon[32999]: pgmap v776: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 13 op/s 2024-04-26T20:34:56.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:56 smithi135 ceph-mon[32816]: pgmap v776: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 13 op/s 2024-04-26T20:34:56.908 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:56 smithi082 ceph-mon[28105]: pgmap v776: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 13 op/s 2024-04-26T20:34:56.966 INFO:tasks.check_counter:Daemon mds.g mds.exported=348 2024-04-26T20:34:56.966 INFO:tasks.check_counter:Daemon mds.g mds.imported=270 2024-04-26T20:34:56.966 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=3522 2024-04-26T20:34:56.966 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=3382 2024-04-26T20:34:56.966 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=94 2024-04-26T20:34:56.966 DEBUG:tasks.check_counter:Getting stats from j 2024-04-26T20:34:56.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-26T20:34:57.397 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T20:34:58.593 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:58 smithi082 ceph-mon[28105]: pgmap v777: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-04-26T20:34:58.593 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:34:58 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:58 smithi139 ceph-mon[32999]: pgmap v777: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-04-26T20:34:58.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:34:58 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:58 smithi135 ceph-mon[32816]: pgmap v777: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-04-26T20:34:58.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:34:58 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:59.688 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T20:34:59.688 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:34:59.688 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1528, 2024-04-26T20:34:59.688 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1495, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 38713830, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 549528, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.379407737, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.096419876, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.159596514, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.104523758, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1494, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.225728913, 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000151090 2024-04-26T20:34:59.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 576912, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 156480 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 499, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 690, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 57148814, 2024-04-26T20:34:59.690 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 564384, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 6, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.296208693, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.050340019, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.189757936, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.045701563, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 688, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.135789994, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000197369 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.691 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 405952 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 912, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 912, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 58960579, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 289193, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.348234155, 2024-04-26T20:34:59.692 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.045687676, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.226602866, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.056066083, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 911, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.116134619, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000127480 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4508, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.233975284, 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000051902 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-04-26T20:34:59.695 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-04-26T20:34:59.696 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 13934, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 13934, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 13934, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-04-26T20:34:59.697 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-04-26T20:34:59.698 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:34:59.699 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:34:59.700 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:34:59.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 76027, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-04-26T20:34:59.702 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 103, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 8, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 157684295, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 157683696, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.703 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 76027 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 13, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 19811, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 19798, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 11, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 829, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 818, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 13934, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 44556, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 30622, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-04-26T20:34:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 78692, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215416 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.706 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.707 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.708 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.710 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-04-26T20:34:59.711 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.713 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.714 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.715 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.716 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 2, 2024-04-26T20:34:59.717 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 2060, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:34:59.718 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-04-26T20:34:59.719 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:34:59.720 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 243061, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 84, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:34:59.721 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8696, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 166, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 9853128, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 55864, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-04-26T20:34:59.722 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2642, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2642, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2642, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 27.241474196, 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.010310928 2024-04-26T20:34:59.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2642, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2643 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2642, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2642, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1447, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 1193, 2024-04-26T20:34:59.724 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-04-26T20:34:59.725 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-04-26T20:34:59.726 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 92, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 3, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 11, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 11, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-04-26T20:34:59.727 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-04-26T20:34:59.728 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2935, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 154541242, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:59.729 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2935, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2935, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 154541242, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-04-26T20:34:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2642, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 153500297, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2642, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 153500297, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-04-26T20:34:59.731 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2642, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2642, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2642, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2642, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:59.733 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55c7618e4780": { 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-04-26T20:34:59.734 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T20:34:59.735 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T20:35:00.725 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-04-26T20:35:00.725 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-04-26T20:35:00.725 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update=0 2024-04-26T20:35:00.725 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update_receipt=0 2024-04-26T20:35:00.725 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2024-04-26T20:35:00.725 DEBUG:tasks.check_counter:Getting stats from b 2024-04-26T20:35:00.726 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-26T20:35:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:00 smithi135 ceph-mon[32816]: pgmap v778: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-04-26T20:35:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:00 smithi135 ceph-mon[32816]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:35:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:00.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:00 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:35:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:00 smithi082 ceph-mon[28105]: pgmap v778: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-04-26T20:35:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:00 smithi082 ceph-mon[28105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:35:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:00 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:35:00.978 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:35:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:00 smithi139 ceph-mon[32999]: pgmap v778: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-04-26T20:35:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:00 smithi139 ceph-mon[32999]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-26T20:35:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:01.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:01.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:00 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' 2024-04-26T20:35:02.705 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:02 smithi135 ceph-mon[32816]: pgmap v779: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-04-26T20:35:02.833 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 50548, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 53702, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 31243204, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 106701970, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 12, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 3.534532154, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 1.278108358, 2024-04-26T20:35:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.302643227, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 1.050165345, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 53703, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 30.404069736, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000566152 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 38282, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.006102062, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000159 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 426944, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 31936 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 142056, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 211222, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 57038761, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 166959932, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 166, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 8.526918820, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 3.767483728, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 6.195772638, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.809444395, 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 211223, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 29.782766316, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000141001 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 230647, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.038770253, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000168 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 43624256, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 91141312 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 66972, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 59225, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 26945497, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 65038126, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 16, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 8, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 3.671646835, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 1.289344824, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 1.654539781, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.937136863, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 59219, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 21.554036942, 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000363971 2024-04-26T20:35:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 63987, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.009107057, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000142 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 610272, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 176864 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-04-26T20:35:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 16829, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 43.071371740, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002559354 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 19470, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2.693924761, 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000138362 2024-04-26T20:35:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 52605, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 49675, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 49675, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 475.315587771, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.009568507 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 2928, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 83, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 2, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 3119, 2024-04-26T20:35:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 51, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 19, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 2, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 7, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 10, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 13, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 35239, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 5, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 89291, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 76120, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 2840, 2024-04-26T20:35:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 917, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 176, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 45, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 155, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 24969, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 142, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 23551, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 13011, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-04-26T20:35:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 13011, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 179, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 8, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 171, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 12832, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 82, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 11330, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 22657, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 5, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 29721, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 12729, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 502, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 23895 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 1652, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 7171, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 4117, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 5810, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 2485, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 9896, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 9896, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 8, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 155, 2024-04-26T20:35:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 51, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 3, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 66624, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 66621, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 66621, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 3, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 5, 2024-04-26T20:35:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 119, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 118, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 118, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 1, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 1, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 1, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 152217316, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 152222374, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1749, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 132.125802855, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.075543626 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 26, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 26332, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 26306, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 23, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 4146, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 4123, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 19, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 56708, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 56689, 2024-04-26T20:35:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 25759, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 25759, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 135452, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 231800 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 59688, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 3080, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 52605, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 235, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 8130, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10991, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 21.992214789, 2024-04-26T20:35:02.850 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002000929 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 989, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 8.667880170, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.008764287 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.851 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 14953, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 264.789282059, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.017708104 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-04-26T20:35:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:02.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.854 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.854 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 81, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 8.565792545, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.105750525 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.855 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3118, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 4.237681567, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001359102 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 395, 2024-04-26T20:35:02.856 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.191699730, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.003016961 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10610, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 143.059911111, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.013483497 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.857 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 55, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 7.796964130, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.141762984 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.858 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.033640002, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004805714 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:02.859 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-04-26T20:35:02.860 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.021303074, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002662884 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002009289, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000669763 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8465, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 14.957209305, 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001766947 2024-04-26T20:35:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 3, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-04-26T20:35:02.862 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 3911, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 1955, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 807, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:02.863 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:02.864 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:02.865 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 301660, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 115, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 88, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 1, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 166, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:02.866 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 103725, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 622, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 84885, 2024-04-26T20:35:02.867 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 199519483, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 32, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 84885, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 84885, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 59053.707965770, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.695690734 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 84885, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 160311 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 84885, 2024-04-26T20:35:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 13422, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 71463, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 2582, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 45384, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 318, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 2060, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 335, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 51, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 20104, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-04-26T20:35:02.869 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 13033, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 68341, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:02.870 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 5, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-04-26T20:35:02.871 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 92, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 8, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 6574, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 170, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 1354 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.872 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 17, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 6, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 20022, 2024-04-26T20:35:02.873 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 9896, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 259572, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 86707137, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 259572, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 259572, 2024-04-26T20:35:02.874 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 86707137, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:02.875 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 84885, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 200596635, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 84885, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 200596635, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-04-26T20:35:02.876 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 84885, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 84885, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 84885, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 84885, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.877 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 9896, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1078488, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 9896, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 311, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1078488, 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:02.878 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x5577fd15e500": { 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 66624, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 148028070, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 66624, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:02.879 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1749, 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 148028070, 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:02.880 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-26T20:35:02.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:02 smithi082 ceph-mon[28105]: pgmap v779: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-04-26T20:35:03.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:02 smithi139 ceph-mon[32999]: pgmap v779: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2024-04-26T20:35:03.573 INFO:tasks.check_counter:Daemon mds.b mds.exported=155 2024-04-26T20:35:03.573 INFO:tasks.check_counter:Daemon mds.b mds.imported=142 2024-04-26T20:35:03.574 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1652 2024-04-26T20:35:03.574 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=7171 2024-04-26T20:35:03.574 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=51 2024-04-26T20:35:03.574 DEBUG:tasks.check_counter:Getting stats from e 2024-04-26T20:35:03.574 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-26T20:35:03.818 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:35:04.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:04 smithi135 ceph-mon[32816]: pgmap v780: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:35:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:04 smithi082 ceph-mon[28105]: pgmap v780: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:35:05.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:04 smithi139 ceph-mon[32999]: pgmap v780: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-04-26T20:35:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 533, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 500, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 14338117, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 232966, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.062537977, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.020037764, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.027349069, 2024-04-26T20:35:05.661 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.011225215, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 499, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.020831263, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000041746 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 577248, 2024-04-26T20:35:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 156640 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 742, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 932, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 58916350, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 722995, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.103769797, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.022522364, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.054123521, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.020345400, 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 931, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.050875396, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000054645 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 488624 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:05.664 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1738, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1740, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 46653926, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 552742, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.180166884, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.051269278, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.063695746, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.051458307, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1738, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.066641088, 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000038343 2024-04-26T20:35:05.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.666 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4643, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.112259775, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000024178 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.667 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:05.668 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 6012, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 6012, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 6012, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 3, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-04-26T20:35:05.669 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:05.670 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:05.671 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-04-26T20:35:05.672 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-04-26T20:35:05.673 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:05.674 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:05.674 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:05.674 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-04-26T20:35:05.674 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-04-26T20:35:05.674 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:05.674 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-04-26T20:35:05.675 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 55640, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 71, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 6, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 122749093, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 122747442, 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-04-26T20:35:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 55640 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 20, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 16835, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 16815, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 17, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 789, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 772, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 6012, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 35413, 2024-04-26T20:35:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 29401, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 76660, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 215416 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-04-26T20:35:05.678 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.683 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.684 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.685 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.688 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.689 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 0, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2339, 2024-04-26T20:35:05.691 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:05.692 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:05.693 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 223249, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 70, 2024-04-26T20:35:05.694 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 166, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:05.695 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 4299269, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 24273, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2715, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-04-26T20:35:05.696 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2715, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2715, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 45.728034318, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.016842738 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2715, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2716 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2715, 2024-04-26T20:35:05.697 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2715, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1563, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1150, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-04-26T20:35:05.698 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-04-26T20:35:05.699 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-04-26T20:35:05.700 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 92, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 3, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 9, 2024-04-26T20:35:05.701 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 9, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:05.703 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 3009, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 119619700, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 3009, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3009, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 119619700, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2715, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 118567697, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2715, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 118567697, 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:05.705 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2715, 2024-04-26T20:35:05.706 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2715, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2715, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2715, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:05.707 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x561326c326e0": { 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:05.708 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:05.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.710 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-26T20:35:06.476 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-26T20:35:06.476 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-26T20:35:06.477 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-04-26T20:35:06.477 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-04-26T20:35:06.477 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-04-26T20:35:06.477 DEBUG:tasks.check_counter:Getting stats from h 2024-04-26T20:35:06.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-26T20:35:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:35:06.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:06 smithi135 ceph-mon[32816]: pgmap v781: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-26T20:35:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:06 smithi082 ceph-mon[28105]: pgmap v781: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-26T20:35:07.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:06 smithi139 ceph-mon[32999]: pgmap v781: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-26T20:35:08.413 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 861, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 861, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 30845639, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 272984, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.081345254, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.022449250, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.032106625, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.020707447, 2024-04-26T20:35:08.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 860, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.049603604, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000057678 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.415 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 429, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 506, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 37878102, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 357217, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.054852618, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.011609324, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.028932431, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.011177963, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 504, 2024-04-26T20:35:08.416 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.018071004, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000035855 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 221056 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 182, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 169, 2024-04-26T20:35:08.417 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 13117932, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 82532, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.025541220, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.006572808, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.014870877, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.003531004, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 168, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.012051046, 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000071732 2024-04-26T20:35:08.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 269504, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 63760 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-26T20:35:08.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2211, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.249246651, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000112730 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.420 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-04-26T20:35:08.421 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 8556, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 5981, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 2575, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 11, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:08.422 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 3, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-04-26T20:35:08.423 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:08.424 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-04-26T20:35:08.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:08.426 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-04-26T20:35:08.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 37917, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 2, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 25, 2024-04-26T20:35:08.428 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 152217316, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 152222374, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 152220722, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 37917 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 14, 2024-04-26T20:35:08.429 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 16632, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 16618, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 13, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 868, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 855, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 8556, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 34569, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 26013, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 71924, 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 215416 2024-04-26T20:35:08.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.431 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.437 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.442 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-04-26T20:35:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2339, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:08.444 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:08.445 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:08.446 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 230423, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 70, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:08.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 166, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 6071840, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 34356, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-04-26T20:35:08.448 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 1344, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 26, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 4, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 1344, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1344, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.913917349, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002912140 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1344, 2024-04-26T20:35:08.449 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1345 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 1344, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 1344, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 775, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 566, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-04-26T20:35:08.450 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 2, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-04-26T20:35:08.451 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-04-26T20:35:08.452 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 10, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 10, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-04-26T20:35:08.453 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:35:08.454 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1468, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 81700308, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1468, 2024-04-26T20:35:08.455 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1468, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 81700308, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:08.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 1344, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 81182528, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1344, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 81182528, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:08.457 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 1344, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 1344, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1344, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1344, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.458 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:08.459 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x556db9bf26e0": { 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:08.460 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-26T20:35:08.731 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:08 smithi135 ceph-mon[32816]: pgmap v782: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-26T20:35:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:08 smithi082 ceph-mon[28105]: pgmap v782: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-26T20:35:09.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:08 smithi139 ceph-mon[32999]: pgmap v782: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-26T20:35:09.163 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-04-26T20:35:09.163 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-04-26T20:35:09.163 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-04-26T20:35:09.164 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-04-26T20:35:09.164 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-04-26T20:35:09.164 DEBUG:tasks.check_counter:Getting stats from k 2024-04-26T20:35:09.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-26T20:35:09.401 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T20:35:10.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:10 smithi135 ceph-mon[32816]: pgmap v783: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T20:35:10.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:10 smithi082 ceph-mon[28105]: pgmap v783: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T20:35:11.075 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:10 smithi139 ceph-mon[32999]: pgmap v783: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-26T20:35:11.190 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-26T20:35:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1539, 2024-04-26T20:35:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1507, 2024-04-26T20:35:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 26112690, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 554286, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.171141467, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.049246594, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.062728496, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.047030435, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1507, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.062802057, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000041673 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 563472, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 159648 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 897, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1091, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 37077023, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 782651, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-04-26T20:35:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.098841884, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.030539485, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.039510388, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.020874775, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1089, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.043310805, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000039771 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 497984 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 338, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 340, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 50422413, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 107496, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.048546447, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.006371611, 2024-04-26T20:35:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.032570433, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.007453021, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 338, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.013379089, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000039583 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:35:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4331, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.108430244, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000025035 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-26T20:35:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-04-26T20:35:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 11764, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 11764, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 11764, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-04-26T20:35:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-04-26T20:35:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-04-26T20:35:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-04-26T20:35:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 56947, 2024-04-26T20:35:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 73, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 6, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 116536451, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 116535313, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 56947 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 13, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 14637, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 14624, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 11, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 674, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 663, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 11764, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 35282, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 23518, 2024-04-26T20:35:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 72340, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 215416 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-04-26T20:35:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-04-26T20:35:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.216 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 1, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 0, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2343, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:11.218 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:11.219 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:11.220 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 231415, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 75, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:11.221 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 166, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 8325448, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 47184, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.222 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2474, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2474, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2474, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 81.826272120, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.033074483 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-04-26T20:35:11.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2474, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2475 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2474, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2474, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1368, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1104, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-04-26T20:35:11.224 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:11.225 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-04-26T20:35:11.226 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 92, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 3, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 10, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 10, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-04-26T20:35:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-04-26T20:35:11.228 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 2770, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 113344827, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 2770, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2770, 2024-04-26T20:35:11.229 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 113344827, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:11.230 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2474, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 112351082, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2474, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 112351082, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-04-26T20:35:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2474, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2474, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2474, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2474, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.232 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55784681e6e0": { 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-26T20:35:11.234 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-26T20:35:11.235 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-26T20:35:12.100 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-26T20:35:12.101 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-26T20:35:12.101 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-04-26T20:35:12.101 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-04-26T20:35:12.101 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-04-26T20:35:12.101 DEBUG:tasks.check_counter:Getting stats from c 2024-04-26T20:35:12.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-26T20:35:12.399 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:35:12.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:12 smithi139 ceph-mon[32999]: pgmap v784: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:35:12.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:12 smithi135 ceph-mon[32816]: pgmap v784: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:35:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:12 smithi082 ceph-mon[28105]: pgmap v784: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 63903, 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 68234, 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 31822781, 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 72967147, 2024-04-26T20:35:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 17, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 4.134545170, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.827892953, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 2.441503295, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.331160553, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 68239, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.506346265, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000051383 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 108967, 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.019667225, 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000180 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 587616, 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 344672 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 32682, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 34196, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 11800216, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 78350732, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 18, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 2.870691705, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.275582941, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.893310445, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.704247916, 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 34195, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.987774975, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000058130 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 25415, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.005672148, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000223 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 579024 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 144566, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 199412, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 56581254, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 140506748, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 18, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 8, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 8.359922269, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 3.851087016, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 7.288120121, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.492033491, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 199404, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 14.907635593, 2024-04-26T20:35:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000074760 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 237684, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.045533404, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000191 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 52775840, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 92466392 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-26T20:35:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 12847, 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 44.294110838, 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.003447817 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 27628, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.846374212, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000139220 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 56431, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 53928, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 53928, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 810.092365515, 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.015021739 2024-04-26T20:35:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 2503, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 35, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 380, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 41, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 18, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 2, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 6, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 10, 2024-04-26T20:35:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 13, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 14989, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 5, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 102539, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 86122, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 2354, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 808, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 5, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 497, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-26T20:35:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 213, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 9790, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 259, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 18058, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 10829, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 29706, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 569578261, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 10829, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 37, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 37, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 10792, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 390, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 10111, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 23554, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 30278, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 10193, 2024-04-26T20:35:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 418, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 32594 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 3418, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 5707, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 3333, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 4518, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 5018, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 13924, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 13924, 2024-04-26T20:35:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 213, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-26T20:35:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 41, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 1, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 76027, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 76027, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 103, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-26T20:35:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 103, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 8, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 157684295, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2369, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 165.403466845, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.069819952 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 25, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 20260, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 20235, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 22, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 3109, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 3087, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 18, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 46748, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 46730, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 23823, 2024-04-26T20:35:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 23823, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 125092, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 223608 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 68135, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 6371, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 56431, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 405, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 16397, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 8570, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 36.667797724, 2024-04-26T20:35:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.004278622 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 39, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.733614676, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.018810632 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 20881, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 412.895379450, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.019773735 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 38, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 4.292435179, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.112958820 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3794, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 5.157150578, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001359291 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 537, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.953304024, 2024-04-26T20:35:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001775240 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 8566, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 317.948406421, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.037117488 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 97, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 11.677927605, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.120391006 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 11406, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 19.766349858, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001732978 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 2, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 13254, 2024-04-26T20:35:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 6627, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 757, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:14.299 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 308747, 2024-04-26T20:35:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 127, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 264, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 3, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 166, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 98789, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 504, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 43728, 2024-04-26T20:35:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 163506644, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 33, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 43728, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 43728, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 712.443881318, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.016292624 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 43728, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 44839 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 43728, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 11376, 2024-04-26T20:35:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 32352, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 10, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 512, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 2881, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 279, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 41, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 28367, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 10835, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 20, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-26T20:35:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-26T20:35:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 92, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 3, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 1486, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 70, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 338 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 17, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-26T20:35:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 5, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 28319, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 13924, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 241147, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 72414785, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 241147, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 241147, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 72414785, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 43728, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 165023592, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 43728, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 165023592, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 43728, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 43728, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 43728, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 43728, 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 13924, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 1517508, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 13924, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 512, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1517508, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x564238052500": { 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 76027, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 153489991, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 76027, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2369, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 153489991, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:14.317 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T20:35:14.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:14 smithi135 ceph-mon[32816]: pgmap v785: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:14 smithi082 ceph-mon[28105]: pgmap v785: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:15.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:14 smithi139 ceph-mon[32999]: pgmap v785: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:15.293 INFO:tasks.check_counter:Daemon mds.c mds.exported=213 2024-04-26T20:35:15.293 INFO:tasks.check_counter:Daemon mds.c mds.imported=259 2024-04-26T20:35:15.293 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=3418 2024-04-26T20:35:15.293 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=5707 2024-04-26T20:35:15.293 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=41 2024-04-26T20:35:15.293 DEBUG:tasks.check_counter:Getting stats from f 2024-04-26T20:35:15.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-26T20:35:15.542 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:35:16.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:16 smithi135 ceph-mon[32816]: pgmap v786: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:35:16.920 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:16 smithi139 ceph-mon[32999]: pgmap v786: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:35:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:16 smithi082 ceph-mon[28105]: pgmap v786: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:35:17.367 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 2026, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 2028, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 104410432, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 644275, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 8, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.217074205, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.052150024, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.092002327, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.058009150, 2024-04-26T20:35:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2026, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.074570818, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000036806 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 687, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 652, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 76187873, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 281814, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.107962360, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.021506748, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.067439803, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.015599709, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 652, 2024-04-26T20:35:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.024633476, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000037781 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 580784, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 158368 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 626, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 819, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 105039571, 2024-04-26T20:35:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 611518, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.107529962, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.018397701, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.068739919, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.015051170, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 817, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.029756189, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000036421 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 412768 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 5096, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.125298098, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000024587 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-04-26T20:35:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 19225, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 625, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 18600, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 18331, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-04-26T20:35:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-04-26T20:35:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-04-26T20:35:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 125736, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-26T20:35:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 129, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 12, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 63586282, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 288352631, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 288351493, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 125736 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 13, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 41939, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 41926, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 11, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 1854, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 1843, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 19225, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 95175, 2024-04-26T20:35:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 75950, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 79504, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 215416 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-26T20:35:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-26T20:35:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 1, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 2368, 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 240215, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 80, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-26T20:35:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 166, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 13577992, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 77028, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-26T20:35:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 3039, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 3039, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3039, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 38.910173177, 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.012803610 2024-04-26T20:35:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3039, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3040 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 3039, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 3039, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1727, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 1310, 2024-04-26T20:35:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-26T20:35:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 92, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 3, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 11, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 11, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-26T20:35:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-26T20:35:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 3335, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 285319739, 2024-04-26T20:35:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 3335, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 3335, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 285319739, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 3039, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 284211022, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 3039, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 284211022, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 3039, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 3039, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 3039, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 3039, 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x559f6a1b26e0": { 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:17.414 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T20:35:18.054 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-26T20:35:18.054 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-26T20:35:18.054 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-26T20:35:18.054 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-04-26T20:35:18.054 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-04-26T20:35:18.055 DEBUG:tasks.check_counter:Getting stats from i 2024-04-26T20:35:18.055 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-26T20:35:18.296 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:35:18.689 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:18 smithi139 ceph-mon[32999]: pgmap v787: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:35:18.869 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:18 smithi135 ceph-mon[32816]: pgmap v787: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:35:18.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:18 smithi082 ceph-mon[28105]: pgmap v787: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-26T20:35:19.982 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 122164, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 169444, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 48137684, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 125869771, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 20, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 7.083023741, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 3.251691113, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 7.017940617, 2024-04-26T20:35:19.983 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.329064471, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 169443, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 13.071626848, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000077144 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 208641, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.037143414, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000178 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 41516336, 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 71539760 2024-04-26T20:35:19.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 46700, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 37392, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 21252902, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 61759941, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 14, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 2.768117897, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.251976173, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 1.512982006, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.270970194, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 37391, 2024-04-26T20:35:19.985 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.633807584, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000043695 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 63003, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.009718817, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000154 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 592992, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 302032 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:19.986 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 19438, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 18307, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 9648004, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 37804348, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 18, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 1.377462801, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.625104445, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.670445025, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.171489376, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 18305, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.002437299, 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000054763 2024-04-26T20:35:19.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 25173, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.004035178, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000160 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 495840 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.988 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 11182, 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 36.539329115, 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.003267691 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 12204, 2024-04-26T20:35:19.989 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.931011852, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000158227 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 43952, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 41476, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 41476, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 689.574176632, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.016625860 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 2476, 2024-04-26T20:35:19.990 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 1, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 497, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 54, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 27, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 6, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 8, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 13, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 18, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 24600, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 4, 2024-04-26T20:35:19.991 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 4, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 4, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 78736, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 62283, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 2349, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 675, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 426, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 5, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 159, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 18741, 2024-04-26T20:35:19.992 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 178, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 12456, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 9762, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 29706, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 569578261, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 9762, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 46, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:19.993 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 46, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 9716, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 79, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 9186, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 16398, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 26972, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 10650, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 352, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 19930 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.994 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 1570, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 7114, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 3999, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 5335, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 2360, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 5994, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 5994, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 159, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 54, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.996 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 2, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 55640, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 55640, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 71, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 71, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 6, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-04-26T20:35:19.997 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 122749093, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1611, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 162.913180438, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.101125499 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 33, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 17363, 2024-04-26T20:35:19.998 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 17330, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 27, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 3902, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 3875, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 27, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 38394, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 38367, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 4, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 16963, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 16959, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 117416, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 223608 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-26T20:35:19.999 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 51062, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 3720, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 43952, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 228, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 10003, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 9786, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 42.615535772, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.004354745 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.000 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 34, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.560880323, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.016496480 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-26T20:35:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 13159, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 413.646033121, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.031434458 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000125832, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000125832 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-26T20:35:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 61, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.288679566, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.037519337 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3823, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 4.768030865, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001247196 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 205, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.383154598, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001869046 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 9793, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 208.020711969, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.021241775 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 39, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 8.351306742, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.214136070 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4575, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 8.939717844, 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001954036 2024-04-26T20:35:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 2, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-26T20:35:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 1834, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 917, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 815, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 325559, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 143, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 880, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 10, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 166, 2024-04-26T20:35:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 133005, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 707, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-26T20:35:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 25316, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 129316246, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 33, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 25316, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 25316, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 536.371597889, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.021187059 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 25316, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 26432 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 25316, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 10081, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 15235, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 0, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 10, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 318, 2024-04-26T20:35:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 1929, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 197, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 54, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 12189, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 9763, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 20, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-26T20:35:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 92, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-26T20:35:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 3, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 1658, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 292 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-26T20:35:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 17, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 5, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 12149, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 5994, 2024-04-26T20:35:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 188298, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 57248857, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 188298, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 188298, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 57248857, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 25316, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 129969464, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 25316, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 129969464, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 25316, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 25316, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 25316, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 25316, 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 5994, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 653234, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 5994, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 318, 2024-04-26T20:35:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 653234, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55fc8d258500": { 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 55640, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 118554789, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 55640, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 1611, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 118554789, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:20.030 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T20:35:20.772 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:20 smithi139 ceph-mon[32999]: pgmap v788: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:35:20.801 INFO:tasks.check_counter:Daemon mds.i mds.exported=159 2024-04-26T20:35:20.801 INFO:tasks.check_counter:Daemon mds.i mds.imported=178 2024-04-26T20:35:20.801 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1570 2024-04-26T20:35:20.801 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=7114 2024-04-26T20:35:20.802 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=54 2024-04-26T20:35:20.802 DEBUG:tasks.check_counter:Getting stats from l 2024-04-26T20:35:20.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 shell --fsid da6438ae-0408-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-26T20:35:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:20 smithi082 ceph-mon[28105]: pgmap v788: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:35:21.039 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T20:35:21.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:20 smithi135 ceph-mon[32816]: pgmap v788: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 141179, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 191432, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 60757019, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 126263497, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 25, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 7.958761075, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 3.525601181, 2024-04-26T20:35:22.653 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 6.699108861, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.429992000, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 191424, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 14.792923163, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000077278 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 241586, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.041088326, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000170 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 44528880, 2024-04-26T20:35:22.654 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 79220944 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 48417, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 53475, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 17573073, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 37257066, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 8, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 3.104390780, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.244355092, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 1.662765323, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.404765900, 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:22.655 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 53481, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.735627058, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000051151 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 72295, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.016092250, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000222 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 583904, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 255552 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 23954, 2024-04-26T20:35:22.656 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 26250, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 6974446, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 71106110, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 19, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 2.573542637, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.247393578, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.685923688, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.623394402, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 26248, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.520619234, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000057932 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.657 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 20485, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.003524632, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000172 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 582896 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:22.658 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 13008, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 33.917038456, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002607398 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 23551, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.634314269, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000154316 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-26T20:35:22.659 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 48404, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 47161, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 47161, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 842.913232196, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.017873099 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 1243, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 8, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 297, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 32, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 31, 2024-04-26T20:35:22.660 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 11, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 10, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 10, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 13, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 8021, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 6, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 92895, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 77967, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 1148, 2024-04-26T20:35:22.661 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 884, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 381, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 235, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 4694, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 261, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 11934, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 10368, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-26T20:35:22.662 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 29706, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 569578261, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 10368, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 42, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 42, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 10326, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 280, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 8022, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 20079, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-26T20:35:22.663 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 18252, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 8193, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 517, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 26453 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 2684, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 6596, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 3812, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 5019, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 4493, 2024-04-26T20:35:22.664 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 11754, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 11754, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-26T20:35:22.665 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 236, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 32, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 56947, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 56947, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-26T20:35:22.666 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 73, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 73, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 6, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 116536451, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2331, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 161.063567278, 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.069096339 2024-04-26T20:35:22.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 38, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 15114, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 15076, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 36, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 3313, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 3277, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 31, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 37607, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 37576, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 17417, 2024-04-26T20:35:22.668 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 17417, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 108548, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 223608 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 61451, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 6283, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 48404, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 367, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 16707, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 7076, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 26.928631371, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.003805629 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.669 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 19, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.230740699, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.064775826 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 19748, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 396.641815971, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.020085163 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-26T20:35:22.672 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.673 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.673 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.673 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-26T20:35:22.673 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.673 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 37, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 13.615915514, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.367997716 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.674 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2470, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.258554068, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001319252 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 422, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.897472564, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002126712 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.675 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 7069, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 369.002058977, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.052200036 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 54, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 8.878937965, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.164424777 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.678 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 10266, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 22.459105067, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002187717 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-26T20:35:22.680 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 1, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 3324, 2024-04-26T20:35:22.681 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 3324, 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 2371, 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-26T20:35:22.682 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-26T20:35:22.683 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-26T20:35:22.683 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-26T20:35:22.683 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-26T20:35:22.683 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-26T20:35:22.683 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-26T20:35:22.683 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-26T20:35:22.684 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-26T20:35:22.685 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-26T20:35:22.685 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-26T20:35:22.685 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-26T20:35:22.685 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-26T20:35:22.685 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-26T20:35:22.685 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-26T20:35:22.686 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-26T20:35:22.687 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 300443, 2024-04-26T20:35:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 120, 2024-04-26T20:35:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 176, 2024-04-26T20:35:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 2, 2024-04-26T20:35:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-26T20:35:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-26T20:35:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-26T20:35:22.689 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-26T20:35:22.689 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-26T20:35:22.689 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-26T20:35:22.689 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8696, 2024-04-26T20:35:22.689 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 166, 2024-04-26T20:35:22.689 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-26T20:35:22.690 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-26T20:35:22.690 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-26T20:35:22.690 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-26T20:35:22.690 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 153693, 2024-04-26T20:35:22.690 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 628, 2024-04-26T20:35:22.690 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-26T20:35:22.691 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-26T20:35:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 38775, 2024-04-26T20:35:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 120215221, 2024-04-26T20:35:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 33, 2024-04-26T20:35:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 38775, 2024-04-26T20:35:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-26T20:35:22.692 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 38775, 2024-04-26T20:35:22.693 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 659.665985059, 2024-04-26T20:35:22.693 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.017012662 2024-04-26T20:35:22.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.693 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-26T20:35:22.693 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-26T20:35:22.693 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 38775, 2024-04-26T20:35:22.694 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 39747 2024-04-26T20:35:22.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.694 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 38775, 2024-04-26T20:35:22.694 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 10995, 2024-04-26T20:35:22.695 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 27780, 2024-04-26T20:35:22.695 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-26T20:35:22.695 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-26T20:35:22.695 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 0, 2024-04-26T20:35:22.695 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 10, 2024-04-26T20:35:22.695 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 619, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 2950, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 321, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 32, 2024-04-26T20:35:22.696 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 23780, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 10368, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 20, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-26T20:35:22.697 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-26T20:35:22.698 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-26T20:35:22.698 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-26T20:35:22.698 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-26T20:35:22.698 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-26T20:35:22.698 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-26T20:35:22.698 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-26T20:35:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-26T20:35:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-26T20:35:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-26T20:35:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-26T20:35:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-26T20:35:22.699 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-26T20:35:22.700 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-26T20:35:22.700 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-26T20:35:22.700 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-26T20:35:22.700 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-26T20:35:22.700 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-26T20:35:22.700 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-26T20:35:22.701 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-26T20:35:22.701 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-26T20:35:22.701 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-26T20:35:22.701 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-26T20:35:22.701 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-26T20:35:22.701 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-26T20:35:22.702 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 92, 2024-04-26T20:35:22.702 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-26T20:35:22.702 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 3, 2024-04-26T20:35:22.702 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-04-26T20:35:22.702 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 1313, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 16, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 318 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-04-26T20:35:22.703 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.704 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 17, 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 5, 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 23742, 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 11754, 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-26T20:35:22.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 213546, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 60894553, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 213546, 2024-04-26T20:35:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 213546, 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 60894553, 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.707 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:22.708 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 38775, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 121496135, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 38775, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 121496135, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:22.709 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 38775, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 38775, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 38775, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 38775, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 11754, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 1281042, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 11754, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 619, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1281042, 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:22.711 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55828406c500": { 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 56947, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 112342147, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 56947, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-26T20:35:22.712 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2331, 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 112342147, 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T20:35:22.713 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T20:35:22.713 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:22 smithi139 ceph-mon[32999]: pgmap v789: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:35:22.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:22 smithi135 ceph-mon[32816]: pgmap v789: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:35:22.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:22 smithi082 ceph-mon[28105]: pgmap v789: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-26T20:35:23.426 INFO:tasks.check_counter:Daemon mds.l mds.exported=235 2024-04-26T20:35:23.426 INFO:tasks.check_counter:Daemon mds.l mds.imported=261 2024-04-26T20:35:23.426 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=2684 2024-04-26T20:35:23.426 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=6596 2024-04-26T20:35:23.426 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=32 2024-04-26T20:35:23.426 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T20:35:23.436 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T20:35:23.436 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:35:23.437 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:35:23.497 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:35:23.498 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:35:23.551 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:35:23.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 -- 172.21.15.82:0/2913173663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4104990 msgr2=0x7efda4104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 --2- 172.21.15.82:0/2913173663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4104990 0x7efda4104db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efd94009900 tx=0x7efd9402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 -- 172.21.15.82:0/2913173663 shutdown_connections 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 --2- 172.21.15.82:0/2913173663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 0x7efda410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 --2- 172.21.15.82:0/2913173663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4105b80 0x7efda4106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 --2- 172.21.15.82:0/2913173663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4104990 0x7efda4104db0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.762+0000 7efda8e00640 1 -- 172.21.15.82:0/2913173663 >> 172.21.15.82:0/2913173663 conn(0x7efda40fff00 msgr2=0x7efda4102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.763+0000 7efda8e00640 1 -- 172.21.15.82:0/2913173663 shutdown_connections 2024-04-26T20:35:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.763+0000 7efda8e00640 1 -- 172.21.15.82:0/2913173663 wait complete. 2024-04-26T20:35:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.763+0000 7efda8e00640 1 Processor -- start 2024-04-26T20:35:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 -- start start 2024-04-26T20:35:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 0x7efda419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4105b80 0x7efda419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 0x7efda41a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efda4110510 con 0x7efda4104990 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efda4110390 con 0x7efda4106540 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda8e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efda4110690 con 0x7efda4105b80 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 0x7efda419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4105b80 0x7efda419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 0x7efda41a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 0x7efda419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44626/0 (socket says 172.21.15.82:44626) 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda2a00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4105b80 0x7efda419b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47016/0 (socket says 172.21.15.82:47016) 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.764+0000 7efda3400640 1 -- 172.21.15.82:0/1567640533 learned_addr learned my addr 172.21.15.82:0/1567640533 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3e00640 1 -- 172.21.15.82:0/1567640533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4105b80 msgr2=0x7efda419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4105b80 0x7efda419b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3e00640 1 -- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 msgr2=0x7efda419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:23.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 0x7efda419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3e00640 1 -- 172.21.15.82:0/1567640533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda41a27d0 con 0x7efda4106540 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3400640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 0x7efda419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda3e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 0x7efda41a2160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009fd0 tx=0x7efd9c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00ce20 con 0x7efda4106540 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda41a2ac0 con 0x7efda4106540 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd9c005020 con 0x7efda4106540 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.765+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c010690 con 0x7efda4106540 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.766+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda41a3010 con 0x7efda4106540 2024-04-26T20:35:23.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.767+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda410bd30 con 0x7efda4106540 2024-04-26T20:35:23.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.769+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efd9c0054d0 con 0x7efda4106540 2024-04-26T20:35:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.770+0000 7efd9be00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efd880a3c40 0x7efd880a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.770+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7efd9c0d13c0 con 0x7efda4106540 2024-04-26T20:35:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.770+0000 7efda3400640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efd880a3c40 0x7efd880a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:23.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.771+0000 7efda3400640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efd880a3c40 0x7efd880a6100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efd94000c00 tx=0x7efd94005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:23.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.772+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7efd9c09d8e0 con 0x7efda4106540 2024-04-26T20:35:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.978+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efda402dca0 con 0x7efda4106540 2024-04-26T20:35:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.980+0000 7efd9be00640 1 -- 172.21.15.82:0/1567640533 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24669 (secure 0 0 0) 0x7efd9c09d1e0 con 0x7efda4106540 2024-04-26T20:35:23.982 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:35:23.983 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:28:53.426105+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efd880a3c40 msgr2=0x7efd880a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efd880a3c40 0x7efd880a6100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efd94000c00 tx=0x7efd94005a20 comp rx=0 tx=0).stop 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 msgr2=0x7efda41a2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 0x7efda41a2160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009fd0 tx=0x7efd9c00ef10 comp rx=0 tx=0).stop 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 shutdown_connections 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7efd880a3c40 0x7efd880a6100 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda4106540 0x7efda41a2160 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efda4105b80 0x7efda419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 --2- 172.21.15.82:0/1567640533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efda4104990 0x7efda419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 >> 172.21.15.82:0/1567640533 conn(0x7efda40fff00 msgr2=0x7efda4108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 shutdown_connections 2024-04-26T20:35:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:23.983+0000 7efda8e00640 1 -- 172.21.15.82:0/1567640533 wait complete. 2024-04-26T20:35:24.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:32.585501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:19:49.748248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:19:51.088720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:19:54.730365+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:35:24.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:35:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.205+0000 7fdaf5400640 1 -- 172.21.15.82:0/2574947799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0108e70 msgr2=0x7fdaf0109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.205+0000 7fdaf5400640 1 --2- 172.21.15.82:0/2574947799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0108e70 0x7fdaf0109290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009860 tx=0x7fdae002a340 comp rx=0 tx=0).stop 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 -- 172.21.15.82:0/2574947799 shutdown_connections 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 --2- 172.21.15.82:0/2574947799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf010a980 0x7fdaf01112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 --2- 172.21.15.82:0/2574947799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0109fc0 0x7fdaf010a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 --2- 172.21.15.82:0/2574947799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0108e70 0x7fdaf0109290 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 -- 172.21.15.82:0/2574947799 >> 172.21.15.82:0/2574947799 conn(0x7fdaf0077e00 msgr2=0x7fdaf007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 -- 172.21.15.82:0/2574947799 shutdown_connections 2024-04-26T20:35:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.206+0000 7fdaf5400640 1 -- 172.21.15.82:0/2574947799 wait complete. 2024-04-26T20:35:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 Processor -- start 2024-04-26T20:35:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 -- start start 2024-04-26T20:35:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 0x7fdaf019f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0109fc0 0x7fdaf019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf010a980 0x7fdaf01a6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01149c0 con 0x7fdaf010a980 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf0114840 con 0x7fdaf0108e70 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaf5400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf0114b40 con 0x7fdaf0109fc0 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaefe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 0x7fdaf019f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.207+0000 7fdaefe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 0x7fdaf019f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51924/0 (socket says 172.21.15.82:51924) 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 -- 172.21.15.82:0/1546858569 learned_addr learned my addr 172.21.15.82:0/1546858569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaf4a00640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf010a980 0x7fdaf01a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdae7400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0109fc0 0x7fdaf019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 -- 172.21.15.82:0/1546858569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0109fc0 msgr2=0x7fdaf019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0109fc0 0x7fdaf019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 -- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf010a980 msgr2=0x7fdaf01a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf010a980 0x7fdaf01a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 -- 172.21.15.82:0/1546858569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf01a6cc0 con 0x7fdaf0108e70 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdae7400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0109fc0 0x7fdaf019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:35:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaefe00640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 0x7fdaf019f0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdae00057c0 tx=0x7fdae0032da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.208+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0037040 con 0x7fdaf0108e70 2024-04-26T20:35:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.209+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdae0030bd0 con 0x7fdaf0108e70 2024-04-26T20:35:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.209+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf01a6f50 con 0x7fdaf0108e70 2024-04-26T20:35:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.209+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0005280 con 0x7fdaf0108e70 2024-04-26T20:35:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.209+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf01a7300 con 0x7fdaf0108e70 2024-04-26T20:35:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.210+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf0110270 con 0x7fdaf0108e70 2024-04-26T20:35:24.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.212+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdae0043020 con 0x7fdaf0108e70 2024-04-26T20:35:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.213+0000 7fdaed600640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdad40a3c40 0x7fdad40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.213+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fdae00effe0 con 0x7fdaf0108e70 2024-04-26T20:35:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.213+0000 7fdae7400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdad40a3c40 0x7fdad40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.214+0000 7fdae7400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdad40a3c40 0x7fdad40a6100 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdaf01a05b0 tx=0x7fdad8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:24.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.215+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fdae00bc640 con 0x7fdaf0108e70 2024-04-26T20:35:24.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.404+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdaf002dd20 con 0x7fdaf0108e70 2024-04-26T20:35:24.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.405+0000 7fdaed600640 1 -- 172.21.15.82:0/1546858569 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7fdae00bbf40 con 0x7fdaf0108e70 2024-04-26T20:35:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-26T20:35:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdad40a3c40 msgr2=0x7fdad40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdad40a3c40 0x7fdad40a6100 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdaf01a05b0 tx=0x7fdad8009260 comp rx=0 tx=0).stop 2024-04-26T20:35:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 msgr2=0x7fdaf019f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 0x7fdaf019f0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdae00057c0 tx=0x7fdae0032da0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 shutdown_connections 2024-04-26T20:35:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fdad40a3c40 0x7fdad40a6100 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf010a980 0x7fdaf01a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaf0109fc0 0x7fdaf019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 --2- 172.21.15.82:0/1546858569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaf0108e70 0x7fdaf019f0f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 >> 172.21.15.82:0/1546858569 conn(0x7fdaf0077e00 msgr2=0x7fdaf010d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 shutdown_connections 2024-04-26T20:35:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.407+0000 7fdaf5400640 1 -- 172.21.15.82:0/1546858569 wait complete. 2024-04-26T20:35:24.427 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:35:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 -- 172.21.15.82:0/3883227030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0106620 msgr2=0x7f0da010ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 --2- 172.21.15.82:0/3883227030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0106620 0x7f0da010ceb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009900 tx=0x7f0d9802a410 comp rx=0 tx=0).stop 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 -- 172.21.15.82:0/3883227030 shutdown_connections 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 --2- 172.21.15.82:0/3883227030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0106620 0x7f0da010ceb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 --2- 172.21.15.82:0/3883227030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0da0105c60 0x7f0da01060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 --2- 172.21.15.82:0/3883227030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0da0104a70 0x7f0da0104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 -- 172.21.15.82:0/3883227030 >> 172.21.15.82:0/3883227030 conn(0x7f0da00fffe0 msgr2=0x7f0da0102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 -- 172.21.15.82:0/3883227030 shutdown_connections 2024-04-26T20:35:24.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.622+0000 7f0da5c00640 1 -- 172.21.15.82:0/3883227030 wait complete. 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.623+0000 7f0da5c00640 1 Processor -- start 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.623+0000 7f0da5c00640 1 -- start start 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 0x7f0da019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0da0105c60 0x7f0da019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0da0106620 0x7f0da01a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0da01105d0 con 0x7f0da0106620 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0da0110450 con 0x7f0da0104a70 2024-04-26T20:35:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0da0110750 con 0x7f0da0105c60 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 0x7f0da019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 0x7f0da019ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51934/0 (socket says 172.21.15.82:51934) 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 -- 172.21.15.82:0/1869115459 learned_addr learned my addr 172.21.15.82:0/1869115459 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0da5200640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0da0106620 0x7f0da01a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d97400640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0da0105c60 0x7f0da019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 -- 172.21.15.82:0/1869115459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0da0105c60 msgr2=0x7f0da019b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0da0105c60 0x7f0da019b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 -- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0da0106620 msgr2=0x7f0da01a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0da0106620 0x7f0da01a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.624+0000 7f0d9fe00640 1 -- 172.21.15.82:0/1869115459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da01a2870 con 0x7f0da0104a70 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.625+0000 7f0d9fe00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 0x7f0da019ac60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000ebc0 tx=0x7f0d9000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.625+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003b70 con 0x7f0da0104a70 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.625+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d90003d10 con 0x7f0da0104a70 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.625+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da01a2b60 con 0x7f0da0104a70 2024-04-26T20:35:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.625+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90019800 con 0x7f0da0104a70 2024-04-26T20:35:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.625+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da01a3100 con 0x7f0da0104a70 2024-04-26T20:35:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.626+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da010bd90 con 0x7f0da0104a70 2024-04-26T20:35:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.628+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0d900199a0 con 0x7f0da0104a70 2024-04-26T20:35:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.630+0000 7f0d9d600640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0d840a3cc0 0x7f0d840a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.630+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f0d900d11e0 con 0x7f0da0104a70 2024-04-26T20:35:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.630+0000 7f0d97400640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0d840a3cc0 0x7f0d840a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.630+0000 7f0d97400640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0d840a3cc0 0x7f0d840a6180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009bd0 tx=0x7f0d88005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:24.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.633+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f0d9009d6a0 con 0x7f0da0104a70 2024-04-26T20:35:24.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:24 smithi082 ceph-mon[28105]: pgmap v790: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:24 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1567640533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:35:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:24 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1546858569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:35:24.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.834+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0da002dd10 con 0x7f0da0104a70 2024-04-26T20:35:24.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.835+0000 7f0d9d600640 1 -- 172.21.15.82:0/1869115459 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f0d9009cfa0 con 0x7f0da0104a70 2024-04-26T20:35:24.837 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.837+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0d840a3cc0 msgr2=0x7f0d840a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.837+0000 7f0da5c00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0d840a3cc0 0x7f0d840a6180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009bd0 tx=0x7f0d88005f90 comp rx=0 tx=0).stop 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.837+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 msgr2=0x7f0da019ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.837+0000 7f0da5c00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 0x7f0da019ac60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000ebc0 tx=0x7f0d9000c6a0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 shutdown_connections 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f0d840a3cc0 0x7f0d840a6180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0da0106620 0x7f0da01a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0da0105c60 0x7f0da019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 --2- 172.21.15.82:0/1869115459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0da0104a70 0x7f0da019ac60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 >> 172.21.15.82:0/1869115459 conn(0x7f0da00fffe0 msgr2=0x7f0da0108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:24.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 shutdown_connections 2024-04-26T20:35:24.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:24.838+0000 7f0da5c00640 1 -- 172.21.15.82:0/1869115459 wait complete. 2024-04-26T20:35:24.858 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 -- 172.21.15.82:0/185649073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff890109f80 msgr2=0x7ff89010a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 --2- 172.21.15.82:0/185649073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff890109f80 0x7ff89010a400 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff878009900 tx=0x7ff87802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 -- 172.21.15.82:0/185649073 shutdown_connections 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 --2- 172.21.15.82:0/185649073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff89010a940 0x7ff8901111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 --2- 172.21.15.82:0/185649073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff890109f80 0x7ff89010a400 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 --2- 172.21.15.82:0/185649073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890108d90 0x7ff8901091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 -- 172.21.15.82:0/185649073 >> 172.21.15.82:0/185649073 conn(0x7ff890077d30 msgr2=0x7ff89007a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:25.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 -- 172.21.15.82:0/185649073 shutdown_connections 2024-04-26T20:35:25.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.061+0000 7ff894e00640 1 -- 172.21.15.82:0/185649073 wait complete. 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 Processor -- start 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 -- start start 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff890108d90 0x7ff89019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890109f80 0x7ff89019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff89010a940 0x7ff8901a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff890114910 con 0x7ff890109f80 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff890114790 con 0x7ff89010a940 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.062+0000 7ff894e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff890114a90 con 0x7ff890108d90 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff887e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890109f80 0x7ff89019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff89010a940 0x7ff8901a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff887e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890109f80 0x7ff89019f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44696/0 (socket says 172.21.15.82:44696) 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff887e00640 1 -- 172.21.15.82:0/3857965239 learned_addr learned my addr 172.21.15.82:0/3857965239 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88f400640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff890108d90 0x7ff89019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 -- 172.21.15.82:0/3857965239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff890108d90 msgr2=0x7ff89019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff890108d90 0x7ff89019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 -- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890109f80 msgr2=0x7ff89019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890109f80 0x7ff89019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 -- 172.21.15.82:0/3857965239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8901a6bd0 con 0x7ff89010a940 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.063+0000 7ff88fe00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff89010a940 0x7ff8901a6560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff88800e940 tx=0x7ff88800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.064+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888004d20 con 0x7ff89010a940 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.064+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff888005020 con 0x7ff89010a940 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.064+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880116d0 con 0x7ff89010a940 2024-04-26T20:35:25.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.064+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8901a6ec0 con 0x7ff89010a940 2024-04-26T20:35:25.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.064+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8901a7330 con 0x7ff89010a940 2024-04-26T20:35:25.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.065+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8901100d0 con 0x7ff89010a940 2024-04-26T20:35:25.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.067+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff888005460 con 0x7ff89010a940 2024-04-26T20:35:25.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.068+0000 7ff88cc00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8700a3cc0 0x7ff8700a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.068+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ff8880d0bb0 con 0x7ff89010a940 2024-04-26T20:35:25.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.068+0000 7ff88f400640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8700a3cc0 0x7ff8700a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.069+0000 7ff88f400640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8700a3cc0 0x7ff8700a6180 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff880005fd0 tx=0x7ff88000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:24 smithi139 ceph-mon[32999]: pgmap v790: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:24 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1567640533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:35:25.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:24 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1546858569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:35:25.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.072+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7ff888016030 con 0x7ff89010a940 2024-04-26T20:35:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:24 smithi135 ceph-mon[32816]: pgmap v790: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-26T20:35:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:24 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1567640533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:35:25.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:24 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1546858569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T20:35:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.262+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff8900635d0 con 0x7ff89010a940 2024-04-26T20:35:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.263+0000 7ff88cc00640 1 -- 172.21.15.82:0/3857965239 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7ff88809ca20 con 0x7ff89010a940 2024-04-26T20:35:25.265 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-04-26T20:35:25.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.265+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8700a3cc0 msgr2=0x7ff8700a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.265+0000 7ff894e00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8700a3cc0 0x7ff8700a6180 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff880005fd0 tx=0x7ff88000b410 comp rx=0 tx=0).stop 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.265+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff89010a940 msgr2=0x7ff8901a6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.265+0000 7ff894e00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff89010a940 0x7ff8901a6560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff88800e940 tx=0x7ff88800ee00 comp rx=0 tx=0).stop 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 shutdown_connections 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7ff8700a3cc0 0x7ff8700a6180 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff89010a940 0x7ff8901a6560 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff890109f80 0x7ff89019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 --2- 172.21.15.82:0/3857965239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff890108d90 0x7ff89019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 >> 172.21.15.82:0/3857965239 conn(0x7ff890077d30 msgr2=0x7ff89010d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 shutdown_connections 2024-04-26T20:35:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.266+0000 7ff894e00640 1 -- 172.21.15.82:0/3857965239 wait complete. 2024-04-26T20:35:25.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:35:25.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 -- 172.21.15.82:0/1987621980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c108e70 msgr2=0x7f075c109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 --2- 172.21.15.82:0/1987621980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c108e70 0x7f075c109290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f074c009900 tx=0x7f074c02a400 comp rx=0 tx=0).stop 2024-04-26T20:35:25.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 -- 172.21.15.82:0/1987621980 shutdown_connections 2024-04-26T20:35:25.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 --2- 172.21.15.82:0/1987621980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c10a980 0x7f075c1112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 --2- 172.21.15.82:0/1987621980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c109fc0 0x7f075c10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 --2- 172.21.15.82:0/1987621980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c108e70 0x7f075c109290 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 -- 172.21.15.82:0/1987621980 >> 172.21.15.82:0/1987621980 conn(0x7f075c077e00 msgr2=0x7f075c07a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:25.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 -- 172.21.15.82:0/1987621980 shutdown_connections 2024-04-26T20:35:25.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.483+0000 7f075be00640 1 -- 172.21.15.82:0/1987621980 wait complete. 2024-04-26T20:35:25.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 Processor -- start 2024-04-26T20:35:25.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 -- start start 2024-04-26T20:35:25.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 0x7f075c19f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c109fc0 0x7f075c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c10a980 0x7f075c1a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f075c114a10 con 0x7f075c10a980 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f075c114890 con 0x7f075c108e70 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.484+0000 7f075be00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f075c114b90 con 0x7f075c109fc0 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 0x7f075c19f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 0x7f075c19f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51970/0 (socket says 172.21.15.82:51970) 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 -- 172.21.15.82:0/2241493330 learned_addr learned my addr 172.21.15.82:0/2241493330 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075b400640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c10a980 0x7f075c1a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f0753e00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c109fc0 0x7f075c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 -- 172.21.15.82:0/2241493330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c109fc0 msgr2=0x7f075c19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c109fc0 0x7f075c19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 -- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c10a980 msgr2=0x7f075c1a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c10a980 0x7f075c1a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 -- 172.21.15.82:0/2241493330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075c1a6ce0 con 0x7f075c108e70 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.485+0000 7f075aa00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 0x7f075c19f0c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f074c005ab0 tx=0x7f074c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.486+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c03f070 con 0x7f075c108e70 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.486+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f074c031c50 con 0x7f075c108e70 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.486+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075c1a6f70 con 0x7f075c108e70 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.486+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c035030 con 0x7f075c108e70 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.486+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f075c1a7380 con 0x7f075c108e70 2024-04-26T20:35:25.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.487+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075c1102a0 con 0x7f075c108e70 2024-04-26T20:35:25.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.489+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f074c042070 con 0x7f075c108e70 2024-04-26T20:35:25.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.490+0000 7f0753400640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07400a3c40 0x7f07400a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.490+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f074c0f10e0 con 0x7f075c108e70 2024-04-26T20:35:25.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.490+0000 7f0753e00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07400a3c40 0x7f07400a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.491+0000 7f0753e00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07400a3c40 0x7f07400a6100 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f075c1a05d0 tx=0x7f0744005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.494+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f074c0bd5a0 con 0x7f075c108e70 2024-04-26T20:35:25.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.696+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f075c02dd20 con 0x7f075c108e70 2024-04-26T20:35:25.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.696+0000 7f0753400640 1 -- 172.21.15.82:0/2241493330 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7f074c0bcea0 con 0x7f075c108e70 2024-04-26T20:35:25.698 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07400a3c40 msgr2=0x7f07400a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07400a3c40 0x7f07400a6100 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f075c1a05d0 tx=0x7f0744005f90 comp rx=0 tx=0).stop 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 msgr2=0x7f075c19f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 0x7f075c19f0c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f074c005ab0 tx=0x7f074c003b90 comp rx=0 tx=0).stop 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 shutdown_connections 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f07400a3c40 0x7f07400a6100 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f075c10a980 0x7f075c1a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075c109fc0 0x7f075c19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 --2- 172.21.15.82:0/2241493330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f075c108e70 0x7f075c19f0c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 >> 172.21.15.82:0/2241493330 conn(0x7f075c077e00 msgr2=0x7f075c10d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:25.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 shutdown_connections 2024-04-26T20:35:25.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.700+0000 7f075be00640 1 -- 172.21.15.82:0/2241493330 wait complete. 2024-04-26T20:35:25.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 -- 172.21.15.82:0/376948525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b20105b10 msgr2=0x7f9b20107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/376948525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b20105b10 0x7f9b20107f00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009900 tx=0x7f9b0802a3f0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 -- 172.21.15.82:0/376948525 shutdown_connections 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/376948525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20108440 0x7f9b2010a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/376948525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b20105b10 0x7f9b20107f00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/376948525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b201031e0 0x7f9b201055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 -- 172.21.15.82:0/376948525 >> 172.21.15.82:0/376948525 conn(0x7f9b200fcbb0 msgr2=0x7f9b200ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 -- 172.21.15.82:0/376948525 shutdown_connections 2024-04-26T20:35:25.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.921+0000 7f9b1fe00640 1 -- 172.21.15.82:0/376948525 wait complete. 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 Processor -- start 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 -- start start 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b201031e0 0x7f9b2019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 0x7f9b2019b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b20108440 0x7f9b201a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2010e2d0 con 0x7f9b201031e0 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2010e150 con 0x7f9b20105b10 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.922+0000 7f9b1fe00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2010e450 con 0x7f9b20108440 2024-04-26T20:35:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b1ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b201031e0 0x7f9b2019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 0x7f9b2019b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 0x7f9b2019b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:51992/0 (socket says 172.21.15.82:51992) 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b1ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b201031e0 0x7f9b2019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44742/0 (socket says 172.21.15.82:44742) 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 -- 172.21.15.82:0/321984272 learned_addr learned my addr 172.21.15.82:0/321984272 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b1f400640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b20108440 0x7f9b201a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 -- 172.21.15.82:0/321984272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b20108440 msgr2=0x7f9b201a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b20108440 0x7f9b201a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 -- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b201031e0 msgr2=0x7f9b2019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b201031e0 0x7f9b2019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 -- 172.21.15.82:0/321984272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b201a2800 con 0x7f9b20105b10 2024-04-26T20:35:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b1f400640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b20108440 0x7f9b201a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:35:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b16000640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 0x7f9b2019b120 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9b08031500 tx=0x7f9b08003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.923+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0803f070 con 0x7f9b20105b10 2024-04-26T20:35:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.924+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b08031c50 con 0x7f9b20105b10 2024-04-26T20:35:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.924+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b201a2a90 con 0x7f9b20105b10 2024-04-26T20:35:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.924+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08035030 con 0x7f9b20105b10 2024-04-26T20:35:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.924+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201a2fd0 con 0x7f9b20105b10 2024-04-26T20:35:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.925+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b20109f90 con 0x7f9b20105b10 2024-04-26T20:35:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.926+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9b08042070 con 0x7f9b20105b10 2024-04-26T20:35:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.928+0000 7f9b17e00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9b040a3cc0 0x7f9b040a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.928+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9b080f1080 con 0x7f9b20105b10 2024-04-26T20:35:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.928+0000 7f9b1ea00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9b040a3cc0 0x7f9b040a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.929+0000 7f9b1ea00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9b040a3cc0 0x7f9b040a6180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b100099a0 tx=0x7f9b10009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:25.932+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f9b080bd540 con 0x7f9b20105b10 2024-04-26T20:35:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:25 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1869115459' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:35:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:25 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3857965239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:25 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1869115459' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:25 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3857965239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:25 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1869115459' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:25 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3857965239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.148+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b2002dca0 con 0x7f9b20105b10 2024-04-26T20:35:26.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.149+0000 7f9b17e00640 1 -- 172.21.15.82:0/321984272 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+591 (secure 0 0 0) 0x7f9b080bce40 con 0x7f9b20105b10 2024-04-26T20:35:26.151 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3159671154 2024-04-27T20:11:46.422113+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3236939866 2024-04-27T20:11:46.422113+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2488160347 2024-04-27T20:11:11.001209+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3159671154 2024-04-27T20:11:46.422113+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1183753623 2024-04-27T20:11:11.001209+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1310193659 2024-04-27T20:11:46.422113+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3095457796 2024-04-27T20:11:46.422113+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2488160347 2024-04-27T20:11:11.001209+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/539922460 2024-04-27T20:11:11.001209+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1137290075 2024-04-27T20:11:11.001209+0000 2024-04-26T20:35:26.152 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-04-26T20:35:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9b040a3cc0 msgr2=0x7f9b040a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9b040a3cc0 0x7f9b040a6180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b100099a0 tx=0x7f9b10009500 comp rx=0 tx=0).stop 2024-04-26T20:35:26.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 msgr2=0x7f9b2019b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 0x7f9b2019b120 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9b08031500 tx=0x7f9b08003c10 comp rx=0 tx=0).stop 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 shutdown_connections 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f9b040a3cc0 0x7f9b040a6180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b20108440 0x7f9b201a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b20105b10 0x7f9b2019b120 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 --2- 172.21.15.82:0/321984272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b201031e0 0x7f9b2019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 >> 172.21.15.82:0/321984272 conn(0x7f9b200fcbb0 msgr2=0x7f9b20102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 shutdown_connections 2024-04-26T20:35:26.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:26.152+0000 7f9b1fe00640 1 -- 172.21.15.82:0/321984272 wait complete. 2024-04-26T20:35:26.175 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T20:35:26.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:26.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T20:35:26.442 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:35:26.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:26.443 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T20:35:26.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:26.527 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-26T20:35:26.672 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:35:26.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:26.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:35:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:26 smithi082 ceph-mon[28105]: pgmap v791: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:35:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:26 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/2241493330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:26 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/321984272' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:35:26.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:26.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-26T20:35:26.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:26 smithi139 ceph-mon[32999]: pgmap v791: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:35:26.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:26 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/2241493330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:35:26.821 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:26 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/321984272' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:35:26.893 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T20:35:26.893 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T20:35:26.893 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:35:26.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052716,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/535ef2d527d8c155dde781bd2b751b4895f06b42f92789e038f92efdafa58f25/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/535ef2d527d8c155dde781bd2b751b4895f06b42f92789e038f92efdafa58f25/diff,workdir=/var/lib/containers/storage/overlay/535ef2d527d8c155dde781bd2b751b4895f06b42f92789e038f92efdafa58f25/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a6cd82b73606dd307c0282bfb6d26c42431855244d91ba2a709afc40e862d2b4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/a6cd82b73606dd307c0282bfb6d26c42431855244d91ba2a709afc40e862d2b4/diff,workdir=/var/lib/containers/storage/overlay/a6cd82b73606dd307c0282bfb6d26c42431855244d91ba2a709afc40e862d2b4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/3fd64d2c009313cf61db1bd8e6f5af711b0b2988e74fa06e2195c405085eceb3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/3fd64d2c009313cf61db1bd8e6f5af711b0b2988e74fa06e2195c405085eceb3/diff,workdir=/var/lib/containers/storage/overlay/3fd64d2c009313cf61db1bd8e6f5af711b0b2988e74fa06e2195c405085eceb3/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/edc4968fb680edfc650e77699fe2ba9f0537b9f93d63016157616afd29771fb7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/edc4968fb680edfc650e77699fe2ba9f0537b9f93d63016157616afd29771fb7/diff,workdir=/var/lib/containers/storage/overlay/edc4968fb680edfc650e77699fe2ba9f0537b9f93d63016157616afd29771fb7/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5b662e8c6235edc7c4dc116bd27af11af06b73544d86d20f4646dfcdf5ec2c40/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/5b662e8c6235edc7c4dc116bd27af11af06b73544d86d20f4646dfcdf5ec2c40/diff,workdir=/var/lib/containers/storage/overlay/5b662e8c6235edc7c4dc116bd27af11af06b73544d86d20f4646dfcdf5ec2c40/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7a61d9dc10cf87dfd060f0b7f5ce6b288c4fc82e099fb17ae145927cfba6bc1f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/7a61d9dc10cf87dfd060f0b7f5ce6b288c4fc82e099fb17ae145927cfba6bc1f/diff,workdir=/var/lib/containers/storage/overlay/7a61d9dc10cf87dfd060f0b7f5ce6b288c4fc82e099fb17ae145927cfba6bc1f/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9ee4e24421f4aac7e3252c5d6ff72c4d7f11a390cf1e3f9e3868a2ddf28d66be/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/9ee4e24421f4aac7e3252c5d6ff72c4d7f11a390cf1e3f9e3868a2ddf28d66be/diff,workdir=/var/lib/containers/storage/overlay/9ee4e24421f4aac7e3252c5d6ff72c4d7f11a390cf1e3f9e3868a2ddf28d66be/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bd6b9cb0ce0b961f96169cca40758bf55a7d08d16492e5772274c96b4bf6d401/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/bd6b9cb0ce0b961f96169cca40758bf55a7d08d16492e5772274c96b4bf6d401/diff,workdir=/var/lib/containers/storage/overlay/bd6b9cb0ce0b961f96169cca40758bf55a7d08d16492e5772274c96b4bf6d401/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/82594c233ba4b6f105afb40be6ecaebf7f0b258ce6dcb4cb5265d0a963890f4d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/82594c233ba4b6f105afb40be6ecaebf7f0b258ce6dcb4cb5265d0a963890f4d/diff,workdir=/var/lib/containers/storage/overlay/82594c233ba4b6f105afb40be6ecaebf7f0b258ce6dcb4cb5265d0a963890f4d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0cd0b067c7055f3c00af709001e4bdc8ad359646b0331392653dbae27ff9fd58/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/TUDY2NKAJECFCB43AVMS74DBGK:/var/lib/containers/storage/overlay/l/3GR7U27TKBWLNMJD6BJ6CJ6GBP,upperdir=/var/lib/containers/storage/overlay/0cd0b067c7055f3c00af709001e4bdc8ad359646b0331392653dbae27ff9fd58/diff,workdir=/var/lib/containers/storage/overlay/0cd0b067c7055f3c00af709001e4bdc8ad359646b0331392653dbae27ff9fd58/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 2024-04-26T20:35:26.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:26.936 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-26T20:35:27.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:35:27.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-26T20:35:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:26 smithi135 ceph-mon[32816]: pgmap v791: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-26T20:35:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:26 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/2241493330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-26T20:35:27.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:26 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/321984272' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T20:35:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-04-26T20:35:27.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:35:27.192 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-26T20:35:27.202 INFO:tasks.cephadm:Teardown begin 2024-04-26T20:35:27.202 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T20:35:27.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:35:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 -- 172.21.15.82:0/3687962365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4940772f0 msgr2=0x7fe494077710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 --2- 172.21.15.82:0/3687962365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4940772f0 0x7fe494077710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe488009860 tx=0x7fe48802a340 comp rx=0 tx=0).stop 2024-04-26T20:35:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 -- 172.21.15.82:0/3687962365 shutdown_connections 2024-04-26T20:35:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 --2- 172.21.15.82:0/3687962365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe494078ed0 0x7fe494079770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 --2- 172.21.15.82:0/3687962365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe494078530 0x7fe494078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 --2- 172.21.15.82:0/3687962365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4940772f0 0x7fe494077710 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 -- 172.21.15.82:0/3687962365 >> 172.21.15.82:0/3687962365 conn(0x7fe4940fff00 msgr2=0x7fe494102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:27.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 -- 172.21.15.82:0/3687962365 shutdown_connections 2024-04-26T20:35:27.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.399+0000 7fe499e00640 1 -- 172.21.15.82:0/3687962365 wait complete. 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.400+0000 7fe499e00640 1 Processor -- start 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.400+0000 7fe499e00640 1 -- start start 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4940772f0 0x7fe49419f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe494078530 0x7fe49419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe494078ed0 0x7fe4941a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941148d0 con 0x7fe4940772f0 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe494114750 con 0x7fe494078530 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe494114a50 con 0x7fe494078ed0 2024-04-26T20:35:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe498a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4940772f0 0x7fe49419f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe498a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4940772f0 0x7fe49419f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44758/0 (socket says 172.21.15.82:44758) 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe498a00640 1 -- 172.21.15.82:0/4255706724 learned_addr learned my addr 172.21.15.82:0/4255706724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe499400640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe494078ed0 0x7fe4941a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.401+0000 7fe493e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe494078530 0x7fe49419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499400640 1 -- 172.21.15.82:0/4255706724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe494078530 msgr2=0x7fe49419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499400640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe494078530 0x7fe49419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499400640 1 -- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4940772f0 msgr2=0x7fe49419f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499400640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4940772f0 0x7fe49419f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499400640 1 -- 172.21.15.82:0/4255706724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4941a6c60 con 0x7fe494078ed0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499400640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe494078ed0 0x7fe4941a65f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009fd0 tx=0x7fe48c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00cd60 con 0x7fe494078ed0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe48c005020 con 0x7fe494078ed0 2024-04-26T20:35:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c010690 con 0x7fe494078ed0 2024-04-26T20:35:27.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4941a6f50 con 0x7fe494078ed0 2024-04-26T20:35:27.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.402+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4941a7460 con 0x7fe494078ed0 2024-04-26T20:35:27.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.403+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe494111300 con 0x7fe494078ed0 2024-04-26T20:35:27.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.405+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe48c0054d0 con 0x7fe494078ed0 2024-04-26T20:35:27.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.407+0000 7fe491600640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe47c0a3cc0 0x7fe47c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.407+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fe48c0d0f50 con 0x7fe494078ed0 2024-04-26T20:35:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.407+0000 7fe498a00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe47c0a3cc0 0x7fe47c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.408+0000 7fe498a00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe47c0a3cc0 0x7fe47c0a6180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe4880095f0 tx=0x7fe488030450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.411+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fe48c09d410 con 0x7fe494078ed0 2024-04-26T20:35:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.639+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe49402dad0 con 0x7fe494078ed0 2024-04-26T20:35:27.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.640+0000 7fe491600640 1 -- 172.21.15.82:0/4255706724 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11985 (secure 0 0 0) 0x7fe48c09cd10 con 0x7fe494078ed0 2024-04-26T20:35:27.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:35:27.643 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:34:59.494702+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":132,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":131,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":133,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26813":{"gid":26813,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3855827233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3855827233},{"type":"v1","addr":"172.21.15.135:6837","nonce":3855827233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:35:27.643 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 56 2024-04-26T20:35:27.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.643+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe47c0a3cc0 msgr2=0x7fe47c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.643+0000 7fe499e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe47c0a3cc0 0x7fe47c0a6180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe4880095f0 tx=0x7fe488030450 comp rx=0 tx=0).stop 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.643+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe494078ed0 msgr2=0x7fe4941a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.643+0000 7fe499e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe494078ed0 0x7fe4941a65f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009fd0 tx=0x7fe48c00ee50 comp rx=0 tx=0).stop 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 shutdown_connections 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fe47c0a3cc0 0x7fe47c0a6180 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe494078ed0 0x7fe4941a65f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe494078530 0x7fe49419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 --2- 172.21.15.82:0/4255706724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4940772f0 0x7fe49419f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 >> 172.21.15.82:0/4255706724 conn(0x7fe4940fff00 msgr2=0x7fe494101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:27.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 shutdown_connections 2024-04-26T20:35:27.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.644+0000 7fe499e00640 1 -- 172.21.15.82:0/4255706724 wait complete. 2024-04-26T20:35:27.665 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.844+0000 7fcab3000640 1 -- 172.21.15.82:0/506094535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 msgr2=0x7fcaac075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.844+0000 7fcab3000640 1 --2- 172.21.15.82:0/506094535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac075810 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca94009900 tx=0x7fca9402a3f0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 -- 172.21.15.82:0/506094535 shutdown_connections 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 --2- 172.21.15.82:0/506094535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaac10ef40 0x7fcaac111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 --2- 172.21.15.82:0/506094535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac075810 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 --2- 172.21.15.82:0/506094535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 -- 172.21.15.82:0/506094535 >> 172.21.15.82:0/506094535 conn(0x7fcaac0fdee0 msgr2=0x7fcaac100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 -- 172.21.15.82:0/506094535 shutdown_connections 2024-04-26T20:35:27.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.845+0000 7fcab3000640 1 -- 172.21.15.82:0/506094535 wait complete. 2024-04-26T20:35:27.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 Processor -- start 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 -- start start 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac19f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaac10ef40 0x7fcaac1a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac114aa0 con 0x7fcaac076970 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac114920 con 0x7fcaac10ef40 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab3000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac114c20 con 0x7fcaac075390 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcaa3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcaa3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac19f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44784/0 (socket says 172.21.15.82:44784) 2024-04-26T20:35:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcaa3400640 1 -- 172.21.15.82:0/1339530083 learned_addr learned my addr 172.21.15.82:0/1339530083 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcaabe00640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac19f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.846+0000 7fcab1000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaac10ef40 0x7fcaac1a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaabe00640 1 -- 172.21.15.82:0/1339530083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaac10ef40 msgr2=0x7fcaac1a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaabe00640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaac10ef40 0x7fcaac1a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaabe00640 1 -- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 msgr2=0x7fcaac19f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaabe00640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac19f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaabe00640 1 -- 172.21.15.82:0/1339530083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac1a6d60 con 0x7fcaac075390 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaa3400640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaabe00640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac19f140 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00eb00 tx=0x7fca9c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c010430 con 0x7fcaac075390 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9c010a80 con 0x7fcaac075390 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaac1a6ff0 con 0x7fcaac075390 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c017a90 con 0x7fcaac075390 2024-04-26T20:35:27.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.847+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaac1a7500 con 0x7fcaac075390 2024-04-26T20:35:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.848+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaac105110 con 0x7fcaac075390 2024-04-26T20:35:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.850+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fca9c017c70 con 0x7fcaac075390 2024-04-26T20:35:27.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.851+0000 7fcaa9600640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca900a3cc0 0x7fca900a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:27.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.852+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fca9c0d12c0 con 0x7fcaac075390 2024-04-26T20:35:27.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.852+0000 7fcaa3400640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca900a3cc0 0x7fca900a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:27.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.852+0000 7fcaa3400640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca900a3cc0 0x7fca900a6180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcaac1a0650 tx=0x7fca94031450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:27.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:27.856+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fca9c09d780 con 0x7fcaac075390 2024-04-26T20:35:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:27 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/4255706724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:35:28.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:27 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/4255706724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:35:28.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:27 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/4255706724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:35:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.123+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaac02dad0 con 0x7fcaac075390 2024-04-26T20:35:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.124+0000 7fcaa9600640 1 -- 172.21.15.82:0/1339530083 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11985 (secure 0 0 0) 0x7fca9c09d080 con 0x7fcaac075390 2024-04-26T20:35:28.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:35:28.126 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4285824325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4285824325},{"type":"v1","addr":"172.21.15.82:6837","nonce":4285824325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1325720417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1325720417},{"type":"v1","addr":"172.21.15.82:6841","nonce":1325720417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T20:19:52.134957+0000","modified":"2024-04-26T20:34:59.494702+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24554,"mds_2":24550,"mds_3":24529,"mds_4":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/3324936648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3324936648},{"type":"v1","addr":"172.21.15.135:6833","nonce":3324936648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.139:6833/4280186600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":4280186600},{"type":"v1","addr":"172.21.15.139:6833","nonce":4280186600}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"j","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/3327585570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3327585570},{"type":"v1","addr":"172.21.15.82:6835","nonce":3327585570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1988909695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1988909695},{"type":"v1","addr":"172.21.15.135:6835","nonce":1988909695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/2462659708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2462659708},{"type":"v1","addr":"172.21.15.139:6835","nonce":2462659708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":132,"addr":"172.21.15.139:6837/4255230594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":4255230594},{"type":"v1","addr":"172.21.15.139:6837","nonce":4255230594}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":131,"addr":"172.21.15.139:6839/1238493959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":1238493959},{"type":"v1","addr":"172.21.15.139:6839","nonce":1238493959}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":133,"addr":"172.21.15.82:6839/1585592636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1585592636},{"type":"v1","addr":"172.21.15.82:6839","nonce":1585592636}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6839/1800754758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1800754758},{"type":"v1","addr":"172.21.15.135:6839","nonce":1800754758}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26813":{"gid":26813,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3855827233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3855827233},{"type":"v1","addr":"172.21.15.135:6837","nonce":3855827233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24584,"qdb_cluster":[24554,24584,24454,24529,24550]},"id":1}]} 2024-04-26T20:35:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 56 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca900a3cc0 msgr2=0x7fca900a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca900a3cc0 0x7fca900a6180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcaac1a0650 tx=0x7fca94031450 comp rx=0 tx=0).stop 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 msgr2=0x7fcaac19f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac19f140 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00eb00 tx=0x7fca9c00c2d0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 shutdown_connections 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fca900a3cc0 0x7fca900a6180 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaac10ef40 0x7fcaac1a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac076970 0x7fcaac19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 --2- 172.21.15.82:0/1339530083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaac075390 0x7fcaac19f140 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 >> 172.21.15.82:0/1339530083 conn(0x7fcaac0fdee0 msgr2=0x7fcaac1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:28.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 shutdown_connections 2024-04-26T20:35:28.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.127+0000 7fcab3000640 1 -- 172.21.15.82:0/1339530083 wait complete. 2024-04-26T20:35:28.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:35:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 -- 172.21.15.82:0/1953823587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 msgr2=0x7f3b38103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 --2- 172.21.15.82:0/1953823587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b38103410 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009900 tx=0x7f3b2c02a410 comp rx=0 tx=0).stop 2024-04-26T20:35:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 -- 172.21.15.82:0/1953823587 shutdown_connections 2024-04-26T20:35:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 --2- 172.21.15.82:0/1953823587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38106300 0x7f3b38106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 --2- 172.21.15.82:0/1953823587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38103950 0x7f3b38105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 --2- 172.21.15.82:0/1953823587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b38103410 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 -- 172.21.15.82:0/1953823587 >> 172.21.15.82:0/1953823587 conn(0x7f3b380fcbc0 msgr2=0x7f3b380ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 -- 172.21.15.82:0/1953823587 shutdown_connections 2024-04-26T20:35:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.330+0000 7f3b3f000640 1 -- 172.21.15.82:0/1953823587 wait complete. 2024-04-26T20:35:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.331+0000 7f3b3f000640 1 Processor -- start 2024-04-26T20:35:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.331+0000 7f3b3f000640 1 -- start start 2024-04-26T20:35:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3f000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b3819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3f000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38103950 0x7f3b3819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3f000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 0x7f3b381a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3f000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38114870 con 0x7f3b38100fe0 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3f000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381146f0 con 0x7f3b38103950 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3f000640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381149f0 con 0x7f3b38106300 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b3819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 0x7f3b381a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b3819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44804/0 (socket says 172.21.15.82:44804) 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3dc00640 1 -- 172.21.15.82:0/310357232 learned_addr learned my addr 172.21.15.82:0/310357232 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 0x7f3b381a64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:47150/0 (socket says 172.21.15.82:47150) 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3d200640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38103950 0x7f3b3819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 -- 172.21.15.82:0/310357232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38103950 msgr2=0x7f3b3819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38103950 0x7f3b3819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 -- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 msgr2=0x7f3b3819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b3819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3e600640 1 -- 172.21.15.82:0/310357232 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b381a6b50 con 0x7f3b38106300 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.332+0000 7f3b3dc00640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b3819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.333+0000 7f3b3e600640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 0x7f3b381a64e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009fd0 tx=0x7f3b3000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.333+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000ce20 con 0x7f3b38106300 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.333+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b30005020 con 0x7f3b38106300 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.333+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b381a6e40 con 0x7f3b38106300 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.333+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30010690 con 0x7f3b38106300 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.333+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b381a72b0 con 0x7f3b38106300 2024-04-26T20:35:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.334+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b380fe6b0 con 0x7f3b38106300 2024-04-26T20:35:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.336+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3b300054d0 con 0x7f3b38106300 2024-04-26T20:35:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.338+0000 7f3b36000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3b200a3c40 0x7f3b200a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.338+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f3b300d0f30 con 0x7f3b38106300 2024-04-26T20:35:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.338+0000 7f3b3dc00640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3b200a3c40 0x7f3b200a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.339+0000 7f3b3dc00640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3b200a3c40 0x7f3b200a6100 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009230 tx=0x7f3b2c0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.340+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f3b3009d3f0 con 0x7f3b38106300 2024-04-26T20:35:28.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.543+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b3802dcd0 con 0x7f3b38106300 2024-04-26T20:35:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.545+0000 7f3b36000640 1 -- 172.21.15.82:0/310357232 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24669 (secure 0 0 0) 0x7f3b3009ccf0 con 0x7f3b38106300 2024-04-26T20:35:28.547 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T20:35:28.547 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"da6438ae-0408-11ef-bc93-c7b262605968","created":"2024-04-26T20:10:28.312875+0000","modified":"2024-04-26T20:28:53.426105+0000","last_up_change":"2024-04-26T20:18:53.419719+0000","last_in_change":"2024-04-26T20:18:33.097617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:32.585501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:19:49.748248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:19:51.088720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:19:54.730365+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"80c3dc83-f48e-4004-88fb-6912e18b0f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6803","nonce":4190226369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6805","nonce":4190226369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6809","nonce":4190226369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4190226369},{"type":"v1","addr":"172.21.15.82:6807","nonce":4190226369}]},"public_addr":"172.21.15.82:6803/4190226369","cluster_addr":"172.21.15.82:6805/4190226369","heartbeat_back_addr":"172.21.15.82:6809/4190226369","heartbeat_front_addr":"172.21.15.82:6807/4190226369","state":["exists","up"]},{"osd":1,"uuid":"385f5baf-d127-4e28-a50b-3bbfa29eb384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6801","nonce":3571001062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6803","nonce":3571001062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6807","nonce":3571001062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3571001062},{"type":"v1","addr":"172.21.15.135:6805","nonce":3571001062}]},"public_addr":"172.21.15.135:6801/3571001062","cluster_addr":"172.21.15.135:6803/3571001062","heartbeat_back_addr":"172.21.15.135:6807/3571001062","heartbeat_front_addr":"172.21.15.135:6805/3571001062","state":["exists","up"]},{"osd":2,"uuid":"60c32ad5-c88e-4a60-a35b-2920afb27c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6801","nonce":3051837314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6803","nonce":3051837314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6807","nonce":3051837314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3051837314},{"type":"v1","addr":"172.21.15.139:6805","nonce":3051837314}]},"public_addr":"172.21.15.139:6801/3051837314","cluster_addr":"172.21.15.139:6803/3051837314","heartbeat_back_addr":"172.21.15.139:6807/3051837314","heartbeat_front_addr":"172.21.15.139:6805/3051837314","state":["exists","up"]},{"osd":3,"uuid":"8aac68fa-5146-49fd-9727-22515d9800c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6811","nonce":825292228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6813","nonce":825292228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6817","nonce":825292228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":825292228},{"type":"v1","addr":"172.21.15.82:6815","nonce":825292228}]},"public_addr":"172.21.15.82:6811/825292228","cluster_addr":"172.21.15.82:6813/825292228","heartbeat_back_addr":"172.21.15.82:6817/825292228","heartbeat_front_addr":"172.21.15.82:6815/825292228","state":["exists","up"]},{"osd":4,"uuid":"baa87007-045a-47a3-ada4-cb7a97da2a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6809","nonce":3619586985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6811","nonce":3619586985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6815","nonce":3619586985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3619586985},{"type":"v1","addr":"172.21.15.135:6813","nonce":3619586985}]},"public_addr":"172.21.15.135:6809/3619586985","cluster_addr":"172.21.15.135:6811/3619586985","heartbeat_back_addr":"172.21.15.135:6815/3619586985","heartbeat_front_addr":"172.21.15.135:6813/3619586985","state":["exists","up"]},{"osd":5,"uuid":"c77f7c06-0d03-476c-bdba-b28ef21c18af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6809","nonce":1412243105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6811","nonce":1412243105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6815","nonce":1412243105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1412243105},{"type":"v1","addr":"172.21.15.139:6813","nonce":1412243105}]},"public_addr":"172.21.15.139:6809/1412243105","cluster_addr":"172.21.15.139:6811/1412243105","heartbeat_back_addr":"172.21.15.139:6815/1412243105","heartbeat_front_addr":"172.21.15.139:6813/1412243105","state":["exists","up"]},{"osd":6,"uuid":"16b52ba7-1d31-42b1-8491-22423e769d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6819","nonce":3682218709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6821","nonce":3682218709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6825","nonce":3682218709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3682218709},{"type":"v1","addr":"172.21.15.82:6823","nonce":3682218709}]},"public_addr":"172.21.15.82:6819/3682218709","cluster_addr":"172.21.15.82:6821/3682218709","heartbeat_back_addr":"172.21.15.82:6825/3682218709","heartbeat_front_addr":"172.21.15.82:6823/3682218709","state":["exists","up"]},{"osd":7,"uuid":"b9989e74-b2cd-47cd-9919-608a028380dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6817","nonce":1349628889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6819","nonce":1349628889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6823","nonce":1349628889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1349628889},{"type":"v1","addr":"172.21.15.135:6821","nonce":1349628889}]},"public_addr":"172.21.15.135:6817/1349628889","cluster_addr":"172.21.15.135:6819/1349628889","heartbeat_back_addr":"172.21.15.135:6823/1349628889","heartbeat_front_addr":"172.21.15.135:6821/1349628889","state":["exists","up"]},{"osd":8,"uuid":"42d15fb2-bd22-4cd8-b05a-afea2784ddff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6817","nonce":345848933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6819","nonce":345848933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6823","nonce":345848933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":345848933},{"type":"v1","addr":"172.21.15.139:6821","nonce":345848933}]},"public_addr":"172.21.15.139:6817/345848933","cluster_addr":"172.21.15.139:6819/345848933","heartbeat_back_addr":"172.21.15.139:6823/345848933","heartbeat_front_addr":"172.21.15.139:6821/345848933","state":["exists","up"]},{"osd":9,"uuid":"f60f2ace-b710-46dc-b501-b76a51631621","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6827","nonce":2126970869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6829","nonce":2126970869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6833","nonce":2126970869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2126970869},{"type":"v1","addr":"172.21.15.82:6831","nonce":2126970869}]},"public_addr":"172.21.15.82:6827/2126970869","cluster_addr":"172.21.15.82:6829/2126970869","heartbeat_back_addr":"172.21.15.82:6833/2126970869","heartbeat_front_addr":"172.21.15.82:6831/2126970869","state":["exists","up"]},{"osd":10,"uuid":"1566c893-87e7-456b-8ef0-c9721c5e6a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6825","nonce":2039734304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6827","nonce":2039734304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6831","nonce":2039734304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2039734304},{"type":"v1","addr":"172.21.15.135:6829","nonce":2039734304}]},"public_addr":"172.21.15.135:6825/2039734304","cluster_addr":"172.21.15.135:6827/2039734304","heartbeat_back_addr":"172.21.15.135:6831/2039734304","heartbeat_front_addr":"172.21.15.135:6829/2039734304","state":["exists","up"]},{"osd":11,"uuid":"df535157-a9a7-4de6-abb4-efe248039226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6825","nonce":3441375254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6827","nonce":3441375254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6831","nonce":3441375254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":3441375254},{"type":"v1","addr":"172.21.15.139:6829","nonce":3441375254}]},"public_addr":"172.21.15.139:6825/3441375254","cluster_addr":"172.21.15.139:6827/3441375254","heartbeat_back_addr":"172.21.15.139:6831/3441375254","heartbeat_front_addr":"172.21.15.139:6829/3441375254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:13:39.635201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.738872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:28.978501+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:01.728790+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:27.999539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:15:53.517499+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:28.933459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:16:56.305798+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:23.031023+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:17:57.742521+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:25.483677+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:18:51.361766+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3236939866":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6800/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:6801/3159671154":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/1183753623":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1310193659":"2024-04-27T20:11:46.422113+0000","172.21.15.82:0/3095457796":"2024-04-27T20:11:46.422113+0000","172.21.15.82:6801/2488160347":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/539922460":"2024-04-27T20:11:11.001209+0000","172.21.15.82:0/1137290075":"2024-04-27T20:11:11.001209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:35:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.547+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3b200a3c40 msgr2=0x7f3b200a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.547+0000 7f3b3f000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3b200a3c40 0x7f3b200a6100 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009230 tx=0x7f3b2c0058d0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.547+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 msgr2=0x7f3b381a64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.547+0000 7f3b3f000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 0x7f3b381a64e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009fd0 tx=0x7f3b3000ef10 comp rx=0 tx=0).stop 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.547+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 shutdown_connections 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f3b200a3c40 0x7f3b200a6100 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b38106300 0x7f3b381a64e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38103950 0x7f3b3819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 --2- 172.21.15.82:0/310357232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38100fe0 0x7f3b3819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 >> 172.21.15.82:0/310357232 conn(0x7f3b380fcbc0 msgr2=0x7f3b38104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 shutdown_connections 2024-04-26T20:35:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.548+0000 7f3b3f000640 1 -- 172.21.15.82:0/310357232 wait complete. 2024-04-26T20:35:28.568 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T20:35:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 -- 172.21.15.82:0/893351375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac102350 msgr2=0x7fbdac1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 --2- 172.21.15.82:0/893351375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac102350 0x7fbdac1027d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009be0 tx=0x7fbda402a750 comp rx=0 tx=0).stop 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 -- 172.21.15.82:0/893351375 shutdown_connections 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 --2- 172.21.15.82:0/893351375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac102350 0x7fbdac1027d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 --2- 172.21.15.82:0/893351375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdac1019b0 0x7fbdac101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 --2- 172.21.15.82:0/893351375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdac101050 0x7fbdac101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 -- 172.21.15.82:0/893351375 >> 172.21.15.82:0/893351375 conn(0x7fbdac0fcbb0 msgr2=0x7fbdac0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.754+0000 7fbdb1400640 1 -- 172.21.15.82:0/893351375 shutdown_connections 2024-04-26T20:35:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.755+0000 7fbdb1400640 1 -- 172.21.15.82:0/893351375 wait complete. 2024-04-26T20:35:28.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 Processor -- start 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 -- start start 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 0x7fbdac19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdac1019b0 0x7fbdac19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdac102350 0x7fbdac1a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac110490 con 0x7fbdac101050 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac110310 con 0x7fbdac102350 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdb1400640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac110610 con 0x7fbdac1019b0 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.756+0000 7fbdabe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 0x7fbdac19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 0x7fbdac19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44816/0 (socket says 172.21.15.82:44816) 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 -- 172.21.15.82:0/587197169 learned_addr learned my addr 172.21.15.82:0/587197169 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdb0a00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdac102350 0x7fbdac1a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbda3e00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdac1019b0 0x7fbdac19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 -- 172.21.15.82:0/587197169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdac1019b0 msgr2=0x7fbdac19b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdac1019b0 0x7fbdac19b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 -- 172.21.15.82:0/587197169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdac102350 msgr2=0x7fbdac1a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdac102350 0x7fbdac1a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 -- 172.21.15.82:0/587197169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac1a2780 con 0x7fbdac101050 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.757+0000 7fbdabe00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 0x7fbdac19ab60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e9f0 tx=0x7fbd9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.758+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00cd80 con 0x7fbdac101050 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.758+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9c0054d0 con 0x7fbdac101050 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.758+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac1a2a70 con 0x7fbdac101050 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.758+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c010690 con 0x7fbdac101050 2024-04-26T20:35:28.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.758+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac1a2fc0 con 0x7fbdac101050 2024-04-26T20:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.759+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac10bda0 con 0x7fbdac101050 2024-04-26T20:35:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.761+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbd9c004e90 con 0x7fbdac101050 2024-04-26T20:35:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.762+0000 7fbda9600640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd900a3cc0 0x7fbd900a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.762+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fbd9c0d0ce0 con 0x7fbdac101050 2024-04-26T20:35:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.763+0000 7fbda3e00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd900a3cc0 0x7fbd900a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.763+0000 7fbda3e00640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd900a3cc0 0x7fbd900a6180 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbdac19c070 tx=0x7fbd94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:28.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:28.767+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7fbd9c09d1a0 con 0x7fbdac101050 2024-04-26T20:35:28.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:28 smithi082 ceph-mon[28105]: pgmap v792: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:35:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:28 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1339530083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:35:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:28 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/310357232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:35:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.005+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbdac02dd40 con 0x7fbdac101050 2024-04-26T20:35:29.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.011+0000 7fbda9600640 1 -- 172.21.15.82:0/587197169 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fbd9c09caa0 con 0x7fbdac101050 2024-04-26T20:35:29.013 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd900a3cc0 msgr2=0x7fbd900a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd900a3cc0 0x7fbd900a6180 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbdac19c070 tx=0x7fbd94009260 comp rx=0 tx=0).stop 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 msgr2=0x7fbdac19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 0x7fbdac19ab60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00e9f0 tx=0x7fbd9c00edf0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 shutdown_connections 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7fbd900a3cc0 0x7fbd900a6180 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdac102350 0x7fbdac1a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdac1019b0 0x7fbdac19b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 --2- 172.21.15.82:0/587197169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdac101050 0x7fbdac19ab60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 >> 172.21.15.82:0/587197169 conn(0x7fbdac0fcbb0 msgr2=0x7fbdac0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 shutdown_connections 2024-04-26T20:35:29.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.017+0000 7fbdb1400640 1 -- 172.21.15.82:0/587197169 wait complete. 2024-04-26T20:35:29.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T20:35:29.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:28 smithi135 ceph-mon[32816]: pgmap v792: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:35:29.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:28 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1339530083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:35:29.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:28 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/310357232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:35:29.064 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:28 smithi139 ceph-mon[32999]: pgmap v792: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-26T20:35:29.064 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:28 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1339530083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T20:35:29.064 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:28 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/310357232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T20:35:29.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 -- 172.21.15.82:0/1117393014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 msgr2=0x7f378410a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:29.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 --2- 172.21.15.82:0/1117393014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378410a440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f376c009860 tx=0x7f376c02a340 comp rx=0 tx=0).stop 2024-04-26T20:35:29.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 -- 172.21.15.82:0/1117393014 shutdown_connections 2024-04-26T20:35:29.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 --2- 172.21.15.82:0/1117393014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378410a980 0x7f37841112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 --2- 172.21.15.82:0/1117393014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378410a440 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 --2- 172.21.15.82:0/1117393014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3784108e70 0x7f3784109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 -- 172.21.15.82:0/1117393014 >> 172.21.15.82:0/1117393014 conn(0x7f3784077e00 msgr2=0x7f378407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:29.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 -- 172.21.15.82:0/1117393014 shutdown_connections 2024-04-26T20:35:29.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.218+0000 7f3783200640 1 -- 172.21.15.82:0/1117393014 wait complete. 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 Processor -- start 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 -- start start 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 0x7f378419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f378410a980 0x7f37841a6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37841149a0 con 0x7f3784108e70 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3784114820 con 0x7f378410a980 2024-04-26T20:35:29.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3783200640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3784114b20 con 0x7f3784109fc0 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.219+0000 7f3781e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 0x7f378419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 0x7f378419f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44864/0 (socket says 172.21.15.82:44864) 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 -- 172.21.15.82:0/1826947297 learned_addr learned my addr 172.21.15.82:0/1826947297 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3782800640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f378410a980 0x7f37841a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3779400640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 -- 172.21.15.82:0/1826947297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 msgr2=0x7f378419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 -- 172.21.15.82:0/1826947297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f378410a980 msgr2=0x7f37841a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f378410a980 0x7f37841a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 -- 172.21.15.82:0/1826947297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37841a6cc0 con 0x7f3784108e70 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3779400640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:35:29.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f3781e00640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 0x7f378419f0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f377400c420 tx=0x7f3774009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:29.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.220+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774003970 con 0x7f3784108e70 2024-04-26T20:35:29.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.221+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3774004020 con 0x7f3784108e70 2024-04-26T20:35:29.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.221+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377400b980 con 0x7f3784108e70 2024-04-26T20:35:29.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.221+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37841a6fb0 con 0x7f3784108e70 2024-04-26T20:35:29.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.221+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37841a7360 con 0x7f3784108e70 2024-04-26T20:35:29.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.222+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3784110250 con 0x7f3784108e70 2024-04-26T20:35:29.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.224+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f377401d020 con 0x7f3784108e70 2024-04-26T20:35:29.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.225+0000 7f377b400640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37680a3c40 0x7f37680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:29.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.225+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9522+0+0 (secure 0 0 0) 0x7f37740d0ff0 con 0x7f3784108e70 2024-04-26T20:35:29.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.226+0000 7f3779400640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37680a3c40 0x7f37680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:29.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.226+0000 7f3779400640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37680a3c40 0x7f37680a6100 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f376c009830 tx=0x7f376c005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:29.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.228+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f377409d300 con 0x7f3784108e70 2024-04-26T20:35:29.321 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.321 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.321 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mds[63434]: -- 172.21.15.139:0/1987329861 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560bfac01a40 con 0x560bfabd4c00 2024-04-26T20:35:29.321 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: starting mds.c at 2024-04-26T20:35:29.322 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f[63119]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.322 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f[63119]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.322 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mds[63123]: -- 172.21.15.139:0/913059470 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eaf4fc7a40 con 0x55eaf4f9a800 2024-04-26T20:35:29.322 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f[63119]: starting mds.f at 2024-04-26T20:35:29.322 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.322 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mds[63752]: -- 172.21.15.139:0/2833979116 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56178750da40 con 0x5617874e0800 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: starting mds.i at 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mds[62807]: -- 172.21.15.139:0/1743016474 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e8503e24e0 con 0x55e8503b9000 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mds[62807]: -- 172.21.15.139:0/1743016474 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e8503e5a40 con 0x55e8503b9000 2024-04-26T20:35:29.323 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: starting mds.l at 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mds[61393]: -- 172.21.15.135:0/1409665882 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56404ef67a40 con 0x56404ef3b000 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: starting mds.k at 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: 2024-04-26T20:35:29.061+0000 7fcef4346700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.369 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mds[62327]: -- 172.21.15.135:0/3461581317 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643c282ba40 con 0x5643c27fec00 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: starting mds.b at 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[65477]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[65477]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mds[65481]: -- 172.21.15.135:0/496590478 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bae7fefa40 con 0x55bae7fc2c00 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[65477]: starting mds.h at 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e[61707]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.370 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e[61707]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.371 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mds[61711]: -- 172.21.15.135:0/840061945 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560ad31c04e0 con 0x560ad3196800 2024-04-26T20:35:29.371 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mds[61711]: -- 172.21.15.135:0/840061945 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ad31c3a40 con 0x560ad3196800 2024-04-26T20:35:29.371 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e[61707]: starting mds.e at 2024-04-26T20:35:29.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:35:29.008+0000 7f7376400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:35:29.438 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j[68815]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.438 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j[68815]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.438 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mds[68819]: -- 172.21.15.82:0/1571556177 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55647d815a40 con 0x55647d7e9000 2024-04-26T20:35:29.438 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j[68815]: starting mds.j at 2024-04-26T20:35:29.439 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: ignoring --setuser ceph since I am not root 2024-04-26T20:35:29.439 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: ignoring --setgroup ceph since I am not root 2024-04-26T20:35:29.439 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mds[69807]: -- 172.21.15.82:0/3137115657 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5614696eda40 con 0x5614696c0c00 2024-04-26T20:35:29.439 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: starting mds.g at 2024-04-26T20:35:29.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:29.473+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f378402dd40 con 0x7f3784108e70 2024-04-26T20:35:29.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/587197169' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: Health check cleared: MDS_DAMAGE (was: 3 MDSs report damaged metadata) 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/587197169' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T20:35:29.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:29 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1826947297' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:35:30.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.021+0000 7f377b400640 1 -- 172.21.15.82:0/1826947297 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) ==== 104+0+0 (secure 0 0 0) 0x7f377409cc00 con 0x7f3784108e70 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37680a3c40 msgr2=0x7f37680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37680a3c40 0x7f37680a6100 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f376c009830 tx=0x7f376c005d20 comp rx=0 tx=0).stop 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 msgr2=0x7f378419f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 0x7f378419f0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f377400c420 tx=0x7f3774009f90 comp rx=0 tx=0).stop 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 shutdown_connections 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f37680a3c40 0x7f37680a6100 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f378410a980 0x7f37841a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3784109fc0 0x7f378419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 --2- 172.21.15.82:0/1826947297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3784108e70 0x7f378419f0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 >> 172.21.15.82:0/1826947297 conn(0x7f3784077e00 msgr2=0x7f378410d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:30.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 shutdown_connections 2024-04-26T20:35:30.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.026+0000 7f3783200640 1 -- 172.21.15.82:0/1826947297 wait complete. 2024-04-26T20:35:30.053 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T20:35:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/587197169' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T20:35:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T20:35:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:35:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: Health check cleared: MDS_DAMAGE (was: 3 MDSs report damaged metadata) 2024-04-26T20:35:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/587197169' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T20:35:30.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T20:35:30.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T20:35:30.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:29 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1826947297' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/587197169' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: Health check cleared: MDS_DAMAGE (was: 3 MDSs report damaged metadata) 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/587197169' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-26T20:35:30.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:29 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1826947297' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 -- 172.21.15.82:0/1350407490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900105d80 msgr2=0x7f8900106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 --2- 172.21.15.82:0/1350407490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900105d80 0x7f8900106200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009860 tx=0x7f88ec02a340 comp rx=0 tx=0).stop 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 -- 172.21.15.82:0/1350407490 shutdown_connections 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 --2- 172.21.15.82:0/1350407490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900106740 0x7f890010cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 --2- 172.21.15.82:0/1350407490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900105d80 0x7f8900106200 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 --2- 172.21.15.82:0/1350407490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8900104b90 0x7f8900104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 -- 172.21.15.82:0/1350407490 >> 172.21.15.82:0/1350407490 conn(0x7f8900100120 msgr2=0x7f8900102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 -- 172.21.15.82:0/1350407490 shutdown_connections 2024-04-26T20:35:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.251+0000 7f8907600640 1 -- 172.21.15.82:0/1350407490 wait complete. 2024-04-26T20:35:30.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.252+0000 7f8907600640 1 Processor -- start 2024-04-26T20:35:30.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.252+0000 7f8907600640 1 -- start start 2024-04-26T20:35:30.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8907600640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900104b90 0x7f890019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8907600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 0x7f890019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8907600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8900106740 0x7f89001a2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8907600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89001106a0 con 0x7f8900105d80 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8907600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8900110520 con 0x7f8900106740 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8907600640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8900110820 con 0x7f8900104b90 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 0x7f890019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 0x7f890019b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44876/0 (socket says 172.21.15.82:44876) 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 -- 172.21.15.82:0/664045217 learned_addr learned my addr 172.21.15.82:0/664045217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8904c00640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900104b90 0x7f890019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f8905600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8900106740 0x7f89001a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 -- 172.21.15.82:0/664045217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900104b90 msgr2=0x7f890019ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900104b90 0x7f890019ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 -- 172.21.15.82:0/664045217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8900106740 msgr2=0x7f89001a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8900106740 0x7f89001a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.253+0000 7f88ffe00640 1 -- 172.21.15.82:0/664045217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89001a29b0 con 0x7f8900105d80 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.254+0000 7f88ffe00640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 0x7f890019b2e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f88ec005940 tx=0x7f88ec02ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.254+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec040020 con 0x7f8900105d80 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.254+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88ec030e50 con 0x7f8900105d80 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.254+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89001a2c40 con 0x7f8900105d80 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.254+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec037040 con 0x7f8900105d80 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.254+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89001a3130 con 0x7f8900105d80 2024-04-26T20:35:30.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.256+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890010bf30 con 0x7f8900105d80 2024-04-26T20:35:30.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.258+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f88ec043020 con 0x7f8900105d80 2024-04-26T20:35:30.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.259+0000 7f88fd600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e40a3c40 0x7f88e40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:30.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.259+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9522+0+0 (secure 0 0 0) 0x7f88ec0f0700 con 0x7f8900105d80 2024-04-26T20:35:30.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.259+0000 7f8904c00640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e40a3c40 0x7f88e40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:30.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.260+0000 7f8904c00640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e40a3c40 0x7f88e40a6100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f890019c270 tx=0x7f88f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.264+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f88ec04a020 con 0x7f8900105d80 2024-04-26T20:35:30.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:30.454+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f890002dad0 con 0x7f8900105d80 2024-04-26T20:35:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: pgmap v794: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2024-04-26T20:35:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T20:35:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T20:35:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: Cluster is now healthy 2024-04-26T20:35:30.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1826947297' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6833/333950443,v1:172.21.15.135:6836/333950443] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6834/3327957676,v1:172.21.15.135:6837/3327957676] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6832/2371467571,v1:172.21.15.135:6835/2371467571] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.135:6838/529155636,v1:172.21.15.135:6839/529155636] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6832/4116318385,v1:172.21.15.139:6833/4116318385] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6834/1076674494,v1:172.21.15.139:6836/1076674494] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6835/2947770008,v1:172.21.15.139:6837/2947770008] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.139:6838/2135313578,v1:172.21.15.139:6839/2135313578] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6834/558385095,v1:172.21.15.82:6835/558385095] up:boot 2024-04-26T20:35:30.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: mds.? [v2:172.21.15.82:6838/1351079420,v1:172.21.15.82:6839/1351079420] up:boot 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: fsmap 12 up:standby 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:35:30.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:35:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:35:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:35:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:35:30.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:30 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/664045217' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.025+0000 7f88fd600640 1 -- 172.21.15.82:0/664045217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7f88ec0bcb80 con 0x7f8900105d80 2024-04-26T20:35:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e40a3c40 msgr2=0x7f88e40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e40a3c40 0x7f88e40a6100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f890019c270 tx=0x7f88f0005f90 comp rx=0 tx=0).stop 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 msgr2=0x7f890019b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 0x7f890019b2e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f88ec005940 tx=0x7f88ec02ae20 comp rx=0 tx=0).stop 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 shutdown_connections 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f88e40a3c40 0x7f88e40a6100 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8900106740 0x7f89001a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900105d80 0x7f890019b2e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.030+0000 7f8907600640 1 --2- 172.21.15.82:0/664045217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8900104b90 0x7f890019ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.031+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 >> 172.21.15.82:0/664045217 conn(0x7f8900100120 msgr2=0x7f8900109100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.031+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 shutdown_connections 2024-04-26T20:35:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.032+0000 7f8907600640 1 -- 172.21.15.82:0/664045217 wait complete. 2024-04-26T20:35:31.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: pgmap v794: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: Cluster is now healthy 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1826947297' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6833/333950443,v1:172.21.15.135:6836/333950443] up:boot 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6834/3327957676,v1:172.21.15.135:6837/3327957676] up:boot 2024-04-26T20:35:31.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6832/2371467571,v1:172.21.15.135:6835/2371467571] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.135:6838/529155636,v1:172.21.15.135:6839/529155636] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6832/4116318385,v1:172.21.15.139:6833/4116318385] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6834/1076674494,v1:172.21.15.139:6836/1076674494] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6835/2947770008,v1:172.21.15.139:6837/2947770008] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.139:6838/2135313578,v1:172.21.15.139:6839/2135313578] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6834/558385095,v1:172.21.15.82:6835/558385095] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: mds.? [v2:172.21.15.82:6838/1351079420,v1:172.21.15.82:6839/1351079420] up:boot 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: fsmap 12 up:standby 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:35:31.072 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:35:31.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:35:31.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:35:31.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:35:31.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:35:31.073 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:30 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/664045217' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: pgmap v794: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: Cluster is now healthy 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1826947297' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6833/333950443,v1:172.21.15.135:6836/333950443] up:boot 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6834/3327957676,v1:172.21.15.135:6837/3327957676] up:boot 2024-04-26T20:35:31.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6832/2371467571,v1:172.21.15.135:6835/2371467571] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.135:6838/529155636,v1:172.21.15.135:6839/529155636] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6832/4116318385,v1:172.21.15.139:6833/4116318385] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6834/1076674494,v1:172.21.15.139:6836/1076674494] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6835/2947770008,v1:172.21.15.139:6837/2947770008] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.139:6838/2135313578,v1:172.21.15.139:6839/2135313578] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6834/558385095,v1:172.21.15.82:6835/558385095] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: mds.? [v2:172.21.15.82:6838/1351079420,v1:172.21.15.82:6839/1351079420] up:boot 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: fsmap 12 up:standby 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T20:35:31.120 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T20:35:31.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T20:35:31.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T20:35:31.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T20:35:31.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T20:35:31.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='mgr.14152 172.21.15.82:0/845125376' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T20:35:31.121 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:30 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/664045217' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:31.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 -- 172.21.15.82:0/3609578571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 msgr2=0x7febe4102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:31.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 --2- 172.21.15.82:0/3609578571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 0x7febe4102d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7febd4009be0 tx=0x7febd402a6c0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 -- 172.21.15.82:0/3609578571 shutdown_connections 2024-04-26T20:35:31.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 --2- 172.21.15.82:0/3609578571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe4104520 0x7febe410adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 --2- 172.21.15.82:0/3609578571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe4103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 --2- 172.21.15.82:0/3609578571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 0x7febe4102d90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 -- 172.21.15.82:0/3609578571 >> 172.21.15.82:0/3609578571 conn(0x7febe40fdee0 msgr2=0x7febe4100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:31.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 -- 172.21.15.82:0/3609578571 shutdown_connections 2024-04-26T20:35:31.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.250+0000 7febe8c00640 1 -- 172.21.15.82:0/3609578571 wait complete. 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.251+0000 7febe8c00640 1 Processor -- start 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.251+0000 7febe8c00640 1 -- start start 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe8c00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 0x7febe419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe4104520 0x7febe41a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe8c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7febe410e490 con 0x7febe4104520 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe8c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febe410e310 con 0x7febe4103b60 2024-04-26T20:35:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe8c00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febe410e610 con 0x7febe4102970 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.82:45388/0 (socket says 172.21.15.82:45388) 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe4104520 0x7febe41a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe1400640 1 -- 172.21.15.82:0/1850973399 learned_addr learned my addr 172.21.15.82:0/1850973399 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.252+0000 7febe1e00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 0x7febe419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe1400640 1 -- 172.21.15.82:0/1850973399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 msgr2=0x7febe419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe1400640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 0x7febe419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe1400640 1 -- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe4104520 msgr2=0x7febe41a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe1400640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe4104520 0x7febe41a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe1400640 1 -- 172.21.15.82:0/1850973399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe41a2a60 con 0x7febe4103b60 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe1400640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe419b380 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7febcc00e9f0 tx=0x7febcc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc00ccc0 con 0x7febe4103b60 2024-04-26T20:35:31.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febcc00ce60 con 0x7febe4103b60 2024-04-26T20:35:31.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc010430 con 0x7febe4103b60 2024-04-26T20:35:31.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe41a2d50 con 0x7febe4103b60 2024-04-26T20:35:31.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.253+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe41a3240 con 0x7febe4103b60 2024-04-26T20:35:31.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.254+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe41a34d0 con 0x7febe4103b60 2024-04-26T20:35:31.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.257+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7febcc0046c0 con 0x7febe4103b60 2024-04-26T20:35:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.258+0000 7febdaa00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc80a3cc0 0x7febc80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.258+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9026+0+0 (secure 0 0 0) 0x7febcc0d0dc0 con 0x7febe4103b60 2024-04-26T20:35:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.258+0000 7febe1e00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc80a3cc0 0x7febc80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.259+0000 7febe1e00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc80a3cc0 0x7febc80a6180 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7febd402acb0 tx=0x7febd4030970 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.260+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7febcc09d2c0 con 0x7febe4103b60 2024-04-26T20:35:31.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:31.462+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7febe41a36a0 con 0x7febe4103b60 2024-04-26T20:35:32.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.045+0000 7febdaa00640 1 -- 172.21.15.82:0/1850973399 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7febcc09cbc0 con 0x7febe4103b60 2024-04-26T20:35:32.047 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc80a3cc0 msgr2=0x7febc80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc80a3cc0 0x7febc80a6180 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7febd402acb0 tx=0x7febd4030970 comp rx=0 tx=0).stop 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 msgr2=0x7febe419b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe419b380 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7febcc00e9f0 tx=0x7febcc00edf0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 shutdown_connections 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7febc80a3cc0 0x7febc80a6180 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe4104520 0x7febe41a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febe4103b60 0x7febe419b380 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 --2- 172.21.15.82:0/1850973399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febe4102970 0x7febe419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.051+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 >> 172.21.15.82:0/1850973399 conn(0x7febe40fdee0 msgr2=0x7febe4109380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:32.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.052+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 shutdown_connections 2024-04-26T20:35:32.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.052+0000 7febe8c00640 1 -- 172.21.15.82:0/1850973399 wait complete. 2024-04-26T20:35:32.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T20:35:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.282+0000 7f4966e00640 1 -- 172.21.15.82:0/1466315531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 msgr2=0x7f496010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.282+0000 7f4966e00640 1 --2- 172.21.15.82:0/1466315531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f496010ada0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4958009ca0 tx=0x7f495802a8c0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.283+0000 7f4966e00640 1 -- 172.21.15.82:0/1466315531 shutdown_connections 2024-04-26T20:35:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.283+0000 7f4966e00640 1 --2- 172.21.15.82:0/1466315531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f496010ada0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.283+0000 7f4966e00640 1 --2- 172.21.15.82:0/1466315531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960103b50 0x7f4960103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.283+0000 7f4966e00640 1 --2- 172.21.15.82:0/1466315531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960102960 0x7f4960102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.283+0000 7f4966e00640 1 -- 172.21.15.82:0/1466315531 >> 172.21.15.82:0/1466315531 conn(0x7f49600fdef0 msgr2=0x7f4960100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.284+0000 7f4966e00640 1 -- 172.21.15.82:0/1466315531 shutdown_connections 2024-04-26T20:35:32.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.285+0000 7f4966e00640 1 -- 172.21.15.82:0/1466315531 wait complete. 2024-04-26T20:35:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.286+0000 7f4966e00640 1 Processor -- start 2024-04-26T20:35:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 -- start start 2024-04-26T20:35:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960102960 0x7f496019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 0x7f496019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f49601a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f496010e4f0 con 0x7f4960102960 2024-04-26T20:35:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f496010e370 con 0x7f4960104510 2024-04-26T20:35:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.287+0000 7f4966e00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f496010e670 con 0x7f4960103b50 2024-04-26T20:35:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.288+0000 7f495f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 0x7f496019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.288+0000 7f495f400640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 0x7f496019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.82:46236/0 (socket says 172.21.15.82:46236) 2024-04-26T20:35:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.288+0000 7f495f400640 1 -- 172.21.15.82:0/3068377367 learned_addr learned my addr 172.21.15.82:0/3068377367 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-26T20:35:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.288+0000 7f495f400640 1 -- 172.21.15.82:0/3068377367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 msgr2=0x7f49601a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.289+0000 7f495fe00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960102960 0x7f496019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.289+0000 7f4964e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f49601a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f495f400640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f49601a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f495f400640 1 -- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960102960 msgr2=0x7f496019f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f495f400640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960102960 0x7f496019f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f495f400640 1 -- 172.21.15.82:0/3068377367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49601a6df0 con 0x7f4960103b50 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f495fe00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960102960 0x7f496019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f4964e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f49601a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:35:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.290+0000 7f495f400640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 0x7f496019f760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f494c00b4a0 tx=0x7f494c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.293+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c014070 con 0x7f4960103b50 2024-04-26T20:35:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.293+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f494c010ac0 con 0x7f4960103b50 2024-04-26T20:35:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.293+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c017c30 con 0x7f4960103b50 2024-04-26T20:35:32.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.293+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49601a70e0 con 0x7f4960103b50 2024-04-26T20:35:32.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.293+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49601a7660 con 0x7f4960103b50 2024-04-26T20:35:32.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.296+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49601a7980 con 0x7f4960103b50 2024-04-26T20:35:32.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.298+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f494c017070 con 0x7f4960103b50 2024-04-26T20:35:32.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.300+0000 7f495cc00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49440a3e40 0x7f49440a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:35:32.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.300+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8496+0+0 (secure 0 0 0) 0x7f494c0cf870 con 0x7f4960103b50 2024-04-26T20:35:32.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.301+0000 7f495fe00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49440a3e40 0x7f49440a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:35:32.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.301+0000 7f495fe00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49440a3e40 0x7f49440a6300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f49601039b0 tx=0x7f4950005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:35:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.304+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188494 (secure 0 0 0) 0x7f494c09c0c0 con 0x7f4960103b50 2024-04-26T20:35:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:32 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/664045217' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:35:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:32 smithi139 ceph-mon[32999]: pgmap v795: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:35:32.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:32 smithi139 ceph-mon[32999]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T20:35:32.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:32 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/1850973399' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:32.322 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:32 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:32.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:32 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/664045217' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:35:32.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:32 smithi135 ceph-mon[32816]: pgmap v795: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:35:32.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:32 smithi135 ceph-mon[32816]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T20:35:32.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:32 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/1850973399' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:32.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:32 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:32.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:32 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/664045217' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:35:32.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:32 smithi082 ceph-mon[28105]: pgmap v795: 129 pgs: 129 active+clean; 590 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-26T20:35:32.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:32 smithi082 ceph-mon[28105]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T20:35:32.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:32 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/1850973399' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:32.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:32 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:32.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:32.548+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49601a80e0 con 0x7f4960103b50 2024-04-26T20:35:33.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.044+0000 7f495cc00640 1 -- 172.21.15.82:0/3068377367 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v96) ==== 178+0+0 (secure 0 0 0) 0x7f494c09b9c0 con 0x7f4960103b50 2024-04-26T20:35:33.045 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' removed 2024-04-26T20:35:33.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49440a3e40 msgr2=0x7f49440a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49440a3e40 0x7f49440a6300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f49601039b0 tx=0x7f4950005f90 comp rx=0 tx=0).stop 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 msgr2=0x7f496019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 0x7f496019f760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f494c00b4a0 tx=0x7f494c00b960 comp rx=0 tx=0).stop 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 shutdown_connections 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:6800/893198693,v1:172.21.15.82:6801/893198693] conn(0x7f49440a3e40 0x7f49440a6300 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4960104510 0x7f49601a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4960103b50 0x7f496019f760 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 --2- 172.21.15.82:0/3068377367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4960102960 0x7f496019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:35:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.051+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 >> 172.21.15.82:0/3068377367 conn(0x7f49600fdef0 msgr2=0x7f4960074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:35:33.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.052+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 shutdown_connections 2024-04-26T20:35:33.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T20:35:33.052+0000 7f4966e00640 1 -- 172.21.15.82:0/3068377367 wait complete. 2024-04-26T20:35:33.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:35:33.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:35:33.193 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:35:33.223 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-26T20:35:33.223 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:35:33.265 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:35:33.279 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:35:33.294 INFO:tasks.cephadm:Stopping all daemons... 2024-04-26T20:35:33.294 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-26T20:35:33.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a 2024-04-26T20:35:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:33 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:35:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:33 smithi139 ceph-mon[32999]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T20:35:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:33 smithi139 ceph-mon[32999]: from='client.? 172.21.15.82:0/3068377367' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:33.321 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:33 smithi139 ceph-mon[32999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:33 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:35:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:33 smithi135 ceph-mon[32816]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T20:35:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:33 smithi135 ceph-mon[32816]: from='client.? 172.21.15.82:0/3068377367' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:33.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:33 smithi135 ceph-mon[32816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:33.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-26T20:35:33.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 ceph-mon[28105]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T20:35:33.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 ceph-mon[28105]: from='client.? 172.21.15.82:0/3068377367' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:33.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 ceph-mon[28105]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-26T20:35:33.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 systemd[1]: Stopping Ceph mon.a for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:35:33.965+0000 7f737d200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:35:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a[28101]: 2024-04-26T20:35:33.965+0000 7f737d200700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-26T20:35:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:34 smithi082 podman[97443]: 2024-04-26 20:35:34.142178937 +0000 UTC m=+0.349632726 container died 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-26T20:35:34.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:34 smithi082 podman[97443]: 2024-04-26 20:35:34.661335178 +0000 UTC m=+0.868788966 container cleanup 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-26T20:35:34.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:34 smithi082 bash[97443]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a 2024-04-26T20:35:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Apr 26 20:35:35 smithi082 podman[97453]: 2024-04-26 20:35:35.004981655 +0000 UTC m=+0.849416666 container remove 55db7b274722db63703feec28cb681857d6fe9475c23e40ae250be40edee31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2) 2024-04-26T20:35:35.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.a.service' 2024-04-26T20:35:35.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:35.627 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-26T20:35:35.627 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-26T20:35:35.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.b 2024-04-26T20:35:35.952 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:35 smithi135 systemd[1]: Stopping Ceph mon.b for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:36.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b[32812]: 2024-04-26T20:35:35.951+0000 7fa9ba831700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:35:36.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b[32812]: 2024-04-26T20:35:35.951+0000 7fa9ba831700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-26T20:35:36.369 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:36 smithi135 podman[67906]: 2024-04-26 20:35:36.196629928 +0000 UTC m=+0.378509826 container died c10f668c38508e81aa6ce2c9f9b752d87aaacd5c2c9d851b19f1308d8cbefff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T20:35:36.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:36 smithi135 podman[67906]: 2024-04-26 20:35:36.593671258 +0000 UTC m=+0.775551145 container cleanup c10f668c38508e81aa6ce2c9f9b752d87aaacd5c2c9d851b19f1308d8cbefff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-26T20:35:36.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Apr 26 20:35:36 smithi135 bash[67906]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-b 2024-04-26T20:35:37.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.b.service' 2024-04-26T20:35:37.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:37.058 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-26T20:35:37.058 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-26T20:35:37.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.c 2024-04-26T20:35:37.394 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:37 smithi139 systemd[1]: Stopping Ceph mon.c for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:37.729 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c[32995]: 2024-04-26T20:35:37.392+0000 7fe9ae6f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:35:37.729 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c[32995]: 2024-04-26T20:35:37.392+0000 7fe9ae6f8700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-26T20:35:37.729 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:37 smithi139 podman[68667]: 2024-04-26 20:35:37.414320234 +0000 UTC m=+0.132829204 container died b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T20:35:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:37 smithi139 podman[68667]: 2024-04-26 20:35:37.827724679 +0000 UTC m=+0.546233659 container cleanup b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:35:38.071 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:37 smithi139 bash[68667]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c 2024-04-26T20:35:38.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.c.service' 2024-04-26T20:35:38.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:38 smithi139 podman[68681]: 2024-04-26 20:35:38.079273088 +0000 UTC m=+0.662231082 container remove b6f510e62caacdef9d7ef99dd9a1ddb67fb947af7c5e04bca8a73df2b9c5dca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:35:38.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:38 smithi139 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.c.service: Deactivated successfully. 2024-04-26T20:35:38.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:38 smithi139 systemd[1]: Stopped Ceph mon.c for da6438ae-0408-11ef-bc93-c7b262605968. 2024-04-26T20:35:38.331 INFO:journalctl@ceph.mon.c.smithi139.stdout:Apr 26 20:35:38 smithi139 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mon.c.service: Consumed 14.429s CPU time. 2024-04-26T20:35:38.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:38.369 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-26T20:35:38.369 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-26T20:35:38.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x 2024-04-26T20:35:38.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:38 smithi082 systemd[1]: Stopping Ceph mgr.x for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:39.232 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:35:38.949+0000 7f12c7000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:35:39.232 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x[28337]: 2024-04-26T20:35:38.949+0000 7f12c7000700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-26T20:35:39.232 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:39 smithi082 podman[97563]: 2024-04-26 20:35:39.04307465 +0000 UTC m=+0.277217220 container died 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:35:39.887 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:39 smithi082 podman[97563]: 2024-04-26 20:35:39.6090159 +0000 UTC m=+0.843158473 container cleanup 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T20:35:39.887 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:39 smithi082 bash[97563]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x 2024-04-26T20:35:40.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Apr 26 20:35:39 smithi082 podman[97577]: 2024-04-26 20:35:39.885544636 +0000 UTC m=+0.828988764 container remove 227107b519f59959f4b417cb3c60493002939a85d6387a360513a520957c1fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T20:35:40.442 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-26T20:35:40.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:40.555 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-26T20:35:40.555 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-26T20:35:40.555 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.y 2024-04-26T20:35:40.869 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:35:40 smithi135 systemd[1]: Stopping Ceph mgr.y for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:41.151 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:35:40 smithi135 podman[68029]: 2024-04-26 20:35:40.877764238 +0000 UTC m=+0.133321941 container died 56ae30959cbeac542278c8e0a48c68a3bfc70b6b30b73d100880b7a8c38e6192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T20:35:41.552 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:35:41 smithi135 podman[68029]: 2024-04-26 20:35:41.241253923 +0000 UTC m=+0.496811638 container cleanup 56ae30959cbeac542278c8e0a48c68a3bfc70b6b30b73d100880b7a8c38e6192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T20:35:41.552 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Apr 26 20:35:41 smithi135 bash[68029]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-y 2024-04-26T20:35:41.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-26T20:35:41.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:41.725 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-26T20:35:41.725 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-26T20:35:41.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.z 2024-04-26T20:35:42.026 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:35:41 smithi139 systemd[1]: Stopping Ceph mgr.z for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:42.321 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:35:42 smithi139 podman[68789]: 2024-04-26 20:35:42.044744364 +0000 UTC m=+0.132728630 container died 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:35:42.698 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:35:42 smithi139 podman[68789]: 2024-04-26 20:35:42.541884824 +0000 UTC m=+0.629869089 container cleanup 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T20:35:42.698 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:35:42 smithi139 bash[68789]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z 2024-04-26T20:35:42.969 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:35:42 smithi139 podman[68804]: 2024-04-26 20:35:42.852683093 +0000 UTC m=+0.803435428 container remove 1c68a8317d4e16fcea4378d8ab811e5e1f79d024c91c057b457a12e337689d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T20:35:42.969 INFO:journalctl@ceph.mgr.z.smithi139.stdout:Apr 26 20:35:42 smithi139 systemd[1]: ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-04-26T20:35:42.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-26T20:35:43.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:43.018 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-26T20:35:43.019 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-26T20:35:43.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.0 2024-04-26T20:35:43.437 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:43 smithi082 systemd[1]: Stopping Ceph osd.0 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:43.938 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0[42783]: 2024-04-26T20:35:43.620+0000 7efcc5400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:35:43.938 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0[42783]: 2024-04-26T20:35:43.620+0000 7efcc5400700 -1 osd.0 96 *** Got signal Terminated *** 2024-04-26T20:35:43.938 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0[42783]: 2024-04-26T20:35:43.620+0000 7efcc5400700 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:35:49.438 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:49 smithi082 podman[97682]: 2024-04-26 20:35:49.219352805 +0000 UTC m=+5.778712645 container died d24b4d6cc1da39efeedae6eea09a6b1a5a2e6cb54b7369fc87a7ba5f795323aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS) 2024-04-26T20:35:49.937 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:49 smithi082 podman[97682]: 2024-04-26 20:35:49.841401716 +0000 UTC m=+6.400761565 container cleanup d24b4d6cc1da39efeedae6eea09a6b1a5a2e6cb54b7369fc87a7ba5f795323aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:35:49.937 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:49 smithi082 bash[97682]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0 2024-04-26T20:35:50.438 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:50 smithi082 podman[97703]: 2024-04-26 20:35:50.198961158 +0000 UTC m=+0.938559981 container remove d24b4d6cc1da39efeedae6eea09a6b1a5a2e6cb54b7369fc87a7ba5f795323aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2) 2024-04-26T20:35:51.054 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:50 smithi082 podman[97805]: 2024-04-26 20:35:50.709238135 +0000 UTC m=+0.035582781 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:35:51.054 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:50 smithi082 podman[97805]: 2024-04-26 20:35:50.89164449 +0000 UTC m=+0.217989137 container create 4fa280637fff7f803e0b8cdcf592fca2ed0e3c03dee5e8e25d7658ada36c265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-04-26T20:35:51.688 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:51 smithi082 podman[97805]: 2024-04-26 20:35:51.204455656 +0000 UTC m=+0.530800310 container init 4fa280637fff7f803e0b8cdcf592fca2ed0e3c03dee5e8e25d7658ada36c265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T20:35:51.688 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:51 smithi082 podman[97805]: 2024-04-26 20:35:51.21703993 +0000 UTC m=+0.543384549 container start 4fa280637fff7f803e0b8cdcf592fca2ed0e3c03dee5e8e25d7658ada36c265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T20:35:51.689 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:51 smithi082 podman[97805]: 2024-04-26 20:35:51.311353542 +0000 UTC m=+0.637698199 container attach 4fa280637fff7f803e0b8cdcf592fca2ed0e3c03dee5e8e25d7658ada36c265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:35:52.187 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 26 20:35:51 smithi082 podman[97805]: 2024-04-26 20:35:51.767676668 +0000 UTC m=+1.094021322 container died 4fa280637fff7f803e0b8cdcf592fca2ed0e3c03dee5e8e25d7658ada36c265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:35:52.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.0.service' 2024-04-26T20:35:52.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:35:52.851 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-26T20:35:52.851 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-26T20:35:52.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.1 2024-04-26T20:35:53.225 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:52 smithi135 systemd[1]: Stopping Ceph osd.1 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:35:53.487 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1[37399]: 2024-04-26T20:35:53.265+0000 7fb6fdd52700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:35:53.487 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1[37399]: 2024-04-26T20:35:53.265+0000 7fb6fdd52700 -1 osd.1 96 *** Got signal Terminated *** 2024-04-26T20:35:53.487 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1[37399]: 2024-04-26T20:35:53.265+0000 7fb6fdd52700 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:35:58.991 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:58 smithi135 podman[68155]: 2024-04-26 20:35:58.678678901 +0000 UTC m=+5.638854690 container died 1650c2e598ec5d98dd9e47c051a91ce71a7a3d054db52d064af648dceee63077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T20:35:59.365 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:59 smithi135 podman[68155]: 2024-04-26 20:35:59.088572517 +0000 UTC m=+6.048748302 container cleanup 1650c2e598ec5d98dd9e47c051a91ce71a7a3d054db52d064af648dceee63077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T20:35:59.365 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:59 smithi135 bash[68155]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1 2024-04-26T20:35:59.619 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:59 smithi135 podman[68185]: 2024-04-26 20:35:59.365278375 +0000 UTC m=+0.675695724 container remove 1650c2e598ec5d98dd9e47c051a91ce71a7a3d054db52d064af648dceee63077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0) 2024-04-26T20:36:00.003 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:59 smithi135 podman[68275]: 2024-04-26 20:35:59.60895745 +0000 UTC m=+0.018053781 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:00.003 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:35:59 smithi135 podman[68275]: 2024-04-26 20:35:59.733096576 +0000 UTC m=+0.142192935 container create 29bb35b417ff8aa673cf87b36f52e3d472abf35c33b078cac3581b157a62d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-04-26T20:36:00.003 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:36:00 smithi135 podman[68275]: 2024-04-26 20:36:00.00306772 +0000 UTC m=+0.412164036 container init 29bb35b417ff8aa673cf87b36f52e3d472abf35c33b078cac3581b157a62d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T20:36:00.304 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:36:00 smithi135 podman[68275]: 2024-04-26 20:36:00.006273743 +0000 UTC m=+0.415370061 container start 29bb35b417ff8aa673cf87b36f52e3d472abf35c33b078cac3581b157a62d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T20:36:00.305 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:36:00 smithi135 podman[68275]: 2024-04-26 20:36:00.111638672 +0000 UTC m=+0.520734989 container attach 29bb35b417ff8aa673cf87b36f52e3d472abf35c33b078cac3581b157a62d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T20:36:00.619 INFO:journalctl@ceph.osd.1.smithi135.stdout:Apr 26 20:36:00 smithi135 podman[68275]: 2024-04-26 20:36:00.304590008 +0000 UTC m=+0.713686337 container died 29bb35b417ff8aa673cf87b36f52e3d472abf35c33b078cac3581b157a62d900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T20:36:01.055 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.1.service' 2024-04-26T20:36:01.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:01.099 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-26T20:36:01.100 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-26T20:36:01.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.2 2024-04-26T20:36:01.430 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:01 smithi139 systemd[1]: Stopping Ceph osd.2 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:01.821 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2[38171]: 2024-04-26T20:36:01.429+0000 7fc0a2a9e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:01.821 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2[38171]: 2024-04-26T20:36:01.429+0000 7fc0a2a9e700 -1 osd.2 96 *** Got signal Terminated *** 2024-04-26T20:36:01.821 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2[38171]: 2024-04-26T20:36:01.429+0000 7fc0a2a9e700 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:07.071 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:06 smithi139 podman[68927]: 2024-04-26 20:36:06.790377765 +0000 UTC m=+5.492245881 container died 9edac91fb9b55fe03514e2f09eae2543e110581d61ca88d89556667693be214a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:36:07.473 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:07 smithi139 podman[68927]: 2024-04-26 20:36:07.17109326 +0000 UTC m=+5.872961383 container cleanup 9edac91fb9b55fe03514e2f09eae2543e110581d61ca88d89556667693be214a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:36:07.474 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:07 smithi139 bash[68927]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2 2024-04-26T20:36:07.768 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:07 smithi139 podman[68944]: 2024-04-26 20:36:07.473006314 +0000 UTC m=+0.681025916 container remove 9edac91fb9b55fe03514e2f09eae2543e110581d61ca88d89556667693be214a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T20:36:08.060 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:07 smithi139 podman[69035]: 2024-04-26 20:36:07.670616623 +0000 UTC m=+0.017653540 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:08.061 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:07 smithi139 podman[69035]: 2024-04-26 20:36:07.799096505 +0000 UTC m=+0.146133412 container create d16e1628237c9a03f82191d93d2b9f61f48b16e577a6f188c85112764680309c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T20:36:08.061 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:08 smithi139 podman[69035]: 2024-04-26 20:36:08.060044054 +0000 UTC m=+0.407080965 container init d16e1628237c9a03f82191d93d2b9f61f48b16e577a6f188c85112764680309c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-26T20:36:08.321 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:08 smithi139 podman[69035]: 2024-04-26 20:36:08.063507415 +0000 UTC m=+0.410544326 container start d16e1628237c9a03f82191d93d2b9f61f48b16e577a6f188c85112764680309c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T20:36:08.321 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:08 smithi139 podman[69035]: 2024-04-26 20:36:08.160405366 +0000 UTC m=+0.507442287 container attach d16e1628237c9a03f82191d93d2b9f61f48b16e577a6f188c85112764680309c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T20:36:08.773 INFO:journalctl@ceph.osd.2.smithi139.stdout:Apr 26 20:36:08 smithi139 podman[69035]: 2024-04-26 20:36:08.4017475 +0000 UTC m=+0.748784404 container died d16e1628237c9a03f82191d93d2b9f61f48b16e577a6f188c85112764680309c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T20:36:09.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.2.service' 2024-04-26T20:36:09.149 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:09.150 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-26T20:36:09.150 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-26T20:36:09.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.3 2024-04-26T20:36:09.688 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:09 smithi082 systemd[1]: Stopping Ceph osd.3 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:10.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:09.740+0000 7ff225a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:10.189 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:09.740+0000 7ff225a00700 -1 osd.3 96 *** Got signal Terminated *** 2024-04-26T20:36:10.189 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:09 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:09.740+0000 7ff225a00700 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:10.294 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:09.883+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:10.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:10.218+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:10.324+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:11.320 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:10.860+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:11.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:11.319+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:11.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:11.221+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:12.187 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:11 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:11.704+0000 7ff221200700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.428185+0000 front 2024-04-26T20:35:47.427727+0000 (oldest deadline 2024-04-26T20:36:11.527894+0000) 2024-04-26T20:36:12.321 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:11.830+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:12.208+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:12.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:12.363+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:12.967 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:12 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:12.711+0000 7ff221200700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.428185+0000 front 2024-04-26T20:35:47.427727+0000 (oldest deadline 2024-04-26T20:36:11.527894+0000) 2024-04-26T20:36:13.315 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:12.851+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:13.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:12 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:12.965+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:13.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:13.314+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:13.176+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:14.187 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:13 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:13.918+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:14.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:13 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:13.733+0000 7ff221200700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.428185+0000 front 2024-04-26T20:35:47.427727+0000 (oldest deadline 2024-04-26T20:36:11.527894+0000) 2024-04-26T20:36:14.283 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:13.822+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:14.283+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:14.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:14.177+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:15.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:14.795+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:15.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:14 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3[49677]: 2024-04-26T20:36:14.740+0000 7ff221200700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.428185+0000 front 2024-04-26T20:35:47.427727+0000 (oldest deadline 2024-04-26T20:36:11.527894+0000) 2024-04-26T20:36:15.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:14 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:14.946+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:15.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:15.304+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:15.206+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:15.687 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:15 smithi082 podman[97912]: 2024-04-26 20:36:15.37227604 +0000 UTC m=+5.807368295 container died 963839e33d58fa8975decf9d10e6951072da6d1718beb1a51c1bdba19326405c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T20:36:16.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:15.787+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:16.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:15 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:15.973+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:16.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:15 smithi082 podman[97912]: 2024-04-26 20:36:15.941673328 +0000 UTC m=+6.376765621 container cleanup 963839e33d58fa8975decf9d10e6951072da6d1718beb1a51c1bdba19326405c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD) 2024-04-26T20:36:16.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:15 smithi082 bash[97912]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3 2024-04-26T20:36:16.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:16 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:16.184+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:16.688 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:16 smithi082 podman[97930]: 2024-04-26 20:36:16.21243449 +0000 UTC m=+0.827602823 container remove 963839e33d58fa8975decf9d10e6951072da6d1718beb1a51c1bdba19326405c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-26T20:36:16.773 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:16.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:17.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:16.772+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:17.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:16 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:16.931+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:17.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:17 smithi082 podman[98022]: 2024-04-26 20:36:17.0168559 +0000 UTC m=+0.031503921 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:17.533 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:17 smithi082 podman[98022]: 2024-04-26 20:36:17.202242546 +0000 UTC m=+0.216890592 container create 59df3f3f546ad99b1f0f34c02da100609fc3864af559c67bb4c682132fe06fe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T20:36:17.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:17.307+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:17.618 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:17 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:17.189+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:17.887 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:17 smithi082 podman[98022]: 2024-04-26 20:36:17.531948158 +0000 UTC m=+0.546596234 container init 59df3f3f546ad99b1f0f34c02da100609fc3864af559c67bb4c682132fe06fe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:17.887 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:17 smithi082 podman[98022]: 2024-04-26 20:36:17.544002993 +0000 UTC m=+0.558651011 container start 59df3f3f546ad99b1f0f34c02da100609fc3864af559c67bb4c682132fe06fe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:36:17.887 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:17 smithi082 podman[98022]: 2024-04-26 20:36:17.638176885 +0000 UTC m=+0.652824937 container attach 59df3f3f546ad99b1f0f34c02da100609fc3864af559c67bb4c682132fe06fe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:36:18.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:17.741+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:18.188 INFO:journalctl@ceph.osd.3.smithi082.stdout:Apr 26 20:36:18 smithi082 podman[98022]: 2024-04-26 20:36:18.000808001 +0000 UTC m=+1.015456087 container died 59df3f3f546ad99b1f0f34c02da100609fc3864af559c67bb4c682132fe06fe4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS) 2024-04-26T20:36:18.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:17 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:17.959+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:18.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:18 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:18.208+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:18.786 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:18.349+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:18.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.3.service' 2024-04-26T20:36:18.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:18.933 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-26T20:36:18.933 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-26T20:36:18.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.4 2024-04-26T20:36:19.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:18.786+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:19.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:18.827+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:19.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:18 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:18.933+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:19.250 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:18 smithi135 systemd[1]: Stopping Ceph osd.4 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:19.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:19 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:19.249+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:19.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:19 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:19.259+0000 7fbbb953b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:19.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:19 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:19.259+0000 7fbbb953b700 -1 osd.4 96 *** Got signal Terminated *** 2024-04-26T20:36:19.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:19 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:19.259+0000 7fbbb953b700 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:19.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:19 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:19.431+0000 7fbbb5b2f700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.936678+0000 front 2024-04-26T20:35:54.936703+0000 (oldest deadline 2024-04-26T20:36:19.036939+0000) 2024-04-26T20:36:19.763 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:19.394+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:20.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:19.873+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:20.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:19.762+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:20.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:19.762+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:20.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:19.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:20.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:19 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:19.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:20.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:20 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:20.257+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:20.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:20 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:20.396+0000 7fbbb5b2f700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.936678+0000 front 2024-04-26T20:35:54.936703+0000 (oldest deadline 2024-04-26T20:36:19.036939+0000) 2024-04-26T20:36:20.772 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:20.389+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:20.772 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:20.389+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:21.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:20.884+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:21.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:20.771+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:21.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:20.771+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:21.187 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:20.894+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:21.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:20 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:20.894+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:21.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:21 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:21.425+0000 7fbbb5b2f700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.936678+0000 front 2024-04-26T20:35:54.936703+0000 (oldest deadline 2024-04-26T20:36:19.036939+0000) 2024-04-26T20:36:21.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:21 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:21.237+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:21.812 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:21.338+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:21.812 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:21.338+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:22.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:21.897+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:22.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:21.811+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:22.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:21.811+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:22.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:21 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:21.937+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:22.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:21 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:21.937+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:22.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:21 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:21.799+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:22.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:22.308+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:22.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:22.308+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:22.619 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:22 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:22.407+0000 7fbbb5b2f700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.936678+0000 front 2024-04-26T20:35:54.936703+0000 (oldest deadline 2024-04-26T20:36:19.036939+0000) 2024-04-26T20:36:22.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:22 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:22.223+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:23.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:22.862+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:23.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:22.762+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:23.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:22.762+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:23.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:22 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:22.843+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:23.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:22 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:22.955+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:23.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:22 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:22.955+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:23.520 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:23 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4[43935]: 2024-04-26T20:36:23.410+0000 7fbbb5b2f700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.936678+0000 front 2024-04-26T20:35:54.936703+0000 (oldest deadline 2024-04-26T20:36:19.036939+0000) 2024-04-26T20:36:23.520 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:23 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:23.173+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:23.520 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:23 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:23.174+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:23.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:23.276+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:23.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:23.276+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:24.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:23.868+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:24.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:23.777+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:24.072 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:23 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:23.778+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:24.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:23.822+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:24.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:23.978+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:24.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:23 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:23.978+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:24.533 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:24 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:24.217+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:24.533 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:24 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:24.217+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:24.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:24 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:24.281+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:24.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:24 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:24.281+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:24.785 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:24 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:24.532+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:25.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:24 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:24.887+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:25.072 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:24 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:24.747+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:25.072 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:24 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:24.747+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:25.086 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:24 smithi135 podman[68380]: 2024-04-26 20:36:24.784907575 +0000 UTC m=+5.652001764 container died 15256a9170d5ecd8dc2fadafce4df1a8ed99a676e4c7203ef85dc7bb7d679e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T20:36:25.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:24 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:24.867+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:25.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:24 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:24.940+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:25.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:24 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:24.940+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:25.369 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:25 smithi135 podman[68380]: 2024-04-26 20:36:25.168208332 +0000 UTC m=+6.035302520 container cleanup 15256a9170d5ecd8dc2fadafce4df1a8ed99a676e4c7203ef85dc7bb7d679e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:25.369 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:25 smithi135 bash[68380]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4 2024-04-26T20:36:25.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:25 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:25.182+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:25.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:25 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:25.182+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:25.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:25 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:25.286+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:25.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:25 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:25.286+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:25.770 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:25 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:25.527+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:25.770 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:25 smithi135 podman[68399]: 2024-04-26 20:36:25.436295044 +0000 UTC m=+0.654902015 container remove 15256a9170d5ecd8dc2fadafce4df1a8ed99a676e4c7203ef85dc7bb7d679e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:26.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:25 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:25.916+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:26.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:25 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:25.732+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:26.072 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:25 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:25.732+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:26.081 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:25 smithi135 podman[68502]: 2024-04-26 20:36:25.693654824 +0000 UTC m=+0.019054048 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:26.081 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:25 smithi135 podman[68502]: 2024-04-26 20:36:25.837354616 +0000 UTC m=+0.162753840 container create 8fe8860684545eb965cab736bff2e3582180293ee8f24aaee7babf0f3a4e07d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T20:36:26.081 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:26 smithi135 podman[68502]: 2024-04-26 20:36:26.081473161 +0000 UTC m=+0.406872385 container init 8fe8860684545eb965cab736bff2e3582180293ee8f24aaee7babf0f3a4e07d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:36:26.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:25 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:25.893+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:26.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:25 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:25.970+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:26.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:25 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:25.970+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:26.369 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:26 smithi135 podman[68502]: 2024-04-26 20:36:26.084654902 +0000 UTC m=+0.410054133 container start 8fe8860684545eb965cab736bff2e3582180293ee8f24aaee7babf0f3a4e07d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-26T20:36:26.369 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:26 smithi135 podman[68502]: 2024-04-26 20:36:26.164842685 +0000 UTC m=+0.490241919 container attach 8fe8860684545eb965cab736bff2e3582180293ee8f24aaee7babf0f3a4e07d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T20:36:26.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:26 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:26.210+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:26.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:26 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:26.210+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:26.726 INFO:journalctl@ceph.osd.4.smithi135.stdout:Apr 26 20:36:26 smithi135 podman[68502]: 2024-04-26 20:36:26.389976598 +0000 UTC m=+0.715375820 container died 8fe8860684545eb965cab736bff2e3582180293ee8f24aaee7babf0f3a4e07d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T20:36:26.727 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:26 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:26.501+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:26.746 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:26.332+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:26.746 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:26.332+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:27.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.4.service' 2024-04-26T20:36:27.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:26.745+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:27.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:26.745+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:27.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:26.921+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:27.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:26 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:26.921+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:27.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:27.085 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-26T20:36:27.085 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-26T20:36:27.085 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.5 2024-04-26T20:36:27.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:26 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:26.849+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:27.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:26 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:26.995+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:27.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:26 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:26.995+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:27.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:27 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:27.164+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:27.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:27 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:27.164+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:27.410 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:27 smithi139 systemd[1]: Stopping Ceph osd.5 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:27.410 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:27.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:27.410 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:27.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:27.701 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:27.408+0000 7fc14b0b3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:27.701 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:27.408+0000 7fc14b0b3700 -1 osd.5 96 *** Got signal Terminated *** 2024-04-26T20:36:27.701 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:27.408+0000 7fc14b0b3700 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:27.701 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:27.699+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:27.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:27 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:27.526+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:28.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:27.700+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:28.072 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:27.943+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:28.072 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:27 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:27.943+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:28.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:27 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:27.871+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:28.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:28 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:28.010+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:28.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:28 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:28.010+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:28.525 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:28 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:28.211+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:28.525 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:28 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:28.211+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:28.525 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:28 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:28.523+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:28.691 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:28 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:28.325+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:28.691 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:28 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:28.325+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:28.944 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:28 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:28.690+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:28.944 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:28 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:28.690+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:29.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:28 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:28.825+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:29.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:28 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:28.825+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:29.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:29.006+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:29.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:29.006+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:29.316 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:28 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:28.942+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:29.316 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:28 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:28.942+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:29.564 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:29.210+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:29.564 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:29.210+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:29.565 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:29.210+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:29.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:29.315+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:29.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:29.315+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:29.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:29 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:29.563+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:30.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:29.714+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:30.071 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:29.714+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:30.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:29.935+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:30.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:29 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:29.935+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:30.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:29.780+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:30.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:29.780+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:30.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:30 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:30.014+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:30.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:30 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:30.014+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:30.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:30 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:30.014+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:30.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:30.287+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:30.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:30.287+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:30.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:30.287+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:30.600 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:30 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:30.253+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:30.600 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:30 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:30.253+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:30.600 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:30 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:30.253+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:30.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:30 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:30.598+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:30.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:30 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:30.598+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:31.075 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:30.750+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:31.075 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:30.750+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:31.076 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:30.964+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:31.076 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:30 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:30.964+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:31.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:30 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:30.821+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:31.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:30 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:30.821+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:31.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:31 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:31.009+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:31.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:31 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:31.009+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:31.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:31 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:31.009+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:31.561 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:31 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:31.288+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:31.561 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:31 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:31.288+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:31.561 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:31 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:31.288+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:31.715 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:31.334+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:31.715 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:31.334+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:31.715 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:31.334+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:31.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:31 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:31.560+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:31.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:31 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:31.560+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:31.991 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:31.713+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:48.320108+0000 front 2024-04-26T20:35:48.320259+0000 (oldest deadline 2024-04-26T20:36:09.420073+0000) 2024-04-26T20:36:31.991 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:31.713+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:54.721419+0000 front 2024-04-26T20:35:54.721521+0000 (oldest deadline 2024-04-26T20:36:18.821609+0000) 2024-04-26T20:36:31.991 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5[45107]: 2024-04-26T20:36:31.713+0000 7fc1476a7700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.123693+0000 front 2024-04-26T20:36:05.123718+0000 (oldest deadline 2024-04-26T20:36:31.023925+0000) 2024-04-26T20:36:32.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:31 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:31.810+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:32.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:31 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:31.810+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:32.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:32 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:32.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:32.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:32 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:32.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:32.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:32 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:32.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:32.314 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:31.990+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:32.314 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:31 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:31.990+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:32.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:32 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:32.313+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:32.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:32 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:32.313+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:32.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:32 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:32.313+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:32.619 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:32 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:32.524+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:32.619 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:32 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:32.524+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:32.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:32 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:32.311+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:32.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:32 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:32.311+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:32.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:32 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:32.311+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:33.029 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:32 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:32.771+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:33.030 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:32 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:32.771+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:33.155 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:32 smithi139 podman[69151]: 2024-04-26 20:36:32.835662493 +0000 UTC m=+5.548613192 container died d5de4c07ef1583ab3e2939786715fb444c29fd5df6dfd534995272f6f15fdce8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:36:33.155 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:33 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:33.035+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:33.155 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:33 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:33.035+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:33.437 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:33.028+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:33.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:33.028+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:33.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:33.028+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:33.503 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:33 smithi139 podman[69151]: 2024-04-26 20:36:33.259710131 +0000 UTC m=+5.972660830 container cleanup d5de4c07ef1583ab3e2939786715fb444c29fd5df6dfd534995272f6f15fdce8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T20:36:33.503 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:33 smithi139 bash[69151]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5 2024-04-26T20:36:33.503 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:33 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:33.307+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:33.503 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:33 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:33.307+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:33.504 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:33 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:33.307+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:33.619 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:33 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:33.547+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:33.619 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:33 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:33.547+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:33.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:33 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:33.358+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:33.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:33 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:33.358+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:33.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:33 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:33.358+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:33.821 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:33 smithi139 podman[69168]: 2024-04-26 20:36:33.50264818 +0000 UTC m=+0.663160138 container remove d5de4c07ef1583ab3e2939786715fb444c29fd5df6dfd534995272f6f15fdce8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:34.042 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:33.771+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:34.042 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:33 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:33.771+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:34.206 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:34 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:34.014+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:34.207 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:34 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:34.014+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:34.207 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:33 smithi139 podman[69261]: 2024-04-26 20:36:33.835192624 +0000 UTC m=+0.018033451 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:34.207 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:33 smithi139 podman[69261]: 2024-04-26 20:36:33.953598636 +0000 UTC m=+0.136439445 container create 923882181c7912de2e774b60fec84cd3e787f78e0bf7268504894188b17f8d79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T20:36:34.207 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:34 smithi139 podman[69261]: 2024-04-26 20:36:34.206123993 +0000 UTC m=+0.388964802 container init 923882181c7912de2e774b60fec84cd3e787f78e0bf7268504894188b17f8d79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T20:36:34.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:34.041+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:34.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:34.041+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:34.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:34.041+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:34.501 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:34 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:34.322+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:34.501 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:34 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:34.322+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:34.501 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:34 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:34.322+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:34.501 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:34 smithi139 podman[69261]: 2024-04-26 20:36:34.209573681 +0000 UTC m=+0.392414496 container start 923882181c7912de2e774b60fec84cd3e787f78e0bf7268504894188b17f8d79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T20:36:34.501 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:34 smithi139 podman[69261]: 2024-04-26 20:36:34.289544273 +0000 UTC m=+0.472385093 container attach 923882181c7912de2e774b60fec84cd3e787f78e0bf7268504894188b17f8d79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T20:36:34.821 INFO:journalctl@ceph.osd.5.smithi139.stdout:Apr 26 20:36:34 smithi139 podman[69261]: 2024-04-26 20:36:34.501197697 +0000 UTC m=+0.684038503 container died 923882181c7912de2e774b60fec84cd3e787f78e0bf7268504894188b17f8d79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:34.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:34 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:34.531+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:34.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:34 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:34.531+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:34.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:34 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:34.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:34.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:34 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:34.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:34.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:34 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:34.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:35.122 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:35.016+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:35.122 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:35.016+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:35.139 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.5.service' 2024-04-26T20:36:35.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:35.178 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-26T20:36:35.178 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-26T20:36:35.178 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.6 2024-04-26T20:36:35.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:35.024+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:35.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:35.024+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:35.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:35.024+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:35.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:34.798+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:35.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:34.798+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:35.528 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:35.390+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:35.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:35.390+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:35.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:35.391+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:35.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:35.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:35.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:35.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:35.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:35.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:35.688 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:35 smithi082 systemd[1]: Stopping Ceph osd.6 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:35.838 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:35.527+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:35.838 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:35 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:35.527+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:36.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:36 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:36.013+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:36.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:36 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:36.013+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:36.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:36 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:36.013+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:36.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:35.775+0000 7feb78200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:36.189 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:35.775+0000 7feb78200700 -1 osd.6 96 *** Got signal Terminated *** 2024-04-26T20:36:36.189 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:35.775+0000 7feb78200700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:36.189 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:35.846+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:36.189 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:35 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:35.846+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:36.312 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:35.986+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:36.312 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:35.986+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:36.312 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:35 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:35.986+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:36.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:36 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:36.310+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:36.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:36 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:36.310+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:36.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:36 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:36.310+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:36.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:36 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:36.505+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:36.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:36 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:36.505+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:36.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:36 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:36.405+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:36.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:36 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:36.405+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:36.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:36 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:36.405+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:37.187 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:36 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:36.860+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:37.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:36 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:36.860+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:37.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:37.002+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:37.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:37.002+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:37.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:37.002+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:37.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:37.002+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:37.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:37.002+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:37.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:37.002+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:37.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:37.329+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:37.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:37.330+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:37.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:37.330+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:37.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:37 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:37.498+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:37.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:37 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:37.498+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:37.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:37 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:37.435+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:37.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:37 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:37.435+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:37.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:37 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:37.435+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:37.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:37 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:37.435+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:38.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:37.889+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:38.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:37 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:37.889+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:38.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:38.011+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:38.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:38.011+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:38.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:38.011+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:38.288 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:37.965+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:38.289 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:37.965+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:38.289 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:37 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:37.965+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:38.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:38 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:38.287+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:38.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:38 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:38.287+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:38.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:38 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:38.287+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:38.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:38 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:38.536+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:38.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:38 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:38.536+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:38.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:38 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:38.422+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:38.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:38 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:38.422+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:38.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:38 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:38.422+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:38.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:38 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:38.422+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:39.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:38.924+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:39.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:38.924+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:39.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:38.977+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:39.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:38.977+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:39.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:38.977+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:39.279 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:38 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:38.953+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:39.279 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:38 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:38.953+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:39.279 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:38 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:38.953+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:39.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:39 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:39.277+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:39.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:39 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:39.277+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:39.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:39 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:39.277+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:39.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:39 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:39.520+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:39.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:39 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:39.520+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:39.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:39 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:39.442+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:39.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:39 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:39.442+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:39.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:39 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:39.442+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:39.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:39 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:39.442+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:39.935+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.336875+0000 front 2024-04-26T20:35:56.337143+0000 (oldest deadline 2024-04-26T20:36:21.037158+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:39.935+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:03.339446+0000 front 2024-04-26T20:36:03.339540+0000 (oldest deadline 2024-04-26T20:36:28.039668+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6[56648]: 2024-04-26T20:36:39.935+0000 7feb73a00700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.344396+0000 front 2024-04-26T20:36:14.344480+0000 (oldest deadline 2024-04-26T20:36:39.446681+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:39.959+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:39.959+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:39.959+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:40.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:39 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:39.959+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:40.304 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:39 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:39.913+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:40.305 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:39 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:39.913+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:40.305 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:39 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:39.913+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:40.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:40 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:40.303+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:40.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:40 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:40.303+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:40.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:40 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:40.303+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:40.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:40.545+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:40.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:40.545+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:40.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:40.545+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:40.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:40.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:40.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:40.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:40.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:40.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:40.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:40 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:40.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:41.187 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:40.933+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:41.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:40.933+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:41.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:40.933+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:41.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:40 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:40.933+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:41.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:40 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:40.891+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:41.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:40 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:40.891+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:41.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:40 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:40.891+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:41.676 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:41 smithi082 podman[98139]: 2024-04-26 20:36:41.336478226 +0000 UTC m=+5.716187731 container died ed0b90c646b5d531ee5c53096e4a6093baa22850d9befb2ddff281783ec53a45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T20:36:41.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:41 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:41.321+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:41.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:41 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:41.321+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:41.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:41 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:41.321+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:41.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:41.576+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:41.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:41.576+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:41.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:41.576+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:41.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:41.441+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:41.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:41.441+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:41.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:41.441+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:41.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:41 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:41.441+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:41.938 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:41 smithi082 podman[98139]: 2024-04-26 20:36:41.826561833 +0000 UTC m=+6.206271382 container cleanup ed0b90c646b5d531ee5c53096e4a6093baa22850d9befb2ddff281783ec53a45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T20:36:41.938 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:41 smithi082 bash[98139]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6 2024-04-26T20:36:42.295 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:41 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:41.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:42.295 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:41 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:41.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:42.295 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:41 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:41.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:42.438 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:42 smithi082 podman[98158]: 2024-04-26 20:36:42.11113058 +0000 UTC m=+0.759079986 container remove ed0b90c646b5d531ee5c53096e4a6093baa22850d9befb2ddff281783ec53a45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:36:42.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:41.981+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:42.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:41.981+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:42.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:41.981+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:42.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:41 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:41.981+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:42.567 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:42 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:42.294+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:42.567 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:42 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:42.294+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:42.567 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:42 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:42.294+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:42.565+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:42.565+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:42.565+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:42.468+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:42.468+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:42.468+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:42.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:42 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:42.468+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:43.267 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:43.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:43.267 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:43.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:43.267 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:43.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:43.267 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:43 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:43.004+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:43.267 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:42 smithi082 podman[98249]: 2024-04-26 20:36:42.84521215 +0000 UTC m=+0.033671066 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:43.267 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:42 smithi082 podman[98249]: 2024-04-26 20:36:42.97854229 +0000 UTC m=+0.167001231 container create 7d6f376f7dfa7494a060e0c29f9fb824f4d1d09ac0eb286a317fdb59a189c897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T20:36:43.268 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:43 smithi082 podman[98249]: 2024-04-26 20:36:43.265552223 +0000 UTC m=+0.454011207 container init 7d6f376f7dfa7494a060e0c29f9fb824f4d1d09ac0eb286a317fdb59a189c897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:36:43.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:42 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:42.939+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:43.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:42 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:42.939+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:43.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:42 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:42.939+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:43.688 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:43 smithi082 podman[98249]: 2024-04-26 20:36:43.276866346 +0000 UTC m=+0.465325293 container start 7d6f376f7dfa7494a060e0c29f9fb824f4d1d09ac0eb286a317fdb59a189c897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:36:43.688 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:43 smithi082 podman[98249]: 2024-04-26 20:36:43.364353672 +0000 UTC m=+0.552812626 container attach 7d6f376f7dfa7494a060e0c29f9fb824f4d1d09ac0eb286a317fdb59a189c897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:36:43.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:43 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:43.340+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:43.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:43 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:43.340+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:43.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:43 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:43.340+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:43.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:43.562+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:43.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:43.562+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:43.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:43.562+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:43.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:43.462+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:43.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:43.462+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:43.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:43.462+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:43.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:43.462+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:44.021 INFO:journalctl@ceph.osd.6.smithi082.stdout:Apr 26 20:36:43 smithi082 podman[98249]: 2024-04-26 20:36:43.730414082 +0000 UTC m=+0.918873063 container died 7d6f376f7dfa7494a060e0c29f9fb824f4d1d09ac0eb286a317fdb59a189c897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:36:44.294 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:43 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:43.944+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:44.294 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:43 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:43.944+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:44.294 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:43 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:43.944+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:44.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:44.020+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:44.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:44.020+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:44.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:44.020+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:44.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:44 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:44.020+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:44.558 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.6.service' 2024-04-26T20:36:44.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:44.293+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:44.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:44.293+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:44.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:44.293+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:44.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:44.712 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-26T20:36:44.712 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-26T20:36:44.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.7 2024-04-26T20:36:44.737 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:44.520+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:44.737 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:44.520+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:44.737 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:44.520+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:44.738 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:44.471+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:44.738 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:44.471+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:44.738 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:44.471+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:44.738 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:44 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:44.471+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:45.013 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:44 smithi135 systemd[1]: Stopping Ceph osd.7 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:45.290 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:44.927+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:45.290 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:44.927+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:45.290 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:44.927+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:45.290 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:44 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:44.927+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:45.369 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:45.011+0000 7f27ca620700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:45.369 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:45.011+0000 7f27ca620700 -1 osd.7 96 *** Got signal Terminated *** 2024-04-26T20:36:45.369 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:45.011+0000 7f27ca620700 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:45.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.012+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:45.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.012+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:45.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.012+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:45.439 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.012+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:45.439 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.012+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:45.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:45.288+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:45.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:45.288+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:45.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:45.288+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:45.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:45.288+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:45.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:45.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:45.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:45.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:45.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:45.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:45.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:45.501+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:45.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:45.501+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:45.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:45.501+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:45.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:45 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:45.501+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:46.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:45.977+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:46.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:45.977+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:46.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:45.977+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:46.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:45 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:45.977+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:46.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.965+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:46.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.965+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:46.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.965+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:46.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.965+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:46.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:45 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:45.965+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:46.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:46.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:46.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:46.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:46.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:46.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:46.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:46.327+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:46.599+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:46.599+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:46.599+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:46.474+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:46.474+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:46.474+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:46.474+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:46.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:46.474+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:47.284 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:46.951+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:47.284 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:46.951+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:47.284 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:46.951+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:47.284 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:46 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:46.951+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:47.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:46.971+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:47.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:46.971+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:47.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:46.971+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:47.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:46.971+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:47.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:46 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:46.971+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:47.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:47.282+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:47.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:47.282+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:47.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:47.282+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:47.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:47.282+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:47.612+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:47.612+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:47.612+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:47.487+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:47.487+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:47.487+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:47.487+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:47.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:47 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:47.487+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:48.273 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:47.926+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:48.273 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:47.926+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:48.273 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:47.926+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:48.273 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:47 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:47.926+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:48.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:47.983+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:48.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:47.983+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:48.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:47.983+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:48.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:47.983+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:48.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:47 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:47.983+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:48.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:48.272+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:48.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:48.272+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:48.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:48.272+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:48.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:48.272+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:48.569+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:48.569+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:48.569+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:48.507+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:48.507+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:48.507+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:48.507+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:48.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:48 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:48.507+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:49.231 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:48.946+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:49.231 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:48.946+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:49.231 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:48.946+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:49.231 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:48 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:48.946+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:49.340 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:48.989+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:49.340 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:48.989+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:49.340 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:48.989+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:49.340 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:48.989+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:49.340 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:48 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:48.989+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:49.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:49.230+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:49.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:49.230+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:49.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:49.230+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:49.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:49.230+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:49.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:49.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.882182+0000 front 2024-04-26T20:35:56.882251+0000 (oldest deadline 2024-04-26T20:36:24.482934+0000) 2024-04-26T20:36:49.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:49.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.483533+0000 front 2024-04-26T20:36:04.483413+0000 (oldest deadline 2024-04-26T20:36:30.383605+0000) 2024-04-26T20:36:49.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:49.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:14.484912+0000 front 2024-04-26T20:36:14.485006+0000 (oldest deadline 2024-04-26T20:36:39.784713+0000) 2024-04-26T20:36:49.869 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7[50489]: 2024-04-26T20:36:49.552+0000 7f27c2c0c700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:19.785152+0000 front 2024-04-26T20:36:19.785172+0000 (oldest deadline 2024-04-26T20:36:49.185973+0000) 2024-04-26T20:36:49.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:49.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:49.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:49.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:49.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:49.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:49.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:49.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:49.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:49 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:49.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:50.251 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:49.967+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:50.252 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:49.967+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:50.252 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:49.967+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:50.252 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:49 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:49.967+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:50.377 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:49 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:49.973+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:50.377 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:49 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:49.973+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:50.377 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:49 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:49.973+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:50.377 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:49 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:49.973+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:50.377 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:49 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:49.973+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:50.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:50.251+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:50.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:50.251+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:50.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:50.251+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:50.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:50.251+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:50.681 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:50 smithi135 podman[68610]: 2024-04-26 20:36:50.394903683 +0000 UTC m=+5.494144633 container died 988008f51b8205b30f910d6de3a9b2af7316ab94ec75a8e6e8e3cd82a53390d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:36:50.681 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:50.437+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:50.681 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:50.437+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:50.681 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:50.437+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:50.681 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:50.437+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:50.681 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:50.437+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:51.039 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:50 smithi135 podman[68610]: 2024-04-26 20:36:50.778964281 +0000 UTC m=+5.878205235 container cleanup 988008f51b8205b30f910d6de3a9b2af7316ab94ec75a8e6e8e3cd82a53390d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:51.039 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:50 smithi135 bash[68610]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7 2024-04-26T20:36:51.053 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:50.950+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:51.053 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:50.950+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:51.053 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:50.950+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:51.053 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:50.950+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:51.053 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:50 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:50.950+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:51.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:50.957+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:51.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:50.957+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:51.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:50.957+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:51.321 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:50 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:50.957+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:51.322 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:51.204+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:51.322 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:51.204+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:51.322 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:51.204+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:51.322 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:51.204+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:51.340 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68628]: 2024-04-26 20:36:51.038807535 +0000 UTC m=+0.643023960 container remove 988008f51b8205b30f910d6de3a9b2af7316ab94ec75a8e6e8e3cd82a53390d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T20:36:51.619 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68716]: 2024-04-26 20:36:51.243347204 +0000 UTC m=+0.018257986 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:51.620 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68716]: 2024-04-26 20:36:51.389805733 +0000 UTC m=+0.164716557 container create 3e307dbbd2b3a4ed378254cfca40cbad1528a5776dd29ed25e1b6b0ff0c5de2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:36:51.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:51 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:51.401+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:51.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:51 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:51.401+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:51.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:51 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:51.401+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:51.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:51 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:51.401+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:51.621 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:51 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:51.401+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:51.952 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68716]: 2024-04-26 20:36:51.659108451 +0000 UTC m=+0.434019229 container init 3e307dbbd2b3a4ed378254cfca40cbad1528a5776dd29ed25e1b6b0ff0c5de2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T20:36:51.952 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68716]: 2024-04-26 20:36:51.662149271 +0000 UTC m=+0.437060050 container start 3e307dbbd2b3a4ed378254cfca40cbad1528a5776dd29ed25e1b6b0ff0c5de2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T20:36:51.953 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68716]: 2024-04-26 20:36:51.733976876 +0000 UTC m=+0.508887657 container attach 3e307dbbd2b3a4ed378254cfca40cbad1528a5776dd29ed25e1b6b0ff0c5de2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T20:36:52.244 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:51.933+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:52.244 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:51.933+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:52.244 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:51.933+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:52.244 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:51 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:51.933+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:52.245 INFO:journalctl@ceph.osd.7.smithi135.stdout:Apr 26 20:36:51 smithi135 podman[68716]: 2024-04-26 20:36:51.95244898 +0000 UTC m=+0.727359762 container died 3e307dbbd2b3a4ed378254cfca40cbad1528a5776dd29ed25e1b6b0ff0c5de2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:36:52.437 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:51.945+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:52.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:51.945+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:52.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:51.945+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:52.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:51.945+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:52.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:51 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:51.945+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:52.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:52 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:52.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:52.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:52 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:52.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:52.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:52 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:52.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:52.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:52 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:52.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:52.529 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:52 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:52.402+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:52.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.7.service' 2024-04-26T20:36:52.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:52.243+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:52.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:52.243+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:52.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:52.243+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:52.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:52.243+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:52.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:36:52.630 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-26T20:36:52.631 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-26T20:36:52.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.8 2024-04-26T20:36:52.936 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 systemd[1]: Stopping Ceph osd.8 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:36:53.242 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.935+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:53.243 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.935+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:53.243 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.935+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:53.243 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.935+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:53.243 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.982+0000 7f54fbd09700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:36:53.243 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.982+0000 7f54fbd09700 -1 osd.8 96 *** Got signal Terminated *** 2024-04-26T20:36:53.243 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:52 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:52.982+0000 7f54fbd09700 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:36:53.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:52.956+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:53.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:52.956+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:53.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:52.956+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:53.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:52.956+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:53.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:52 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:52.956+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:53.563 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:53.241+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:53.563 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:53.241+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:53.563 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:53.241+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:53.564 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:53.241+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:53.725 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:53.409+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:53.725 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:53.409+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:53.725 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:53.409+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:53.726 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:53.409+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:53.726 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:53 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:53.409+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:54.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:53.911+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:54.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:53.911+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:54.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:53.911+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:54.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:53.911+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:54.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:53 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:53.911+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:54.263 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:53.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:54.263 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:53.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:54.263 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:53.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:54.263 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:53 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:53.901+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:54.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:54.262+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:54.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:54.262+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:54.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:54.262+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:54.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:54.262+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:54.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:54.453+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:54.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:54.453+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:54.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:54.453+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:54.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:54.453+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:54.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:54.453+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:54.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:54.453+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:36:55.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:54.932+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:55.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:54.932+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:55.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:54.932+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:55.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:54.932+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:55.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:54 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:54.932+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:55.246 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:54.937+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:55.246 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:54.937+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:55.246 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:54.937+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:55.247 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:54.937+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:55.247 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:54 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:54.937+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:28.916070+0000 front 2024-04-26T20:36:28.916102+0000 (oldest deadline 2024-04-26T20:36:54.816141+0000) 2024-04-26T20:36:55.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:55.246+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:55.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:55.246+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:55.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:55.246+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:55.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:55.246+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:55.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:55 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:55.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:55.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:55 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:55.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:55.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:55 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:55.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:55.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:55 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:55.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:55.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:55 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:55.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:55.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:55 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:55.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:36:56.218 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:55.936+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:56.218 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:55.936+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:56.218 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:55.936+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:56.218 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:55.936+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:56.218 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:55 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:55.936+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:28.916070+0000 front 2024-04-26T20:36:28.916102+0000 (oldest deadline 2024-04-26T20:36:54.816141+0000) 2024-04-26T20:36:56.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:55.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:56.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:55.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:56.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:55.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:56.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:55.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:56.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:55.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:56.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:55 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:55.941+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:36:56.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:56.217+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:56.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:56.217+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:56.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:56.217+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:56.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:56.217+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:56.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:56 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:56.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:56.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:56 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:56.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:56.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:56 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:56.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:56.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:56 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:56.469+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:56.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:56 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:56.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:56.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:56 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:56.470+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:36:57.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:56.904+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:57.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:56.904+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:57.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:56.904+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:57.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:56.904+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:57.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:56.904+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:57.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:56 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:56.904+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:36:57.225 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:56.920+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:57.225 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:56.920+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:57.225 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:56.920+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:57.225 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:56.920+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:57.225 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:56 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:56.920+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:28.916070+0000 front 2024-04-26T20:36:28.916102+0000 (oldest deadline 2024-04-26T20:36:54.816141+0000) 2024-04-26T20:36:57.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:57.223+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:57.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:57.223+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:57.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:57.224+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:57.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:57.224+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:57.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:57.224+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:36:57.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:57.425+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:57.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:57.425+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:57.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:57.425+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:57.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:57.425+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:57.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:57.425+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:57.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:57 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:57.425+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:36:58.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:57 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:57.854+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:58.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:57 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:57.854+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:58.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:57 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:57.854+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:58.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:57 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:57.854+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:58.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:57 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:57.854+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:58.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:57 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:57.854+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:36:58.208 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:57.922+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:58.210039+0000 front 2024-04-26T20:35:58.210236+0000 (oldest deadline 2024-04-26T20:36:18.709930+0000) 2024-04-26T20:36:58.209 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:57.922+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.511459+0000 front 2024-04-26T20:36:04.511480+0000 (oldest deadline 2024-04-26T20:36:26.811766+0000) 2024-04-26T20:36:58.209 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:57.922+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:11.513017+0000 front 2024-04-26T20:36:11.513063+0000 (oldest deadline 2024-04-26T20:36:35.612866+0000) 2024-04-26T20:36:58.209 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:57.922+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:22.515147+0000 front 2024-04-26T20:36:22.515158+0000 (oldest deadline 2024-04-26T20:36:44.815234+0000) 2024-04-26T20:36:58.209 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:57 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8[51818]: 2024-04-26T20:36:57.922+0000 7f54f82fd700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:28.916070+0000 front 2024-04-26T20:36:28.916102+0000 (oldest deadline 2024-04-26T20:36:54.816141+0000) 2024-04-26T20:36:58.479 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:58.208+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:58.479 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:58.208+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:58.479 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:58.208+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:58.480 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:58.208+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:58.480 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:58.208+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:36:58.785 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:58 smithi139 podman[69377]: 2024-04-26 20:36:58.479006535 +0000 UTC m=+5.653297633 container died 78f4e29633c2bdf74b7065143b49d8da485248ec21c3888a2cbaa6389acbad23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-04-26T20:36:58.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:58 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:58.378+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:58.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:58 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:58.378+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:58.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:58 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:58.378+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:58.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:58 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:58.378+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:58.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:58 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:58.378+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:58.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:58 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:58.378+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:36:59.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:58 smithi139 podman[69377]: 2024-04-26 20:36:58.875212275 +0000 UTC m=+6.049503380 container cleanup 78f4e29633c2bdf74b7065143b49d8da485248ec21c3888a2cbaa6389acbad23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T20:36:59.071 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:58 smithi139 bash[69377]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8 2024-04-26T20:36:59.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:58 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:58.824+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:36:59.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:58 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:58.824+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:36:59.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:58 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:58.824+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:36:59.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:58 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:58.824+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:36:59.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:58 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:58.824+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:36:59.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:58 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:58.824+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:36:59.410 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69394]: 2024-04-26 20:36:59.110382151 +0000 UTC m=+0.634250927 container remove 78f4e29633c2bdf74b7065143b49d8da485248ec21c3888a2cbaa6389acbad23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:59.411 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:59 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:59.168+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:36:59.411 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:59 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:59.168+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:36:59.411 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:59 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:59.168+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:36:59.411 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:59 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:59.168+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:36:59.411 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:36:59 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:36:59.168+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:36:59.706 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69484]: 2024-04-26 20:36:59.313120138 +0000 UTC m=+0.017712865 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:36:59.707 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69484]: 2024-04-26 20:36:59.436975443 +0000 UTC m=+0.141568192 container create df836f187dbfa4ac1bd15d11492cfd10c496417645f027ad9b03ba33752967d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T20:36:59.707 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69484]: 2024-04-26 20:36:59.706362165 +0000 UTC m=+0.410954882 container init df836f187dbfa4ac1bd15d11492cfd10c496417645f027ad9b03ba33752967d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T20:36:59.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:59 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:59.407+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:36:59.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:59 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:59.407+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:36:59.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:59 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:59.407+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:36:59.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:59 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:59.407+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:36:59.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:59 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:59.407+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:36:59.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:36:59 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:36:59.407+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:36:59.997 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69484]: 2024-04-26 20:36:59.709833273 +0000 UTC m=+0.414425986 container start df836f187dbfa4ac1bd15d11492cfd10c496417645f027ad9b03ba33752967d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-26T20:36:59.997 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69484]: 2024-04-26 20:36:59.789215263 +0000 UTC m=+0.493807982 container attach df836f187dbfa4ac1bd15d11492cfd10c496417645f027ad9b03ba33752967d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_BRANCH=HEAD) 2024-04-26T20:36:59.997 INFO:journalctl@ceph.osd.8.smithi139.stdout:Apr 26 20:36:59 smithi139 podman[69484]: 2024-04-26 20:36:59.996721926 +0000 UTC m=+0.701314649 container died df836f187dbfa4ac1bd15d11492cfd10c496417645f027ad9b03ba33752967d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:37:00.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:59.839+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:00.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:59.839+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:00.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:59.839+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:00.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:59.839+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:00.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:59.839+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:00.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:36:59 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:36:59.839+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:00.260 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:00 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:00.126+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:00.260 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:00 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:00.126+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:00.260 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:00 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:00.126+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:00.260 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:00 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:00.126+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:00.261 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:00 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:00.126+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:00.629 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.8.service' 2024-04-26T20:37:00.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:00.667 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-26T20:37:00.667 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-26T20:37:00.667 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.9 2024-04-26T20:37:00.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:00 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:00.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:00.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:00 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:00.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:00.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:00 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:00.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:00.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:00 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:00.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:00.869 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:00 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:00.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:00.870 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:00 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:00.384+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:01.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 systemd[1]: Stopping Ceph osd.9 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:01.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:00.852+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:01.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:00.852+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:01.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:00.852+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:01.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:00.852+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:01.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:00.852+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:01.189 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:00 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:00.852+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:01.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:01.162+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:01.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:01.162+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:01.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:01.162+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:01.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:01.162+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:01.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:01 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:01.162+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:01.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:01 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:01.351+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:01.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:01 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:01.351+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:01.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:01 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:01.351+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:01.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:01 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:01.351+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:01.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:01 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:01.351+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:01.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:01 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:01.351+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:01.687 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.225+0000 7f0449800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:01.688 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.225+0000 7f0449800700 -1 osd.9 96 *** Got signal Terminated *** 2024-04-26T20:37:01.688 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.225+0000 7f0449800700 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:37:02.075 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.821+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:02.076 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.821+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:02.076 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.821+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:02.076 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.821+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:02.076 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.821+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:02.076 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:01 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:01.821+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:02.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:02.206+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:02.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:02.206+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:02.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:02.206+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:02.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:02.206+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:02.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:02.206+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:02.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:02 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:02.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:02.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:02 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:02.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:02.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:02 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:02.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:02.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:02 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:02.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:02.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:02 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:02.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:02.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:02 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:02.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:03.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:02.842+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:03.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:02.842+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:03.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:02.842+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:03.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:02.842+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:03.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:02.842+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:03.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:02 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:02.842+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:03.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:03 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:03.240+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:03.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:03 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:03.240+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:03.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:03 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:03.240+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:03.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:03 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:03.240+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:03.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:03 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:03.240+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:03.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:03 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:03.240+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:03.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:03 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:03.330+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:03.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:03 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:03.330+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:03.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:03 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:03.330+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:03.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:03 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:03.330+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:03.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:03 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:03.330+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:03.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:03 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:03.330+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:04.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:03.811+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:04.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:03.811+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:04.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:03.811+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:04.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:03.811+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:04.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:03.811+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:04.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:03 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:03.811+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:04.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:04 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:04.202+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:04.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:04 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:04.202+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:04.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:04 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:04.202+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:04.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:04 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:04.202+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:04.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:04 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:04.202+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:04.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:04 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:04.202+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:04.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:04 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:04.336+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:04.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:04 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:04.336+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:04.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:04 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:04.336+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:04.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:04 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:04.336+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:04.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:04 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:04.336+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:04.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:04 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:04.336+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:05.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:04.849+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:05.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:04.849+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:05.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:04.849+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:05.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:04.849+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:05.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:04.849+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:05.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:04 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:04.849+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:05.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:05.250+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:05.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:05.250+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:05.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:05.250+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:05.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:05.250+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:05.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:05.250+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:05.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:05 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:05.250+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:05.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:05.354+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:05.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:05.354+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:05.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:05.354+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:05.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:05.354+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:05.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:05.354+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:05.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:05 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:05.354+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:06.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:05.861+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.279697+0000 front 2024-04-26T20:35:46.279761+0000 (oldest deadline 2024-04-26T20:36:12.179944+0000) 2024-04-26T20:37:06.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:05.861+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.881980+0000 front 2024-04-26T20:35:56.882566+0000 (oldest deadline 2024-04-26T20:36:19.781896+0000) 2024-04-26T20:37:06.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:05.861+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:05.584910+0000 front 2024-04-26T20:36:05.584666+0000 (oldest deadline 2024-04-26T20:36:29.684656+0000) 2024-04-26T20:37:06.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:05.861+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:13.688047+0000 front 2024-04-26T20:36:13.687519+0000 (oldest deadline 2024-04-26T20:36:38.987554+0000) 2024-04-26T20:37:06.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:05.861+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:18.988432+0000 front 2024-04-26T20:36:18.988514+0000 (oldest deadline 2024-04-26T20:36:44.888740+0000) 2024-04-26T20:37:06.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:05 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9[63639]: 2024-04-26T20:37:05.861+0000 7f0440000700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.691966+0000 front 2024-04-26T20:36:30.691837+0000 (oldest deadline 2024-04-26T20:36:55.392100+0000) 2024-04-26T20:37:06.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:06.221+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:06.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:06.221+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:06.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:06.221+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:06.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:06.221+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:06.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:06.221+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:06.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:06.221+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:06.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:06 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:06.356+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:06.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:06 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:06.356+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:06.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:06 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:06.356+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:06.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:06 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:06.356+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:06.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:06 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:06.356+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:06.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:06 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:06.356+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:07.176 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:06 smithi082 podman[98364]: 2024-04-26 20:37:06.835211997 +0000 UTC m=+5.747457840 container died 79bab2da6afde4dcad50d2389ed8bf40bf3040bf9d15681aa8510bf3d7a7b30c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T20:37:07.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:07 smithi082 podman[98364]: 2024-04-26 20:37:07.301419872 +0000 UTC m=+6.213665712 container cleanup 79bab2da6afde4dcad50d2389ed8bf40bf3040bf9d15681aa8510bf3d7a7b30c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T20:37:07.439 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:07 smithi082 bash[98364]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9 2024-04-26T20:37:07.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:07.181+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:07.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:07.181+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:07.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:07.181+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:07.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:07.181+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:07.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:07.181+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:07.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:07 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:07.181+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:07.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:07 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:07.346+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:07.937 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:07 smithi082 podman[98384]: 2024-04-26 20:37:07.552430098 +0000 UTC m=+0.701560597 container remove 79bab2da6afde4dcad50d2389ed8bf40bf3040bf9d15681aa8510bf3d7a7b30c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:37:08.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:08 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:08.189+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:08.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:08 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:08.189+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:08.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:08 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:08.189+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:08.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:08 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:08.189+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:08.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:08 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:08.189+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:08.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:08 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:08.189+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:08.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:08 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:08.316+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:08.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:08 smithi082 podman[98475]: 2024-04-26 20:37:08.275151721 +0000 UTC m=+0.038383435 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:37:08.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:08 smithi082 podman[98475]: 2024-04-26 20:37:08.386701027 +0000 UTC m=+0.149932785 container create 649e57612b77e47bcdd18d42ee0a6cc43206adfa6dc9898d60cab89a7d1fd763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T20:37:08.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:08 smithi082 podman[98475]: 2024-04-26 20:37:08.681973212 +0000 UTC m=+0.445204980 container init 649e57612b77e47bcdd18d42ee0a6cc43206adfa6dc9898d60cab89a7d1fd763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:37:08.937 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:08 smithi082 podman[98475]: 2024-04-26 20:37:08.69398241 +0000 UTC m=+0.457214128 container start 649e57612b77e47bcdd18d42ee0a6cc43206adfa6dc9898d60cab89a7d1fd763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-26T20:37:08.937 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:08 smithi082 podman[98475]: 2024-04-26 20:37:08.772049672 +0000 UTC m=+0.535281397 container attach 649e57612b77e47bcdd18d42ee0a6cc43206adfa6dc9898d60cab89a7d1fd763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD) 2024-04-26T20:37:09.438 INFO:journalctl@ceph.osd.9.smithi082.stdout:Apr 26 20:37:09 smithi082 podman[98501]: 2024-04-26 20:37:09.195164245 +0000 UTC m=+0.034546783 container died 649e57612b77e47bcdd18d42ee0a6cc43206adfa6dc9898d60cab89a7d1fd763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T20:37:09.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:09.209+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:09.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:09.209+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:09.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:09.209+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:09.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:09.209+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:09.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:09.209+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:09.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:09 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:09.209+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:09.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:09 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:09.361+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:09.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.9.service' 2024-04-26T20:37:10.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:10.024 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-26T20:37:10.024 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-26T20:37:10.024 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.10 2024-04-26T20:37:10.339 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 systemd[1]: Stopping Ceph osd.10 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:10.216+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:10.216+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:10.216+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:10.216+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:10.216+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:10.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:10.216+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:10.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.339+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:10.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.342+0000 7fd896770700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:10.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.342+0000 7fd896770700 -1 osd.10 96 *** Got signal Terminated *** 2024-04-26T20:37:10.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:10 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:10.342+0000 7fd896770700 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:37:11.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:11.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:11.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:11.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:11.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:11.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:11.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:11 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:11.249+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:11.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:11.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:11.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:11.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:11.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:11.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:11.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:11 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:11.341+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:12.473 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:12.473 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:12.473 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:12.473 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:12.473 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:12.474 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:12.474 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:12 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:12.219+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:12.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:12 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:12.310+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:13.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:13.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:13.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:13.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:13.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:13.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:13.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:13 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:13.261+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:13.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:13 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:13.302+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:14.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:14.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:14 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:14.297+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:14.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:14.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:14.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:14.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:14.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:14.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:14.620 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:14 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:14.265+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:15.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:15.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:15.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:15.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:15.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:15.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:15.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:15 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:15.285+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:47.647433+0000 front 2024-04-26T20:35:47.647214+0000 (oldest deadline 2024-04-26T20:36:09.947109+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:53.348689+0000 front 2024-04-26T20:35:53.348641+0000 (oldest deadline 2024-04-26T20:36:22.749092+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.450226+0000 front 2024-04-26T20:36:04.450244+0000 (oldest deadline 2024-04-26T20:36:29.150458+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-04-26T20:36:09.151339+0000 front 2024-04-26T20:36:09.151244+0000 (oldest deadline 2024-04-26T20:36:36.751320+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:20.852154+0000 front 2024-04-26T20:36:20.852103+0000 (oldest deadline 2024-04-26T20:36:45.552220+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:29.053172+0000 front 2024-04-26T20:36:29.053195+0000 (oldest deadline 2024-04-26T20:36:54.353049+0000) 2024-04-26T20:37:15.619 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10[57113]: 2024-04-26T20:37:15.230+0000 7fd88ed5c700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:40.754951+0000 front 2024-04-26T20:36:40.754990+0000 (oldest deadline 2024-04-26T20:37:06.654625+0000) 2024-04-26T20:37:16.001 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:15 smithi135 podman[68835]: 2024-04-26 20:37:15.725587337 +0000 UTC m=+5.507265588 container died 776db2170f925549d7d37d1082f235c22bb48e0f011c7806e4c3d051f36adcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:37:16.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 podman[68835]: 2024-04-26 20:37:16.100286301 +0000 UTC m=+5.881964549 container cleanup 776db2170f925549d7d37d1082f235c22bb48e0f011c7806e4c3d051f36adcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:37:16.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 bash[68835]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10 2024-04-26T20:37:16.676 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 podman[68851]: 2024-04-26 20:37:16.376366849 +0000 UTC m=+0.652071811 container remove 776db2170f925549d7d37d1082f235c22bb48e0f011c7806e4c3d051f36adcd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:37:16.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:16.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:16.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:16.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:16.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:16.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:16.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:16 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:16.331+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:17.013 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 podman[68946]: 2024-04-26 20:37:16.57871534 +0000 UTC m=+0.017691262 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:37:17.013 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 podman[68946]: 2024-04-26 20:37:16.693754964 +0000 UTC m=+0.132730863 container create 4fbedf1e555838703e2db4ee54a704a656a262bbfec405654483b97e168c212b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T20:37:17.013 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 podman[68946]: 2024-04-26 20:37:16.921394433 +0000 UTC m=+0.360370339 container init 4fbedf1e555838703e2db4ee54a704a656a262bbfec405654483b97e168c212b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T20:37:17.013 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:16 smithi135 podman[68946]: 2024-04-26 20:37:16.924678651 +0000 UTC m=+0.363654551 container start 4fbedf1e555838703e2db4ee54a704a656a262bbfec405654483b97e168c212b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:37:17.014 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:17 smithi135 podman[68946]: 2024-04-26 20:37:17.012878212 +0000 UTC m=+0.451854133 container attach 4fbedf1e555838703e2db4ee54a704a656a262bbfec405654483b97e168c212b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T20:37:17.369 INFO:journalctl@ceph.osd.10.smithi135.stdout:Apr 26 20:37:17 smithi135 podman[68946]: 2024-04-26 20:37:17.226356758 +0000 UTC m=+0.665332670 container died 4fbedf1e555838703e2db4ee54a704a656a262bbfec405654483b97e168c212b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-26T20:37:17.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.10.service' 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:17.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:17.378+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:17.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:17.853 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-26T20:37:17.853 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-26T20:37:17.853 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.11 2024-04-26T20:37:18.154 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:17 smithi139 systemd[1]: Stopping Ceph osd.11 for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:18.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.153+0000 7fd8360bb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:18.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.153+0000 7fd8360bb700 -1 osd.11 96 *** Got signal Terminated *** 2024-04-26T20:37:18.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.153+0000 7fd8360bb700 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T20:37:18.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:18.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:18.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:18.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:18.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:18.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:18.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:18 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:18.376+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:19.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:19.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:19.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:19.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:19.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:19.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:19.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:19 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:19.365+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:20.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:20.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:20.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:20.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:20.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:20.571 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:20.572 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:20 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:20.316+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:21.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:21.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:21.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:21.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:21.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:21.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:21.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:21.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:21 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:21.356+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6820 osd.8 since back 2024-04-26T20:36:55.472340+0000 front 2024-04-26T20:36:55.472314+0000 (oldest deadline 2024-04-26T20:37:20.772301+0000) 2024-04-26T20:37:22.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-26T20:35:46.661298+0000 front 2024-04-26T20:35:46.661196+0000 (oldest deadline 2024-04-26T20:36:09.561142+0000) 2024-04-26T20:37:22.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-04-26T20:35:56.563146+0000 front 2024-04-26T20:35:56.563157+0000 (oldest deadline 2024-04-26T20:36:19.463025+0000) 2024-04-26T20:37:22.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6804 osd.2 since back 2024-04-26T20:36:04.164099+0000 front 2024-04-26T20:36:04.164244+0000 (oldest deadline 2024-04-26T20:36:30.064208+0000) 2024-04-26T20:37:22.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-04-26T20:36:21.667088+0000 front 2024-04-26T20:36:21.667154+0000 (oldest deadline 2024-04-26T20:36:45.167069+0000) 2024-04-26T20:37:22.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6812 osd.5 since back 2024-04-26T20:36:30.968611+0000 front 2024-04-26T20:36:30.968642+0000 (oldest deadline 2024-04-26T20:36:56.868953+0000) 2024-04-26T20:37:22.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-04-26T20:36:37.970427+0000 front 2024-04-26T20:36:37.970335+0000 (oldest deadline 2024-04-26T20:37:02.670157+0000) 2024-04-26T20:37:22.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-04-26T20:36:47.271555+0000 front 2024-04-26T20:36:47.271463+0000 (oldest deadline 2024-04-26T20:37:10.771322+0000) 2024-04-26T20:37:22.822 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:22 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11[58429]: 2024-04-26T20:37:22.373+0000 7fd82e6a7700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.139:6820 osd.8 since back 2024-04-26T20:36:55.472340+0000 front 2024-04-26T20:36:55.472314+0000 (oldest deadline 2024-04-26T20:37:20.772301+0000) 2024-04-26T20:37:23.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:23 smithi139 podman[69601]: 2024-04-26 20:37:23.517123126 +0000 UTC m=+5.470354405 container died d4a98249330cbd505e0e08169ad251c9c861490d2f41b1325bfd59dcc510a270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T20:37:24.145 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:23 smithi139 podman[69601]: 2024-04-26 20:37:23.94383612 +0000 UTC m=+5.897067391 container cleanup d4a98249330cbd505e0e08169ad251c9c861490d2f41b1325bfd59dcc510a270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T20:37:24.145 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:23 smithi139 bash[69601]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11 2024-04-26T20:37:24.537 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:24 smithi139 podman[69618]: 2024-04-26 20:37:24.145171014 +0000 UTC m=+0.626724882 container remove d4a98249330cbd505e0e08169ad251c9c861490d2f41b1325bfd59dcc510a270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T20:37:24.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:24 smithi139 podman[69713]: 2024-04-26 20:37:24.537579699 +0000 UTC m=+0.106847335 container create 08b76be40a220ad1acf2843691566444b2ba3634afce09d7bcf7f5b89df939cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T20:37:24.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:24 smithi139 podman[69713]: 2024-04-26 20:37:24.449289295 +0000 UTC m=+0.018556959 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T20:37:24.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:24 smithi139 podman[69713]: 2024-04-26 20:37:24.764710655 +0000 UTC m=+0.333978301 container init 08b76be40a220ad1acf2843691566444b2ba3634afce09d7bcf7f5b89df939cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:37:24.821 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:24 smithi139 podman[69713]: 2024-04-26 20:37:24.767648617 +0000 UTC m=+0.336916254 container start 08b76be40a220ad1acf2843691566444b2ba3634afce09d7bcf7f5b89df939cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-04-26T20:37:25.321 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:24 smithi139 podman[69713]: 2024-04-26 20:37:24.847983457 +0000 UTC m=+0.417251094 container attach 08b76be40a220ad1acf2843691566444b2ba3634afce09d7bcf7f5b89df939cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:37:25.321 INFO:journalctl@ceph.osd.11.smithi139.stdout:Apr 26 20:37:25 smithi139 podman[69713]: 2024-04-26 20:37:25.061599511 +0000 UTC m=+0.630867156 container died 08b76be40a220ad1acf2843691566444b2ba3634afce09d7bcf7f5b89df939cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T20:37:25.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@osd.11.service' 2024-04-26T20:37:25.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:25.687 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-26T20:37:25.687 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-26T20:37:25.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.a 2024-04-26T20:37:26.188 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:25 smithi082 systemd[1]: Stopping Ceph mds.a for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:26.687 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:26 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a[70186]: 2024-04-26T20:37:26.241+0000 7f4f6d600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:26.688 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:26 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a[70186]: 2024-04-26T20:37:26.241+0000 7f4f6d600700 -1 mds.a *** got signal Terminated *** 2024-04-26T20:37:27.782 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:27 smithi082 podman[98605]: 2024-04-26 20:37:27.454627353 +0000 UTC m=+1.348342150 container died 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T20:37:28.169 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:27 smithi082 podman[98605]: 2024-04-26 20:37:27.9010884 +0000 UTC m=+1.794803207 container cleanup 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2) 2024-04-26T20:37:28.170 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:27 smithi082 bash[98605]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a 2024-04-26T20:37:28.437 INFO:journalctl@ceph.mds.a.smithi082.stdout:Apr 26 20:37:28 smithi082 podman[98619]: 2024-04-26 20:37:28.16856257 +0000 UTC m=+0.695056064 container remove 00e1a778eff2024c670d52652a5732bff3bb0d12c84149b82e2334b99273475c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T20:37:28.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.a.service' 2024-04-26T20:37:28.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:28.781 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-26T20:37:28.781 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-26T20:37:28.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.d 2024-04-26T20:37:29.187 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:28 smithi082 systemd[1]: Stopping Ceph mds.d for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:29.687 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d[69190]: 2024-04-26T20:37:29.378+0000 7f9f66000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:29.688 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:29 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d[69190]: 2024-04-26T20:37:29.378+0000 7f9f66000700 -1 mds.d *** got signal Terminated *** 2024-04-26T20:37:32.687 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:32 smithi082 podman[98725]: 2024-04-26 20:37:32.398715141 +0000 UTC m=+3.167973798 container died f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T20:37:33.181 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:32 smithi082 podman[98725]: 2024-04-26 20:37:32.895780448 +0000 UTC m=+3.665039120 container cleanup f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:37:33.181 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:32 smithi082 bash[98725]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d 2024-04-26T20:37:33.437 INFO:journalctl@ceph.mds.d.smithi082.stdout:Apr 26 20:37:33 smithi082 podman[98739]: 2024-04-26 20:37:33.179922604 +0000 UTC m=+0.762999310 container remove f391d154f5e4ae8c21fe2223f554efae9c46ddc2f3ef187986c67b65621b2765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T20:37:33.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.d.service' 2024-04-26T20:37:33.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:33.719 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-26T20:37:33.719 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-26T20:37:33.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.g 2024-04-26T20:37:33.937 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:33 smithi082 systemd[1]: Stopping Ceph mds.g for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:34.687 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:37:34.255+0000 7fa55e600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:34.688 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:34 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g[69801]: 2024-04-26T20:37:34.255+0000 7fa55e600700 -1 mds.g *** got signal Terminated *** 2024-04-26T20:37:37.437 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:37 smithi082 podman[98845]: 2024-04-26 20:37:37.155143542 +0000 UTC m=+3.013800986 container died 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T20:37:37.795 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:37 smithi082 podman[98845]: 2024-04-26 20:37:37.557054063 +0000 UTC m=+3.415711500 container cleanup 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T20:37:37.795 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:37 smithi082 bash[98845]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g 2024-04-26T20:37:38.188 INFO:journalctl@ceph.mds.g.smithi082.stdout:Apr 26 20:37:37 smithi082 podman[98859]: 2024-04-26 20:37:37.794019801 +0000 UTC m=+0.621424355 container remove 1d60804847dda6ac49832ac92519cb6564f914d23644d0bf3cbc783ca0cfebd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:37:38.259 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.g.service' 2024-04-26T20:37:38.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:38.360 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-26T20:37:38.360 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-26T20:37:38.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.j 2024-04-26T20:37:38.687 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:38 smithi082 systemd[1]: Stopping Ceph mds.j for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:39.188 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j[68815]: 2024-04-26T20:37:38.932+0000 7fd33b000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:39.188 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:38 smithi082 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j[68815]: 2024-04-26T20:37:38.932+0000 7fd33b000700 -1 mds.j *** got signal Terminated *** 2024-04-26T20:37:41.437 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:41 smithi082 podman[98965]: 2024-04-26 20:37:41.164037289 +0000 UTC m=+2.360514661 container died 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T20:37:41.938 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:41 smithi082 podman[98965]: 2024-04-26 20:37:41.693265788 +0000 UTC m=+2.889743190 container cleanup 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T20:37:41.938 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:41 smithi082 bash[98965]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j 2024-04-26T20:37:42.438 INFO:journalctl@ceph.mds.j.smithi082.stdout:Apr 26 20:37:41 smithi082 podman[98991]: 2024-04-26 20:37:41.971883147 +0000 UTC m=+0.794974498 container remove 4a8d2614b05719e070a5a1c886d47708229a362126735215ab810e26586b0ed9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:37:42.509 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.j.service' 2024-04-26T20:37:42.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:42.618 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-26T20:37:42.619 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-26T20:37:42.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.b 2024-04-26T20:37:43.026 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:37:42 smithi135 systemd[1]: Stopping Ceph mds.b for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:43.286 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:37:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:37:43.025+0000 7f6b9295b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:43.286 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:37:43 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b[62323]: 2024-04-26T20:37:43.025+0000 7f6b9295b700 -1 mds.b *** got signal Terminated *** 2024-04-26T20:37:45.369 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:37:45 smithi135 podman[69051]: 2024-04-26 20:37:45.082407086 +0000 UTC m=+2.259930125 container died 0e309e07d15698f6a8873c0e7665c0e49e00c8102d5e30a81d857c690edb0203 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T20:37:45.660 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:37:45 smithi135 podman[69051]: 2024-04-26 20:37:45.458549009 +0000 UTC m=+2.636072044 container cleanup 0e309e07d15698f6a8873c0e7665c0e49e00c8102d5e30a81d857c690edb0203 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T20:37:45.660 INFO:journalctl@ceph.mds.b.smithi135.stdout:Apr 26 20:37:45 smithi135 bash[69051]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-b 2024-04-26T20:37:45.882 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.b.service' 2024-04-26T20:37:45.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:45.917 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-26T20:37:45.917 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-26T20:37:45.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.e 2024-04-26T20:37:46.247 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:37:45 smithi135 systemd[1]: Stopping Ceph mds.e for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:46.619 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:37:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e[61707]: 2024-04-26T20:37:46.246+0000 7efe10904700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:46.619 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:37:46 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e[61707]: 2024-04-26T20:37:46.246+0000 7efe10904700 -1 mds.e *** got signal Terminated *** 2024-04-26T20:37:49.369 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:37:49 smithi135 podman[69188]: 2024-04-26 20:37:49.077940233 +0000 UTC m=+2.945130806 container died c276d3a6c065c8b1c1398edeff684ccbbeca2ce0bfbc6c3dcc4389d6f7c01cd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-04-26T20:37:49.730 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:37:49 smithi135 podman[69188]: 2024-04-26 20:37:49.454504057 +0000 UTC m=+3.321694627 container cleanup c276d3a6c065c8b1c1398edeff684ccbbeca2ce0bfbc6c3dcc4389d6f7c01cd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:37:49.731 INFO:journalctl@ceph.mds.e.smithi135.stdout:Apr 26 20:37:49 smithi135 bash[69188]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-e 2024-04-26T20:37:49.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.e.service' 2024-04-26T20:37:49.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:49.922 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-26T20:37:49.922 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-26T20:37:49.922 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h 2024-04-26T20:37:50.234 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:49 smithi135 systemd[1]: Stopping Ceph mds.h for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:50.619 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[65477]: 2024-04-26T20:37:50.233+0000 7f8438bfa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:50.620 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:50 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h[65477]: 2024-04-26T20:37:50.233+0000 7f8438bfa700 -1 mds.h *** got signal Terminated *** 2024-04-26T20:37:53.369 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:53 smithi135 podman[69312]: 2024-04-26 20:37:53.084092024 +0000 UTC m=+2.952247760 container died b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T20:37:53.718 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:53 smithi135 podman[69312]: 2024-04-26 20:37:53.408195069 +0000 UTC m=+3.276350852 container cleanup b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T20:37:53.719 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:53 smithi135 bash[69312]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h 2024-04-26T20:37:53.719 INFO:journalctl@ceph.mds.h.smithi135.stdout:Apr 26 20:37:53 smithi135 podman[69326]: 2024-04-26 20:37:53.609299349 +0000 UTC m=+0.528624337 container remove b7a6b1a1824f2c026f0e637b45af339e9376b842f8983fca55b8b3aebb8c1cbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T20:37:53.844 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.h.service' 2024-04-26T20:37:53.876 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:53.876 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-26T20:37:53.876 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-26T20:37:53.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.k 2024-04-26T20:37:54.119 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:37:53 smithi135 systemd[1]: Stopping Ceph mds.k for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:54.619 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:37:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: 2024-04-26T20:37:54.220+0000 7fcef2342700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:54.619 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:37:54 smithi135 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k[61389]: 2024-04-26T20:37:54.220+0000 7fcef2342700 -1 mds.k *** got signal Terminated *** 2024-04-26T20:37:57.369 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:37:57 smithi135 podman[69434]: 2024-04-26 20:37:57.07910018 +0000 UTC m=+2.984373540 container died f1e9e05b8c3b45d604247a5062921bc030c452f0d850131ca17cfcb659a620bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0) 2024-04-26T20:37:57.663 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:37:57 smithi135 podman[69434]: 2024-04-26 20:37:57.478541052 +0000 UTC m=+3.383814405 container cleanup f1e9e05b8c3b45d604247a5062921bc030c452f0d850131ca17cfcb659a620bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T20:37:57.663 INFO:journalctl@ceph.mds.k.smithi135.stdout:Apr 26 20:37:57 smithi135 bash[69434]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-k 2024-04-26T20:37:57.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.k.service' 2024-04-26T20:37:57.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:37:57.830 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-26T20:37:57.831 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-26T20:37:57.831 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.c 2024-04-26T20:37:58.209 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:37:57 smithi139 systemd[1]: Stopping Ceph mds.c for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:37:58.472 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:37:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:37:58.207+0000 7f90cbfcb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:37:58.472 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:37:58 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c[63430]: 2024-04-26T20:37:58.207+0000 7f90cbfcb700 -1 mds.c *** got signal Terminated *** 2024-04-26T20:38:01.416 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:38:01 smithi139 podman[69818]: 2024-04-26 20:38:01.094624579 +0000 UTC m=+3.076672372 container died fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T20:38:01.416 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:38:01 smithi139 podman[69818]: 2024-04-26 20:38:01.415851201 +0000 UTC m=+3.397898994 container cleanup fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T20:38:01.821 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:38:01 smithi139 bash[69818]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c 2024-04-26T20:38:01.821 INFO:journalctl@ceph.mds.c.smithi139.stdout:Apr 26 20:38:01 smithi139 podman[69844]: 2024-04-26 20:38:01.633720289 +0000 UTC m=+0.533511818 container remove fbc65bf8a48e58b136cb534fc2c81c3aab714e7d79dba5d83e76b5292e672c15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T20:38:01.858 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.c.service' 2024-04-26T20:38:01.893 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:01.893 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-26T20:38:01.893 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-26T20:38:01.893 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.f 2024-04-26T20:38:02.212 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:38:01 smithi139 systemd[1]: Stopping Ceph mds.f for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:38:02.571 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:38:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f[63119]: 2024-04-26T20:38:02.210+0000 7fb181d73700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:02.571 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:38:02 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f[63119]: 2024-04-26T20:38:02.210+0000 7fb181d73700 -1 mds.f *** got signal Terminated *** 2024-04-26T20:38:05.371 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:38:05 smithi139 podman[69950]: 2024-04-26 20:38:05.092472544 +0000 UTC m=+2.983019894 container died 5d0aaa22b1a820b06dd47516035a004c05ea5a31d9e74a1175fd8e2f00256a43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:38:05.729 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:38:05 smithi139 podman[69950]: 2024-04-26 20:38:05.452318148 +0000 UTC m=+3.342865494 container cleanup 5d0aaa22b1a820b06dd47516035a004c05ea5a31d9e74a1175fd8e2f00256a43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T20:38:05.729 INFO:journalctl@ceph.mds.f.smithi139.stdout:Apr 26 20:38:05 smithi139 bash[69950]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-f 2024-04-26T20:38:05.869 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.f.service' 2024-04-26T20:38:05.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:05.903 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-26T20:38:05.903 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-26T20:38:05.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.i 2024-04-26T20:38:06.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:38:05 smithi139 systemd[1]: Stopping Ceph mds.i for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:38:06.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:38:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:38:06.229+0000 7fd5a807d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:06.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:38:06 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i[63748]: 2024-04-26T20:38:06.229+0000 7fd5a807d700 -1 mds.i *** got signal Terminated *** 2024-04-26T20:38:09.321 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:38:09 smithi139 podman[70072]: 2024-04-26 20:38:09.101263504 +0000 UTC m=+2.982073295 container died 44a0369f22ab43c61b1f6d5c200dbcabb7899df1e4252d8bb1f41c644c30983e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5) 2024-04-26T20:38:09.715 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:38:09 smithi139 podman[70072]: 2024-04-26 20:38:09.464286668 +0000 UTC m=+3.345096459 container cleanup 44a0369f22ab43c61b1f6d5c200dbcabb7899df1e4252d8bb1f41c644c30983e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T20:38:09.715 INFO:journalctl@ceph.mds.i.smithi139.stdout:Apr 26 20:38:09 smithi139 bash[70072]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-i 2024-04-26T20:38:09.884 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.i.service' 2024-04-26T20:38:09.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:09.916 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-26T20:38:09.916 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-26T20:38:09.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.l 2024-04-26T20:38:10.321 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:38:09 smithi139 systemd[1]: Stopping Ceph mds.l for da6438ae-0408-11ef-bc93-c7b262605968... 2024-04-26T20:38:10.321 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:38:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: 2024-04-26T20:38:10.217+0000 7f2e29678700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:38:10.321 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:38:10 smithi139 ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l[62803]: 2024-04-26T20:38:10.217+0000 7f2e29678700 -1 mds.l *** got signal Terminated *** 2024-04-26T20:38:13.343 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:38:13 smithi139 podman[70194]: 2024-04-26 20:38:13.086800344 +0000 UTC m=+2.962457347 container died 77f79c3cd69a18456d4c790ece6be70dcc5743c5fe90da04fc6c46a5bbbcc7d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T20:38:13.643 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:38:13 smithi139 podman[70194]: 2024-04-26 20:38:13.434166391 +0000 UTC m=+3.309823392 container cleanup 77f79c3cd69a18456d4c790ece6be70dcc5743c5fe90da04fc6c46a5bbbcc7d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-04-26T20:38:13.644 INFO:journalctl@ceph.mds.l.smithi139.stdout:Apr 26 20:38:13 smithi139 bash[70194]: ceph-da6438ae-0408-11ef-bc93-c7b262605968-mds-l 2024-04-26T20:38:13.861 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-da6438ae-0408-11ef-bc93-c7b262605968@mds.l.service' 2024-04-26T20:38:13.891 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T20:38:13.891 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-26T20:38:13.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid da6438ae-0408-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T20:38:14.204 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:38:19.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid da6438ae-0408-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T20:38:19.331 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:38:21.794 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid da6438ae-0408-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T20:38:21.982 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:38:24.364 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:38:24.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:38:24.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:38:24.513 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-26T20:38:24.516 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi082/crash 2024-04-26T20:38:24.517 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash -- . 2024-04-26T20:38:24.599 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T20:38:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-04-26T20:38:24.604 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi135/crash 2024-04-26T20:38:24.605 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash -- . 2024-04-26T20:38:24.873 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T20:38:24.873 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-04-26T20:38:24.875 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi139/crash 2024-04-26T20:38:24.876 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash -- . 2024-04-26T20:38:24.912 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/da6438ae-0408-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T20:38:24.912 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2024-04-26T20:38:24.913 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-26T20:38:24.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-26T20:38:25.026 INFO:teuthology.orchestra.run.smithi082.stdout:2024-04-26T20:26:46.482381+0000 mds.g (mds.1) 8 : cluster [WRN] Scrub error on inode 0x20000000c3d (/volumes/qa/sv_1/1fbfe3b6-e9b5-4d30-8621-0c14b6565def/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13) see mds.g log and `damage ls` output for details 2024-04-26T20:38:25.031 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-26T20:38:25.031 INFO:tasks.cephadm:Compressing logs... 2024-04-26T20:38:25.031 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:38:25.035 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:38:25.038 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:38:25.062 INFO:teuthology.orchestra.run.smithi139.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log 2024-04-26T20:38:25.063 INFO:teuthology.orchestra.run.smithi139.stderr:: No such file or directory 2024-04-26T20:38:25.063 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-26T20:38:25.063 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-26T20:38:25.063 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T20:38:25.063 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-26T20:38:25.068 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.b.log: /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-26T20:38:25.069 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.h.log: 90.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-26T20:38:25.070 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T20:38:25.071 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.11.log: /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-26T20:38:25.071 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T20:38:25.071 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-26T20:38:25.071 INFO:teuthology.orchestra.run.smithi135.stderr: 90.9% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T20:38:25.077 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T20:38:25.077 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-26T20:38:25.077 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T20:38:25.077 INFO:teuthology.orchestra.run.smithi135.stderr: 82.4% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T20:38:25.091 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-26T20:38:25.091 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 82.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T20:38:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-26T20:38:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T20:38:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-26T20:38:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log 2024-04-26T20:38:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T20:38:25.111 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T20:38:25.112 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-26T20:38:25.113 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-26T20:38:25.114 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-26T20:38:25.116 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-26T20:38:25.116 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-26T20:38:25.117 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-26T20:38:25.118 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.x.log: 90.8% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T20:38:25.118 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-26T20:38:25.119 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T20:38:25.120 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-26T20:38:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T20:38:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-26T20:38:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log: 90.2% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T20:38:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-26T20:38:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T20:38:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T20:38:25.125 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-04-26T20:38:25.126 INFO:teuthology.orchestra.run.smithi082.stderr: 94.4% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-26T20:38:25.128 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 94.4% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-26T20:38:25.128 INFO:teuthology.orchestra.run.smithi082.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-04-26T20:38:25.143 INFO:teuthology.orchestra.run.smithi082.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T20:38:25.175 INFO:teuthology.orchestra.run.smithi082.stderr: 82.7% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T20:38:25.193 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T20:38:25.280 INFO:teuthology.orchestra.run.smithi139.stderr: 93.1% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-26T20:38:25.297 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T20:38:25.343 INFO:teuthology.orchestra.run.smithi139.stderr: 90.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T20:38:25.401 INFO:teuthology.orchestra.run.smithi082.stderr: 90.5% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-26T20:38:25.459 INFO:teuthology.orchestra.run.smithi139.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T20:38:25.643 INFO:teuthology.orchestra.run.smithi082.stderr: 90.9% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T20:38:25.702 INFO:teuthology.orchestra.run.smithi135.stderr: 91.7% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-26T20:38:26.457 INFO:teuthology.orchestra.run.smithi082.stderr: 90.4% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-26T20:38:27.011 INFO:teuthology.orchestra.run.smithi139.stderr: 91.7% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-26T20:38:29.926 INFO:teuthology.orchestra.run.smithi135.stderr: 95.6% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-26T20:38:30.018 INFO:teuthology.orchestra.run.smithi135.stderr: 95.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-26T20:38:31.339 INFO:teuthology.orchestra.run.smithi135.stderr: 95.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-26T20:38:31.949 INFO:teuthology.orchestra.run.smithi082.stderr: 95.4% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-26T20:38:41.867 INFO:teuthology.orchestra.run.smithi135.stderr: 91.9% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-26T20:38:44.819 INFO:teuthology.orchestra.run.smithi139.stderr: 95.5% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-26T20:38:50.067 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-26T20:38:54.961 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-26T20:38:55.392 INFO:teuthology.orchestra.run.smithi082.stderr: 91.2% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-26T20:38:58.186 INFO:teuthology.orchestra.run.smithi082.stderr: 91.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-26T20:38:59.202 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-26T20:39:00.215 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-26T20:39:02.036 INFO:teuthology.orchestra.run.smithi082.stderr: 91.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-26T20:39:10.463 INFO:teuthology.orchestra.run.smithi139.stderr: 93.8% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-26T20:39:25.386 INFO:teuthology.orchestra.run.smithi135.stderr: 93.8% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-26T20:39:25.388 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-04-26T20:39:25.388 INFO:teuthology.orchestra.run.smithi135.stderr:real 1m0.336s 2024-04-26T20:39:25.388 INFO:teuthology.orchestra.run.smithi135.stderr:user 2m57.354s 2024-04-26T20:39:25.388 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m5.497s 2024-04-26T20:39:25.957 INFO:teuthology.orchestra.run.smithi139.stderr: 91.6% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-26T20:39:46.987 INFO:teuthology.orchestra.run.smithi139.stderr: 91.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-26T20:39:56.867 INFO:teuthology.orchestra.run.smithi139.stderr: 91.5% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-26T20:40:01.113 INFO:teuthology.orchestra.run.smithi139.stderr: 91.4% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-26T20:40:23.171 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-26T20:40:23.174 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-04-26T20:40:23.174 INFO:teuthology.orchestra.run.smithi082.stderr:real 1m58.108s 2024-04-26T20:40:23.174 INFO:teuthology.orchestra.run.smithi082.stderr:user 3m47.316s 2024-04-26T20:40:23.174 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m17.213s 2024-04-26T20:40:29.764 INFO:teuthology.orchestra.run.smithi139.stderr: 93.7% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-26T20:40:37.932 INFO:teuthology.orchestra.run.smithi139.stderr: 93.7% -- replaced with /var/log/ceph/da6438ae-0408-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-26T20:40:37.934 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T20:40:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:real 2m12.882s 2024-04-26T20:40:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:user 4m16.194s 2024-04-26T20:40:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m9.098s 2024-04-26T20:40:37.935 INFO:tasks.cephadm:Archiving logs... 2024-04-26T20:40:37.936 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi082/log 2024-04-26T20:40:37.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:41:11.385 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi135/log 2024-04-26T20:41:11.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:41:35.662 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi139/log 2024-04-26T20:41:35.663 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:42:15.754 INFO:tasks.cephadm:Removing cluster... 2024-04-26T20:42:15.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid da6438ae-0408-11ef-bc93-c7b262605968 --force 2024-04-26T20:42:16.076 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:42:17.329 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid da6438ae-0408-11ef-bc93-c7b262605968 --force 2024-04-26T20:42:17.521 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:42:17.999 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid da6438ae-0408-11ef-bc93-c7b262605968 --force 2024-04-26T20:42:18.191 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: da6438ae-0408-11ef-bc93-c7b262605968 2024-04-26T20:42:18.841 INFO:tasks.cephadm:Removing cephadm ... 2024-04-26T20:42:18.841 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T20:42:18.897 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T20:42:18.913 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T20:42:18.928 INFO:tasks.cephadm:Teardown complete 2024-04-26T20:42:18.928 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T20:42:18.940 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T20:42:18.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:42:18.946 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:42:18.955 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:42:19.107 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T20:42:19.117 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T20:42:19.117 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:42:19.125 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:42:19.127 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:42:19.138 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:42:19.141 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:42:19.142 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:42:19.142 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-04-26T20:42:19.143 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +1606us[+1607us] +/- 67ms 2024-04-26T20:42:19.143 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -741us[ -741us] +/- 53ms 2024-04-26T20:42:19.143 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -616us[ -616us] +/- 66ms 2024-04-26T20:42:19.143 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:42:19.148 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:42:19.148 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-26T20:42:19.148 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +1606us[+1631us] +/- 67ms 2024-04-26T20:42:19.149 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -734us[ -734us] +/- 53ms 2024-04-26T20:42:19.149 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -603us[ -603us] +/- 66ms 2024-04-26T20:42:19.149 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:42:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:42:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:42:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-26T20:42:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +1585us[+1617us] +/- 67ms 2024-04-26T20:42:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -745us[ -713us] +/- 53ms 2024-04-26T20:42:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -607us[ -575us] +/- 66ms 2024-04-26T20:42:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:42:19.181 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T20:42:19.194 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T20:42:19.195 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T20:42:19.206 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T20:42:19.426 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T20:42:19.499 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T20:42:19.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:42:19.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:42:19.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:42:19.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:42:19.695 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:42:19.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:42:19.721 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T20:42:19.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T20:42:19.830 INFO:teuthology.task.internal:Duration was 2430.291774 seconds 2024-04-26T20:42:19.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T20:42:19.888 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T20:42:19.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:42:19.897 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:42:19.899 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:42:19.934 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:42:19.979 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:42:20.045 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:42:20.547 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T20:42:20.548 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T20:42:20.548 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:42:20.612 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-04-26T20:42:20.612 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:42:20.648 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T20:42:20.648 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:42:20.680 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T20:42:20.681 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:42:20.688 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:42:20.690 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:42:20.767 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T20:42:20.767 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:42:20.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:42:20.774 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:42:21.310 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T20:42:21.321 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T20:42:21.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:42:21.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:42:21.432 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:42:21.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T20:42:21.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:42:21.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:42:21.479 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:42:21.499 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-04-26T20:42:21.529 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-04-26T20:42:21.578 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-26T20:42:21.620 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:42:21.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:42:21.669 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:42:21.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:42:21.683 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:42:21.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:42:21.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T20:42:21.709 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T20:42:21.710 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi082 2024-04-26T20:42:21.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:42:21.816 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi135 2024-04-26T20:42:21.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:42:21.852 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149/remote/smithi139 2024-04-26T20:42:21.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:42:21.889 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T20:42:21.889 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:42:21.897 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:42:21.899 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:42:21.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T20:42:21.958 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T20:42:21.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T20:42:21.971 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T20:42:21.971 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:42:21.976 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:42:21.978 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:42:21.990 INFO:teuthology.orchestra.run.smithi135.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:42 /home/ubuntu/cephtest 2024-04-26T20:42:21.992 INFO:teuthology.orchestra.run.smithi139.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:42 /home/ubuntu/cephtest 2024-04-26T20:42:22.024 INFO:teuthology.orchestra.run.smithi082.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:42 /home/ubuntu/cephtest 2024-04-26T20:42:22.027 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T20:42:22.040 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T20:42:22.064 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T20:42:22.084 DEBUG:teuthology.nuke:shortname: smithi082 2024-04-26T20:42:22.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:42:22.105 DEBUG:teuthology.nuke:shortname: smithi135 2024-04-26T20:42:22.106 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:42:22.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:56.859744', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTGjejqpbQDAD++nbA9+Ym/T8BUDwtYqcEoG0njRBily8ego5Nmk3hszPyBVSIiiktsyjzS2wZY5iYKzYOHvtg='} 2024-04-26T20:42:22.126 DEBUG:teuthology.nuke:shortname: smithi139 2024-04-26T20:42:22.127 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:42:22.130 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:56.861062', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVs/7j9ob/Q/IcH0U+XvENvvdM8lmGH5+eYGLR9+ceZI/Jmf0C7/7P00h6e8mxFqN1gzUvP0ZJfaxOetYvV0nI='} 2024-04-26T20:42:22.155 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:56.862142', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcqEWnmnALbLH9IW3Cl+mf2kqGl6sokW9hQmXnjwsJfVz+O4L/OD0EqdgT8rZUzsY/spq7PsdHlfXIUptpm/IU='} 2024-04-26T20:42:22.161 INFO:teuthology.orchestra.console.smithi082:Power off 2024-04-26T20:42:22.162 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T20:42:22.187 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-04-26T20:42:22.188 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:22.206 INFO:teuthology.orchestra.console.smithi135:Power off 2024-04-26T20:42:22.207 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T20:42:22.218 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-26T20:42:22.230 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2024-04-26T20:42:22.230 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:22.246 INFO:teuthology.orchestra.console.smithi139:Power off 2024-04-26T20:42:22.246 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T20:42:22.257 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-26T20:42:22.270 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2024-04-26T20:42:22.270 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:22.295 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-26T20:42:26.219 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:26.257 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:26.297 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:26.329 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-26T20:42:26.369 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-26T20:42:26.406 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-26T20:42:30.330 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:30.370 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:30.407 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:30.442 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-26T20:42:30.480 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-04-26T20:42:30.519 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-04-26T20:42:30.542 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-04-26T20:42:30.620 INFO:teuthology.orchestra.console.smithi139:Power off completed 2024-04-26T20:42:34.484 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T20:42:34.596 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-04-26T20:42:34.696 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-04-26T20:42:34.802 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} duration: 2430.2917737960815 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2024-04-26T20:42:34.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:42:34.894 INFO:teuthology.run:FAIL